![[Jenkins]](/jenkins/static/b68c8964/images/svgs/logo.svg){kind=logo}
Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30028 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37173 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6671 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17648 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7501 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6676 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8695 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8940 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2940 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29250 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5148 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30028 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4672 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12961 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9235 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4693 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8032 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5187 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5528 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3905 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins11096205966521850289.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-08 23:11:30 + trial_dir_prefix=trial- + rm -rf trial-2350 trial-2350-bin.tgz trial-2350-run.tgz + trial_dir=trial-2351 + mkdir -p trial-2351 + mv open5gs.build-8.tgz osmo-bsc.build-17648.tgz osmo-bts-oc2g.build-5528.tgz osmo-bts-sysmo.build-8032.tgz osmo-bts.build-7501.tgz osmo-ggsn.build-6676.tgz osmo-hlr.build-8695.tgz osmo-hnbgw.build-2940.tgz osmo-mgw.build-8940.tgz osmo-msc.build-29250.tgz osmo-nitb.build-12961.tgz osmo-pcu-oc2g.build-3905.tgz osmo-pcu-sysmo.build-5187.tgz osmo-pcu.build-5148.tgz osmo-sgsn.build-30028.tgz osmo-stp.build-9235.tgz osmo-trx.build-4672.tgz osmocom-bb.build-4693.tgz srslte.build-19.tgz trial-2351 + cat open5gs.build-8.md5 osmo-bsc.build-17648.md5 osmo-bts-oc2g.build-5528.md5 osmo-bts-sysmo.build-8032.md5 osmo-bts.build-7501.md5 osmo-ggsn.build-6676.md5 osmo-hlr.build-8695.md5 osmo-hnbgw.build-2940.md5 osmo-mgw.build-8940.md5 osmo-msc.build-29250.md5 osmo-nitb.build-12961.md5 osmo-pcu-oc2g.build-3905.md5 osmo-pcu-sysmo.build-5187.md5 osmo-pcu.build-5148.md5 osmo-sgsn.build-30028.md5 osmo-stp.build-9235.md5 osmo-trx.build-4672.md5 osmocom-bb.build-4693.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17648.md5 osmo-bts-oc2g.build-5528.md5 osmo-bts-sysmo.build-8032.md5 osmo-bts.build-7501.md5 osmo-ggsn.build-6676.md5 osmo-hlr.build-8695.md5 osmo-hnbgw.build-2940.md5 osmo-mgw.build-8940.md5 osmo-msc.build-29250.md5 osmo-nitb.build-12961.md5 osmo-pcu-oc2g.build-3905.md5 osmo-pcu-sysmo.build-5187.md5 osmo-pcu.build-5148.md5 osmo-sgsn.build-30028.md5 osmo-stp.build-9235.md5 osmo-trx.build-4672.md5 osmocom-bb.build-4693.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2351 combinations: None trial: 'trial-2351' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2351 -------------------------------------------------------------------------------------------- 23:11:41.810689 tst trial-2351: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/log --------------------------------------------------------------------- trial-2351 nitb_sms:sysmo --------------------------------------------------------------------- 23:13:50.592592 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:13:50.596383 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 23:13:50.617673 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 23:13:50.624697 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 23:13:50.677746 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 23:13:50.699117 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 23:13:50.706137 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 23:13:51.246694 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 23:13:51.251712 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 23:13:51.262975 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 23:13:51.645498 tst mo_mt_sms.py: using LAC 17415 23:13:51.897101 tst mo_mt_sms.py: using RAC 75 23:13:52.021157 tst mo_mt_sms.py: using CellId 17415 23:13:52.143758 tst mo_mt_sms.py: using BVCI 17416 23:13:52.258816 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 23:13:52.438751 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 23:13:52.557597 tst mo_mt_sms.py:9: start nitb and bts... 23:13:52.776899 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:13:55.109721 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26140): Launched 23:13:55.437509 run osmo-nitb_10.42.42.2(pid=26141): Launched 23:13:55.615269 run osmo-nitb_10.42.42.2(pid=26141): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26141)] 23:13:55.749531 run osmo-nitb_10.42.42.2(pid=26141): stdout: | (launched: 2022-12-08_23:13:55.376671) 23:13:55.885720 run osmo-nitb_10.42.42.2(pid=26141): stderr: | (launched: 2022-12-08_23:13:55.425401) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:13:56.021637 run osmo-nitb_10.42.42.2(pid=26141): stdout: | (launched: 2022-12-08_23:13:55.376671) 23:13:56.151011 run osmo-nitb_10.42.42.2(pid=26141): stderr: | (launched: 2022-12-08_23:13:55.425401) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:13:56.306416 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=26141): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26141) [trial-2351↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26141)] [trial-2351↪nitb_sms:sysmo↪mo_mt_sms.py:11] 23:13:56.315290 tst mo_mt_sms.py:11: Test FAILED (5.1 sec) 23:13:56.322287 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26140): Terminating (SIGTERM) 23:13:56.532845 --- ParallelTerminationStrategy: PID 26140 died... 23:13:56.554139 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26140): Terminated: ok {rc=0} 23:13:56.643099 bus /sierra_3: Setting Powered False 23:13:57.744181 bus /sierra_3: Setting Powered False 23:13:58.863448 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 sms:sysmo --------------------------------------------------------------------- 23:14:00.044013 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:14:00.048020 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 23:14:00.069372 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 23:14:00.095942 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 23:14:00.147789 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 23:14:00.168308 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 23:14:00.194782 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 23:14:00.741169 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 sms:sysmo mo_mt_sms.py ---------------------------------------------- 23:14:00.746103 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 23:14:00.756587 tst sms:sysmo: Using 1 x bts (candidates: 1) 23:14:00.793656 tst mo_mt_sms.py: using LAC 17416 23:14:00.961553 tst mo_mt_sms.py: using RAC 76 23:14:01.093354 tst mo_mt_sms.py: using CellId 17416 23:14:01.222528 tst mo_mt_sms.py: using BVCI 17417 23:14:01.343944 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 23:14:01.355965 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 23:14:01.369139 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 23:14:01.381299 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 23:14:01.393561 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 23:14:01.405648 tst sms:sysmo: Using 1 x modem (candidates: 2) 23:14:01.552634 tst sms:sysmo: Using 1 x modem (candidates: 2) 23:14:01.706010 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:14:03.453120 run create_hlr_db(pid=26146): Launched 23:14:03.572858 bus /sierra_2: Setting Powered False 23:14:04.634142 run create_hlr_db(pid=26146): Terminated: ok {rc=0} 23:14:05.064751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26148): Launched 23:14:05.374569 run osmo-hlr_10.42.42.2(pid=26149): Launched 23:14:05.493959 run osmo-stp_10.42.42.5: Starting osmo-stp 23:14:07.957653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26151): Launched 23:14:08.268476 run osmo-stp_10.42.42.5(pid=26152): Launched 23:14:08.387989 run osmo-msc_10.42.42.6: Starting osmo-msc 23:14:13.599506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26154): Launched 23:14:13.910054 run osmo-msc_10.42.42.6(pid=26155): Launched 23:14:14.082423 run osmo-stp_10.42.42.5(pid=26152): ERR: Terminated: ERROR {rc=1} [trial-2351↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26152)] 23:14:14.211904 run osmo-stp_10.42.42.5(pid=26152): stdout: | (launched: 2022-12-08_23:14:08.210715) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:14.341504 run osmo-stp_10.42.42.5(pid=26152): stderr: | [0;m[38;5;43m20221208231408384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231408384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231408384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231408385 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231408385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231408385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231408385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:14.468771 run osmo-stp_10.42.42.5(pid=26152): stdout: | (launched: 2022-12-08_23:14:08.210715) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:14.590779 run osmo-stp_10.42.42.5(pid=26152): stderr: | [0;m[38;5;43m20221208231408384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231408384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231408384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231408385 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231408385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231408385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231408385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:14.736230 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=26152): Process ended prematurely: osmo-stp_10.42.42.5(pid=26152) [trial-2351↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26152)] [trial-2351↪sms:sysmo↪mo_mt_sms.py:16] 23:14:14.744589 tst mo_mt_sms.py:16: Test FAILED (14.0 sec) 23:14:14.771096 run osmo-hlr_10.42.42.2(pid=26149): ERR: Terminated: ERROR {rc=237} [trial-2351↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26149)] 23:14:14.819503 run osmo-hlr_10.42.42.2(pid=26149): stdout: | (launched: 2022-12-08_23:14:05.316871) 23:14:14.869713 run osmo-hlr_10.42.42.2(pid=26149): stderr: | [0;m[1;31m20221208231405494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231405494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231405494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231405494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231405494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231405494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231405507 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231405517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231405517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231405517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:14:14.939147 run osmo-msc_10.42.42.6(pid=26155): ERR: Terminated: ERROR {rc=2} [trial-2351↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26155)] 23:14:14.987591 run osmo-msc_10.42.42.6(pid=26155): stdout: | (launched: 2022-12-08_23:14:13.852264) 23:14:15.037718 run osmo-msc_10.42.42.6(pid=26155): stderr: | [0;m[38;5;43m20221208231414128 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208231414128 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f87a5235c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208231414128 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208231414128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208231414129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208231414129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208231414131 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208231414131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208231414131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208231414131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:14:15.088342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26148): Terminating (SIGTERM) 23:14:15.128627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26151): Terminating (SIGTERM) 23:14:15.168803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26154): Terminating (SIGTERM) 23:14:15.209254 --- ParallelTerminationStrategy: PID 26148 died... 23:14:15.228279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26148): Terminated: ok {rc=0} 23:14:15.273235 --- ParallelTerminationStrategy: PID 26151 died... 23:14:15.292417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26151): Terminated: ok {rc=0} 23:14:15.337257 --- ParallelTerminationStrategy: PID 26154 died... 23:14:15.355734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26154): Terminated: ok {rc=0} 23:14:15.440263 bus /sierra_3: Setting Powered False 23:14:16.544047 bus /sierra_3: Setting Powered False 23:14:17.669008 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 nitb_ussd:sysmo --------------------------------------------------------------------- 23:14:18.885794 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:14:18.889751 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 23:14:18.911071 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 23:14:18.918200 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 23:14:18.952183 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 23:14:18.973511 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 23:14:18.980475 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 23:14:19.502317 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2351 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 23:14:19.508692 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 23:14:19.519599 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 23:14:19.554546 tst assert_extension.py: using LAC 17417 23:14:19.675806 tst assert_extension.py: using RAC 77 23:14:19.800319 tst assert_extension.py: using CellId 17417 23:14:19.920405 tst assert_extension.py: using BVCI 17418 23:14:20.031321 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 23:14:20.150666 tst assert_extension.py:10: start nitb and bts... 23:14:20.371731 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:14:21.040430 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26160): Launched 23:14:21.371435 run osmo-nitb_10.42.42.2(pid=26161): Launched 23:14:21.553229 run osmo-nitb_10.42.42.2(pid=26161): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26161)] 23:14:21.700203 run osmo-nitb_10.42.42.2(pid=26161): stdout: | (launched: 2022-12-08_23:14:21.309219) 23:14:21.848306 run osmo-nitb_10.42.42.2(pid=26161): stderr: | (launched: 2022-12-08_23:14:21.358544) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:14:21.996340 run osmo-nitb_10.42.42.2(pid=26161): stdout: | (launched: 2022-12-08_23:14:21.309219) 23:14:22.138289 run osmo-nitb_10.42.42.2(pid=26161): stderr: | (launched: 2022-12-08_23:14:21.358544) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6f22fc268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26161): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26161) [trial-2351↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26161)] 23:14:22.495148 tst osmo-nitb_10.42.42.2(pid=26161): stdout: | (launched: 2022-12-08_23:14:21.309219) 23:14:22.627727 tst osmo-nitb_10.42.42.2(pid=26161): stderr: | (launched: 2022-12-08_23:14:21.358544) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:14:22.783863 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=26161): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26161) [trial-2351↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26161)] [trial-2351↪nitb_ussd:sysmo↪assert_extension.py:12] 23:14:22.792884 tst assert_extension.py:12: Test FAILED (3.3 sec) 23:14:22.800101 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26160): Terminating (SIGTERM) 23:14:23.010830 --- ParallelTerminationStrategy: PID 26160 died... 23:14:23.032505 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26160): Terminated: ok {rc=0} 23:14:23.121322 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 ussd:sysmo --------------------------------------------------------------------- 23:14:24.280878 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:14:24.284737 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 23:14:24.306572 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 23:14:24.333459 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 23:14:24.368849 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 23:14:24.389489 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 23:14:24.416306 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 23:14:24.943325 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2351 ussd:sysmo assert_extension.py ---------------------------------------------- 23:14:24.948550 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 23:14:24.959040 tst ussd:sysmo: Using 1 x bts (candidates: 1) 23:14:24.993952 tst assert_extension.py: using LAC 17418 23:14:25.117456 tst assert_extension.py: using RAC 78 23:14:25.239959 tst assert_extension.py: using CellId 17418 23:14:25.360361 tst assert_extension.py: using BVCI 17419 23:14:25.470903 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 23:14:25.481610 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 23:14:25.492179 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 23:14:25.502996 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 23:14:25.513652 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 23:14:25.524357 tst ussd:sysmo: Using 1 x modem (candidates: 1) 23:14:25.642863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:14:26.153577 run create_hlr_db(pid=26166): Launched 23:14:26.287012 bus /sierra_2: Setting Powered False 23:14:27.351402 run create_hlr_db(pid=26166): Terminated: ok {rc=0} 23:14:27.793656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26168): Launched 23:14:28.103111 run osmo-hlr_10.42.42.2(pid=26169): Launched 23:14:28.220870 run osmo-stp_10.42.42.5: Starting osmo-stp 23:14:28.752463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26171): Launched 23:14:29.062909 run osmo-stp_10.42.42.5(pid=26172): Launched 23:14:29.180285 run osmo-msc_10.42.42.6: Starting osmo-msc 23:14:29.736439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26174): Launched 23:14:30.067138 run osmo-msc_10.42.42.6(pid=26175): Launched 23:14:30.248915 run osmo-stp_10.42.42.5(pid=26172): ERR: Terminated: ERROR {rc=1} [trial-2351↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26172)] 23:14:30.387562 run osmo-stp_10.42.42.5(pid=26172): stdout: | (launched: 2022-12-08_23:14:29.003985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:30.526929 run osmo-stp_10.42.42.5(pid=26172): stderr: | [0;m[38;5;43m20221208231429178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231429178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231429178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231429179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231429179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231429179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231429180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:30.663705 run osmo-stp_10.42.42.5(pid=26172): stdout: | (launched: 2022-12-08_23:14:29.003985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:30.794400 run osmo-stp_10.42.42.5(pid=26172): stderr: | [0;m[38;5;43m20221208231429178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231429178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231429178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231429179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231429179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231429179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231429180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:30.974409 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=26172): Process ended prematurely: osmo-stp_10.42.42.5(pid=26172) [trial-2351↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26172)] [trial-2351↪ussd:sysmo↪assert_extension.py:17] 23:14:30.983786 tst assert_extension.py:17: Test FAILED (6.0 sec) 23:14:31.016480 run osmo-hlr_10.42.42.2(pid=26169): ERR: Terminated: ERROR {rc=237} [trial-2351↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26169)] 23:14:31.071221 run osmo-hlr_10.42.42.2(pid=26169): stdout: | (launched: 2022-12-08_23:14:28.044794) 23:14:31.124789 run osmo-hlr_10.42.42.2(pid=26169): stderr: | [0;m[1;31m20221208231428223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231428223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231428223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231428223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231428223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231428223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231428288 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231428297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231428297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231428297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:14:31.198809 run osmo-msc_10.42.42.6(pid=26175): ERR: Terminated: ERROR {rc=2} [trial-2351↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26175)] 23:14:31.250674 run osmo-msc_10.42.42.6(pid=26175): stdout: | (launched: 2022-12-08_23:14:30.005489) 23:14:31.304078 run osmo-msc_10.42.42.6(pid=26175): stderr: | [0;m[38;5;43m20221208231430334 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208231430334 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc0addc2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208231430334 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208231430334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208231430334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208231430334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208231430336 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208231430336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208231430337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208231430337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:14:31.359204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26168): Terminating (SIGTERM) 23:14:31.403684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26171): Terminating (SIGTERM) 23:14:31.448937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26174): Terminating (SIGTERM) 23:14:31.492623 --- ParallelTerminationStrategy: PID 26168 died... 23:14:31.513041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26168): Terminated: ok {rc=0} 23:14:31.560846 --- ParallelTerminationStrategy: PID 26171 died... 23:14:31.581274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26171): Terminated: ok {rc=0} 23:14:31.634376 --- ParallelTerminationStrategy: PID 26174 died... 23:14:31.659232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26174): Terminated: ok {rc=0} 23:14:31.755766 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 23:14:32.980807 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:14:32.987675 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 23:14:33.008740 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 23:14:33.035663 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 23:14:33.085444 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 23:14:33.105932 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 23:14:33.132581 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 23:14:33.688824 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 23:14:33.741906 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:33.752757 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:14:33.807317 tst mo_mt_call.py: using LAC 17419 23:14:33.929352 tst mo_mt_call.py: using RAC 79 23:14:34.050820 tst mo_mt_call.py: using CellId 17419 23:14:34.172155 tst mo_mt_call.py: using BVCI 17420 23:14:34.285251 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:34.296217 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:34.307098 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:34.318224 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:34.329361 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:34.340463 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:14:34.460700 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:14:34.577248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:14:35.064645 run create_hlr_db(pid=26180): Launched 23:14:35.184177 bus /sierra_2: Setting Powered False 23:14:36.246539 run create_hlr_db(pid=26180): Terminated: ok {rc=0} 23:14:36.683806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26182): Launched 23:14:37.004809 run osmo-hlr_10.42.42.2(pid=26183): Launched 23:14:37.154252 run osmo-stp_10.42.42.5: Starting osmo-stp 23:14:37.779580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26185): Launched 23:14:38.096049 run osmo-stp_10.42.42.5(pid=26186): Launched 23:14:38.215713 run osmo-msc_10.42.42.6: Starting osmo-msc 23:14:38.781918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26188): Launched 23:14:39.096437 run osmo-msc_10.42.42.6(pid=26189): Launched 23:14:39.272088 run osmo-stp_10.42.42.5(pid=26186): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26186)] 23:14:39.404390 run osmo-stp_10.42.42.5(pid=26186): stdout: | (launched: 2022-12-08_23:14:38.036331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:39.537233 run osmo-stp_10.42.42.5(pid=26186): stderr: | [0;m[38;5;43m20221208231438210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231438210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231438210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231438211 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231438211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231438211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231438211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:39.667293 run osmo-stp_10.42.42.5(pid=26186): stdout: | (launched: 2022-12-08_23:14:38.036331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:39.790869 run osmo-stp_10.42.42.5(pid=26186): stderr: | [0;m[38;5;43m20221208231438210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231438210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231438210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231438211 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231438211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231438211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231438211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:39.939318 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26186): Process ended prematurely: osmo-stp_10.42.42.5(pid=26186) [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26186)] [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 23:14:39.948153 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 23:14:39.975064 run osmo-hlr_10.42.42.2(pid=26183): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26183)] 23:14:40.022815 run osmo-hlr_10.42.42.2(pid=26183): stdout: | (launched: 2022-12-08_23:14:36.943916) 23:14:40.072394 run osmo-hlr_10.42.42.2(pid=26183): stderr: | [0;m[1;31m20221208231437141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231437141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231437141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231437141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231437141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231437141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231437325 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231437335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231437335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231437335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:14:40.140909 run osmo-msc_10.42.42.6(pid=26189): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26189)] 23:14:40.188659 run osmo-msc_10.42.42.6(pid=26189): stdout: | (launched: 2022-12-08_23:14:39.037193) 23:14:40.237975 run osmo-msc_10.42.42.6(pid=26189): stderr: | [0;m[38;5;43m20221208231439312 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208231439313 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f313e5adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208231439313 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208231439313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208231439313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208231439313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208231439315 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208231439315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208231439315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208231439316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:14:40.287622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26182): Terminating (SIGTERM) 23:14:40.326953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26185): Terminating (SIGTERM) 23:14:40.366865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26188): Terminating (SIGTERM) 23:14:40.406773 --- ParallelTerminationStrategy: PID 26182 died... 23:14:40.425675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26182): Terminated: ok {rc=0} 23:14:40.469892 --- ParallelTerminationStrategy: PID 26185 died... 23:14:40.488344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26185): Terminated: ok {rc=0} 23:14:40.532606 --- ParallelTerminationStrategy: PID 26188 died... 23:14:40.551166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26188): Terminated: ok {rc=0} 23:14:40.636029 bus /sierra_3: Setting Powered False 23:14:41.734286 bus /sierra_3: Setting Powered False 23:14:42.849491 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 23:14:43.996712 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:44.008452 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:14:44.098072 tst mo_mt_call_osmux.py: using LAC 17420 23:14:44.221371 tst mo_mt_call_osmux.py: using RAC 80 23:14:44.342457 tst mo_mt_call_osmux.py: using CellId 17420 23:14:44.466080 tst mo_mt_call_osmux.py: using BVCI 17421 23:14:44.589480 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:44.601478 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:44.613094 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:44.624730 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:44.636364 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:44.648203 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:14:44.767272 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:14:44.890025 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:14:45.410435 run create_hlr_db(pid=26191): Launched 23:14:45.547090 bus /sierra_2: Setting Powered False 23:14:46.613543 run create_hlr_db(pid=26191): Terminated: ok {rc=0} 23:14:47.094202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26193): Launched 23:14:47.439903 run osmo-hlr_10.42.42.2(pid=26194): Launched 23:14:47.568579 run osmo-stp_10.42.42.5: Starting osmo-stp 23:14:48.146629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26196): Launched 23:14:48.482629 run osmo-stp_10.42.42.5(pid=26197): Launched 23:14:48.610234 run osmo-msc_10.42.42.6: Starting osmo-msc 23:14:49.215276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26199): Launched 23:14:49.551971 run osmo-msc_10.42.42.6(pid=26200): Launched 23:14:49.741373 run osmo-stp_10.42.42.5(pid=26197): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26197)] 23:14:49.881259 run osmo-stp_10.42.42.5(pid=26197): stdout: | (launched: 2022-12-08_23:14:48.419702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:50.022666 run osmo-stp_10.42.42.5(pid=26197): stderr: | [0;m[38;5;43m20221208231448616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231448616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231448616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231448617 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231448619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231448619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231448619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:50.162079 run osmo-stp_10.42.42.5(pid=26197): stdout: | (launched: 2022-12-08_23:14:48.419702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:50.294600 run osmo-stp_10.42.42.5(pid=26197): stderr: | [0;m[38;5;43m20221208231448616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231448616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231448616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231448617 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231448619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231448619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231448619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:50.453356 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26197): Process ended prematurely: osmo-stp_10.42.42.5(pid=26197) [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26197)] [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 23:14:50.462876 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 23:14:50.490653 run osmo-hlr_10.42.42.2(pid=26194): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26194)] 23:14:50.541048 run osmo-hlr_10.42.42.2(pid=26194): stdout: | (launched: 2022-12-08_23:14:47.377159) 23:14:50.593253 run osmo-hlr_10.42.42.2(pid=26194): stderr: | [0;m[1;31m20221208231447581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231447581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231447581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231447581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231447581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231447581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231447595 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231447603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231447603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231447603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:14:50.666162 run osmo-msc_10.42.42.6(pid=26200): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26200)] 23:14:50.716472 run osmo-msc_10.42.42.6(pid=26200): stdout: | (launched: 2022-12-08_23:14:49.488786) 23:14:50.768765 run osmo-msc_10.42.42.6(pid=26200): stderr: | [0;m[38;5;43m20221208231449818 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208231449818 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5f0fa12c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208231449818 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208231449818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208231449818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208231449818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208231449820 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208231449820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208231449820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208231449821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:14:50.821196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26193): Terminating (SIGTERM) 23:14:50.863235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26196): Terminating (SIGTERM) 23:14:50.905290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26199): Terminating (SIGTERM) 23:14:50.947472 --- ParallelTerminationStrategy: PID 26193 died... 23:14:50.967643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26193): Terminated: ok {rc=0} 23:14:51.013822 --- ParallelTerminationStrategy: PID 26196 died... 23:14:51.033549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26196): Terminated: ok {rc=0} 23:14:51.079684 --- ParallelTerminationStrategy: PID 26199 died... 23:14:51.099253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26199): Terminated: ok {rc=0} 23:14:51.187529 bus /sierra_3: Setting Powered False 23:14:52.288079 bus /sierra_3: Setting Powered False 23:14:53.405494 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 23:14:54.643127 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:14:54.649904 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 23:14:54.671377 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 23:14:54.698839 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 23:14:54.751564 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 23:14:54.772813 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 23:14:54.799891 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 23:14:55.356337 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 23:14:55.409207 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:14:55.420502 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:14:55.477643 tst mo_mt_call.py: using LAC 17421 23:14:55.608001 tst mo_mt_call.py: using RAC 81 23:14:55.740323 tst mo_mt_call.py: using CellId 17421 23:14:55.872447 tst mo_mt_call.py: using BVCI 17422 23:14:55.994620 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:14:56.006127 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:14:56.017428 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:14:56.029153 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:14:56.040395 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:14:56.051712 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:14:56.170216 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:14:56.286343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:14:56.775079 run create_hlr_db(pid=26205): Launched 23:14:56.896297 bus /sierra_2: Setting Powered False 23:14:57.957271 run create_hlr_db(pid=26205): Terminated: ok {rc=0} 23:14:58.414790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26207): Launched 23:14:58.751599 run osmo-hlr_10.42.42.2(pid=26208): Launched 23:14:58.879197 run osmo-stp_10.42.42.5: Starting osmo-stp 23:14:59.458806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26210): Launched 23:14:59.796229 run osmo-stp_10.42.42.5(pid=26211): Launched 23:14:59.923015 run osmo-msc_10.42.42.6: Starting osmo-msc 23:15:00.528303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26213): Launched 23:15:00.869584 run osmo-msc_10.42.42.6(pid=26214): Launched 23:15:01.251335 run osmo-stp_10.42.42.5(pid=26211): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26211)] 23:15:01.580447 run osmo-stp_10.42.42.5(pid=26211): stdout: | (launched: 2022-12-08_23:14:59.733606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:01.759416 run osmo-stp_10.42.42.5(pid=26211): stderr: | [0;m[38;5;43m20221208231459930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231459930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231459930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231459931 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231459931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231459931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231459931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:01.903989 run osmo-stp_10.42.42.5(pid=26211): stdout: | (launched: 2022-12-08_23:14:59.733606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:02.038910 run osmo-stp_10.42.42.5(pid=26211): stderr: | [0;m[38;5;43m20221208231459930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231459930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231459930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231459931 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231459931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231459931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231459931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:02.200673 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26211): Process ended prematurely: osmo-stp_10.42.42.5(pid=26211) [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26211)] [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 23:15:02.211328 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 23:15:02.240313 run osmo-hlr_10.42.42.2(pid=26208): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26208)] 23:15:02.291947 run osmo-hlr_10.42.42.2(pid=26208): stdout: | (launched: 2022-12-08_23:14:58.688714) 23:15:02.345400 run osmo-hlr_10.42.42.2(pid=26208): stderr: | [0;m[1;31m20221208231458894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231458894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231458894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231458894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231458894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231458894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231458907 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231458915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231458915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231458915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:02.419390 run osmo-msc_10.42.42.6(pid=26214): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26214)] 23:15:02.471271 run osmo-msc_10.42.42.6(pid=26214): stdout: | (launched: 2022-12-08_23:15:00.802509) 23:15:02.524556 run osmo-msc_10.42.42.6(pid=26214): stderr: | [0;m[38;5;43m20221208231501293 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208231501293 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f78869fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208231501293 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208231501293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208231501294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208231501294 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208231501295 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208231501302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208231501302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208231501302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:15:02.577939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26207): Terminating (SIGTERM) 23:15:02.621442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26210): Terminating (SIGTERM) 23:15:02.663744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26213): Terminating (SIGTERM) 23:15:02.706174 --- ParallelTerminationStrategy: PID 26207 died... 23:15:02.726269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26207): Terminated: ok {rc=0} 23:15:02.772897 --- ParallelTerminationStrategy: PID 26210 died... 23:15:02.792919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26210): Terminated: ok {rc=0} 23:15:02.839424 --- ParallelTerminationStrategy: PID 26213 died... 23:15:02.859066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26213): Terminated: ok {rc=0} 23:15:02.948604 bus /sierra_3: Setting Powered False 23:15:04.045803 bus /sierra_3: Setting Powered False 23:15:05.161957 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 23:15:06.313272 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:15:06.325411 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:15:06.383559 tst mo_mt_call_osmux.py: using LAC 17422 23:15:06.515274 tst mo_mt_call_osmux.py: using RAC 82 23:15:06.645592 tst mo_mt_call_osmux.py: using CellId 17422 23:15:06.777423 tst mo_mt_call_osmux.py: using BVCI 17423 23:15:06.893731 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:15:06.905113 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:15:06.916407 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:15:06.928313 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:15:06.940309 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:15:06.952243 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:15:07.075959 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:15:07.194261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:07.683437 run create_hlr_db(pid=26219): Launched 23:15:07.803895 bus /sierra_2: Setting Powered False 23:15:08.866506 run create_hlr_db(pid=26219): Terminated: ok {rc=0} 23:15:09.325100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26221): Launched 23:15:09.645334 run osmo-hlr_10.42.42.2(pid=26222): Launched 23:15:09.766624 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:10.323333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26224): Launched 23:15:10.641092 run osmo-stp_10.42.42.5(pid=26225): Launched 23:15:10.761522 run osmo-msc_10.42.42.6: Starting osmo-msc 23:15:11.330326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26227): Launched 23:15:11.646233 run osmo-msc_10.42.42.6(pid=26228): Launched 23:15:11.820857 run osmo-stp_10.42.42.5(pid=26225): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26225)] 23:15:11.953791 run osmo-stp_10.42.42.5(pid=26225): stdout: | (launched: 2022-12-08_23:15:10.581688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:12.086633 run osmo-stp_10.42.42.5(pid=26225): stderr: | [0;m[38;5;43m20221208231510756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231510756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231510756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231510757 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231510757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231510757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231510757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:12.217818 run osmo-stp_10.42.42.5(pid=26225): stdout: | (launched: 2022-12-08_23:15:10.581688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:12.342660 run osmo-stp_10.42.42.5(pid=26225): stderr: | [0;m[38;5;43m20221208231510756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231510756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231510756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231510757 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231510757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231510757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231510757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:12.492252 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26225): Process ended prematurely: osmo-stp_10.42.42.5(pid=26225) [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26225)] [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 23:15:12.501525 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:15:12.528419 run osmo-hlr_10.42.42.2(pid=26222): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26222)] 23:15:12.576890 run osmo-hlr_10.42.42.2(pid=26222): stdout: | (launched: 2022-12-08_23:15:09.585936) 23:15:12.626580 run osmo-hlr_10.42.42.2(pid=26222): stderr: | [0;m[1;31m20221208231509771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231509771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231509771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231509771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231509771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231509771 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231509784 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231509792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231509792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231509792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:12.695275 run osmo-msc_10.42.42.6(pid=26228): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26228)] 23:15:12.743160 run osmo-msc_10.42.42.6(pid=26228): stdout: | (launched: 2022-12-08_23:15:11.586880) 23:15:12.792664 run osmo-msc_10.42.42.6(pid=26228): stderr: | [0;m[38;5;43m20221208231511865 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208231511866 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fedd1a9ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208231511866 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208231511866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208231511866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208231511866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208231511868 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208231511868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208231511868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208231511868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:15:12.842736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26221): Terminating (SIGTERM) 23:15:12.882763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26224): Terminating (SIGTERM) 23:15:12.922674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26227): Terminating (SIGTERM) 23:15:12.962852 --- ParallelTerminationStrategy: PID 26221 died... 23:15:12.981811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26221): Terminated: ok {rc=0} 23:15:13.026562 --- ParallelTerminationStrategy: PID 26224 died... 23:15:13.045377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26224): Terminated: ok {rc=0} 23:15:13.090085 --- ParallelTerminationStrategy: PID 26227 died... 23:15:13.108922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26227): Terminated: ok {rc=0} 23:15:13.194948 bus /sierra_3: Setting Powered False 23:15:14.294479 bus /sierra_3: Setting Powered False 23:15:15.411159 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 23:15:16.695212 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:15:16.706657 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 23:15:16.740884 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 23:15:16.784620 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 23:15:16.853290 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 23:15:16.879843 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 23:15:16.914499 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 23:15:17.450185 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 23:15:17.503519 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:17.515044 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:15:17.573183 tst mo_mt_call.py: using LAC 17423 23:15:17.709811 tst mo_mt_call.py: using RAC 83 23:15:17.837838 tst mo_mt_call.py: using CellId 17423 23:15:17.961997 tst mo_mt_call.py: using BVCI 17424 23:15:18.076659 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:18.088080 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:18.099294 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:18.110831 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:18.122293 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:18.133879 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:15:18.256757 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:15:18.378283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:18.899855 run create_hlr_db(pid=26233): Launched 23:15:19.035369 bus /sierra_2: Setting Powered False 23:15:20.100417 run create_hlr_db(pid=26233): Terminated: ok {rc=0} 23:15:20.549328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26235): Launched 23:15:20.867040 run osmo-hlr_10.42.42.2(pid=26236): Launched 23:15:20.986700 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:21.544680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26238): Launched 23:15:21.862056 run osmo-stp_10.42.42.5(pid=26239): Launched 23:15:21.981626 run osmo-msc_10.42.42.6: Starting osmo-msc 23:15:22.550085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26241): Launched 23:15:22.866940 run osmo-msc_10.42.42.6(pid=26242): Launched 23:15:23.043267 run osmo-stp_10.42.42.5(pid=26239): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26239)] 23:15:23.176732 run osmo-stp_10.42.42.5(pid=26239): stdout: | (launched: 2022-12-08_23:15:21.801925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:23.309164 run osmo-stp_10.42.42.5(pid=26239): stderr: | [0;m[38;5;43m20221208231521978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231521978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231521979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231521979 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231521980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231521980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231521980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:23.440011 run osmo-stp_10.42.42.5(pid=26239): stdout: | (launched: 2022-12-08_23:15:21.801925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:23.564691 run osmo-stp_10.42.42.5(pid=26239): stderr: | [0;m[38;5;43m20221208231521978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231521978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231521979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231521979 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231521980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231521980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231521980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:23.714590 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26239): Process ended prematurely: osmo-stp_10.42.42.5(pid=26239) [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26239)] [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 23:15:23.723612 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 23:15:23.750768 run osmo-hlr_10.42.42.2(pid=26236): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26236)] 23:15:23.799081 run osmo-hlr_10.42.42.2(pid=26236): stdout: | (launched: 2022-12-08_23:15:20.807468) 23:15:23.849294 run osmo-hlr_10.42.42.2(pid=26236): stderr: | [0;m[1;31m20221208231520986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231520986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231520986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231520986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231520986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231520986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231521001 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231521012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231521012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231521012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:23.918776 run osmo-msc_10.42.42.6(pid=26242): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26242)] 23:15:23.966741 run osmo-msc_10.42.42.6(pid=26242): stdout: | (launched: 2022-12-08_23:15:22.807130) 23:15:24.016483 run osmo-msc_10.42.42.6(pid=26242): stderr: | [0;m[38;5;43m20221208231523081 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208231523081 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f86d1ee3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208231523081 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208231523082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208231523082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208231523082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208231523084 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208231523084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208231523084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208231523084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:15:24.066748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26235): Terminating (SIGTERM) 23:15:24.106515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26238): Terminating (SIGTERM) 23:15:24.146235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26241): Terminating (SIGTERM) 23:15:24.186190 --- ParallelTerminationStrategy: PID 26235 died... 23:15:24.205237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26235): Terminated: ok {rc=0} 23:15:24.249749 --- ParallelTerminationStrategy: PID 26238 died... 23:15:24.268248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26238): Terminated: ok {rc=0} 23:15:24.312628 --- ParallelTerminationStrategy: PID 26241 died... 23:15:24.331144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26241): Terminated: ok {rc=0} 23:15:24.418623 bus /sierra_3: Setting Powered False 23:15:25.518365 bus /sierra_3: Setting Powered False 23:15:26.634759 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:15:27.782631 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:27.794839 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:15:27.851027 tst mo_mt_call_osmux.py: using LAC 17424 23:15:27.975702 tst mo_mt_call_osmux.py: using RAC 84 23:15:28.106571 tst mo_mt_call_osmux.py: using CellId 17424 23:15:28.238883 tst mo_mt_call_osmux.py: using BVCI 17425 23:15:28.362177 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:28.373982 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:28.385547 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:28.396943 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:28.408280 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:28.419636 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:15:28.537347 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:15:28.659750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:29.180896 run create_hlr_db(pid=26244): Launched 23:15:29.316486 bus /sierra_2: Setting Powered False 23:15:30.381477 run create_hlr_db(pid=26244): Terminated: ok {rc=0} 23:15:30.840330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26246): Launched 23:15:31.188263 run osmo-hlr_10.42.42.2(pid=26247): Launched 23:15:31.443230 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:32.100884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26249): Launched 23:15:32.434015 run osmo-stp_10.42.42.5(pid=26250): Launched 23:15:32.555424 run osmo-msc_10.42.42.6: Starting osmo-msc 23:15:33.124686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26252): Launched 23:15:33.441382 run osmo-msc_10.42.42.6(pid=26253): Launched 23:15:33.618451 run osmo-stp_10.42.42.5(pid=26250): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26250)] 23:15:33.752163 run osmo-stp_10.42.42.5(pid=26250): stdout: | (launched: 2022-12-08_23:15:32.374636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:33.886216 run osmo-stp_10.42.42.5(pid=26250): stderr: | [0;m[38;5;43m20221208231532548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231532548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231532549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231532549 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231532550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231532550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231532550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:34.017844 run osmo-stp_10.42.42.5(pid=26250): stdout: | (launched: 2022-12-08_23:15:32.374636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:34.142665 run osmo-stp_10.42.42.5(pid=26250): stderr: | [0;m[38;5;43m20221208231532548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231532548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231532549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231532549 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231532550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231532550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231532550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:34.292129 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26250): Process ended prematurely: osmo-stp_10.42.42.5(pid=26250) [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26250)] [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:15:34.301348 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 23:15:34.328244 run osmo-hlr_10.42.42.2(pid=26247): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26247)] 23:15:34.377169 run osmo-hlr_10.42.42.2(pid=26247): stdout: | (launched: 2022-12-08_23:15:31.122527) 23:15:34.427439 run osmo-hlr_10.42.42.2(pid=26247): stderr: | [0;m[1;31m20221208231531430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231531430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231531430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231531430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231531430 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231531431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231531469 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231531485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231531486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231531486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:34.497530 run osmo-msc_10.42.42.6(pid=26253): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26253)] 23:15:34.546102 run osmo-msc_10.42.42.6(pid=26253): stdout: | (launched: 2022-12-08_23:15:33.381661) 23:15:34.596467 run osmo-msc_10.42.42.6(pid=26253): stderr: | [0;m[38;5;43m20221208231533657 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208231533657 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3cd8fd8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208231533657 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208231533657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208231533657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208231533657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208231533659 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208231533659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208231533660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208231533660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:15:34.647152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26246): Terminating (SIGTERM) 23:15:34.687441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26249): Terminating (SIGTERM) 23:15:34.727784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26252): Terminating (SIGTERM) 23:15:34.768395 --- ParallelTerminationStrategy: PID 26246 died... 23:15:34.787727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26246): Terminated: ok {rc=0} 23:15:34.832636 --- ParallelTerminationStrategy: PID 26249 died... 23:15:34.851439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26249): Terminated: ok {rc=0} 23:15:34.896053 --- ParallelTerminationStrategy: PID 26252 died... 23:15:34.914832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26252): Terminated: ok {rc=0} 23:15:35.002147 bus /sierra_3: Setting Powered False 23:15:36.102157 bus /sierra_3: Setting Powered False 23:15:37.217686 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 23:15:38.454930 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:15:38.461320 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 23:15:38.482062 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 23:15:38.508717 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 23:15:38.561176 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 23:15:38.582735 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 23:15:38.610319 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 23:15:39.158404 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 23:15:39.208941 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:39.219919 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:15:39.277644 tst mo_mt_call.py: using LAC 17425 23:15:39.402977 tst mo_mt_call.py: using RAC 85 23:15:39.526560 tst mo_mt_call.py: using CellId 17425 23:15:39.651023 tst mo_mt_call.py: using BVCI 17426 23:15:39.766044 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:39.777135 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:39.787940 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:39.798996 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:39.809779 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:39.820859 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:15:39.939810 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:15:40.057406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:40.543747 run create_hlr_db(pid=26258): Launched 23:15:40.663723 bus /sierra_2: Setting Powered False 23:15:41.726025 run create_hlr_db(pid=26258): Terminated: ok {rc=0} 23:15:42.183910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26260): Launched 23:15:42.522399 run osmo-hlr_10.42.42.2(pid=26261): Launched 23:15:42.652747 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:43.228872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26263): Launched 23:15:43.564875 run osmo-stp_10.42.42.5(pid=26264): Launched 23:15:43.693106 run osmo-msc_10.42.42.6: Starting osmo-msc 23:15:44.301043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26266): Launched 23:15:44.638134 run osmo-msc_10.42.42.6(pid=26267): Launched 23:15:44.824306 run osmo-stp_10.42.42.5(pid=26264): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26264)] 23:15:44.964413 run osmo-stp_10.42.42.5(pid=26264): stdout: | (launched: 2022-12-08_23:15:43.502324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:45.105786 run osmo-stp_10.42.42.5(pid=26264): stderr: | [0;m[38;5;43m20221208231543699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231543699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231543699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231543700 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231543702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231543702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231543702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:45.245312 run osmo-stp_10.42.42.5(pid=26264): stdout: | (launched: 2022-12-08_23:15:43.502324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:45.378347 run osmo-stp_10.42.42.5(pid=26264): stderr: | [0;m[38;5;43m20221208231543699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231543699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231543699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231543700 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231543702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231543702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231543702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:45.537374 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26264): Process ended prematurely: osmo-stp_10.42.42.5(pid=26264) [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26264)] [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 23:15:45.547107 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 23:15:45.575312 run osmo-hlr_10.42.42.2(pid=26261): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26261)] 23:15:45.625960 run osmo-hlr_10.42.42.2(pid=26261): stdout: | (launched: 2022-12-08_23:15:42.458755) 23:15:45.678457 run osmo-hlr_10.42.42.2(pid=26261): stderr: | [0;m[1;31m20221208231542664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231542664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231542664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231542664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231542664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231542664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231542694 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231542705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231542706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231542706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:45.750900 run osmo-msc_10.42.42.6(pid=26267): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26267)] 23:15:45.801163 run osmo-msc_10.42.42.6(pid=26267): stdout: | (launched: 2022-12-08_23:15:44.575226) 23:15:45.865141 run osmo-msc_10.42.42.6(pid=26267): stderr: | [0;m[38;5;43m20221208231544901 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208231544901 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0ea423ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208231544901 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208231544901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208231544901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208231544902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208231544903 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208231544904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208231544904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208231544904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:15:45.923189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26260): Terminating (SIGTERM) 23:15:45.966282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26263): Terminating (SIGTERM) 23:15:46.010387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26266): Terminating (SIGTERM) 23:15:46.056078 --- ParallelTerminationStrategy: PID 26260 died... 23:15:46.076524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26260): Terminated: ok {rc=0} 23:15:46.125299 --- ParallelTerminationStrategy: PID 26263 died... 23:15:46.145429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26263): Terminated: ok {rc=0} 23:15:46.192465 --- ParallelTerminationStrategy: PID 26266 died... 23:15:46.212420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26266): Terminated: ok {rc=0} 23:15:46.301585 bus /sierra_3: Setting Powered False 23:15:47.400739 bus /sierra_3: Setting Powered False 23:15:48.515882 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 23:15:49.669098 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:49.681691 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:15:49.740434 tst mo_mt_call_osmux.py: using LAC 17426 23:15:49.871747 tst mo_mt_call_osmux.py: using RAC 86 23:15:50.001404 tst mo_mt_call_osmux.py: using CellId 17426 23:15:50.131843 tst mo_mt_call_osmux.py: using BVCI 17427 23:15:50.253216 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:50.264870 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:50.276381 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:50.288092 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:50.299870 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:50.311617 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:15:50.428532 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:15:50.548376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:51.069605 run create_hlr_db(pid=26269): Launched 23:15:51.204618 bus /sierra_2: Setting Powered False 23:15:52.270508 run create_hlr_db(pid=26269): Terminated: ok {rc=0} 23:15:52.737227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26271): Launched 23:15:53.074574 run osmo-hlr_10.42.42.2(pid=26272): Launched 23:15:53.202574 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:53.783604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26274): Launched 23:15:54.120635 run osmo-stp_10.42.42.5(pid=26275): Launched 23:15:54.248285 run osmo-msc_10.42.42.6: Starting osmo-msc 23:15:54.855517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26277): Launched 23:15:55.191966 run osmo-msc_10.42.42.6(pid=26278): Launched 23:15:55.377381 run osmo-stp_10.42.42.5(pid=26275): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26275)] 23:15:55.517295 run osmo-stp_10.42.42.5(pid=26275): stdout: | (launched: 2022-12-08_23:15:54.057695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:55.658208 run osmo-stp_10.42.42.5(pid=26275): stderr: | [0;m[38;5;43m20221208231554253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231554253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231554254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231554254 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231554256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231554257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231554257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:55.798001 run osmo-stp_10.42.42.5(pid=26275): stdout: | (launched: 2022-12-08_23:15:54.057695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:55.930696 run osmo-stp_10.42.42.5(pid=26275): stderr: | [0;m[38;5;43m20221208231554253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231554253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231554254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231554254 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231554256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231554257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231554257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:56.089936 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26275): Process ended prematurely: osmo-stp_10.42.42.5(pid=26275) [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26275)] [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 23:15:56.099972 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 23:15:56.128124 run osmo-hlr_10.42.42.2(pid=26272): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26272)] 23:15:56.178444 run osmo-hlr_10.42.42.2(pid=26272): stdout: | (launched: 2022-12-08_23:15:53.011559) 23:15:56.230395 run osmo-hlr_10.42.42.2(pid=26272): stderr: | [0;m[1;31m20221208231553216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231553216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231553216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231553216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231553216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231553216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231553230 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231553240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231553240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231553240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:56.302442 run osmo-msc_10.42.42.6(pid=26278): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26278)] 23:15:56.352889 run osmo-msc_10.42.42.6(pid=26278): stdout: | (launched: 2022-12-08_23:15:55.129244) 23:15:56.405173 run osmo-msc_10.42.42.6(pid=26278): stderr: | [0;m[38;5;43m20221208231555457 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208231555457 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8a39ae5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208231555458 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208231555458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208231555458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208231555458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208231555460 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208231555460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208231555460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208231555460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:15:56.457383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26271): Terminating (SIGTERM) 23:15:56.499098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26274): Terminating (SIGTERM) 23:15:56.540842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26277): Terminating (SIGTERM) 23:15:56.582958 --- ParallelTerminationStrategy: PID 26271 died... 23:15:56.602581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26271): Terminated: ok {rc=0} 23:15:56.649175 --- ParallelTerminationStrategy: PID 26274 died... 23:15:56.668810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26274): Terminated: ok {rc=0} 23:15:56.715369 --- ParallelTerminationStrategy: PID 26277 died... 23:15:56.735026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26277): Terminated: ok {rc=0} 23:15:56.822724 bus /sierra_3: Setting Powered False 23:15:57.923076 bus /sierra_3: Setting Powered False 23:15:59.038884 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:16:00.276440 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:16:00.283450 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:16:00.305418 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:16:00.333118 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:16:00.387868 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:16:00.410414 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:16:00.438043 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:16:00.993493 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:16:01.051410 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:01.064039 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:16:01.125949 tst mo_mt_call.py: using LAC 17427 23:16:01.259245 tst mo_mt_call.py: using RAC 87 23:16:01.390038 tst mo_mt_call.py: using CellId 17427 23:16:01.519228 tst mo_mt_call.py: using BVCI 17428 23:16:01.639517 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:01.651624 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:01.663578 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:01.676290 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:01.689159 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:01.702897 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:16:01.824564 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:16:01.967678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:02.543710 run create_hlr_db(pid=26283): Launched 23:16:02.679724 bus /sierra_2: Setting Powered False 23:16:03.744686 run create_hlr_db(pid=26283): Terminated: ok {rc=0} 23:16:04.212940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26285): Launched 23:16:04.550169 run osmo-hlr_10.42.42.2(pid=26286): Launched 23:16:04.677761 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:05.259410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26288): Launched 23:16:05.596639 run osmo-stp_10.42.42.5(pid=26289): Launched 23:16:05.724090 run osmo-msc_10.42.42.6: Starting osmo-msc 23:16:06.331898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26291): Launched 23:16:06.670515 run osmo-msc_10.42.42.6(pid=26292): Launched 23:16:06.858304 run osmo-stp_10.42.42.5(pid=26289): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26289)] 23:16:06.998539 run osmo-stp_10.42.42.5(pid=26289): stdout: | (launched: 2022-12-08_23:16:05.533857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:07.139583 run osmo-stp_10.42.42.5(pid=26289): stderr: | [0;m[38;5;43m20221208231605731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231605731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231605731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231605732 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231605732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231605732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231605732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:07.279214 run osmo-stp_10.42.42.5(pid=26289): stdout: | (launched: 2022-12-08_23:16:05.533857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:07.412533 run osmo-stp_10.42.42.5(pid=26289): stderr: | [0;m[38;5;43m20221208231605731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231605731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231605731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231605732 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231605732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231605732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231605732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:07.572274 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26289): Process ended prematurely: osmo-stp_10.42.42.5(pid=26289) [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26289)] [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:16:07.582096 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 23:16:07.610165 run osmo-hlr_10.42.42.2(pid=26286): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26286)] 23:16:07.661345 run osmo-hlr_10.42.42.2(pid=26286): stdout: | (launched: 2022-12-08_23:16:04.487157) 23:16:07.713784 run osmo-hlr_10.42.42.2(pid=26286): stderr: | [0;m[1;31m20221208231604691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231604691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231604691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231604691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231604692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231604692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231604704 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231604712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231604713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231604713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:07.786186 run osmo-msc_10.42.42.6(pid=26292): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26292)] 23:16:07.836388 run osmo-msc_10.42.42.6(pid=26292): stdout: | (launched: 2022-12-08_23:16:06.606690) 23:16:07.888090 run osmo-msc_10.42.42.6(pid=26292): stderr: | [0;m[38;5;43m20221208231606935 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208231606935 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6e0e97ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208231606936 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208231606936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208231606936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208231606936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208231606938 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208231606938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208231606938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208231606938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:16:07.940462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26285): Terminating (SIGTERM) 23:16:07.982451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26288): Terminating (SIGTERM) 23:16:08.024481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26291): Terminating (SIGTERM) 23:16:08.066936 --- ParallelTerminationStrategy: PID 26285 died... 23:16:08.087018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26285): Terminated: ok {rc=0} 23:16:08.133743 --- ParallelTerminationStrategy: PID 26288 died... 23:16:08.153438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26288): Terminated: ok {rc=0} 23:16:08.200339 --- ParallelTerminationStrategy: PID 26291 died... 23:16:08.220072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26291): Terminated: ok {rc=0} 23:16:08.309598 bus /sierra_3: Setting Powered False 23:16:09.410068 bus /sierra_3: Setting Powered False 23:16:10.528178 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:16:11.681526 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:11.694031 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:16:11.752394 tst mo_mt_call_osmux.py: using LAC 17428 23:16:11.884493 tst mo_mt_call_osmux.py: using RAC 88 23:16:12.015269 tst mo_mt_call_osmux.py: using CellId 17428 23:16:12.151337 tst mo_mt_call_osmux.py: using BVCI 17429 23:16:12.275943 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:12.287661 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:12.299036 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:12.310605 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:12.322088 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:12.333734 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:16:12.456350 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:16:12.583920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:13.071096 run create_hlr_db(pid=26294): Launched 23:16:13.191417 bus /sierra_2: Setting Powered False 23:16:14.253141 run create_hlr_db(pid=26294): Terminated: ok {rc=0} 23:16:14.689500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26296): Launched 23:16:15.004611 run osmo-hlr_10.42.42.2(pid=26297): Launched 23:16:15.124675 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:15.664836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26299): Launched 23:16:16.004718 run osmo-stp_10.42.42.5(pid=26300): Launched 23:16:16.304207 run osmo-msc_10.42.42.6: Starting osmo-msc 23:16:17.229418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26302): Launched 23:16:17.575805 run osmo-msc_10.42.42.6(pid=26303): Launched 23:16:17.763715 run osmo-stp_10.42.42.5(pid=26300): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26300)] 23:16:17.905503 run osmo-stp_10.42.42.5(pid=26300): stdout: | (launched: 2022-12-08_23:16:15.942107) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:18.047825 run osmo-stp_10.42.42.5(pid=26300): stderr: | [0;m[38;5;43m20221208231616408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231616408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231616409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231616409 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231616410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231616411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231616411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:18.187858 run osmo-stp_10.42.42.5(pid=26300): stdout: | (launched: 2022-12-08_23:16:15.942107) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:18.321624 run osmo-stp_10.42.42.5(pid=26300): stderr: | [0;m[38;5;43m20221208231616408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231616408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231616409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231616409 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231616410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231616411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231616411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:18.480437 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26300): Process ended prematurely: osmo-stp_10.42.42.5(pid=26300) [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26300)] [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:16:18.490212 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 23:16:18.517952 run osmo-hlr_10.42.42.2(pid=26297): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26297)] 23:16:18.567938 run osmo-hlr_10.42.42.2(pid=26297): stdout: | (launched: 2022-12-08_23:16:14.944840) 23:16:18.619769 run osmo-hlr_10.42.42.2(pid=26297): stderr: | [0;m[1;31m20221208231615125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231615125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231615125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231615125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231615125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231615125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231615136 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231615144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231615144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231615145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:18.691944 run osmo-msc_10.42.42.6(pid=26303): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26303)] 23:16:18.742016 run osmo-msc_10.42.42.6(pid=26303): stdout: | (launched: 2022-12-08_23:16:17.512677) 23:16:18.793781 run osmo-msc_10.42.42.6(pid=26303): stderr: | [0;m[38;5;43m20221208231617837 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208231617837 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6396829c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208231617837 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208231617837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208231617837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208231617837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208231617839 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208231617839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208231617839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208231617840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:16:18.845781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26296): Terminating (SIGTERM) 23:16:18.887581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26299): Terminating (SIGTERM) 23:16:18.929431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26302): Terminating (SIGTERM) 23:16:18.971559 --- ParallelTerminationStrategy: PID 26296 died... 23:16:18.991570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26296): Terminated: ok {rc=0} 23:16:19.037802 --- ParallelTerminationStrategy: PID 26299 died... 23:16:19.057517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26299): Terminated: ok {rc=0} 23:16:19.103582 --- ParallelTerminationStrategy: PID 26302 died... 23:16:19.123224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26302): Terminated: ok {rc=0} 23:16:19.211222 bus /sierra_3: Setting Powered False 23:16:20.310948 bus /sierra_3: Setting Powered False 23:16:21.425734 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:16:22.664545 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:16:22.671632 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:16:22.692991 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:16:22.720446 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:16:22.774638 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:16:22.796283 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:16:22.823532 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:16:23.374984 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:16:23.427900 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:23.439330 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:16:23.497524 tst mo_mt_call.py: using LAC 17429 23:16:23.630024 tst mo_mt_call.py: using RAC 89 23:16:23.762307 tst mo_mt_call.py: using CellId 17429 23:16:23.893046 tst mo_mt_call.py: using BVCI 17430 23:16:24.014479 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:24.026016 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:24.037392 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:24.048653 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:24.060005 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:24.071459 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:16:24.188117 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:16:24.308291 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:24.830334 run create_hlr_db(pid=26308): Launched 23:16:24.968022 bus /sierra_2: Setting Powered False 23:16:26.034154 run create_hlr_db(pid=26308): Terminated: ok {rc=0} 23:16:26.483220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26310): Launched 23:16:26.800504 run osmo-hlr_10.42.42.2(pid=26311): Launched 23:16:26.920558 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:27.476304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26313): Launched 23:16:27.793819 run osmo-stp_10.42.42.5(pid=26314): Launched 23:16:27.914125 run osmo-msc_10.42.42.6: Starting osmo-msc 23:16:28.483497 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26316): Launched 23:16:28.800565 run osmo-msc_10.42.42.6(pid=26317): Launched 23:16:28.976663 run osmo-stp_10.42.42.5(pid=26314): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26314)] 23:16:29.109594 run osmo-stp_10.42.42.5(pid=26314): stdout: | (launched: 2022-12-08_23:16:27.734341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:29.242655 run osmo-stp_10.42.42.5(pid=26314): stderr: | [0;m[38;5;43m20221208231627906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231627907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231627907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231627907 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231627909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231627910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231627910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:29.373369 run osmo-stp_10.42.42.5(pid=26314): stdout: | (launched: 2022-12-08_23:16:27.734341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:29.498291 run osmo-stp_10.42.42.5(pid=26314): stderr: | [0;m[38;5;43m20221208231627906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231627907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231627907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231627907 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231627909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231627910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231627910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:29.647789 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26314): Process ended prematurely: osmo-stp_10.42.42.5(pid=26314) [trial-2351↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26314)] [trial-2351↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:16:29.657474 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 23:16:29.684591 run osmo-hlr_10.42.42.2(pid=26311): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26311)] 23:16:29.733391 run osmo-hlr_10.42.42.2(pid=26311): stdout: | (launched: 2022-12-08_23:16:26.741380) 23:16:29.783569 run osmo-hlr_10.42.42.2(pid=26311): stderr: | [0;m[1;31m20221208231626919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231626919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231626919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231626919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231626919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231626919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231626932 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231626942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231626942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231626942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:29.853159 run osmo-msc_10.42.42.6(pid=26317): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26317)] 23:16:29.901514 run osmo-msc_10.42.42.6(pid=26317): stdout: | (launched: 2022-12-08_23:16:28.741242) 23:16:29.951690 run osmo-msc_10.42.42.6(pid=26317): stderr: | [0;m[38;5;43m20221208231629016 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208231629016 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f332f2d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208231629016 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208231629016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208231629017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208231629017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208231629018 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208231629019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208231629019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208231629019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:16:30.001839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26310): Terminating (SIGTERM) 23:16:30.042224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26313): Terminating (SIGTERM) 23:16:30.082642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26316): Terminating (SIGTERM) 23:16:30.123406 --- ParallelTerminationStrategy: PID 26310 died... 23:16:30.142602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26310): Terminated: ok {rc=0} 23:16:30.187570 --- ParallelTerminationStrategy: PID 26313 died... 23:16:30.206404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26313): Terminated: ok {rc=0} 23:16:30.251279 --- ParallelTerminationStrategy: PID 26316 died... 23:16:30.269942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26316): Terminated: ok {rc=0} 23:16:30.356785 bus /sierra_3: Setting Powered False 23:16:31.456600 bus /sierra_3: Setting Powered False 23:16:32.574100 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:16:33.722022 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:33.734303 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:16:33.791164 tst mo_mt_call_osmux.py: using LAC 17430 23:16:33.914426 tst mo_mt_call_osmux.py: using RAC 90 23:16:34.036799 tst mo_mt_call_osmux.py: using CellId 17430 23:16:34.160455 tst mo_mt_call_osmux.py: using BVCI 17431 23:16:34.276443 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:34.287662 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:34.298623 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:34.309914 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:34.321321 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:34.332630 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:16:34.455961 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:16:34.576005 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:35.097583 run create_hlr_db(pid=26319): Launched 23:16:35.234020 bus /sierra_2: Setting Powered False 23:16:36.299690 run create_hlr_db(pid=26319): Terminated: ok {rc=0} 23:16:36.748538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26321): Launched 23:16:37.065642 run osmo-hlr_10.42.42.2(pid=26322): Launched 23:16:37.185108 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:37.739661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26324): Launched 23:16:38.056515 run osmo-stp_10.42.42.5(pid=26325): Launched 23:16:38.176160 run osmo-msc_10.42.42.6: Starting osmo-msc 23:16:38.743646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26327): Launched 23:16:39.060179 run osmo-msc_10.42.42.6(pid=26328): Launched 23:16:39.235891 run osmo-stp_10.42.42.5(pid=26325): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26325)] 23:16:39.368926 run osmo-stp_10.42.42.5(pid=26325): stdout: | (launched: 2022-12-08_23:16:37.996709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:39.501237 run osmo-stp_10.42.42.5(pid=26325): stderr: | [0;m[38;5;43m20221208231638170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231638170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231638170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231638171 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231638172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231638172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231638172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:39.631126 run osmo-stp_10.42.42.5(pid=26325): stdout: | (launched: 2022-12-08_23:16:37.996709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:39.755132 run osmo-stp_10.42.42.5(pid=26325): stderr: | [0;m[38;5;43m20221208231638170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231638170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231638170 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231638171 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231638172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231638172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231638172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:39.903560 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26325): Process ended prematurely: osmo-stp_10.42.42.5(pid=26325) [trial-2351↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26325)] [trial-2351↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:16:39.912701 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:16:39.939513 run osmo-hlr_10.42.42.2(pid=26322): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26322)] 23:16:39.987785 run osmo-hlr_10.42.42.2(pid=26322): stdout: | (launched: 2022-12-08_23:16:37.006079) 23:16:40.037372 run osmo-hlr_10.42.42.2(pid=26322): stderr: | [0;m[1;31m20221208231637187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231637187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231637187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231637188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231637188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231637188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231637201 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231637211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231637212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231637212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:40.106694 run osmo-msc_10.42.42.6(pid=26328): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26328)] 23:16:40.154308 run osmo-msc_10.42.42.6(pid=26328): stdout: | (launched: 2022-12-08_23:16:39.000646) 23:16:40.203664 run osmo-msc_10.42.42.6(pid=26328): stderr: | [0;m[38;5;43m20221208231639275 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208231639275 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa0ff374c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208231639275 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208231639275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208231639275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208231639276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208231639277 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208231639278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208231639278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208231639278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:16:40.253468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26321): Terminating (SIGTERM) 23:16:40.293257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26324): Terminating (SIGTERM) 23:16:40.333223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26327): Terminating (SIGTERM) 23:16:40.373561 --- ParallelTerminationStrategy: PID 26321 died... 23:16:40.392543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26321): Terminated: ok {rc=0} 23:16:40.437378 --- ParallelTerminationStrategy: PID 26324 died... 23:16:40.456014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26324): Terminated: ok {rc=0} 23:16:40.500676 --- ParallelTerminationStrategy: PID 26327 died... 23:16:40.519155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26327): Terminated: ok {rc=0} 23:16:40.604825 bus /sierra_3: Setting Powered False 23:16:41.704319 bus /sierra_3: Setting Powered False 23:16:42.820811 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:16:44.057490 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:16:44.063495 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:16:44.085446 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 23:16:44.113431 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 23:16:44.168168 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:16:44.189675 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 23:16:44.216831 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 23:16:44.765900 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 23:16:44.818905 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:44.830205 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:16:44.889119 tst mo_mt_call.py: using LAC 17431 23:16:45.020856 tst mo_mt_call.py: using RAC 91 23:16:45.152187 tst mo_mt_call.py: using CellId 17431 23:16:45.283766 tst mo_mt_call.py: using BVCI 17432 23:16:45.406552 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:45.417949 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:45.429053 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:45.440120 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:45.451248 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:45.462469 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:16:45.580499 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:16:45.699725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:46.213664 run create_hlr_db(pid=26334): Launched 23:16:46.368647 bus /sierra_2: Setting Powered False 23:16:47.433462 run create_hlr_db(pid=26334): Terminated: ok {rc=0} 23:16:47.902895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26336): Launched 23:16:48.239837 run osmo-hlr_10.42.42.2(pid=26337): Launched 23:16:48.367331 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:48.950952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26339): Launched 23:16:49.288444 run osmo-stp_10.42.42.5(pid=26340): Launched 23:16:49.416864 run osmo-msc_10.42.42.6: Starting osmo-msc 23:16:50.024238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26342): Launched 23:16:50.361531 run osmo-msc_10.42.42.6(pid=26343): Launched 23:16:50.547774 run osmo-stp_10.42.42.5(pid=26340): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26340)] 23:16:50.693305 run osmo-stp_10.42.42.5(pid=26340): stdout: | (launched: 2022-12-08_23:16:49.225760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:50.833462 run osmo-stp_10.42.42.5(pid=26340): stderr: | [0;m[38;5;43m20221208231649421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231649421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231649421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231649422 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231649422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231649422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231649422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:50.972488 run osmo-stp_10.42.42.5(pid=26340): stdout: | (launched: 2022-12-08_23:16:49.225760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:51.105255 run osmo-stp_10.42.42.5(pid=26340): stderr: | [0;m[38;5;43m20221208231649421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231649421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231649421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231649422 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231649422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231649422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231649422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:51.263841 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26340): Process ended prematurely: osmo-stp_10.42.42.5(pid=26340) [trial-2351↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26340)] [trial-2351↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 23:16:51.273620 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 23:16:51.301477 run osmo-hlr_10.42.42.2(pid=26337): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26337)] 23:16:51.351734 run osmo-hlr_10.42.42.2(pid=26337): stdout: | (launched: 2022-12-08_23:16:48.177125) 23:16:51.403906 run osmo-hlr_10.42.42.2(pid=26337): stderr: | [0;m[1;31m20221208231648381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231648381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231648381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231648381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231648381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231648381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231648394 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231648402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231648402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231648402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:51.476482 run osmo-msc_10.42.42.6(pid=26343): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26343)] 23:16:51.526454 run osmo-msc_10.42.42.6(pid=26343): stdout: | (launched: 2022-12-08_23:16:50.298492) 23:16:51.578122 run osmo-msc_10.42.42.6(pid=26343): stderr: | [0;m[38;5;43m20221208231650632 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208231650632 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff1fce7fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208231650632 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208231650632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208231650632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208231650632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208231650634 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208231650635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208231650635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208231650635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:16:51.630192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26336): Terminating (SIGTERM) 23:16:51.672569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26339): Terminating (SIGTERM) 23:16:51.714696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26342): Terminating (SIGTERM) 23:16:51.757185 --- ParallelTerminationStrategy: PID 26336 died... 23:16:51.777374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26336): Terminated: ok {rc=0} 23:16:51.823845 --- ParallelTerminationStrategy: PID 26339 died... 23:16:51.843532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26339): Terminated: ok {rc=0} 23:16:51.889804 --- ParallelTerminationStrategy: PID 26342 died... 23:16:51.909456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26342): Terminated: ok {rc=0} 23:16:51.997741 bus /sierra_3: Setting Powered False 23:16:53.096077 bus /sierra_3: Setting Powered False 23:16:54.212407 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 23:16:55.361152 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:55.372707 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:16:55.430853 tst mo_mt_call_osmux.py: using LAC 17432 23:16:55.554536 tst mo_mt_call_osmux.py: using RAC 92 23:16:55.681370 tst mo_mt_call_osmux.py: using CellId 17432 23:16:55.817752 tst mo_mt_call_osmux.py: using BVCI 17433 23:16:55.940413 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:55.952028 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:55.963402 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:55.974911 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:55.986517 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:55.998251 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:16:56.115583 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:16:56.235948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:56.759613 run create_hlr_db(pid=26345): Launched 23:16:56.896382 bus /sierra_2: Setting Powered False 23:16:57.962192 run create_hlr_db(pid=26345): Terminated: ok {rc=0} 23:16:58.411151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26347): Launched 23:16:58.730763 run osmo-hlr_10.42.42.2(pid=26348): Launched 23:16:58.850938 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:59.411327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26350): Launched 23:16:59.728204 run osmo-stp_10.42.42.5(pid=26351): Launched 23:16:59.848648 run osmo-msc_10.42.42.6: Starting osmo-msc 23:17:00.418421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26353): Launched 23:17:00.736275 run osmo-msc_10.42.42.6(pid=26354): Launched 23:17:00.931117 run osmo-stp_10.42.42.5(pid=26351): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26351)] 23:17:01.242034 run osmo-stp_10.42.42.5(pid=26351): stdout: | (launched: 2022-12-08_23:16:59.668562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:01.398980 run osmo-stp_10.42.42.5(pid=26351): stderr: | [0;m[38;5;43m20221208231659842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231659842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231659843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231659843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231659845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231659846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231659846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:01.537131 run osmo-stp_10.42.42.5(pid=26351): stdout: | (launched: 2022-12-08_23:16:59.668562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:01.665444 run osmo-stp_10.42.42.5(pid=26351): stderr: | [0;m[38;5;43m20221208231659842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231659842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231659843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231659843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231659845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231659846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231659846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:01.819440 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26351): Process ended prematurely: osmo-stp_10.42.42.5(pid=26351) [trial-2351↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26351)] [trial-2351↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 23:17:01.829438 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 23:17:01.859801 run osmo-hlr_10.42.42.2(pid=26348): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26348)] 23:17:01.910931 run osmo-hlr_10.42.42.2(pid=26348): stdout: | (launched: 2022-12-08_23:16:58.670827) 23:17:01.963575 run osmo-hlr_10.42.42.2(pid=26348): stderr: | [0;m[1;31m20221208231658851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231658851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231658851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231658851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231658851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231658851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231658864 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231658874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231658874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231658874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:17:02.035810 run osmo-msc_10.42.42.6(pid=26354): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26354)] 23:17:02.086507 run osmo-msc_10.42.42.6(pid=26354): stdout: | (launched: 2022-12-08_23:17:00.676882) 23:17:02.138506 run osmo-msc_10.42.42.6(pid=26354): stderr: | [0;m[38;5;43m20221208231701062 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208231701063 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f678e863c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208231701063 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208231701063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208231701063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208231701063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208231701069 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208231701070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208231701070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208231701070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:17:02.191207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26347): Terminating (SIGTERM) 23:17:02.233792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26350): Terminating (SIGTERM) 23:17:02.283630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26353): Terminating (SIGTERM) 23:17:02.342114 --- ParallelTerminationStrategy: PID 26347 died... 23:17:02.364498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26347): Terminated: ok {rc=0} 23:17:02.412093 --- ParallelTerminationStrategy: PID 26350 died... 23:17:02.432219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26350): Terminated: ok {rc=0} 23:17:02.476914 --- ParallelTerminationStrategy: PID 26353 died... 23:17:02.496010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26353): Terminated: ok {rc=0} 23:17:02.583161 bus /sierra_3: Setting Powered False 23:17:03.682495 bus /sierra_3: Setting Powered False 23:17:04.798542 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 emergency:sysmo --------------------------------------------------------------------- 23:17:06.032377 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:17:06.036589 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 23:17:06.057323 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 23:17:06.085293 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 23:17:06.169523 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 23:17:06.190095 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 23:17:06.216775 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 23:17:06.798909 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2351 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 23:17:06.803888 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:06.814599 tst emergency:sysmo: Using 1 x bts (candidates: 1) 23:17:06.850295 tst emergency_mo_mt_call.py: using LAC 17433 23:17:06.973276 tst emergency_mo_mt_call.py: using RAC 93 23:17:07.095599 tst emergency_mo_mt_call.py: using CellId 17433 23:17:07.217493 tst emergency_mo_mt_call.py: using BVCI 17434 23:17:07.328529 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:07.339160 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:07.349705 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:07.360333 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:07.371002 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:07.381779 tst emergency:sysmo: Using 1 x modem (candidates: 4) 23:17:07.498837 tst emergency:sysmo: Using 1 x modem (candidates: 4) 23:17:07.618665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:17:08.131859 run create_hlr_db(pid=26362): Launched 23:17:08.265355 bus /sierra_2: Setting Powered False 23:17:09.330378 run create_hlr_db(pid=26362): Terminated: ok {rc=0} 23:17:09.774454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26364): Launched 23:17:10.087006 run osmo-hlr_10.42.42.2(pid=26365): Launched 23:17:10.204569 run osmo-stp_10.42.42.5: Starting osmo-stp 23:17:10.749318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26367): Launched 23:17:11.059962 run osmo-stp_10.42.42.5(pid=26368): Launched 23:17:11.187270 tst emergency_mo_mt_call.py: using MSISDN 6907 23:17:11.344566 run osmo-msc_10.42.42.6: Starting osmo-msc 23:17:11.899697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26370): Launched 23:17:12.210322 run osmo-msc_10.42.42.6(pid=26371): Launched 23:17:12.382761 run osmo-stp_10.42.42.5(pid=26368): ERR: Terminated: ERROR {rc=1} [trial-2351↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26368)] 23:17:12.513238 run osmo-stp_10.42.42.5(pid=26368): stdout: | (launched: 2022-12-08_23:17:11.001539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:12.643478 run osmo-stp_10.42.42.5(pid=26368): stderr: | [0;m[38;5;43m20221208231711177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231711177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231711177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231711177 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231711178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231711178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231711178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:12.772225 run osmo-stp_10.42.42.5(pid=26368): stdout: | (launched: 2022-12-08_23:17:11.001539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:12.894943 run osmo-stp_10.42.42.5(pid=26368): stderr: | [0;m[38;5;43m20221208231711177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231711177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231711177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231711177 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231711178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231711178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231711178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:13.041737 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=26368): Process ended prematurely: osmo-stp_10.42.42.5(pid=26368) [trial-2351↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26368)] [trial-2351↪emergency:sysmo↪emergency_mo_mt_call.py:19] 23:17:13.050022 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 23:17:13.076505 run osmo-hlr_10.42.42.2(pid=26365): ERR: Terminated: ERROR {rc=237} [trial-2351↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26365)] 23:17:13.124661 run osmo-hlr_10.42.42.2(pid=26365): stdout: | (launched: 2022-12-08_23:17:10.027679) 23:17:13.174671 run osmo-hlr_10.42.42.2(pid=26365): stderr: | [0;m[1;31m20221208231710209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231710209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231710209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231710209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231710209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231710209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231710228 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231710238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231710238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231710238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:17:13.244235 run osmo-msc_10.42.42.6(pid=26371): ERR: Terminated: ERROR {rc=2} [trial-2351↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26371)] 23:17:13.292086 run osmo-msc_10.42.42.6(pid=26371): stdout: | (launched: 2022-12-08_23:17:12.151530) 23:17:13.341691 run osmo-msc_10.42.42.6(pid=26371): stderr: | [0;m[38;5;43m20221208231712427 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208231712427 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff7869bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208231712427 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208231712428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208231712428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208231712428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208231712430 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208231712430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208231712430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208231712430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:17:13.391880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26364): Terminating (SIGTERM) 23:17:13.431859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26367): Terminating (SIGTERM) 23:17:13.471911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26370): Terminating (SIGTERM) 23:17:13.512609 --- ParallelTerminationStrategy: PID 26364 died... 23:17:13.531805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26364): Terminated: ok {rc=0} 23:17:13.576488 --- ParallelTerminationStrategy: PID 26367 died... 23:17:13.595105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26367): Terminated: ok {rc=0} 23:17:13.639547 --- ParallelTerminationStrategy: PID 26370 died... 23:17:13.658499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26370): Terminated: ok {rc=0} 23:17:13.743658 bus /sierra_3: Setting Powered False 23:17:14.838839 bus /sierra_3: Setting Powered False 23:17:15.968624 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 23:17:17.057677 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:17.070902 tst emergency:sysmo: Using 1 x bts (candidates: 1) 23:17:17.111027 tst emergency_preemptive_call.py: using LAC 17434 23:17:17.235653 tst emergency_preemptive_call.py: using RAC 94 23:17:17.358148 tst emergency_preemptive_call.py: using CellId 17434 23:17:17.488051 tst emergency_preemptive_call.py: using BVCI 17435 23:17:17.607485 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:17.618913 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:17.630122 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:17.641455 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:17.652751 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:17.664069 tst emergency:sysmo: Using 1 x modem (candidates: 4) 23:17:17.780707 tst emergency:sysmo: Using 1 x modem (candidates: 4) 23:17:17.903365 tst emergency:sysmo: Using 1 x modem (candidates: 4) 23:17:18.023106 tst emergency:sysmo: Using 1 x modem (candidates: 4) 23:17:18.139683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:17:18.618834 run create_hlr_db(pid=26373): Launched 23:17:18.738274 bus /sierra_2: Setting Powered False 23:17:19.799099 run create_hlr_db(pid=26373): Terminated: ok {rc=0} 23:17:20.250304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26375): Launched 23:17:20.582381 run osmo-hlr_10.42.42.2(pid=26376): Launched 23:17:20.708892 run osmo-stp_10.42.42.5: Starting osmo-stp 23:17:21.277085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26378): Launched 23:17:21.608924 run osmo-stp_10.42.42.5(pid=26379): Launched 23:17:21.744224 tst emergency_preemptive_call.py: using MSISDN 6908 23:17:21.912771 run osmo-msc_10.42.42.6: Starting osmo-msc 23:17:22.504205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26381): Launched 23:17:22.836303 run osmo-msc_10.42.42.6(pid=26383): Launched 23:17:23.026177 run osmo-stp_10.42.42.5(pid=26379): ERR: Terminated: ERROR {rc=1} [trial-2351↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26379)] 23:17:23.163960 run osmo-stp_10.42.42.5(pid=26379): stdout: | (launched: 2022-12-08_23:17:21.546251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:23.302550 run osmo-stp_10.42.42.5(pid=26379): stderr: | [0;m[38;5;43m20221208231721741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231721742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231721742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231721743 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231721745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231721745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231721745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:23.440895 run osmo-stp_10.42.42.5(pid=26379): stdout: | (launched: 2022-12-08_23:17:21.546251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:23.572244 run osmo-stp_10.42.42.5(pid=26379): stderr: | [0;m[38;5;43m20221208231721741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231721742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231721742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231721743 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231721745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231721745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231721745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:23.729553 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=26379): Process ended prematurely: osmo-stp_10.42.42.5(pid=26379) [trial-2351↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26379)] [trial-2351↪emergency:sysmo↪emergency_preemptive_call.py:32] 23:17:23.738601 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 23:17:23.766250 run osmo-hlr_10.42.42.2(pid=26376): ERR: Terminated: ERROR {rc=237} [trial-2351↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26376)] 23:17:23.816807 run osmo-hlr_10.42.42.2(pid=26376): stdout: | (launched: 2022-12-08_23:17:20.520272) 23:17:23.869184 run osmo-hlr_10.42.42.2(pid=26376): stderr: | [0;m[1;31m20221208231720721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231720721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231720721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231720721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231720721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231720721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231720734 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231720744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231720745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231720745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:17:23.941747 run osmo-msc_10.42.42.6(pid=26383): ERR: Terminated: ERROR {rc=2} [trial-2351↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26383)] 23:17:23.991952 run osmo-msc_10.42.42.6(pid=26383): stdout: | (launched: 2022-12-08_23:17:22.774260) 23:17:24.043673 run osmo-msc_10.42.42.6(pid=26383): stderr: | [0;m[38;5;43m20221208231723099 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208231723099 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fef14285c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208231723099 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208231723100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208231723100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208231723100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208231723103 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208231723104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208231723104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208231723104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:17:24.096363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26375): Terminating (SIGTERM) 23:17:24.138428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26378): Terminating (SIGTERM) 23:17:24.180556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26381): Terminating (SIGTERM) 23:17:24.222886 --- ParallelTerminationStrategy: PID 26375 died... 23:17:24.243039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26375): Terminated: ok {rc=0} 23:17:24.289518 --- ParallelTerminationStrategy: PID 26378 died... 23:17:24.309396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26378): Terminated: ok {rc=0} 23:17:24.355925 --- ParallelTerminationStrategy: PID 26381 died... 23:17:24.375628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26381): Terminated: ok {rc=0} 23:17:24.463735 bus /sierra_9: Setting Powered False 23:17:25.563301 bus /sierra_9: Setting Powered False 23:17:26.679128 bus /sierra_8: Setting Powered False 23:17:27.778405 bus /sierra_8: Setting Powered False 23:17:28.893745 bus /sierra_3: Setting Powered False 23:17:29.992798 bus /sierra_3: Setting Powered False 23:17:31.106855 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:sysmo --------------------------------------------------------------------- 23:17:32.365168 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:17:32.369327 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 23:17:32.389928 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 23:17:32.428927 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 23:17:32.516837 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 23:17:32.539859 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 23:17:32.578020 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 23:17:33.162643 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 23:17:33.214905 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:33.225687 tst gprs:sysmo: Using 1 x bts (candidates: 1) 23:17:33.263989 tst cs_paging_gprs_active.py: using LAC 17435 23:17:33.386413 tst cs_paging_gprs_active.py: using RAC 95 23:17:33.510020 tst cs_paging_gprs_active.py: using CellId 17435 23:17:33.632715 tst cs_paging_gprs_active.py: using BVCI 17436 23:17:33.746693 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:33.757253 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:33.767629 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:33.778381 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:33.788926 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:33.799592 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:33.810382 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:33.821017 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:33.831700 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:17:33.951627 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:17:34.069104 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:17:34.282399 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:34.600429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26389): Launched 23:17:34.879180 run iperf3-srv_10.42.42.10(pid=26390): Launched 23:17:34.999666 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:17:35.211520 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:35.528257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26391): Launched 23:17:35.811864 run iperf3-srv_10.42.42.10(pid=26392): Launched 23:17:35.937356 tst cs_paging_gprs_active.py:38: start network... 23:17:36.164602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:17:36.687555 run create_hlr_db(pid=26393): Launched 23:17:36.823784 bus /sierra_2: Setting Powered False 23:17:37.889291 run create_hlr_db(pid=26393): Terminated: ok {rc=0} 23:17:38.355195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26395): Launched 23:17:38.692055 run osmo-hlr_10.42.42.2(pid=26396): Launched 23:17:38.819713 run osmo-stp_10.42.42.5: Starting osmo-stp 23:17:39.397565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26398): Launched 23:17:39.734082 run osmo-stp_10.42.42.5(pid=26399): Launched 23:17:39.861197 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:17:41.441320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26401): Launched 23:17:41.569617 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:17:41.855357 run patchelf(pid=26402): Launched 23:17:42.043670 run osmo-stp_10.42.42.5(pid=26399): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26399)] 23:17:42.185141 run osmo-stp_10.42.42.5(pid=26399): stdout: | (launched: 2022-12-08_23:17:39.670796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:42.328216 run osmo-stp_10.42.42.5(pid=26399): stderr: | [0;m[38;5;43m20221208231739869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231739869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231739869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231739869 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231739870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231739870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231739870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:42.470484 run osmo-stp_10.42.42.5(pid=26399): stdout: | (launched: 2022-12-08_23:17:39.670796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:42.607670 run osmo-stp_10.42.42.5(pid=26399): stderr: | [0;m[38;5;43m20221208231739869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231739869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231739869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231739869 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231739870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231739870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231739870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:42.770753 run patchelf(pid=26402): Terminating (SIGINT) 23:17:42.958307 run patchelf(pid=26402): Terminated: ok {rc=0} 23:17:43.093522 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26399): Process ended prematurely: osmo-stp_10.42.42.5(pid=26399) [trial-2351↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26399)] [trial-2351↪gprs:sysmo↪cs_paging_gprs_active.py:38] 23:17:43.103685 tst cs_paging_gprs_active.py:38: Test FAILED (9.9 sec) 23:17:43.132397 run osmo-hlr_10.42.42.2(pid=26396): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26396)] 23:17:43.182408 run osmo-hlr_10.42.42.2(pid=26396): stdout: | (launched: 2022-12-08_23:17:38.629157) 23:17:43.234167 run osmo-hlr_10.42.42.2(pid=26396): stderr: | [0;m[1;31m20221208231738832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231738832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231738832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231738832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231738832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231738832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231738846 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231738854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231738855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231738855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:17:43.286183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26389): Terminating (SIGTERM) 23:17:43.328074 run iperf3-srv_10.42.42.10(pid=26390): Terminating (SIGTERM) 23:17:43.369839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26391): Terminating (SIGTERM) 23:17:43.411667 run iperf3-srv_10.42.42.10(pid=26392): Terminating (SIGTERM) 23:17:43.453184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26395): Terminating (SIGTERM) 23:17:43.495040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26398): Terminating (SIGTERM) 23:17:43.536776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26401): Terminating (SIGTERM) 23:17:43.579303 --- ParallelTerminationStrategy: PID 26389 died... 23:17:43.599274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26389): Terminated: ok {rc=0} 23:17:43.645556 --- ParallelTerminationStrategy: PID 26390 died... 23:17:43.664857 run iperf3-srv_10.42.42.10(pid=26390): Terminated {rc=256} 23:17:43.711470 --- ParallelTerminationStrategy: PID 26391 died... 23:17:43.731078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26391): Terminated: ok {rc=0} 23:17:43.777393 --- ParallelTerminationStrategy: PID 26392 died... 23:17:43.796848 run iperf3-srv_10.42.42.10(pid=26392): Terminated {rc=256} 23:17:43.843026 --- ParallelTerminationStrategy: PID 26395 died... 23:17:43.867003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26395): Terminated: ok {rc=0} 23:17:43.913779 --- ParallelTerminationStrategy: PID 26398 died... 23:17:43.933476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26398): Terminated: ok {rc=0} 23:17:43.980089 --- ParallelTerminationStrategy: PID 26401 died... 23:17:43.999934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26401): Terminated: ok {rc=0} 23:17:44.089154 bus /gobi_0: Setting Powered False 23:17:45.189119 bus /gobi_0: Setting Powered False 23:17:46.306277 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:sysmo iperf3.py ---------------------------------------------- 23:17:47.461243 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:47.472870 tst gprs:sysmo: Using 1 x bts (candidates: 1) 23:17:47.509656 tst iperf3.py: using LAC 17436 23:17:47.644459 tst iperf3.py: using RAC 96 23:17:47.776058 tst iperf3.py: using CellId 17436 23:17:47.899472 tst iperf3.py: using BVCI 17437 23:17:48.022407 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:48.033616 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:48.044473 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:48.055368 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:48.066489 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:48.077602 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:48.088452 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:48.099883 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:48.111014 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:17:48.229780 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:17:48.442216 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:48.760172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26403): Launched 23:17:49.036542 run iperf3-srv_10.42.42.10(pid=26404): Launched 23:17:49.154420 tst iperf3.py:8: start network... 23:17:49.365061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:17:49.854103 run create_hlr_db(pid=26405): Launched 23:17:49.975264 bus /gobi_6: Setting Powered False 23:17:51.040451 run create_hlr_db(pid=26405): Terminated: ok {rc=0} 23:17:51.489039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26407): Launched 23:17:51.805978 run osmo-hlr_10.42.42.2(pid=26408): Launched 23:17:51.926450 run osmo-stp_10.42.42.5: Starting osmo-stp 23:17:52.488282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26410): Launched 23:17:52.804725 run osmo-stp_10.42.42.5(pid=26411): Launched 23:17:52.924510 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:17:53.466445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26413): Launched 23:17:53.586862 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:17:53.853693 run patchelf(pid=26414): Launched 23:17:54.027903 run osmo-stp_10.42.42.5(pid=26411): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26411)] 23:17:54.160385 run osmo-stp_10.42.42.5(pid=26411): stdout: | (launched: 2022-12-08_23:17:52.744582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:54.295173 run osmo-stp_10.42.42.5(pid=26411): stderr: | [0;m[38;5;43m20221208231752917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231752918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231752918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231752918 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231752919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231752919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231752919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:54.429490 run osmo-stp_10.42.42.5(pid=26411): stdout: | (launched: 2022-12-08_23:17:52.744582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:54.557453 run osmo-stp_10.42.42.5(pid=26411): stderr: | [0;m[38;5;43m20221208231752917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231752918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231752918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231752918 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231752919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231752919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231752919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:54.708756 run patchelf(pid=26414): Terminating (SIGINT) 23:17:54.883956 run patchelf(pid=26414): Terminated: ok {rc=0} 23:17:55.010082 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26411): Process ended prematurely: osmo-stp_10.42.42.5(pid=26411) [trial-2351↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26411)] [trial-2351↪gprs:sysmo↪iperf3.py:8] 23:17:55.019839 tst iperf3.py:8: Test FAILED (7.6 sec) 23:17:55.047521 run osmo-hlr_10.42.42.2(pid=26408): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26408)] 23:17:55.095417 run osmo-hlr_10.42.42.2(pid=26408): stdout: | (launched: 2022-12-08_23:17:51.746162) 23:17:55.145210 run osmo-hlr_10.42.42.2(pid=26408): stderr: | [0;m[1;31m20221208231751924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231751924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231751924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231751924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231751924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231751925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231751936 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231751945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231751945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231751945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:17:55.195354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26403): Terminating (SIGTERM) 23:17:55.235373 run iperf3-srv_10.42.42.10(pid=26404): Terminating (SIGTERM) 23:17:55.275253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26407): Terminating (SIGTERM) 23:17:55.315237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26410): Terminating (SIGTERM) 23:17:55.355092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26413): Terminating (SIGTERM) 23:17:55.395212 --- ParallelTerminationStrategy: PID 26403 died... 23:17:55.414246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26403): Terminated: ok {rc=0} 23:17:55.458892 --- ParallelTerminationStrategy: PID 26404 died... 23:17:55.477625 run iperf3-srv_10.42.42.10(pid=26404): Terminated {rc=256} 23:17:55.521932 --- ParallelTerminationStrategy: PID 26407 died... 23:17:55.540559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26407): Terminated: ok {rc=0} 23:17:55.585178 --- ParallelTerminationStrategy: PID 26410 died... 23:17:55.603581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26410): Terminated: ok {rc=0} 23:17:55.648642 --- ParallelTerminationStrategy: PID 26413 died... 23:17:55.667462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26413): Terminated: ok {rc=0} 23:17:55.752343 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:sysmo iperf3m4.py ---------------------------------------------- 23:17:56.903944 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:56.915734 tst gprs:sysmo: Using 1 x bts (candidates: 1) 23:17:56.953649 tst iperf3m4.py: using LAC 17437 23:17:57.088185 tst iperf3m4.py: using RAC 97 23:17:57.211884 tst iperf3m4.py: using CellId 17437 23:17:57.336622 tst iperf3m4.py: using BVCI 17438 23:17:57.451525 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:57.462374 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:57.473137 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:57.484542 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:57.495965 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:57.507197 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:57.518839 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:57.530307 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:57.541919 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:17:57.661294 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:17:57.785599 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:17:57.905420 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:17:58.026618 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:17:58.254499 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:58.594218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26415): Launched 23:17:58.890160 run iperf3-srv_10.42.42.10(pid=26416): Launched 23:17:59.018522 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:17:59.246515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:59.585176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26417): Launched 23:17:59.878987 run iperf3-srv_10.42.42.10(pid=26418): Launched 23:18:00.004917 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:18:00.231623 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:00.570454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26419): Launched 23:18:00.877635 run iperf3-srv_10.42.42.10(pid=26420): Launched 23:18:01.024184 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:18:01.256150 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:01.602611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26421): Launched 23:18:01.931202 run iperf3-srv_10.42.42.10(pid=26422): Launched 23:18:02.071994 tst iperf3m4.py:8: start network... 23:18:02.301463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:18:02.823978 run create_hlr_db(pid=26423): Launched 23:18:02.958840 bus /gobi_6: Setting Powered False 23:18:04.024620 run create_hlr_db(pid=26423): Terminated: ok {rc=0} 23:18:04.472608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26425): Launched 23:18:04.790934 run osmo-hlr_10.42.42.2(pid=26426): Launched 23:18:04.910461 run osmo-stp_10.42.42.5: Starting osmo-stp 23:18:05.469901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26428): Launched 23:18:05.785369 run osmo-stp_10.42.42.5(pid=26429): Launched 23:18:05.905165 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:18:06.446192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26431): Launched 23:18:06.568597 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:18:06.835785 run patchelf(pid=26432): Launched 23:18:07.010752 run osmo-stp_10.42.42.5(pid=26429): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26429)] 23:18:07.144159 run osmo-stp_10.42.42.5(pid=26429): stdout: | (launched: 2022-12-08_23:18:05.726161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:07.278788 run osmo-stp_10.42.42.5(pid=26429): stderr: | [0;m[38;5;43m20221208231805897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231805898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231805898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231805898 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231805900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231805901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231805901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:07.414040 run osmo-stp_10.42.42.5(pid=26429): stdout: | (launched: 2022-12-08_23:18:05.726161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:07.542428 run osmo-stp_10.42.42.5(pid=26429): stderr: | [0;m[38;5;43m20221208231805897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231805898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231805898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231805898 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231805900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231805901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231805901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:07.694400 run patchelf(pid=26432): Terminating (SIGINT) 23:18:07.869849 run patchelf(pid=26432): Terminated: ok {rc=0} 23:18:07.996072 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26429): Process ended prematurely: osmo-stp_10.42.42.5(pid=26429) [trial-2351↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26429)] [trial-2351↪gprs:sysmo↪iperf3m4.py:8] 23:18:08.005743 tst iperf3m4.py:8: Test FAILED (11.1 sec) 23:18:08.033748 run osmo-hlr_10.42.42.2(pid=26426): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26426)] 23:18:08.082318 run osmo-hlr_10.42.42.2(pid=26426): stdout: | (launched: 2022-12-08_23:18:04.730477) 23:18:08.132503 run osmo-hlr_10.42.42.2(pid=26426): stderr: | [0;m[1;31m20221208231804909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231804909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231804909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231804909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231804910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231804910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231804922 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231804930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231804930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231804930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:18:08.183093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26415): Terminating (SIGTERM) 23:18:08.223431 run iperf3-srv_10.42.42.10(pid=26416): Terminating (SIGTERM) 23:18:08.263509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26417): Terminating (SIGTERM) 23:18:08.303770 run iperf3-srv_10.42.42.10(pid=26418): Terminating (SIGTERM) 23:18:08.343797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26419): Terminating (SIGTERM) 23:18:08.383954 run iperf3-srv_10.42.42.10(pid=26420): Terminating (SIGTERM) 23:18:08.424288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26421): Terminating (SIGTERM) 23:18:08.464455 run iperf3-srv_10.42.42.10(pid=26422): Terminating (SIGTERM) 23:18:08.504455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26425): Terminating (SIGTERM) 23:18:08.544851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26428): Terminating (SIGTERM) 23:18:08.584917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26431): Terminating (SIGTERM) 23:18:08.625371 --- ParallelTerminationStrategy: PID 26415 died... 23:18:08.644482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26415): Terminated: ok {rc=0} 23:18:08.689270 --- ParallelTerminationStrategy: PID 26416 died... 23:18:08.707683 run iperf3-srv_10.42.42.10(pid=26416): Terminated {rc=256} 23:18:08.752284 --- ParallelTerminationStrategy: PID 26417 died... 23:18:08.770953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26417): Terminated: ok {rc=0} 23:18:08.815628 --- ParallelTerminationStrategy: PID 26418 died... 23:18:08.834230 run iperf3-srv_10.42.42.10(pid=26418): Terminated {rc=256} 23:18:08.878681 --- ParallelTerminationStrategy: PID 26419 died... 23:18:08.897355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26419): Terminated: ok {rc=0} 23:18:08.941864 --- ParallelTerminationStrategy: PID 26420 died... 23:18:08.960376 run iperf3-srv_10.42.42.10(pid=26420): Terminated {rc=256} 23:18:09.004587 --- ParallelTerminationStrategy: PID 26421 died... 23:18:09.023284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26421): Terminated: ok {rc=0} 23:18:09.067633 --- ParallelTerminationStrategy: PID 26422 died... 23:18:09.086285 run iperf3-srv_10.42.42.10(pid=26422): Terminated {rc=256} 23:18:09.130819 --- ParallelTerminationStrategy: PID 26425 died... 23:18:09.149623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26425): Terminated: ok {rc=0} 23:18:09.194204 --- ParallelTerminationStrategy: PID 26428 died... 23:18:09.212840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26428): Terminated: ok {rc=0} 23:18:09.257823 --- ParallelTerminationStrategy: PID 26431 died... 23:18:09.276480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26431): Terminated: ok {rc=0} 23:18:09.363514 bus /gobi_4: Setting Powered False 23:18:10.464126 bus /gobi_4: Setting Powered False 23:18:11.580270 bus /gobi_1: Setting Powered False 23:18:12.680534 bus /gobi_1: Setting Powered False 23:18:13.797382 bus /gobi_0: Setting Powered False 23:18:14.895633 bus /gobi_0: Setting Powered False 23:18:16.014253 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:sysmo ping.py ---------------------------------------------- 23:18:17.121541 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:17.134456 tst gprs:sysmo: Using 1 x bts (candidates: 1) 23:18:17.171024 tst ping.py: using LAC 17438 23:18:17.311358 tst ping.py: using RAC 98 23:18:17.453434 tst ping.py: using CellId 17438 23:18:17.578582 tst ping.py: using BVCI 17439 23:18:17.691631 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:17.702519 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:17.713416 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:17.724869 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:17.736557 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:17.747925 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:17.759473 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:17.771092 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:18:17.893581 tst ping.py:19: start network... 23:18:18.117094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:18:18.628786 run create_hlr_db(pid=26433): Launched 23:18:18.763074 bus /gobi_6: Setting Powered False 23:18:19.827335 run create_hlr_db(pid=26433): Terminated: ok {rc=0} 23:18:20.271463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26435): Launched 23:18:20.583406 run osmo-hlr_10.42.42.2(pid=26436): Launched 23:18:20.701985 run osmo-stp_10.42.42.5: Starting osmo-stp 23:18:21.235397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26438): Launched 23:18:21.543679 run osmo-stp_10.42.42.5(pid=26439): Launched 23:18:21.661199 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:18:22.191828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26441): Launched 23:18:22.310844 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:18:22.572400 run patchelf(pid=26442): Launched 23:18:22.744265 run osmo-stp_10.42.42.5(pid=26439): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26439)] 23:18:22.874729 run osmo-stp_10.42.42.5(pid=26439): stdout: | (launched: 2022-12-08_23:18:21.485732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:23.006527 run osmo-stp_10.42.42.5(pid=26439): stderr: | [0;m[38;5;43m20221208231821658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231821658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231821659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231821659 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231821660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231821660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231821660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:23.138947 run osmo-stp_10.42.42.5(pid=26439): stdout: | (launched: 2022-12-08_23:18:21.485732) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:23.265535 run osmo-stp_10.42.42.5(pid=26439): stderr: | [0;m[38;5;43m20221208231821658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231821658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231821659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231821659 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231821660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231821660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231821660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:23.414890 run patchelf(pid=26442): Terminating (SIGINT) 23:18:23.586970 run patchelf(pid=26442): Terminated: ok {rc=0} 23:18:23.711067 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26439): Process ended prematurely: osmo-stp_10.42.42.5(pid=26439) [trial-2351↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26439)] [trial-2351↪gprs:sysmo↪ping.py:22] 23:18:23.719867 tst ping.py:22: Test FAILED (6.6 sec) 23:18:23.747668 run osmo-hlr_10.42.42.2(pid=26436): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26436)] 23:18:23.796024 run osmo-hlr_10.42.42.2(pid=26436): stdout: | (launched: 2022-12-08_23:18:20.524750) 23:18:23.845475 run osmo-hlr_10.42.42.2(pid=26436): stderr: | [0;m[1;31m20221208231820705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231820705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231820705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231820705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231820705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231820705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231820717 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231820726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231820726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231820726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:18:23.895257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26435): Terminating (SIGTERM) 23:18:23.935180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26438): Terminating (SIGTERM) 23:18:23.975237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26441): Terminating (SIGTERM) 23:18:24.015401 --- ParallelTerminationStrategy: PID 26435 died... 23:18:24.034480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26435): Terminated: ok {rc=0} 23:18:24.079545 --- ParallelTerminationStrategy: PID 26438 died... 23:18:24.098515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26438): Terminated: ok {rc=0} 23:18:24.143211 --- ParallelTerminationStrategy: PID 26441 died... 23:18:24.162061 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26441): Terminated: ok {rc=0} 23:18:24.246530 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 23:18:25.333762 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:25.345835 tst gprs:sysmo: Using 1 x bts (candidates: 1) 23:18:25.388863 tst ping_idle_ping.py: using LAC 17439 23:18:25.518375 tst ping_idle_ping.py: using RAC 99 23:18:25.646675 tst ping_idle_ping.py: using CellId 17439 23:18:25.775279 tst ping_idle_ping.py: using BVCI 17440 23:18:25.889799 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:25.900546 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:25.911276 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:25.922287 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:25.933134 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:25.943872 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:25.955330 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:25.966331 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:18:26.095927 tst ping_idle_ping.py:24: start network... 23:18:26.320649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:18:26.833454 run create_hlr_db(pid=26443): Launched 23:18:26.966782 bus /gobi_6: Setting Powered False 23:18:28.032341 run create_hlr_db(pid=26443): Terminated: ok {rc=0} 23:18:28.475789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26445): Launched 23:18:28.789163 run osmo-hlr_10.42.42.2(pid=26446): Launched 23:18:28.907364 run osmo-stp_10.42.42.5: Starting osmo-stp 23:18:29.445551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26448): Launched 23:18:29.755799 run osmo-stp_10.42.42.5(pid=26449): Launched 23:18:29.874091 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:18:30.409615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26451): Launched 23:18:30.528860 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:18:30.792510 run patchelf(pid=26452): Launched 23:18:30.991776 run osmo-stp_10.42.42.5(pid=26449): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26449)] 23:18:31.127078 run osmo-stp_10.42.42.5(pid=26449): stdout: | (launched: 2022-12-08_23:18:29.697208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:31.263631 run osmo-stp_10.42.42.5(pid=26449): stderr: | [0;m[38;5;43m20221208231829869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231829870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231829870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231829870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231829871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231829871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231829871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:31.424790 run osmo-stp_10.42.42.5(pid=26449): stdout: | (launched: 2022-12-08_23:18:29.697208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:31.571468 run osmo-stp_10.42.42.5(pid=26449): stderr: | [0;m[38;5;43m20221208231829869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231829870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231829870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231829870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231829871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231829871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231829871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:31.737882 run patchelf(pid=26452): Terminating (SIGINT) 23:18:31.927811 run patchelf(pid=26452): Terminated: ok {rc=0} 23:18:32.065135 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26449): Process ended prematurely: osmo-stp_10.42.42.5(pid=26449) [trial-2351↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26449)] [trial-2351↪gprs:sysmo↪ping_idle_ping.py:27] 23:18:32.075703 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 23:18:32.106673 run osmo-hlr_10.42.42.2(pid=26446): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26446)] 23:18:32.159224 run osmo-hlr_10.42.42.2(pid=26446): stdout: | (launched: 2022-12-08_23:18:28.730245) 23:18:32.214599 run osmo-hlr_10.42.42.2(pid=26446): stderr: | [0;m[1;31m20221208231828910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231828910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231828910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231828911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231828911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231828911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231828922 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231828930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231828930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231828931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:18:32.268075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26445): Terminating (SIGTERM) 23:18:32.310334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26448): Terminating (SIGTERM) 23:18:32.352752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26451): Terminating (SIGTERM) 23:18:32.395336 --- ParallelTerminationStrategy: PID 26445 died... 23:18:32.415482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26445): Terminated: ok {rc=0} 23:18:32.462836 --- ParallelTerminationStrategy: PID 26448 died... 23:18:32.482660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26448): Terminated: ok {rc=0} 23:18:32.529416 --- ParallelTerminationStrategy: PID 26451 died... 23:18:32.549532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26451): Terminated: ok {rc=0} 23:18:32.638370 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 23:18:33.925899 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:18:33.931693 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 23:18:33.953297 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 23:18:33.992939 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 23:18:34.083515 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 23:18:34.105272 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 23:18:34.144463 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 23:18:34.737916 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 23:18:34.791620 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:34.802827 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:18:34.841142 tst cs_paging_gprs_active.py: using LAC 17440 23:18:34.972475 tst cs_paging_gprs_active.py: using RAC 100 23:18:35.104199 tst cs_paging_gprs_active.py: using CellId 17440 23:18:35.237441 tst cs_paging_gprs_active.py: using BVCI 17441 23:18:35.354930 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:35.366180 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:35.376919 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:35.388230 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:35.399318 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:35.410413 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:35.421772 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:35.432775 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:35.444017 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:18:35.565235 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:18:35.686674 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:18:35.915409 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:36.254448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26456): Launched 23:18:36.549456 run iperf3-srv_10.42.42.10(pid=26457): Launched 23:18:36.675270 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:18:36.903726 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:37.242925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26458): Launched 23:18:37.538329 run iperf3-srv_10.42.42.10(pid=26459): Launched 23:18:37.664598 tst cs_paging_gprs_active.py:38: start network... 23:18:37.892769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:18:38.417495 run create_hlr_db(pid=26460): Launched 23:18:38.553975 bus /gobi_6: Setting Powered False 23:18:39.620045 run create_hlr_db(pid=26460): Terminated: ok {rc=0} 23:18:40.069064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26462): Launched 23:18:40.387987 run osmo-hlr_10.42.42.2(pid=26463): Launched 23:18:40.507922 run osmo-stp_10.42.42.5: Starting osmo-stp 23:18:41.064777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26465): Launched 23:18:41.381937 run osmo-stp_10.42.42.5(pid=26466): Launched 23:18:41.503300 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:18:42.049917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26468): Launched 23:18:42.170492 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:18:42.438355 run patchelf(pid=26469): Launched 23:18:42.613717 run osmo-stp_10.42.42.5(pid=26466): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26466)] 23:18:42.747269 run osmo-stp_10.42.42.5(pid=26466): stdout: | (launched: 2022-12-08_23:18:41.321987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:42.881682 run osmo-stp_10.42.42.5(pid=26466): stderr: | [0;m[38;5;43m20221208231841495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231841495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231841495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231841496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231841496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231841496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231841496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:43.015626 run osmo-stp_10.42.42.5(pid=26466): stdout: | (launched: 2022-12-08_23:18:41.321987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:43.144845 run osmo-stp_10.42.42.5(pid=26466): stderr: | [0;m[38;5;43m20221208231841495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231841495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231841495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231841496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231841496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231841496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231841496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:43.297578 run patchelf(pid=26469): Terminating (SIGINT) 23:18:43.474169 run patchelf(pid=26469): Terminated: ok {rc=0} 23:18:43.600843 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26466): Process ended prematurely: osmo-stp_10.42.42.5(pid=26466) [trial-2351↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26466)] [trial-2351↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 23:18:43.610499 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 23:18:43.638168 run osmo-hlr_10.42.42.2(pid=26463): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26463)] 23:18:43.686654 run osmo-hlr_10.42.42.2(pid=26463): stdout: | (launched: 2022-12-08_23:18:40.327936) 23:18:43.737219 run osmo-hlr_10.42.42.2(pid=26463): stderr: | [0;m[1;31m20221208231840506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231840506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231840506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231840506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231840506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231840506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231840518 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231840526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231840527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231840527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:18:43.788009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26456): Terminating (SIGTERM) 23:18:43.828432 run iperf3-srv_10.42.42.10(pid=26457): Terminating (SIGTERM) 23:18:43.868884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26458): Terminating (SIGTERM) 23:18:43.909428 run iperf3-srv_10.42.42.10(pid=26459): Terminating (SIGTERM) 23:18:43.949397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26462): Terminating (SIGTERM) 23:18:43.990251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26465): Terminating (SIGTERM) 23:18:44.030590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26468): Terminating (SIGTERM) 23:18:44.071177 --- ParallelTerminationStrategy: PID 26456 died... 23:18:44.090130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26456): Terminated: ok {rc=0} 23:18:44.134996 --- ParallelTerminationStrategy: PID 26457 died... 23:18:44.153643 run iperf3-srv_10.42.42.10(pid=26457): Terminated {rc=256} 23:18:44.197816 --- ParallelTerminationStrategy: PID 26458 died... 23:18:44.216486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26458): Terminated: ok {rc=0} 23:18:44.260582 --- ParallelTerminationStrategy: PID 26459 died... 23:18:44.279149 run iperf3-srv_10.42.42.10(pid=26459): Terminated {rc=256} 23:18:44.323196 --- ParallelTerminationStrategy: PID 26462 died... 23:18:44.341751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26462): Terminated: ok {rc=0} 23:18:44.385832 --- ParallelTerminationStrategy: PID 26465 died... 23:18:44.404310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26465): Terminated: ok {rc=0} 23:18:44.448816 --- ParallelTerminationStrategy: PID 26468 died... 23:18:44.467487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26468): Terminated: ok {rc=0} 23:18:44.551407 bus /gobi_0: Setting Powered False 23:18:45.650105 bus /gobi_0: Setting Powered False 23:18:46.776384 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 23:18:47.931835 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:47.943425 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:18:47.981797 tst iperf3.py: using LAC 17441 23:18:48.115349 tst iperf3.py: using RAC 101 23:18:48.249051 tst iperf3.py: using CellId 17441 23:18:48.383928 tst iperf3.py: using BVCI 17442 23:18:48.507557 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:48.519063 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:48.530493 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:48.542372 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:48.554034 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:48.565608 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:48.577431 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:48.588905 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:48.600621 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:18:48.724489 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:18:48.952515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:49.290928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26470): Launched 23:18:49.585712 run iperf3-srv_10.42.42.10(pid=26471): Launched 23:18:49.711445 tst iperf3.py:8: start network... 23:18:49.938766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:18:50.460392 run create_hlr_db(pid=26472): Launched 23:18:50.595760 bus /gobi_6: Setting Powered False 23:18:51.661376 run create_hlr_db(pid=26472): Terminated: ok {rc=0} 23:18:52.110631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26474): Launched 23:18:52.427343 run osmo-hlr_10.42.42.2(pid=26475): Launched 23:18:52.548190 run osmo-stp_10.42.42.5: Starting osmo-stp 23:18:53.094642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26477): Launched 23:18:53.410911 run osmo-stp_10.42.42.5(pid=26478): Launched 23:18:53.533110 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:18:54.077094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26480): Launched 23:18:54.197480 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:18:54.465579 run patchelf(pid=26481): Launched 23:18:54.639466 run osmo-stp_10.42.42.5(pid=26478): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26478)] 23:18:54.772079 run osmo-stp_10.42.42.5(pid=26478): stdout: | (launched: 2022-12-08_23:18:53.351087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:54.906887 run osmo-stp_10.42.42.5(pid=26478): stderr: | [0;m[38;5;43m20221208231853525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231853525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231853526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231853526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231853526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231853527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231853527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:55.041544 run osmo-stp_10.42.42.5(pid=26478): stdout: | (launched: 2022-12-08_23:18:53.351087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:55.169703 run osmo-stp_10.42.42.5(pid=26478): stderr: | [0;m[38;5;43m20221208231853525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231853525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231853526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231853526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231853526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231853527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231853527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:55.321455 run patchelf(pid=26481): Terminating (SIGINT) 23:18:55.496596 run patchelf(pid=26481): Terminated: ok {rc=0} 23:18:55.624724 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26478): Process ended prematurely: osmo-stp_10.42.42.5(pid=26478) [trial-2351↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26478)] [trial-2351↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 23:18:55.634262 tst iperf3.py:8: Test FAILED (7.7 sec) 23:18:55.661900 run osmo-hlr_10.42.42.2(pid=26475): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26475)] 23:18:55.710211 run osmo-hlr_10.42.42.2(pid=26475): stdout: | (launched: 2022-12-08_23:18:52.367476) 23:18:55.759915 run osmo-hlr_10.42.42.2(pid=26475): stderr: | [0;m[1;31m20221208231852548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231852548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231852548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231852548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231852548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231852548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231852560 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231852568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231852569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231852569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:18:55.810056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26470): Terminating (SIGTERM) 23:18:55.850422 run iperf3-srv_10.42.42.10(pid=26471): Terminating (SIGTERM) 23:18:55.890497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26474): Terminating (SIGTERM) 23:18:55.930595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26477): Terminating (SIGTERM) 23:18:55.970598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26480): Terminating (SIGTERM) 23:18:56.010935 --- ParallelTerminationStrategy: PID 26470 died... 23:18:56.030050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26470): Terminated: ok {rc=0} 23:18:56.074439 --- ParallelTerminationStrategy: PID 26471 died... 23:18:56.092850 run iperf3-srv_10.42.42.10(pid=26471): Terminated {rc=256} 23:18:56.137293 --- ParallelTerminationStrategy: PID 26474 died... 23:18:56.155709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26474): Terminated: ok {rc=0} 23:18:56.200064 --- ParallelTerminationStrategy: PID 26477 died... 23:18:56.218775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26477): Terminated: ok {rc=0} 23:18:56.263158 --- ParallelTerminationStrategy: PID 26480 died... 23:18:56.281815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26480): Terminated: ok {rc=0} 23:18:56.368064 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 23:18:57.517518 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:57.529085 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:18:57.565690 tst iperf3m4.py: using LAC 17442 23:18:57.690945 tst iperf3m4.py: using RAC 102 23:18:57.814255 tst iperf3m4.py: using CellId 17442 23:18:57.936370 tst iperf3m4.py: using BVCI 17443 23:18:58.051811 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:58.062644 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:58.073474 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:58.084362 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:58.095155 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:58.105933 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:58.116888 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:58.127649 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:58.138642 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:18:58.256819 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:18:58.378262 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:18:58.496779 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:18:58.618439 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:18:58.830281 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:59.149180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26482): Launched 23:18:59.424118 run iperf3-srv_10.42.42.10(pid=26483): Launched 23:18:59.542125 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:18:59.753588 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:00.069632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26484): Launched 23:19:00.343591 run iperf3-srv_10.42.42.10(pid=26485): Launched 23:19:00.461288 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:19:00.671455 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:01.013863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26486): Launched 23:19:01.307451 run iperf3-srv_10.42.42.10(pid=26487): Launched 23:19:01.442115 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:19:01.657900 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:01.983496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26488): Launched 23:19:02.291207 run iperf3-srv_10.42.42.10(pid=26489): Launched 23:19:02.417637 tst iperf3m4.py:8: start network... 23:19:02.644779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:19:03.168696 run create_hlr_db(pid=26490): Launched 23:19:03.304257 bus /gobi_6: Setting Powered False 23:19:04.369384 run create_hlr_db(pid=26490): Terminated: ok {rc=0} 23:19:04.816777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26492): Launched 23:19:05.132634 run osmo-hlr_10.42.42.2(pid=26493): Launched 23:19:05.251903 run osmo-stp_10.42.42.5: Starting osmo-stp 23:19:05.808457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26495): Launched 23:19:06.124622 run osmo-stp_10.42.42.5(pid=26496): Launched 23:19:06.244302 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:19:06.784139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26498): Launched 23:19:06.904655 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:19:07.170660 run patchelf(pid=26499): Launched 23:19:07.343994 run osmo-stp_10.42.42.5(pid=26496): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26496)] 23:19:07.476028 run osmo-stp_10.42.42.5(pid=26496): stdout: | (launched: 2022-12-08_23:19:06.065092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:07.610899 run osmo-stp_10.42.42.5(pid=26496): stderr: | [0;m[38;5;43m20221208231906238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231906238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231906238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231906239 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231906241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231906241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231906241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:07.745716 run osmo-stp_10.42.42.5(pid=26496): stdout: | (launched: 2022-12-08_23:19:06.065092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:07.873448 run osmo-stp_10.42.42.5(pid=26496): stderr: | [0;m[38;5;43m20221208231906238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231906238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231906238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231906239 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231906241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231906241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231906241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:08.024926 run patchelf(pid=26499): Terminating (SIGINT) 23:19:08.199867 run patchelf(pid=26499): Terminated: ok {rc=0} 23:19:08.325795 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26496): Process ended prematurely: osmo-stp_10.42.42.5(pid=26496) [trial-2351↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26496)] [trial-2351↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 23:19:08.335429 tst iperf3m4.py:8: Test FAILED (10.9 sec) 23:19:08.363481 run osmo-hlr_10.42.42.2(pid=26493): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26493)] 23:19:08.410855 run osmo-hlr_10.42.42.2(pid=26493): stdout: | (launched: 2022-12-08_23:19:05.073245) 23:19:08.460142 run osmo-hlr_10.42.42.2(pid=26493): stderr: | [0;m[1;31m20221208231905252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231905252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231905253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231905253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231905253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231905253 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231905265 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231905273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231905273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231905273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:19:08.510315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26482): Terminating (SIGTERM) 23:19:08.549580 run iperf3-srv_10.42.42.10(pid=26483): Terminating (SIGTERM) 23:19:08.588858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26484): Terminating (SIGTERM) 23:19:08.628257 run iperf3-srv_10.42.42.10(pid=26485): Terminating (SIGTERM) 23:19:08.667365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26486): Terminating (SIGTERM) 23:19:08.706680 run iperf3-srv_10.42.42.10(pid=26487): Terminating (SIGTERM) 23:19:08.746225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26488): Terminating (SIGTERM) 23:19:08.785698 run iperf3-srv_10.42.42.10(pid=26489): Terminating (SIGTERM) 23:19:08.825233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26492): Terminating (SIGTERM) 23:19:08.864921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26495): Terminating (SIGTERM) 23:19:08.904131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26498): Terminating (SIGTERM) 23:19:08.944403 --- ParallelTerminationStrategy: PID 26482 died... 23:19:08.963873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26482): Terminated: ok {rc=0} 23:19:09.008350 --- ParallelTerminationStrategy: PID 26483 died... 23:19:09.026897 run iperf3-srv_10.42.42.10(pid=26483): Terminated {rc=256} 23:19:09.070793 --- ParallelTerminationStrategy: PID 26484 died... 23:19:09.089198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26484): Terminated: ok {rc=0} 23:19:09.133402 --- ParallelTerminationStrategy: PID 26485 died... 23:19:09.151872 run iperf3-srv_10.42.42.10(pid=26485): Terminated {rc=256} 23:19:09.195504 --- ParallelTerminationStrategy: PID 26486 died... 23:19:09.213815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26486): Terminated: ok {rc=0} 23:19:09.258183 --- ParallelTerminationStrategy: PID 26487 died... 23:19:09.276686 run iperf3-srv_10.42.42.10(pid=26487): Terminated {rc=256} 23:19:09.320706 --- ParallelTerminationStrategy: PID 26488 died... 23:19:09.339185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26488): Terminated: ok {rc=0} 23:19:09.383590 --- ParallelTerminationStrategy: PID 26489 died... 23:19:09.402620 run iperf3-srv_10.42.42.10(pid=26489): Terminated {rc=256} 23:19:09.446557 --- ParallelTerminationStrategy: PID 26492 died... 23:19:09.465018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26492): Terminated: ok {rc=0} 23:19:09.509299 --- ParallelTerminationStrategy: PID 26495 died... 23:19:09.527868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26495): Terminated: ok {rc=0} 23:19:09.571949 --- ParallelTerminationStrategy: PID 26498 died... 23:19:09.590696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26498): Terminated: ok {rc=0} 23:19:09.678038 bus /gobi_4: Setting Powered False 23:19:10.777208 bus /gobi_4: Setting Powered False 23:19:11.893611 bus /gobi_1: Setting Powered False 23:19:12.997710 bus /gobi_1: Setting Powered False 23:19:14.112447 bus /gobi_0: Setting Powered False 23:19:15.210268 bus /gobi_0: Setting Powered False 23:19:16.328837 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 23:19:17.432775 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:17.444400 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:19:17.482970 tst ping.py: using LAC 17443 23:19:17.605186 tst ping.py: using RAC 103 23:19:17.727601 tst ping.py: using CellId 17443 23:19:17.849395 tst ping.py: using BVCI 17444 23:19:17.963192 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:17.974208 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:17.985154 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:17.996151 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:18.006974 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:18.017749 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:18.028736 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:18.039718 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:19:18.162971 tst ping.py:19: start network... 23:19:18.387169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:19:18.900509 run create_hlr_db(pid=26501): Launched 23:19:19.034484 bus /gobi_6: Setting Powered False 23:19:20.095584 run create_hlr_db(pid=26501): Terminated: ok {rc=0} 23:19:20.538984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26503): Launched 23:19:20.848892 run osmo-hlr_10.42.42.2(pid=26504): Launched 23:19:20.965851 run osmo-stp_10.42.42.5: Starting osmo-stp 23:19:21.514745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26506): Launched 23:19:21.824931 run osmo-stp_10.42.42.5(pid=26507): Launched 23:19:21.942855 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:19:22.475089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26509): Launched 23:19:22.593618 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:19:22.855779 run patchelf(pid=26510): Launched 23:19:23.027122 run osmo-stp_10.42.42.5(pid=26507): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26507)] 23:19:23.157180 run osmo-stp_10.42.42.5(pid=26507): stdout: | (launched: 2022-12-08_23:19:21.766341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:23.289069 run osmo-stp_10.42.42.5(pid=26507): stderr: | [0;m[38;5;43m20221208231921939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231921939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231921939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231921939 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231921940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231921940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231921940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:23.421149 run osmo-stp_10.42.42.5(pid=26507): stdout: | (launched: 2022-12-08_23:19:21.766341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:23.547246 run osmo-stp_10.42.42.5(pid=26507): stderr: | [0;m[38;5;43m20221208231921939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231921939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231921939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231921939 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231921940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231921940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231921940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:23.696294 run patchelf(pid=26510): Terminating (SIGINT) 23:19:23.868378 run patchelf(pid=26510): Terminated: ok {rc=0} 23:19:23.992174 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26507): Process ended prematurely: osmo-stp_10.42.42.5(pid=26507) [trial-2351↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26507)] [trial-2351↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 23:19:24.001199 tst ping.py:22: Test FAILED (6.6 sec) 23:19:24.028746 run osmo-hlr_10.42.42.2(pid=26504): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26504)] 23:19:24.076744 run osmo-hlr_10.42.42.2(pid=26504): stdout: | (launched: 2022-12-08_23:19:20.790458) 23:19:24.126557 run osmo-hlr_10.42.42.2(pid=26504): stderr: | [0;m[1;31m20221208231920967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231920967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231920967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231920967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231920967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231920967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231920979 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231920987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231920988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231920988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:19:24.176588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26503): Terminating (SIGTERM) 23:19:24.216879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26506): Terminating (SIGTERM) 23:19:24.257222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26509): Terminating (SIGTERM) 23:19:24.298242 --- ParallelTerminationStrategy: PID 26503 died... 23:19:24.317570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26503): Terminated: ok {rc=0} 23:19:24.363154 --- ParallelTerminationStrategy: PID 26506 died... 23:19:24.382169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26506): Terminated: ok {rc=0} 23:19:24.426947 --- ParallelTerminationStrategy: PID 26509 died... 23:19:24.446023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26509): Terminated: ok {rc=0} 23:19:24.532770 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 23:19:25.622385 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:25.634647 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:19:25.673213 tst ping_idle_ping.py: using LAC 17444 23:19:25.795010 tst ping_idle_ping.py: using RAC 104 23:19:25.915188 tst ping_idle_ping.py: using CellId 17444 23:19:26.037609 tst ping_idle_ping.py: using BVCI 17445 23:19:26.149301 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:26.160079 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:26.170896 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:26.182011 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:26.192930 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:26.203857 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:26.214975 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:26.225968 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:19:26.353913 tst ping_idle_ping.py:24: start network... 23:19:26.560923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:19:27.040281 run create_hlr_db(pid=26511): Launched 23:19:27.157620 bus /gobi_6: Setting Powered False 23:19:28.218862 run create_hlr_db(pid=26511): Terminated: ok {rc=0} 23:19:28.672431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26513): Launched 23:19:29.006398 run osmo-hlr_10.42.42.2(pid=26514): Launched 23:19:29.132578 run osmo-stp_10.42.42.5: Starting osmo-stp 23:19:29.704670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26516): Launched 23:19:30.038109 run osmo-stp_10.42.42.5(pid=26517): Launched 23:19:30.164686 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:19:30.739270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26519): Launched 23:19:30.878064 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:19:31.168203 run patchelf(pid=26520): Launched 23:19:31.368816 run osmo-stp_10.42.42.5(pid=26517): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26517)] 23:19:31.511651 run osmo-stp_10.42.42.5(pid=26517): stdout: | (launched: 2022-12-08_23:19:29.975752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:31.656214 run osmo-stp_10.42.42.5(pid=26517): stderr: | [0;m[38;5;43m20221208231930171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231930171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231930172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231930172 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231930172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231930174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231930174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:31.801110 run osmo-stp_10.42.42.5(pid=26517): stdout: | (launched: 2022-12-08_23:19:29.975752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:31.939270 run osmo-stp_10.42.42.5(pid=26517): stderr: | [0;m[38;5;43m20221208231930171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231930171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231930172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231930172 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231930172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231930174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231930174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:32.102531 run patchelf(pid=26520): Terminating (SIGINT) 23:19:32.288691 run patchelf(pid=26520): Terminated: ok {rc=0} 23:19:32.421934 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26517): Process ended prematurely: osmo-stp_10.42.42.5(pid=26517) [trial-2351↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26517)] [trial-2351↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 23:19:32.431934 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 23:19:32.460387 run osmo-hlr_10.42.42.2(pid=26514): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26514)] 23:19:32.510967 run osmo-hlr_10.42.42.2(pid=26514): stdout: | (launched: 2022-12-08_23:19:28.943858) 23:19:32.563248 run osmo-hlr_10.42.42.2(pid=26514): stderr: | [0;m[1;31m20221208231929145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231929145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231929145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231929145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231929145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231929145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231929158 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231929166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231929167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231929167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:19:32.616391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26513): Terminating (SIGTERM) 23:19:32.658746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26516): Terminating (SIGTERM) 23:19:32.701144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26519): Terminating (SIGTERM) 23:19:32.743670 --- ParallelTerminationStrategy: PID 26513 died... 23:19:32.764095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26513): Terminated: ok {rc=0} 23:19:32.811287 --- ParallelTerminationStrategy: PID 26516 died... 23:19:32.831026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26516): Terminated: ok {rc=0} 23:19:32.877615 --- ParallelTerminationStrategy: PID 26519 died... 23:19:32.897366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26519): Terminated: ok {rc=0} 23:19:32.986907 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 23:19:34.281777 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:19:34.288336 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 23:19:34.310182 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 23:19:34.350517 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 23:19:34.438391 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 23:19:34.460525 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 23:19:34.500518 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 23:19:35.096147 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 23:19:35.150525 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:35.162074 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:19:35.218563 tst cs_paging_gprs_active.py: using LAC 17445 23:19:35.340717 tst cs_paging_gprs_active.py: using RAC 105 23:19:35.462023 tst cs_paging_gprs_active.py: using CellId 17445 23:19:35.585215 tst cs_paging_gprs_active.py: using BVCI 17446 23:19:35.699424 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:35.710636 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:35.721670 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:35.732372 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:35.743212 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:35.754153 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:35.765331 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:35.776100 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:35.787180 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:19:35.908583 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:19:36.031997 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:19:36.260187 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:36.598547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26524): Launched 23:19:36.892624 run iperf3-srv_10.42.42.10(pid=26525): Launched 23:19:37.018636 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:19:37.245981 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:37.585009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26526): Launched 23:19:37.878783 run iperf3-srv_10.42.42.10(pid=26527): Launched 23:19:38.004412 tst cs_paging_gprs_active.py:38: start network... 23:19:38.230879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:19:38.753486 run create_hlr_db(pid=26528): Launched 23:19:38.890879 bus /gobi_6: Setting Powered False 23:19:39.956199 run create_hlr_db(pid=26528): Terminated: ok {rc=0} 23:19:40.405620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26530): Launched 23:19:40.723802 run osmo-hlr_10.42.42.2(pid=26531): Launched 23:19:40.844198 run osmo-stp_10.42.42.5: Starting osmo-stp 23:19:41.391278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26533): Launched 23:19:41.708431 run osmo-stp_10.42.42.5(pid=26534): Launched 23:19:41.829212 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:19:42.373346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26536): Launched 23:19:42.496566 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:19:42.763626 run patchelf(pid=26537): Launched 23:19:42.938781 run osmo-stp_10.42.42.5(pid=26534): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26534)] 23:19:43.071110 run osmo-stp_10.42.42.5(pid=26534): stdout: | (launched: 2022-12-08_23:19:41.649061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:43.205248 run osmo-stp_10.42.42.5(pid=26534): stderr: | [0;m[38;5;43m20221208231941824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231941824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231941824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231941825 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231941825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231941825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231941825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:43.339140 run osmo-stp_10.42.42.5(pid=26534): stdout: | (launched: 2022-12-08_23:19:41.649061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:43.467408 run osmo-stp_10.42.42.5(pid=26534): stderr: | [0;m[38;5;43m20221208231941824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231941824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231941824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231941825 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231941825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231941825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231941825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:43.619523 run patchelf(pid=26537): Terminating (SIGINT) 23:19:43.795189 run patchelf(pid=26537): Terminated: ok {rc=0} 23:19:43.922524 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26534): Process ended prematurely: osmo-stp_10.42.42.5(pid=26534) [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26534)] [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 23:19:43.932163 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 23:19:43.959745 run osmo-hlr_10.42.42.2(pid=26531): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26531)] 23:19:44.007769 run osmo-hlr_10.42.42.2(pid=26531): stdout: | (launched: 2022-12-08_23:19:40.663948) 23:19:44.057211 run osmo-hlr_10.42.42.2(pid=26531): stderr: | [0;m[1;31m20221208231940843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231940843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231940843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231940844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231940844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231940844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231940856 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231940864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231940865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231940865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:19:44.106890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26524): Terminating (SIGTERM) 23:19:44.146466 run iperf3-srv_10.42.42.10(pid=26525): Terminating (SIGTERM) 23:19:44.185907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26526): Terminating (SIGTERM) 23:19:44.225418 run iperf3-srv_10.42.42.10(pid=26527): Terminating (SIGTERM) 23:19:44.265087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26530): Terminating (SIGTERM) 23:19:44.304750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26533): Terminating (SIGTERM) 23:19:44.344452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26536): Terminating (SIGTERM) 23:19:44.384390 --- ParallelTerminationStrategy: PID 26524 died... 23:19:44.403456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26524): Terminated: ok {rc=0} 23:19:44.447888 --- ParallelTerminationStrategy: PID 26525 died... 23:19:44.466440 run iperf3-srv_10.42.42.10(pid=26525): Terminated {rc=256} 23:19:44.510529 --- ParallelTerminationStrategy: PID 26526 died... 23:19:44.529031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26526): Terminated: ok {rc=0} 23:19:44.573123 --- ParallelTerminationStrategy: PID 26527 died... 23:19:44.591871 run iperf3-srv_10.42.42.10(pid=26527): Terminated {rc=256} 23:19:44.636081 --- ParallelTerminationStrategy: PID 26530 died... 23:19:44.654699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26530): Terminated: ok {rc=0} 23:19:44.698947 --- ParallelTerminationStrategy: PID 26533 died... 23:19:44.717492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26533): Terminated: ok {rc=0} 23:19:44.761870 --- ParallelTerminationStrategy: PID 26536 died... 23:19:44.780294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26536): Terminated: ok {rc=0} 23:19:44.866785 bus /gobi_0: Setting Powered False 23:19:45.968734 bus /gobi_0: Setting Powered False 23:19:47.102670 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 23:19:48.255274 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:48.267323 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:19:48.328718 tst iperf3.py: using LAC 17446 23:19:48.461946 tst iperf3.py: using RAC 106 23:19:48.594323 tst iperf3.py: using CellId 17446 23:19:48.726411 tst iperf3.py: using BVCI 17447 23:19:48.850059 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:48.861682 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:48.872719 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:48.884181 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:48.895270 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:48.906384 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:48.917700 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:48.928660 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:48.939962 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:19:49.060434 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:19:49.287900 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:49.627322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26538): Launched 23:19:49.922787 run iperf3-srv_10.42.42.10(pid=26539): Launched 23:19:50.050054 tst iperf3.py:8: start network... 23:19:50.277479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:19:50.800780 run create_hlr_db(pid=26540): Launched 23:19:50.937475 bus /gobi_6: Setting Powered False 23:19:52.003922 run create_hlr_db(pid=26540): Terminated: ok {rc=0} 23:19:52.452626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26542): Launched 23:19:52.769605 run osmo-hlr_10.42.42.2(pid=26543): Launched 23:19:52.889581 run osmo-stp_10.42.42.5: Starting osmo-stp 23:19:53.430355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26545): Launched 23:19:53.745863 run osmo-stp_10.42.42.5(pid=26546): Launched 23:19:53.865087 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:19:54.408372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26548): Launched 23:19:54.528738 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:19:54.795184 run patchelf(pid=26549): Launched 23:19:54.970249 run osmo-stp_10.42.42.5(pid=26546): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26546)] 23:19:55.103234 run osmo-stp_10.42.42.5(pid=26546): stdout: | (launched: 2022-12-08_23:19:53.686387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:55.237987 run osmo-stp_10.42.42.5(pid=26546): stderr: | [0;m[38;5;43m20221208231953860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231953860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231953861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231953861 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231953862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231953862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231953862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:55.372533 run osmo-stp_10.42.42.5(pid=26546): stdout: | (launched: 2022-12-08_23:19:53.686387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:55.501087 run osmo-stp_10.42.42.5(pid=26546): stderr: | [0;m[38;5;43m20221208231953860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208231953860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208231953861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208231953861 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208231953862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208231953862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208231953862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:55.653102 run patchelf(pid=26549): Terminating (SIGINT) 23:19:55.828547 run patchelf(pid=26549): Terminated: ok {rc=0} 23:19:55.954961 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26546): Process ended prematurely: osmo-stp_10.42.42.5(pid=26546) [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26546)] [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 23:19:55.964493 tst iperf3.py:8: Test FAILED (7.7 sec) 23:19:55.992562 run osmo-hlr_10.42.42.2(pid=26543): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26543)] 23:19:56.040777 run osmo-hlr_10.42.42.2(pid=26543): stdout: | (launched: 2022-12-08_23:19:52.710045) 23:19:56.090567 run osmo-hlr_10.42.42.2(pid=26543): stderr: | [0;m[1;31m20221208231952892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208231952892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208231952892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208231952893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208231952893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208231952893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208231952904 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208231952913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208231952913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208231952913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:19:56.140867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26538): Terminating (SIGTERM) 23:19:56.180850 run iperf3-srv_10.42.42.10(pid=26539): Terminating (SIGTERM) 23:19:56.220751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26542): Terminating (SIGTERM) 23:19:56.260937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26545): Terminating (SIGTERM) 23:19:56.300829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26548): Terminating (SIGTERM) 23:19:56.340986 --- ParallelTerminationStrategy: PID 26538 died... 23:19:56.360100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26538): Terminated: ok {rc=0} 23:19:56.404527 --- ParallelTerminationStrategy: PID 26539 died... 23:19:56.423038 run iperf3-srv_10.42.42.10(pid=26539): Terminated {rc=256} 23:19:56.467135 --- ParallelTerminationStrategy: PID 26542 died... 23:19:56.485804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26542): Terminated: ok {rc=0} 23:19:56.530098 --- ParallelTerminationStrategy: PID 26545 died... 23:19:56.548675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26545): Terminated: ok {rc=0} 23:19:56.593080 --- ParallelTerminationStrategy: PID 26548 died... 23:19:56.611613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26548): Terminated: ok {rc=0} 23:19:56.697812 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 23:19:57.851142 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:57.863429 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:19:57.923400 tst iperf3m4.py: using LAC 17447 23:19:58.055620 tst iperf3m4.py: using RAC 107 23:19:58.188014 tst iperf3m4.py: using CellId 17447 23:19:58.319847 tst iperf3m4.py: using BVCI 17448 23:19:58.443377 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:58.454915 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:58.466158 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:58.477599 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:58.488736 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:58.500386 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:58.511960 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:58.523204 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:58.534790 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:19:58.652676 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:19:58.775964 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:19:58.896005 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:19:59.016927 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:19:59.243861 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:59.582575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26550): Launched 23:19:59.878682 run iperf3-srv_10.42.42.10(pid=26551): Launched 23:20:00.005062 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:20:00.233335 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:20:00.572103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26552): Launched 23:20:00.876747 run iperf3-srv_10.42.42.10(pid=26553): Launched 23:20:01.022339 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:20:01.259501 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:20:01.609904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26557): Launched 23:20:01.913920 run iperf3-srv_10.42.42.10(pid=26559): Launched 23:20:02.142575 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:20:02.384345 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:20:02.714613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26566): Launched 23:20:02.990737 run iperf3-srv_10.42.42.10(pid=26567): Launched 23:20:03.108569 tst iperf3m4.py:8: start network... 23:20:03.318865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:03.806933 run create_hlr_db(pid=26568): Launched 23:20:03.926961 bus /gobi_6: Setting Powered False 23:20:04.988937 run create_hlr_db(pid=26568): Terminated: ok {rc=0} 23:20:05.447584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26570): Launched 23:20:05.785504 run osmo-hlr_10.42.42.2(pid=26571): Launched 23:20:05.912806 run osmo-stp_10.42.42.5: Starting osmo-stp 23:20:06.492887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26573): Launched 23:20:06.830567 run osmo-stp_10.42.42.5(pid=26574): Launched 23:20:06.957936 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:20:07.537619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26576): Launched 23:20:07.665441 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:20:07.949826 run patchelf(pid=26577): Launched 23:20:08.137828 run osmo-stp_10.42.42.5(pid=26574): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26574)] 23:20:08.278615 run osmo-stp_10.42.42.5(pid=26574): stdout: | (launched: 2022-12-08_23:20:06.767240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:08.421449 run osmo-stp_10.42.42.5(pid=26574): stderr: | [0;m[38;5;43m20221208232006963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232006963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232006963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232006963 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232006966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232006966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232006966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:08.564109 run osmo-stp_10.42.42.5(pid=26574): stdout: | (launched: 2022-12-08_23:20:06.767240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:08.700738 run osmo-stp_10.42.42.5(pid=26574): stderr: | [0;m[38;5;43m20221208232006963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232006963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232006963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232006963 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232006966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232006966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232006966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:08.863424 run patchelf(pid=26577): Terminating (SIGINT) 23:20:09.050102 run patchelf(pid=26577): Terminated: ok {rc=0} 23:20:09.184764 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26574): Process ended prematurely: osmo-stp_10.42.42.5(pid=26574) [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26574)] [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 23:20:09.195032 tst iperf3m4.py:8: Test FAILED (11.4 sec) 23:20:09.223867 run osmo-hlr_10.42.42.2(pid=26571): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26571)] 23:20:09.273705 run osmo-hlr_10.42.42.2(pid=26571): stdout: | (launched: 2022-12-08_23:20:05.721945) 23:20:09.325464 run osmo-hlr_10.42.42.2(pid=26571): stderr: | [0;m[1;31m20221208232005924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232005924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232005924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232005925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232005925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232005925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232005937 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232005945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232005946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232005946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:09.377585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26550): Terminating (SIGTERM) 23:20:09.419536 run iperf3-srv_10.42.42.10(pid=26551): Terminating (SIGTERM) 23:20:09.461595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26552): Terminating (SIGTERM) 23:20:09.503686 run iperf3-srv_10.42.42.10(pid=26553): Terminating (SIGTERM) 23:20:09.545589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26557): Terminating (SIGTERM) 23:20:09.587546 run iperf3-srv_10.42.42.10(pid=26559): Terminating (SIGTERM) 23:20:09.629347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26566): Terminating (SIGTERM) 23:20:09.671180 run iperf3-srv_10.42.42.10(pid=26567): Terminating (SIGTERM) 23:20:09.712866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26570): Terminating (SIGTERM) 23:20:09.754940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26573): Terminating (SIGTERM) 23:20:09.797239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26576): Terminating (SIGTERM) 23:20:09.839569 --- ParallelTerminationStrategy: PID 26550 died... 23:20:09.859594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26550): Terminated: ok {rc=0} 23:20:09.906326 --- ParallelTerminationStrategy: PID 26551 died... 23:20:09.925958 run iperf3-srv_10.42.42.10(pid=26551): Terminated {rc=256} 23:20:09.971906 --- ParallelTerminationStrategy: PID 26552 died... 23:20:09.991651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26552): Terminated: ok {rc=0} 23:20:10.037796 --- ParallelTerminationStrategy: PID 26553 died... 23:20:10.057425 run iperf3-srv_10.42.42.10(pid=26553): Terminated {rc=256} 23:20:10.103990 --- ParallelTerminationStrategy: PID 26557 died... 23:20:10.123854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26557): Terminated: ok {rc=0} 23:20:10.170035 --- ParallelTerminationStrategy: PID 26559 died... 23:20:10.189690 run iperf3-srv_10.42.42.10(pid=26559): Terminated {rc=256} 23:20:10.235678 --- ParallelTerminationStrategy: PID 26566 died... 23:20:10.255134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26566): Terminated: ok {rc=0} 23:20:10.301365 --- ParallelTerminationStrategy: PID 26567 died... 23:20:10.321154 run iperf3-srv_10.42.42.10(pid=26567): Terminated {rc=256} 23:20:10.367246 --- ParallelTerminationStrategy: PID 26570 died... 23:20:10.387233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26570): Terminated: ok {rc=0} 23:20:10.433482 --- ParallelTerminationStrategy: PID 26573 died... 23:20:10.453278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26573): Terminated: ok {rc=0} 23:20:10.499702 --- ParallelTerminationStrategy: PID 26576 died... 23:20:10.519417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26576): Terminated: ok {rc=0} 23:20:10.607353 bus /gobi_4: Setting Powered False 23:20:11.706974 bus /gobi_4: Setting Powered False 23:20:12.832104 bus /gobi_1: Setting Powered False 23:20:13.941208 bus /gobi_1: Setting Powered False 23:20:15.062196 bus /gobi_0: Setting Powered False 23:20:16.160528 bus /gobi_0: Setting Powered False 23:20:17.283085 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 23:20:18.386673 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:18.398347 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:20:18.455000 tst ping.py: using LAC 17448 23:20:18.576102 tst ping.py: using RAC 108 23:20:18.698527 tst ping.py: using CellId 17448 23:20:18.821162 tst ping.py: using BVCI 17449 23:20:18.934319 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:18.945354 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:18.956036 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:18.967106 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:18.977996 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:18.988913 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:19.000033 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:19.010988 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:20:19.130655 tst ping.py:19: start network... 23:20:19.354326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:19.866969 run create_hlr_db(pid=26929): Launched 23:20:20.000302 bus /gobi_6: Setting Powered False 23:20:21.065554 run create_hlr_db(pid=26929): Terminated: ok {rc=0} 23:20:21.508920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26931): Launched 23:20:21.821355 run osmo-hlr_10.42.42.2(pid=26932): Launched 23:20:21.938456 run osmo-stp_10.42.42.5: Starting osmo-stp 23:20:22.495118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26934): Launched 23:20:22.813829 run osmo-stp_10.42.42.5(pid=26935): Launched 23:20:22.983228 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:20:23.646566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27037): Launched 23:20:23.779876 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:20:24.061526 run patchelf(pid=27113): Launched 23:20:24.260482 run osmo-stp_10.42.42.5(pid=26935): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26935)] 23:20:24.402898 run osmo-stp_10.42.42.5(pid=26935): stdout: | (launched: 2022-12-08_23:20:22.746907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:24.545758 run osmo-stp_10.42.42.5(pid=26935): stderr: | [0;m[38;5;43m20221208232022976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232022976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232022981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232022981 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232022982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232022982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232022982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:24.690593 run osmo-stp_10.42.42.5(pid=26935): stdout: | (launched: 2022-12-08_23:20:22.746907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:24.829240 run osmo-stp_10.42.42.5(pid=26935): stderr: | [0;m[38;5;43m20221208232022976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232022976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232022981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232022981 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232022982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232022982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232022982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:24.991864 run patchelf(pid=27113): Terminating (SIGINT) 23:20:25.179279 run patchelf(pid=27113): Terminated: ok {rc=0} 23:20:25.313805 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26935): Process ended prematurely: osmo-stp_10.42.42.5(pid=26935) [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26935)] [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 23:20:25.324236 tst ping.py:22: Test FAILED (6.9 sec) 23:20:25.353944 run osmo-hlr_10.42.42.2(pid=26932): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26932)] 23:20:25.407489 run osmo-hlr_10.42.42.2(pid=26932): stdout: | (launched: 2022-12-08_23:20:21.762198) 23:20:25.460422 run osmo-hlr_10.42.42.2(pid=26932): stderr: | [0;m[1;31m20221208232021942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232021942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232021942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232021942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232021942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232021942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232021962 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232021970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232021970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232021971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:25.513492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26931): Terminating (SIGTERM) 23:20:25.556923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26934): Terminating (SIGTERM) 23:20:25.604047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27037): Terminating (SIGTERM) 23:20:25.649752 --- ParallelTerminationStrategy: PID 26931 died... 23:20:25.670988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26931): Terminated: ok {rc=0} 23:20:25.720345 --- ParallelTerminationStrategy: PID 26934 died... 23:20:25.742240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26934): Terminated: ok {rc=0} 23:20:25.791192 --- ParallelTerminationStrategy: PID 27037 died... 23:20:25.811641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27037): Terminated: ok {rc=0} 23:20:25.902123 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 23:20:26.995022 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:27.008020 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:20:27.066965 tst ping_idle_ping.py: using LAC 17449 23:20:27.201677 tst ping_idle_ping.py: using RAC 109 23:20:27.329442 tst ping_idle_ping.py: using CellId 17449 23:20:27.458944 tst ping_idle_ping.py: using BVCI 17450 23:20:27.582649 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:27.594987 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:27.607135 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:27.620046 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:27.633777 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:27.645814 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:27.658561 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:27.673054 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:20:27.800866 tst ping_idle_ping.py:24: start network... 23:20:28.029422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:28.563393 run create_hlr_db(pid=27114): Launched 23:20:28.735094 bus /gobi_6: Setting Powered False 23:20:29.800100 run create_hlr_db(pid=27114): Terminated: ok {rc=0} 23:20:30.273044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27117): Launched 23:20:30.606837 run osmo-hlr_10.42.42.2(pid=27118): Launched 23:20:30.732491 run osmo-stp_10.42.42.5: Starting osmo-stp 23:20:31.390872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27120): Launched 23:20:31.738890 run osmo-stp_10.42.42.5(pid=27121): Launched 23:20:32.032794 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:20:32.605355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27123): Launched 23:20:32.731878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:20:33.013497 run patchelf(pid=27124): Launched 23:20:33.197192 run osmo-stp_10.42.42.5(pid=27121): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27121)] 23:20:33.336676 run osmo-stp_10.42.42.5(pid=27121): stdout: | (launched: 2022-12-08_23:20:31.675412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:33.477904 run osmo-stp_10.42.42.5(pid=27121): stderr: | [0;m[38;5;43m20221208232031879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232031879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232031880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232031880 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232031881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232031881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232031881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:33.619059 run osmo-stp_10.42.42.5(pid=27121): stdout: | (launched: 2022-12-08_23:20:31.675412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:33.754048 run osmo-stp_10.42.42.5(pid=27121): stderr: | [0;m[38;5;43m20221208232031879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232031879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232031880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232031880 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232031881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232031881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232031881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:33.914462 run patchelf(pid=27124): Terminating (SIGINT) 23:20:34.098572 run patchelf(pid=27124): Terminated: ok {rc=0} 23:20:34.231213 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27121): Process ended prematurely: osmo-stp_10.42.42.5(pid=27121) [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27121)] [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 23:20:34.240851 tst ping_idle_ping.py:27: Test FAILED (7.2 sec) 23:20:34.268845 run osmo-hlr_10.42.42.2(pid=27118): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27118)] 23:20:34.319415 run osmo-hlr_10.42.42.2(pid=27118): stdout: | (launched: 2022-12-08_23:20:30.544217) 23:20:34.371379 run osmo-hlr_10.42.42.2(pid=27118): stderr: | [0;m[1;31m20221208232030745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232030745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232030745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232030745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232030745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232030745 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232030758 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232030770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232030770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232030770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:34.424070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27117): Terminating (SIGTERM) 23:20:34.466460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27120): Terminating (SIGTERM) 23:20:34.508785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27123): Terminating (SIGTERM) 23:20:34.551585 --- ParallelTerminationStrategy: PID 27117 died... 23:20:34.571724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27117): Terminated: ok {rc=0} 23:20:34.618409 --- ParallelTerminationStrategy: PID 27120 died... 23:20:34.638233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27120): Terminated: ok {rc=0} 23:20:34.684682 --- ParallelTerminationStrategy: PID 27123 died... 23:20:34.704291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27123): Terminated: ok {rc=0} 23:20:34.793602 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:20:36.085699 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:20:36.093735 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:20:36.115416 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 23:20:36.154931 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 23:20:36.247394 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:20:36.270061 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 23:20:36.309890 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 23:20:36.900314 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 23:20:36.954027 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:36.965445 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:20:37.022532 tst cs_paging_gprs_active.py: using LAC 17450 23:20:37.154504 tst cs_paging_gprs_active.py: using RAC 110 23:20:37.277653 tst cs_paging_gprs_active.py: using CellId 17450 23:20:37.409696 tst cs_paging_gprs_active.py: using BVCI 17451 23:20:37.533856 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:37.545420 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:37.556707 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:37.568092 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:37.579219 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:37.590570 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:37.601896 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:37.612898 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:37.624197 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:20:37.745511 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:20:37.865094 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:20:38.076762 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:20:38.394453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27128): Launched 23:20:38.670526 run iperf3-srv_10.42.42.10(pid=27129): Launched 23:20:38.787834 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:20:38.999221 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:20:39.315526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27130): Launched 23:20:39.590374 run iperf3-srv_10.42.42.10(pid=27131): Launched 23:20:39.707704 tst cs_paging_gprs_active.py:38: start network... 23:20:39.919637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:40.409228 run create_hlr_db(pid=27132): Launched 23:20:40.530401 bus /gobi_6: Setting Powered False 23:20:41.592104 run create_hlr_db(pid=27132): Terminated: ok {rc=0} 23:20:42.030433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27134): Launched 23:20:42.346970 run osmo-hlr_10.42.42.2(pid=27135): Launched 23:20:42.468387 run osmo-stp_10.42.42.5: Starting osmo-stp 23:20:43.024137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27137): Launched 23:20:43.340643 run osmo-stp_10.42.42.5(pid=27138): Launched 23:20:43.461239 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:20:44.004073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27140): Launched 23:20:44.125353 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:20:44.393396 run patchelf(pid=27141): Launched 23:20:44.568762 run osmo-stp_10.42.42.5(pid=27138): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27138)] 23:20:44.701492 run osmo-stp_10.42.42.5(pid=27138): stdout: | (launched: 2022-12-08_23:20:43.280832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:44.835671 run osmo-stp_10.42.42.5(pid=27138): stderr: | [0;m[38;5;43m20221208232043455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232043455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232043455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232043456 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232043456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232043456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232043456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:44.970108 run osmo-stp_10.42.42.5(pid=27138): stdout: | (launched: 2022-12-08_23:20:43.280832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:45.098913 run osmo-stp_10.42.42.5(pid=27138): stderr: | [0;m[38;5;43m20221208232043455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232043455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232043455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232043456 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232043456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232043456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232043456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:45.251487 run patchelf(pid=27141): Terminating (SIGINT) 23:20:45.427356 run patchelf(pid=27141): Terminated: ok {rc=0} 23:20:45.554151 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27138): Process ended prematurely: osmo-stp_10.42.42.5(pid=27138) [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27138)] [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 23:20:45.563624 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 23:20:45.591380 run osmo-hlr_10.42.42.2(pid=27135): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27135)] 23:20:45.639301 run osmo-hlr_10.42.42.2(pid=27135): stdout: | (launched: 2022-12-08_23:20:42.287068) 23:20:45.689322 run osmo-hlr_10.42.42.2(pid=27135): stderr: | [0;m[1;31m20221208232042469 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232042470 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232042470 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232042470 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232042470 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232042470 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232042491 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232042501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232042501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232042501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:45.739084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27128): Terminating (SIGTERM) 23:20:45.779004 run iperf3-srv_10.42.42.10(pid=27129): Terminating (SIGTERM) 23:20:45.819137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27130): Terminating (SIGTERM) 23:20:45.886726 run iperf3-srv_10.42.42.10(pid=27131): Terminating (SIGTERM) 23:20:45.930648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27134): Terminating (SIGTERM) 23:20:45.974735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27137): Terminating (SIGTERM) 23:20:46.018873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27140): Terminating (SIGTERM) 23:20:46.061995 --- ParallelTerminationStrategy: PID 27128 died... 23:20:46.081865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27128): Terminated: ok {rc=0} 23:20:46.129753 --- ParallelTerminationStrategy: PID 27129 died... 23:20:46.149458 run iperf3-srv_10.42.42.10(pid=27129): Terminated {rc=256} 23:20:46.197283 --- ParallelTerminationStrategy: PID 27130 died... 23:20:46.216889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27130): Terminated: ok {rc=0} 23:20:46.265095 --- ParallelTerminationStrategy: PID 27131 died... 23:20:46.284849 run iperf3-srv_10.42.42.10(pid=27131): Terminated {rc=256} 23:20:46.332597 --- ParallelTerminationStrategy: PID 27134 died... 23:20:46.352545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27134): Terminated: ok {rc=0} 23:20:46.400857 --- ParallelTerminationStrategy: PID 27137 died... 23:20:46.420820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27137): Terminated: ok {rc=0} 23:20:46.468668 --- ParallelTerminationStrategy: PID 27140 died... 23:20:46.488621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27140): Terminated: ok {rc=0} 23:20:46.581764 bus /gobi_0: Setting Powered False 23:20:47.693338 bus /gobi_0: Setting Powered False 23:20:48.811093 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 23:20:49.958656 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:49.970232 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:20:50.030641 tst iperf3.py: using LAC 17451 23:20:50.158910 tst iperf3.py: using RAC 111 23:20:50.281366 tst iperf3.py: using CellId 17451 23:20:50.404877 tst iperf3.py: using BVCI 17452 23:20:50.519540 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:50.530653 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:50.541431 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:50.552315 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:50.563260 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:50.574164 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:50.585294 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:50.596096 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:50.607158 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:20:50.723245 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:20:50.935735 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:20:51.253631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27142): Launched 23:20:51.529725 run iperf3-srv_10.42.42.10(pid=27143): Launched 23:20:51.648095 tst iperf3.py:8: start network... 23:20:51.859681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:52.348534 run create_hlr_db(pid=27144): Launched 23:20:52.468894 bus /gobi_6: Setting Powered False 23:20:53.530735 run create_hlr_db(pid=27144): Terminated: ok {rc=0} 23:20:53.968607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27146): Launched 23:20:54.284437 run osmo-hlr_10.42.42.2(pid=27147): Launched 23:20:54.405506 run osmo-stp_10.42.42.5: Starting osmo-stp 23:20:54.960241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27149): Launched 23:20:55.277753 run osmo-stp_10.42.42.5(pid=27150): Launched 23:20:55.398718 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:20:55.942537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27152): Launched 23:20:56.063267 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:20:56.331134 run patchelf(pid=27153): Launched 23:20:56.509355 run osmo-stp_10.42.42.5(pid=27150): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27150)] 23:20:56.641549 run osmo-stp_10.42.42.5(pid=27150): stdout: | (launched: 2022-12-08_23:20:55.218060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:56.776301 run osmo-stp_10.42.42.5(pid=27150): stderr: | [0;m[38;5;43m20221208232055393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232055393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232055394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232055394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232055394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232055395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232055395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:56.910992 run osmo-stp_10.42.42.5(pid=27150): stdout: | (launched: 2022-12-08_23:20:55.218060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:57.038945 run osmo-stp_10.42.42.5(pid=27150): stderr: | [0;m[38;5;43m20221208232055393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232055393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232055394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232055394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232055394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232055395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232055395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:57.190659 run patchelf(pid=27153): Terminating (SIGINT) 23:20:57.366298 run patchelf(pid=27153): Terminated: ok {rc=0} 23:20:57.493449 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27150): Process ended prematurely: osmo-stp_10.42.42.5(pid=27150) [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27150)] [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 23:20:57.503059 tst iperf3.py:8: Test FAILED (7.6 sec) 23:20:57.530407 run osmo-hlr_10.42.42.2(pid=27147): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27147)] 23:20:57.577514 run osmo-hlr_10.42.42.2(pid=27147): stdout: | (launched: 2022-12-08_23:20:54.224827) 23:20:57.626576 run osmo-hlr_10.42.42.2(pid=27147): stderr: | [0;m[1;31m20221208232054405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232054406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232054406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232054406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232054406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232054406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232054418 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232054426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232054426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232054426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:57.675963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27142): Terminating (SIGTERM) 23:20:57.715237 run iperf3-srv_10.42.42.10(pid=27143): Terminating (SIGTERM) 23:20:57.754346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27146): Terminating (SIGTERM) 23:20:57.794325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27149): Terminating (SIGTERM) 23:20:57.833702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27152): Terminating (SIGTERM) 23:20:57.873366 --- ParallelTerminationStrategy: PID 27142 died... 23:20:57.891994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27142): Terminated: ok {rc=0} 23:20:57.936093 --- ParallelTerminationStrategy: PID 27143 died... 23:20:57.954408 run iperf3-srv_10.42.42.10(pid=27143): Terminated {rc=256} 23:20:57.997984 --- ParallelTerminationStrategy: PID 27146 died... 23:20:58.016306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27146): Terminated: ok {rc=0} 23:20:58.060122 --- ParallelTerminationStrategy: PID 27149 died... 23:20:58.078566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27149): Terminated: ok {rc=0} 23:20:58.122572 --- ParallelTerminationStrategy: PID 27152 died... 23:20:58.141110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27152): Terminated: ok {rc=0} 23:20:58.224494 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 23:20:59.376022 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:59.388224 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:20:59.449380 tst iperf3m4.py: using LAC 17452 23:20:59.581414 tst iperf3m4.py: using RAC 112 23:20:59.713036 tst iperf3m4.py: using CellId 17452 23:20:59.845619 tst iperf3m4.py: using BVCI 17453 23:20:59.962401 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:59.973476 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:59.984171 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:59.995168 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:00.006136 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:00.017145 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:00.028623 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:00.039558 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:00.050851 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:21:00.167385 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:21:00.288890 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:21:00.410495 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:21:00.528491 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:21:00.739239 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:21:01.081340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27154): Launched 23:21:01.397069 run iperf3-srv_10.42.42.10(pid=27155): Launched 23:21:01.593854 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:21:01.846976 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:21:02.198148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27156): Launched 23:21:02.504738 run iperf3-srv_10.42.42.10(pid=27157): Launched 23:21:02.631914 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:21:02.859147 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:21:03.198237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27158): Launched 23:21:03.493212 run iperf3-srv_10.42.42.10(pid=27159): Launched 23:21:03.619250 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:21:03.846012 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:21:04.184502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27160): Launched 23:21:04.478410 run iperf3-srv_10.42.42.10(pid=27161): Launched 23:21:04.604246 tst iperf3m4.py:8: start network... 23:21:04.830867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:21:05.353656 run create_hlr_db(pid=27162): Launched 23:21:05.489457 bus /gobi_6: Setting Powered False 23:21:06.555438 run create_hlr_db(pid=27162): Terminated: ok {rc=0} 23:21:07.023229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27164): Launched 23:21:07.361260 run osmo-hlr_10.42.42.2(pid=27165): Launched 23:21:07.490400 run osmo-stp_10.42.42.5: Starting osmo-stp 23:21:08.076281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27167): Launched 23:21:08.414805 run osmo-stp_10.42.42.5(pid=27168): Launched 23:21:08.542524 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:21:09.125343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27170): Launched 23:21:09.254197 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:21:09.540585 run patchelf(pid=27171): Launched 23:21:09.727680 run osmo-stp_10.42.42.5(pid=27168): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27168)] 23:21:09.869770 run osmo-stp_10.42.42.5(pid=27168): stdout: | (launched: 2022-12-08_23:21:08.351151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:10.013482 run osmo-stp_10.42.42.5(pid=27168): stderr: | [0;m[38;5;43m20221208232108547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232108547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232108547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232108547 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232108550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232108550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232108550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:10.157243 run osmo-stp_10.42.42.5(pid=27168): stdout: | (launched: 2022-12-08_23:21:08.351151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:10.294340 run osmo-stp_10.42.42.5(pid=27168): stderr: | [0;m[38;5;43m20221208232108547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232108547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232108547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232108547 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232108550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232108550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232108550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:10.456693 run patchelf(pid=27171): Terminating (SIGINT) 23:21:10.644731 run patchelf(pid=27171): Terminated: ok {rc=0} 23:21:10.779986 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27168): Process ended prematurely: osmo-stp_10.42.42.5(pid=27168) [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27168)] [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 23:21:10.790364 tst iperf3m4.py:8: Test FAILED (11.5 sec) 23:21:10.819582 run osmo-hlr_10.42.42.2(pid=27165): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27165)] 23:21:10.869816 run osmo-hlr_10.42.42.2(pid=27165): stdout: | (launched: 2022-12-08_23:21:07.297981) 23:21:10.921594 run osmo-hlr_10.42.42.2(pid=27165): stderr: | [0;m[1;31m20221208232107502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232107502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232107503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232107503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232107503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232107503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232107515 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232107524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232107524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232107524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:21:10.973750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27154): Terminating (SIGTERM) 23:21:11.015814 run iperf3-srv_10.42.42.10(pid=27155): Terminating (SIGTERM) 23:21:11.057827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27156): Terminating (SIGTERM) 23:21:11.099980 run iperf3-srv_10.42.42.10(pid=27157): Terminating (SIGTERM) 23:21:11.142001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27158): Terminating (SIGTERM) 23:21:11.183966 run iperf3-srv_10.42.42.10(pid=27159): Terminating (SIGTERM) 23:21:11.225740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27160): Terminating (SIGTERM) 23:21:11.267687 run iperf3-srv_10.42.42.10(pid=27161): Terminating (SIGTERM) 23:21:11.309577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27164): Terminating (SIGTERM) 23:21:11.351564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27167): Terminating (SIGTERM) 23:21:11.393529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27170): Terminating (SIGTERM) 23:21:11.435916 --- ParallelTerminationStrategy: PID 27154 died... 23:21:11.455997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27154): Terminated: ok {rc=0} 23:21:11.502350 --- ParallelTerminationStrategy: PID 27155 died... 23:21:11.522014 run iperf3-srv_10.42.42.10(pid=27155): Terminated {rc=256} 23:21:11.567935 --- ParallelTerminationStrategy: PID 27156 died... 23:21:11.587578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27156): Terminated: ok {rc=0} 23:21:11.633689 --- ParallelTerminationStrategy: PID 27157 died... 23:21:11.653369 run iperf3-srv_10.42.42.10(pid=27157): Terminated {rc=256} 23:21:11.699260 --- ParallelTerminationStrategy: PID 27158 died... 23:21:11.718924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27158): Terminated: ok {rc=0} 23:21:11.765070 --- ParallelTerminationStrategy: PID 27159 died... 23:21:11.784528 run iperf3-srv_10.42.42.10(pid=27159): Terminated {rc=256} 23:21:11.830829 --- ParallelTerminationStrategy: PID 27160 died... 23:21:11.850580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27160): Terminated: ok {rc=0} 23:21:11.896726 --- ParallelTerminationStrategy: PID 27161 died... 23:21:11.916409 run iperf3-srv_10.42.42.10(pid=27161): Terminated {rc=256} 23:21:11.962357 --- ParallelTerminationStrategy: PID 27164 died... 23:21:11.982368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27164): Terminated: ok {rc=0} 23:21:12.028353 --- ParallelTerminationStrategy: PID 27167 died... 23:21:12.048057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27167): Terminated: ok {rc=0} 23:21:12.094124 --- ParallelTerminationStrategy: PID 27170 died... 23:21:12.113777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27170): Terminated: ok {rc=0} 23:21:12.200996 bus /gobi_4: Setting Powered False 23:21:13.299034 bus /gobi_4: Setting Powered False 23:21:14.414820 bus /gobi_1: Setting Powered False 23:21:15.515223 bus /gobi_1: Setting Powered False 23:21:16.635093 bus /gobi_0: Setting Powered False 23:21:17.736150 bus /gobi_0: Setting Powered False 23:21:18.853487 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 23:21:19.956035 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:19.968321 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:21:20.027782 tst ping.py: using LAC 17453 23:21:20.158660 tst ping.py: using RAC 113 23:21:20.288888 tst ping.py: using CellId 17453 23:21:20.422582 tst ping.py: using BVCI 17454 23:21:20.543172 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:20.554748 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:20.565997 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:20.577277 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:20.588248 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:20.599364 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:20.610801 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:20.621923 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:21:20.738088 tst ping.py:19: start network... 23:21:20.945471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:21:21.424915 run create_hlr_db(pid=27172): Launched 23:21:21.543962 bus /gobi_6: Setting Powered False 23:21:22.608772 run create_hlr_db(pid=27172): Terminated: ok {rc=0} 23:21:23.053360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27174): Launched 23:21:23.364804 run osmo-hlr_10.42.42.2(pid=27175): Launched 23:21:23.482222 run osmo-stp_10.42.42.5: Starting osmo-stp 23:21:24.029646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27177): Launched 23:21:24.341179 run osmo-stp_10.42.42.5(pid=27178): Launched 23:21:24.460011 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:21:24.995872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27180): Launched 23:21:25.114976 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:21:25.378012 run patchelf(pid=27181): Launched 23:21:25.549358 run osmo-stp_10.42.42.5(pid=27178): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27178)] 23:21:25.680776 run osmo-stp_10.42.42.5(pid=27178): stdout: | (launched: 2022-12-08_23:21:24.282396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:25.813522 run osmo-stp_10.42.42.5(pid=27178): stderr: | [0;m[38;5;43m20221208232124454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232124455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232124455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232124455 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232124458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232124458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232124458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:25.946156 run osmo-stp_10.42.42.5(pid=27178): stdout: | (launched: 2022-12-08_23:21:24.282396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:26.072902 run osmo-stp_10.42.42.5(pid=27178): stderr: | [0;m[38;5;43m20221208232124454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232124455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232124455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232124455 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232124458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232124458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232124458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:26.222990 run patchelf(pid=27181): Terminating (SIGINT) 23:21:26.396339 run patchelf(pid=27181): Terminated: ok {rc=0} 23:21:26.521098 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27178): Process ended prematurely: osmo-stp_10.42.42.5(pid=27178) [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27178)] [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 23:21:26.530051 tst ping.py:22: Test FAILED (6.6 sec) 23:21:26.557437 run osmo-hlr_10.42.42.2(pid=27175): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27175)] 23:21:26.606010 run osmo-hlr_10.42.42.2(pid=27175): stdout: | (launched: 2022-12-08_23:21:23.306062) 23:21:26.655955 run osmo-hlr_10.42.42.2(pid=27175): stderr: | [0;m[1;31m20221208232123486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232123486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232123486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232123486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232123486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232123486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232123498 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232123507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232123507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232123507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:21:26.706513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27174): Terminating (SIGTERM) 23:21:26.747185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27177): Terminating (SIGTERM) 23:21:26.787606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27180): Terminating (SIGTERM) 23:21:26.828226 --- ParallelTerminationStrategy: PID 27174 died... 23:21:26.847442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27174): Terminated: ok {rc=0} 23:21:26.891980 --- ParallelTerminationStrategy: PID 27177 died... 23:21:26.910689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27177): Terminated: ok {rc=0} 23:21:26.955073 --- ParallelTerminationStrategy: PID 27180 died... 23:21:26.973732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27180): Terminated: ok {rc=0} 23:21:27.060493 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 23:21:28.150155 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:28.162288 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:21:28.227401 tst ping_idle_ping.py: using LAC 17454 23:21:28.348641 tst ping_idle_ping.py: using RAC 114 23:21:28.468518 tst ping_idle_ping.py: using CellId 17454 23:21:28.593459 tst ping_idle_ping.py: using BVCI 17455 23:21:28.710678 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:28.721894 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:28.732615 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:28.743791 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:28.754756 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:28.765741 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:28.776869 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:28.787895 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:21:28.907879 tst ping_idle_ping.py:24: start network... 23:21:29.132627 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:21:29.650273 run create_hlr_db(pid=27182): Launched 23:21:29.786470 bus /gobi_6: Setting Powered False 23:21:30.853450 run create_hlr_db(pid=27182): Terminated: ok {rc=0} 23:21:31.351516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27184): Launched 23:21:31.690316 run osmo-hlr_10.42.42.2(pid=27185): Launched 23:21:31.846028 run osmo-stp_10.42.42.5: Starting osmo-stp 23:21:32.589308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27187): Launched 23:21:32.923696 run osmo-stp_10.42.42.5(pid=27188): Launched 23:21:33.052404 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:21:33.627798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27190): Launched 23:21:33.755095 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:21:34.037411 run patchelf(pid=27191): Launched 23:21:34.221769 run osmo-stp_10.42.42.5(pid=27188): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27188)] 23:21:34.362067 run osmo-stp_10.42.42.5(pid=27188): stdout: | (launched: 2022-12-08_23:21:32.861229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:34.503936 run osmo-stp_10.42.42.5(pid=27188): stderr: | [0;m[38;5;43m20221208232133058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232133059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232133059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232133059 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232133060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232133060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232133060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:34.645633 run osmo-stp_10.42.42.5(pid=27188): stdout: | (launched: 2022-12-08_23:21:32.861229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:34.781636 run osmo-stp_10.42.42.5(pid=27188): stderr: | [0;m[38;5;43m20221208232133058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232133059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232133059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232133059 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232133060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232133060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232133060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:34.943069 run patchelf(pid=27191): Terminating (SIGINT) 23:21:35.127859 run patchelf(pid=27191): Terminated: ok {rc=0} 23:21:35.261244 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27188): Process ended prematurely: osmo-stp_10.42.42.5(pid=27188) [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27188)] [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 23:21:35.270972 tst ping_idle_ping.py:27: Test FAILED (7.1 sec) 23:21:35.299289 run osmo-hlr_10.42.42.2(pid=27185): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27185)] 23:21:35.349492 run osmo-hlr_10.42.42.2(pid=27185): stdout: | (launched: 2022-12-08_23:21:31.626900) 23:21:35.401706 run osmo-hlr_10.42.42.2(pid=27185): stderr: | [0;m[1;31m20221208232131963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232131963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232131963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232131963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232131963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232131964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232131990 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232132003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232132003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232132003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:21:35.454495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27184): Terminating (SIGTERM) 23:21:35.496822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27187): Terminating (SIGTERM) 23:21:35.539285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27190): Terminating (SIGTERM) 23:21:35.582070 --- ParallelTerminationStrategy: PID 27184 died... 23:21:35.602410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27184): Terminated: ok {rc=0} 23:21:35.649618 --- ParallelTerminationStrategy: PID 27187 died... 23:21:35.669553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27187): Terminated: ok {rc=0} 23:21:35.716185 --- ParallelTerminationStrategy: PID 27190 died... 23:21:35.736088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27190): Terminated: ok {rc=0} 23:21:35.825328 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:21:37.125062 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:21:37.134210 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:21:37.156282 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 23:21:37.191696 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:21:37.246781 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:21:37.268438 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 23:21:37.303859 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:21:37.861818 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2351 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 23:21:37.868891 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:37.880648 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:21:37.939539 tst switch_tch_pdch.py: using LAC 17455 23:21:38.062718 tst switch_tch_pdch.py: using RAC 115 23:21:38.184906 tst switch_tch_pdch.py: using CellId 17455 23:21:38.304908 tst switch_tch_pdch.py: using BVCI 17456 23:21:38.425925 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:38.437948 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:38.449790 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:38.461538 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:38.473080 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:38.484495 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:38.496201 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:38.507753 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:21:38.624885 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:21:38.744638 tst switch_tch_pdch.py:51: start network... 23:21:38.969055 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:21:39.481553 run create_hlr_db(pid=27195): Launched 23:21:39.614671 bus /gobi_6: Setting Powered False 23:21:40.679410 run create_hlr_db(pid=27195): Terminated: ok {rc=0} 23:21:41.140520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27197): Launched 23:21:41.471961 run osmo-hlr_10.42.42.2(pid=27198): Launched 23:21:41.597666 run osmo-stp_10.42.42.5: Starting osmo-stp 23:21:42.165066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27200): Launched 23:21:42.495837 run osmo-stp_10.42.42.5(pid=27201): Launched 23:21:42.621608 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:21:43.195340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27203): Launched 23:21:43.321230 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:21:43.600768 run patchelf(pid=27204): Launched 23:21:43.783421 run osmo-stp_10.42.42.5(pid=27201): ERR: Terminated: ERROR {rc=1} [trial-2351↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27201)] 23:21:43.922506 run osmo-stp_10.42.42.5(pid=27201): stdout: | (launched: 2022-12-08_23:21:42.433798) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:44.063133 run osmo-stp_10.42.42.5(pid=27201): stderr: | [0;m[38;5;43m20221208232142629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232142629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232142630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232142630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232142631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232142631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232142631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:44.203869 run osmo-stp_10.42.42.5(pid=27201): stdout: | (launched: 2022-12-08_23:21:42.433798) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:44.338025 run osmo-stp_10.42.42.5(pid=27201): stderr: | [0;m[38;5;43m20221208232142629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232142629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232142630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232142630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232142631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232142631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232142631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:44.497102 run patchelf(pid=27204): Terminating (SIGINT) 23:21:44.680590 run patchelf(pid=27204): Terminated: ok {rc=0} 23:21:44.813199 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27201): Process ended prematurely: osmo-stp_10.42.42.5(pid=27201) [trial-2351↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27201)] [trial-2351↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 23:21:44.822778 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 23:21:44.851090 run osmo-hlr_10.42.42.2(pid=27198): ERR: Terminated: ERROR {rc=237} [trial-2351↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27198)] 23:21:44.901254 run osmo-hlr_10.42.42.2(pid=27198): stdout: | (launched: 2022-12-08_23:21:41.409877) 23:21:44.952642 run osmo-hlr_10.42.42.2(pid=27198): stderr: | [0;m[1;31m20221208232141613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232141613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232141613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232141613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232141613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232141614 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232141625 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232141634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232141634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232141634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:21:45.004483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27197): Terminating (SIGTERM) 23:21:45.046181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27200): Terminating (SIGTERM) 23:21:45.088112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27203): Terminating (SIGTERM) 23:21:45.130290 --- ParallelTerminationStrategy: PID 27197 died... 23:21:45.150413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27197): Terminated: ok {rc=0} 23:21:45.196469 --- ParallelTerminationStrategy: PID 27200 died... 23:21:45.216068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27200): Terminated: ok {rc=0} 23:21:45.262038 --- ParallelTerminationStrategy: PID 27203 died... 23:21:45.281688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27203): Terminated: ok {rc=0} 23:21:45.368581 bus /gobi_0: Setting Powered False 23:21:46.462388 bus /gobi_0: Setting Powered False 23:21:47.581925 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 23:21:48.817339 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:21:48.823138 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 23:21:48.844165 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 23:21:48.879277 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 23:21:48.935388 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 23:21:48.957171 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 23:21:48.992730 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 23:21:49.541172 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2351 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 23:21:49.546457 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:49.557367 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 23:21:49.613700 tst switch_tch_pdch.py: using LAC 17456 23:21:49.734829 tst switch_tch_pdch.py: using RAC 116 23:21:49.868912 tst switch_tch_pdch.py: using CellId 17456 23:21:49.997941 tst switch_tch_pdch.py: using BVCI 17457 23:21:50.109478 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:50.120319 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:50.131098 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:50.142091 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:50.153041 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:50.163901 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:50.175094 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:50.186547 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:21:50.301571 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:21:50.418069 tst switch_tch_pdch.py:51: start network... 23:21:50.625167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:21:51.078684 run create_hlr_db(pid=27208): Launched 23:21:51.196380 bus /gobi_6: Setting Powered False 23:21:52.257842 run create_hlr_db(pid=27208): Terminated: ok {rc=0} 23:21:52.681597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27210): Launched 23:21:53.014500 run osmo-hlr_10.42.42.2(pid=27211): Launched 23:21:53.139942 run osmo-stp_10.42.42.5: Starting osmo-stp 23:21:53.679453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27213): Launched 23:21:54.011493 run osmo-stp_10.42.42.5(pid=27214): Launched 23:21:54.137151 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:21:54.680313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27216): Launched 23:21:54.806974 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:21:55.088699 run patchelf(pid=27217): Launched 23:21:55.272075 run osmo-stp_10.42.42.5(pid=27214): ERR: Terminated: ERROR {rc=1} [trial-2351↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27214)] 23:21:55.411811 run osmo-stp_10.42.42.5(pid=27214): stdout: | (launched: 2022-12-08_23:21:53.949540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:55.552926 run osmo-stp_10.42.42.5(pid=27214): stderr: | [0;m[38;5;43m20221208232154144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232154144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232154144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232154145 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232154145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232154145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232154146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:55.694619 run osmo-stp_10.42.42.5(pid=27214): stdout: | (launched: 2022-12-08_23:21:53.949540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:55.829599 run osmo-stp_10.42.42.5(pid=27214): stderr: | [0;m[38;5;43m20221208232154144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232154144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232154144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232154145 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232154145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232154145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232154146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:55.990316 run patchelf(pid=27217): Terminating (SIGINT) 23:21:56.174422 run patchelf(pid=27217): Terminated: ok {rc=0} 23:21:56.307600 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27214): Process ended prematurely: osmo-stp_10.42.42.5(pid=27214) [trial-2351↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27214)] [trial-2351↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 23:21:56.317616 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 23:21:56.346013 run osmo-hlr_10.42.42.2(pid=27211): ERR: Terminated: ERROR {rc=237} [trial-2351↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27211)] 23:21:56.395799 run osmo-hlr_10.42.42.2(pid=27211): stdout: | (launched: 2022-12-08_23:21:52.952298) 23:21:56.447694 run osmo-hlr_10.42.42.2(pid=27211): stderr: | [0;m[1;31m20221208232153153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232153153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232153153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232153153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232153153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232153153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232153165 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232153174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232153174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232153174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:21:56.499861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27210): Terminating (SIGTERM) 23:21:56.542220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27213): Terminating (SIGTERM) 23:21:56.584308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27216): Terminating (SIGTERM) 23:21:56.626732 --- ParallelTerminationStrategy: PID 27210 died... 23:21:56.646925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27210): Terminated: ok {rc=0} 23:21:56.693321 --- ParallelTerminationStrategy: PID 27213 died... 23:21:56.712916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27213): Terminated: ok {rc=0} 23:21:56.759154 --- ParallelTerminationStrategy: PID 27216 died... 23:21:56.778891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27216): Terminated: ok {rc=0} 23:21:56.866795 bus /gobi_0: Setting Powered False 23:21:57.967293 bus /gobi_0: Setting Powered False 23:21:59.083750 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 nitb_sms:oc2g --------------------------------------------------------------------- 23:22:00.326498 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:22:00.331032 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 23:22:00.352310 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 23:22:00.359487 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 23:22:00.411477 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 23:22:00.432650 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 23:22:00.439911 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 23:22:00.985777 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 23:22:00.990750 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 23:22:01.005748 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 23:22:01.050801 tst mo_mt_sms.py: using LAC 17457 23:22:01.194942 tst mo_mt_sms.py: using RAC 117 23:22:01.324794 tst mo_mt_sms.py: using CellId 17457 23:22:01.485293 tst mo_mt_sms.py: using BVCI 17458 23:22:01.607408 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 23:22:01.753507 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 23:22:01.899940 tst mo_mt_sms.py:9: start nitb and bts... 23:22:02.126062 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:22:02.765622 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27221): Launched 23:22:03.079671 run osmo-nitb_10.42.42.2(pid=27222): Launched 23:22:03.251258 run osmo-nitb_10.42.42.2(pid=27222): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27222)] 23:22:03.390046 run osmo-nitb_10.42.42.2(pid=27222): stdout: | (launched: 2022-12-08_23:22:03.020472) 23:22:03.530006 run osmo-nitb_10.42.42.2(pid=27222): stderr: | (launched: 2022-12-08_23:22:03.066552) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:22:03.669763 run osmo-nitb_10.42.42.2(pid=27222): stdout: | (launched: 2022-12-08_23:22:03.020472) 23:22:03.804148 run osmo-nitb_10.42.42.2(pid=27222): stderr: | (launched: 2022-12-08_23:22:03.066552) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6f22fc268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27222): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27222) [trial-2351↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27222)] 23:22:04.196917 tst osmo-nitb_10.42.42.2(pid=27222): stdout: | (launched: 2022-12-08_23:22:03.020472) 23:22:04.321717 tst osmo-nitb_10.42.42.2(pid=27222): stderr: | (launched: 2022-12-08_23:22:03.066552) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:22:04.468406 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=27222): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27222) [trial-2351↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27222)] [trial-2351↪nitb_sms:oc2g↪mo_mt_sms.py:11] 23:22:04.476865 tst mo_mt_sms.py:11: Test FAILED (3.5 sec) 23:22:04.483449 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27221): Terminating (SIGTERM) 23:22:04.692665 --- ParallelTerminationStrategy: PID 27221 died... 23:22:04.713911 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27221): Terminated: ok {rc=0} 23:22:04.799934 bus /sierra_3: Setting Powered False 23:22:05.901544 bus /sierra_3: Setting Powered False 23:22:07.019558 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 sms:oc2g --------------------------------------------------------------------- 23:22:08.216139 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:22:08.221667 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 23:22:08.243803 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 23:22:08.271283 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 23:22:08.324427 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 23:22:08.344786 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 23:22:08.371585 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 23:22:08.916334 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 sms:oc2g mo_mt_sms.py ---------------------------------------------- 23:22:08.921343 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 23:22:08.931705 tst sms:oc2g: Using 1 x bts (candidates: 1) 23:22:08.965652 tst mo_mt_sms.py: using LAC 17458 23:22:09.097291 tst mo_mt_sms.py: using RAC 118 23:22:09.227832 tst mo_mt_sms.py: using CellId 17458 23:22:09.358846 tst mo_mt_sms.py: using BVCI 17459 23:22:09.479588 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 23:22:09.490695 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 23:22:09.501585 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 23:22:09.512334 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 23:22:09.523253 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 23:22:09.534115 tst sms:oc2g: Using 1 x modem (candidates: 2) 23:22:09.649762 tst sms:oc2g: Using 1 x modem (candidates: 2) 23:22:09.765366 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:22:10.245166 run create_hlr_db(pid=27226): Launched 23:22:10.363183 bus /sierra_2: Setting Powered False 23:22:11.423831 run create_hlr_db(pid=27226): Terminated: ok {rc=0} 23:22:11.876927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27228): Launched 23:22:12.208921 run osmo-hlr_10.42.42.2(pid=27229): Launched 23:22:12.334500 run osmo-stp_10.42.42.5: Starting osmo-stp 23:22:12.904211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27231): Launched 23:22:13.237275 run osmo-stp_10.42.42.5(pid=27232): Launched 23:22:13.363036 run osmo-msc_10.42.42.6: Starting osmo-msc 23:22:13.964702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27234): Launched 23:22:14.297554 run osmo-msc_10.42.42.6(pid=27235): Launched 23:22:14.481218 run osmo-stp_10.42.42.5(pid=27232): ERR: Terminated: ERROR {rc=1} [trial-2351↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27232)] 23:22:14.619221 run osmo-stp_10.42.42.5(pid=27232): stdout: | (launched: 2022-12-08_23:22:13.174999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:14.758323 run osmo-stp_10.42.42.5(pid=27232): stderr: | [0;m[38;5;43m20221208232213371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232213371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232213371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232213372 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232213372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232213372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232213372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:14.897184 run osmo-stp_10.42.42.5(pid=27232): stdout: | (launched: 2022-12-08_23:22:13.174999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:15.027744 run osmo-stp_10.42.42.5(pid=27232): stderr: | [0;m[38;5;43m20221208232213371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232213371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232213371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232213372 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232213372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232213372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232213372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:15.185297 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=27232): Process ended prematurely: osmo-stp_10.42.42.5(pid=27232) [trial-2351↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27232)] [trial-2351↪sms:oc2g↪mo_mt_sms.py:16] 23:22:15.194396 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 23:22:15.221893 run osmo-hlr_10.42.42.2(pid=27229): ERR: Terminated: ERROR {rc=237} [trial-2351↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27229)] 23:22:15.271865 run osmo-hlr_10.42.42.2(pid=27229): stdout: | (launched: 2022-12-08_23:22:12.146598) 23:22:15.323987 run osmo-hlr_10.42.42.2(pid=27229): stderr: | [0;m[1;31m20221208232212346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232212346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232212346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232212347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232212347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232212347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232212362 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232212370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232212370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232212370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:22:15.396773 run osmo-msc_10.42.42.6(pid=27235): ERR: Terminated: ERROR {rc=2} [trial-2351↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27235)] 23:22:15.447235 run osmo-msc_10.42.42.6(pid=27235): stdout: | (launched: 2022-12-08_23:22:14.235078) 23:22:15.499189 run osmo-msc_10.42.42.6(pid=27235): stderr: | [0;m[38;5;43m20221208232214560 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208232214560 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f061f2a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208232214561 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208232214561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208232214561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208232214561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208232214565 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208232214565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208232214565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208232214565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:22:15.551488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27228): Terminating (SIGTERM) 23:22:15.593443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27231): Terminating (SIGTERM) 23:22:15.635344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27234): Terminating (SIGTERM) 23:22:15.677848 --- ParallelTerminationStrategy: PID 27228 died... 23:22:15.698049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27228): Terminated: ok {rc=0} 23:22:15.744394 --- ParallelTerminationStrategy: PID 27231 died... 23:22:15.764069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27231): Terminated: ok {rc=0} 23:22:15.810493 --- ParallelTerminationStrategy: PID 27234 died... 23:22:15.833281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27234): Terminated: ok {rc=0} 23:22:15.934577 bus /sierra_3: Setting Powered False 23:22:17.046686 bus /sierra_3: Setting Powered False 23:22:18.163539 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 nitb_ussd:oc2g --------------------------------------------------------------------- 23:22:19.382609 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:22:19.386669 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 23:22:19.407735 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 23:22:19.414966 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 23:22:19.451746 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 23:22:19.473425 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 23:22:19.480404 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 23:22:19.999319 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2351 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 23:22:20.005491 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 23:22:20.016091 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 23:22:20.051222 tst assert_extension.py: using LAC 17459 23:22:20.182032 tst assert_extension.py: using RAC 119 23:22:20.312065 tst assert_extension.py: using CellId 17459 23:22:20.442607 tst assert_extension.py: using BVCI 17460 23:22:20.561834 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 23:22:20.676554 tst assert_extension.py:10: start nitb and bts... 23:22:20.884476 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:22:21.513234 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27241): Launched 23:22:21.824539 run osmo-nitb_10.42.42.2(pid=27242): Launched 23:22:21.995886 run osmo-nitb_10.42.42.2(pid=27242): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27242)] 23:22:22.134674 run osmo-nitb_10.42.42.2(pid=27242): stdout: | (launched: 2022-12-08_23:22:21.765471) 23:22:22.274907 run osmo-nitb_10.42.42.2(pid=27242): stderr: | (launched: 2022-12-08_23:22:21.811359) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:22:22.415295 run osmo-nitb_10.42.42.2(pid=27242): stdout: | (launched: 2022-12-08_23:22:21.765471) 23:22:22.549985 run osmo-nitb_10.42.42.2(pid=27242): stderr: | (launched: 2022-12-08_23:22:21.811359) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6f22fc268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27242): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27242) [trial-2351↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27242)] 23:22:22.941655 tst osmo-nitb_10.42.42.2(pid=27242): stdout: | (launched: 2022-12-08_23:22:21.765471) 23:22:23.065674 tst osmo-nitb_10.42.42.2(pid=27242): stderr: | (launched: 2022-12-08_23:22:21.811359) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:22:23.212659 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=27242): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27242) [trial-2351↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27242)] [trial-2351↪nitb_ussd:oc2g↪assert_extension.py:12] 23:22:23.221078 tst assert_extension.py:12: Test FAILED (3.2 sec) 23:22:23.227740 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27241): Terminating (SIGTERM) 23:22:23.437285 --- ParallelTerminationStrategy: PID 27241 died... 23:22:23.457771 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27241): Terminated: ok {rc=0} 23:22:23.544251 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 ussd:oc2g --------------------------------------------------------------------- 23:22:24.710097 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:22:24.713800 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 23:22:24.734084 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 23:22:24.761688 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 23:22:24.797469 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 23:22:24.818090 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 23:22:24.844701 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 23:22:25.371244 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2351 ussd:oc2g assert_extension.py ---------------------------------------------- 23:22:25.376162 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 23:22:25.386769 tst ussd:oc2g: Using 1 x bts (candidates: 1) 23:22:25.422659 tst assert_extension.py: using LAC 17460 23:22:25.545373 tst assert_extension.py: using RAC 120 23:22:25.666243 tst assert_extension.py: using CellId 17460 23:22:25.786460 tst assert_extension.py: using BVCI 17461 23:22:25.899094 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 23:22:25.909694 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 23:22:25.920135 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 23:22:25.930888 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 23:22:25.941598 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 23:22:25.952152 tst ussd:oc2g: Using 1 x modem (candidates: 1) 23:22:26.065969 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:22:26.544440 run create_hlr_db(pid=27249): Launched 23:22:26.661284 bus /sierra_2: Setting Powered False 23:22:27.722518 run create_hlr_db(pid=27249): Terminated: ok {rc=0} 23:22:28.155063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27251): Launched 23:22:28.467208 run osmo-hlr_10.42.42.2(pid=27252): Launched 23:22:28.585810 run osmo-stp_10.42.42.5: Starting osmo-stp 23:22:29.125888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27254): Launched 23:22:29.437997 run osmo-stp_10.42.42.5(pid=27255): Launched 23:22:29.556013 run osmo-msc_10.42.42.6: Starting osmo-msc 23:22:30.120724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27257): Launched 23:22:30.431520 run osmo-msc_10.42.42.6(pid=27258): Launched 23:22:30.603972 run osmo-stp_10.42.42.5(pid=27255): ERR: Terminated: ERROR {rc=1} [trial-2351↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27255)] 23:22:30.734667 run osmo-stp_10.42.42.5(pid=27255): stdout: | (launched: 2022-12-08_23:22:29.379010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:30.888386 run osmo-stp_10.42.42.5(pid=27255): stderr: | [0;m[38;5;43m20221208232229553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232229553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232229553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232229553 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232229554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232229554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232229554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:31.034189 run osmo-stp_10.42.42.5(pid=27255): stdout: | (launched: 2022-12-08_23:22:29.379010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:31.160898 run osmo-stp_10.42.42.5(pid=27255): stderr: | [0;m[38;5;43m20221208232229553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232229553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232229553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232229553 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232229554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232229554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232229554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:31.312329 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=27255): Process ended prematurely: osmo-stp_10.42.42.5(pid=27255) [trial-2351↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27255)] [trial-2351↪ussd:oc2g↪assert_extension.py:17] 23:22:31.321838 tst assert_extension.py:17: Test FAILED (5.9 sec) 23:22:31.351639 run osmo-hlr_10.42.42.2(pid=27252): ERR: Terminated: ERROR {rc=237} [trial-2351↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27252)] 23:22:31.402300 run osmo-hlr_10.42.42.2(pid=27252): stdout: | (launched: 2022-12-08_23:22:28.407820) 23:22:31.454386 run osmo-hlr_10.42.42.2(pid=27252): stderr: | [0;m[1;31m20221208232228588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232228588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232228588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232228588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232228588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232228588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232228600 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232228609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232228609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232228609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:22:31.526296 run osmo-msc_10.42.42.6(pid=27258): ERR: Terminated: ERROR {rc=2} [trial-2351↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27258)] 23:22:31.576540 run osmo-msc_10.42.42.6(pid=27258): stdout: | (launched: 2022-12-08_23:22:30.372355) 23:22:31.629308 run osmo-msc_10.42.42.6(pid=27258): stderr: | [0;m[38;5;43m20221208232230647 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208232230647 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcc6bb63c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208232230647 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208232230647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208232230647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208232230647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208232230649 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208232230649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208232230650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208232230650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:22:31.682046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27251): Terminating (SIGTERM) 23:22:31.724519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27254): Terminating (SIGTERM) 23:22:31.766991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27257): Terminating (SIGTERM) 23:22:31.809785 --- ParallelTerminationStrategy: PID 27251 died... 23:22:31.829493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27251): Terminated: ok {rc=0} 23:22:31.877284 --- ParallelTerminationStrategy: PID 27254 died... 23:22:31.896915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27254): Terminated: ok {rc=0} 23:22:31.944697 --- ParallelTerminationStrategy: PID 27257 died... 23:22:31.964423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27257): Terminated: ok {rc=0} 23:22:32.057460 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 23:22:33.259100 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:22:33.265761 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 23:22:33.287189 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 23:22:33.314412 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 23:22:33.366044 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 23:22:33.387234 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 23:22:33.414406 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 23:22:33.965980 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 23:22:34.020195 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:34.031884 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:22:34.089338 tst mo_mt_call.py: using LAC 17461 23:22:34.222340 tst mo_mt_call.py: using RAC 121 23:22:34.353535 tst mo_mt_call.py: using CellId 17461 23:22:34.485565 tst mo_mt_call.py: using BVCI 17462 23:22:34.607762 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:34.619308 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:34.630679 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:34.641986 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:34.653446 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:34.664731 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:22:34.782340 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:22:34.903068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:22:35.426850 run create_hlr_db(pid=27264): Launched 23:22:35.563501 bus /sierra_2: Setting Powered False 23:22:36.630182 run create_hlr_db(pid=27264): Terminated: ok {rc=0} 23:22:37.099541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27268): Launched 23:22:37.439919 run osmo-hlr_10.42.42.2(pid=27269): Launched 23:22:37.570120 run osmo-stp_10.42.42.5: Starting osmo-stp 23:22:38.152280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27271): Launched 23:22:38.492499 run osmo-stp_10.42.42.5(pid=27272): Launched 23:22:38.621174 run osmo-msc_10.42.42.6: Starting osmo-msc 23:22:39.233542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27274): Launched 23:22:39.573203 run osmo-msc_10.42.42.6(pid=27275): Launched 23:22:39.760477 run osmo-stp_10.42.42.5(pid=27272): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27272)] 23:22:39.901932 run osmo-stp_10.42.42.5(pid=27272): stdout: | (launched: 2022-12-08_23:22:38.428274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:40.043603 run osmo-stp_10.42.42.5(pid=27272): stderr: | [0;m[38;5;43m20221208232238625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232238625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232238626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232238626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232238626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232238626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232238626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:40.183642 run osmo-stp_10.42.42.5(pid=27272): stdout: | (launched: 2022-12-08_23:22:38.428274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:40.316804 run osmo-stp_10.42.42.5(pid=27272): stderr: | [0;m[38;5;43m20221208232238625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232238625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232238626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232238626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232238626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232238626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232238626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:40.476835 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27272): Process ended prematurely: osmo-stp_10.42.42.5(pid=27272) [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27272)] [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 23:22:40.486418 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 23:22:40.514300 run osmo-hlr_10.42.42.2(pid=27269): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27269)] 23:22:40.564385 run osmo-hlr_10.42.42.2(pid=27269): stdout: | (launched: 2022-12-08_23:22:37.376349) 23:22:40.616353 run osmo-hlr_10.42.42.2(pid=27269): stderr: | [0;m[1;31m20221208232237580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232237580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232237580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232237580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232237580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232237580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232237592 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232237601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232237602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232237602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:22:40.688600 run osmo-msc_10.42.42.6(pid=27275): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27275)] 23:22:40.738517 run osmo-msc_10.42.42.6(pid=27275): stdout: | (launched: 2022-12-08_23:22:39.509913) 23:22:40.790395 run osmo-msc_10.42.42.6(pid=27275): stderr: | [0;m[38;5;43m20221208232239836 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208232239836 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd609930c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208232239836 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208232239836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208232239837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208232239837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208232239838 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208232239839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208232239839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208232239839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:22:40.842903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27268): Terminating (SIGTERM) 23:22:40.884715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27271): Terminating (SIGTERM) 23:22:40.926661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27274): Terminating (SIGTERM) 23:22:40.968798 --- ParallelTerminationStrategy: PID 27268 died... 23:22:40.988857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27268): Terminated: ok {rc=0} 23:22:41.035010 --- ParallelTerminationStrategy: PID 27271 died... 23:22:41.054691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27271): Terminated: ok {rc=0} 23:22:41.100873 --- ParallelTerminationStrategy: PID 27274 died... 23:22:41.120917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27274): Terminated: ok {rc=0} 23:22:41.208523 bus /sierra_3: Setting Powered False 23:22:42.308722 bus /sierra_3: Setting Powered False 23:22:43.424772 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 23:22:44.576649 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:44.589449 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:22:44.651366 tst mo_mt_call_osmux.py: using LAC 17462 23:22:44.782753 tst mo_mt_call_osmux.py: using RAC 122 23:22:44.913400 tst mo_mt_call_osmux.py: using CellId 17462 23:22:45.043181 tst mo_mt_call_osmux.py: using BVCI 17463 23:22:45.165771 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:45.177390 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:45.188727 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:45.200089 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:45.211470 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:45.222933 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:22:45.342649 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:22:45.464367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:22:46.001723 run create_hlr_db(pid=27277): Launched 23:22:46.171170 bus /sierra_2: Setting Powered False 23:22:47.245758 run create_hlr_db(pid=27277): Terminated: ok {rc=0} 23:22:47.697330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27279): Launched 23:22:48.014400 run osmo-hlr_10.42.42.2(pid=27280): Launched 23:22:48.134269 run osmo-stp_10.42.42.5: Starting osmo-stp 23:22:48.688304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27282): Launched 23:22:49.006253 run osmo-stp_10.42.42.5(pid=27283): Launched 23:22:49.127368 run osmo-msc_10.42.42.6: Starting osmo-msc 23:22:49.698579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27285): Launched 23:22:50.016496 run osmo-msc_10.42.42.6(pid=27286): Launched 23:22:50.193899 run osmo-stp_10.42.42.5(pid=27283): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27283)] 23:22:50.327258 run osmo-stp_10.42.42.5(pid=27283): stdout: | (launched: 2022-12-08_23:22:48.946053) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:50.460573 run osmo-stp_10.42.42.5(pid=27283): stderr: | [0;m[38;5;43m20221208232249120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232249120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232249120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232249121 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232249121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232249121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232249121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:50.591295 run osmo-stp_10.42.42.5(pid=27283): stdout: | (launched: 2022-12-08_23:22:48.946053) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:50.716239 run osmo-stp_10.42.42.5(pid=27283): stderr: | [0;m[38;5;43m20221208232249120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232249120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232249120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232249121 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232249121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232249121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232249121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:50.865939 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27283): Process ended prematurely: osmo-stp_10.42.42.5(pid=27283) [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27283)] [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 23:22:50.874748 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 23:22:50.901681 run osmo-hlr_10.42.42.2(pid=27280): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27280)] 23:22:50.950177 run osmo-hlr_10.42.42.2(pid=27280): stdout: | (launched: 2022-12-08_23:22:47.954482) 23:22:50.999802 run osmo-hlr_10.42.42.2(pid=27280): stderr: | [0;m[1;31m20221208232248135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232248135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232248135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232248135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232248136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232248136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232248151 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232248161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232248162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232248162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:22:51.068826 run osmo-msc_10.42.42.6(pid=27286): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27286)] 23:22:51.116786 run osmo-msc_10.42.42.6(pid=27286): stdout: | (launched: 2022-12-08_23:22:49.956532) 23:22:51.166369 run osmo-msc_10.42.42.6(pid=27286): stderr: | [0;m[38;5;43m20221208232250233 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208232250233 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f55db1c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208232250233 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208232250233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208232250234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208232250234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208232250235 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208232250236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208232250236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208232250236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:22:51.216214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27279): Terminating (SIGTERM) 23:22:51.255869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27282): Terminating (SIGTERM) 23:22:51.295377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27285): Terminating (SIGTERM) 23:22:51.335325 --- ParallelTerminationStrategy: PID 27279 died... 23:22:51.354407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27279): Terminated: ok {rc=0} 23:22:51.398791 --- ParallelTerminationStrategy: PID 27282 died... 23:22:51.417412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27282): Terminated: ok {rc=0} 23:22:51.461478 --- ParallelTerminationStrategy: PID 27285 died... 23:22:51.479903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27285): Terminated: ok {rc=0} 23:22:51.565519 bus /sierra_3: Setting Powered False 23:22:52.665327 bus /sierra_3: Setting Powered False 23:22:53.781354 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 23:22:55.014248 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:22:55.020524 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 23:22:55.041661 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 23:22:55.068599 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 23:22:55.122283 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 23:22:55.143846 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 23:22:55.170602 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 23:22:55.717991 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 23:22:55.768326 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:22:55.779456 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:22:55.835330 tst mo_mt_call.py: using LAC 17463 23:22:55.960230 tst mo_mt_call.py: using RAC 123 23:22:56.083980 tst mo_mt_call.py: using CellId 17463 23:22:56.207266 tst mo_mt_call.py: using BVCI 17464 23:22:56.322918 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:22:56.334080 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:22:56.344917 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:22:56.356073 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:22:56.367183 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:22:56.378264 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:22:56.496303 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:22:56.613471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:22:57.106046 run create_hlr_db(pid=27291): Launched 23:22:57.226405 bus /sierra_2: Setting Powered False 23:22:58.289098 run create_hlr_db(pid=27291): Terminated: ok {rc=0} 23:22:58.751665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27293): Launched 23:22:59.092033 run osmo-hlr_10.42.42.2(pid=27294): Launched 23:22:59.220711 run osmo-stp_10.42.42.5: Starting osmo-stp 23:22:59.804331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27296): Launched 23:23:00.144622 run osmo-stp_10.42.42.5(pid=27297): Launched 23:23:00.273299 run osmo-msc_10.42.42.6: Starting osmo-msc 23:23:00.886076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27299): Launched 23:23:01.265651 run osmo-msc_10.42.42.6(pid=27312): Launched 23:23:01.712555 run osmo-stp_10.42.42.5(pid=27297): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27297)] 23:23:02.005862 run osmo-stp_10.42.42.5(pid=27297): stdout: | (launched: 2022-12-08_23:23:00.080900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:02.266987 run osmo-stp_10.42.42.5(pid=27297): stderr: | [0;m[38;5;43m20221208232300279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232300280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232300280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232300280 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232300281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232300281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232300281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:02.448548 run osmo-stp_10.42.42.5(pid=27297): stdout: | (launched: 2022-12-08_23:23:00.080900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:02.597595 run osmo-stp_10.42.42.5(pid=27297): stderr: | [0;m[38;5;43m20221208232300279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232300280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232300280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232300280 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232300281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232300281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232300281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:02.760396 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27297): Process ended prematurely: osmo-stp_10.42.42.5(pid=27297) [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27297)] [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 23:23:02.775112 tst mo_mt_call.py:8: Test FAILED (7.0 sec) 23:23:02.811295 run osmo-hlr_10.42.42.2(pid=27294): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27294)] 23:23:02.866180 run osmo-hlr_10.42.42.2(pid=27294): stdout: | (launched: 2022-12-08_23:22:59.028255) 23:23:02.924597 run osmo-hlr_10.42.42.2(pid=27294): stderr: | [0;m[1;31m20221208232259232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232259232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232259232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232259232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232259232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232259232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232259249 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232259259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232259259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232259259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:23:02.998671 run osmo-msc_10.42.42.6(pid=27312): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27312)] 23:23:03.057736 run osmo-msc_10.42.42.6(pid=27312): stdout: | (launched: 2022-12-08_23:23:01.173742) 23:23:03.113059 run osmo-msc_10.42.42.6(pid=27312): stderr: | [0;m[38;5;43m20221208232301750 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208232301750 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f08be3ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208232301750 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208232301750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208232301750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208232301750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208232301752 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208232301752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208232301753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208232301753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:23:03.169472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27293): Terminating (SIGTERM) 23:23:03.223391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27296): Terminating (SIGTERM) 23:23:03.277959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27299): Terminating (SIGTERM) 23:23:03.334735 --- ParallelTerminationStrategy: PID 27293 died... 23:23:03.361244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27293): Terminated: ok {rc=0} 23:23:03.421339 --- ParallelTerminationStrategy: PID 27296 died... 23:23:03.445742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27296): Terminated: ok {rc=0} 23:23:03.501499 --- ParallelTerminationStrategy: PID 27299 died... 23:23:03.525988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27299): Terminated: ok {rc=0} 23:23:03.641357 bus /sierra_3: Setting Powered False 23:23:04.747105 bus /sierra_3: Setting Powered False 23:23:05.868331 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 23:23:07.025606 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:23:07.039137 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:23:07.097302 tst mo_mt_call_osmux.py: using LAC 17464 23:23:07.232486 tst mo_mt_call_osmux.py: using RAC 124 23:23:07.367762 tst mo_mt_call_osmux.py: using CellId 17464 23:23:07.502060 tst mo_mt_call_osmux.py: using BVCI 17465 23:23:07.630435 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:23:07.643469 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:23:07.656137 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:23:07.669355 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:23:07.681885 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:23:07.694297 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:23:07.819459 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:23:07.951424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:23:08.488462 run create_hlr_db(pid=27573): Launched 23:23:08.663248 bus /sierra_2: Setting Powered False 23:23:09.733927 run create_hlr_db(pid=27573): Terminated: ok {rc=0} 23:23:10.220884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27575): Launched 23:23:10.582444 run osmo-hlr_10.42.42.2(pid=27576): Launched 23:23:10.836518 run osmo-stp_10.42.42.5: Starting osmo-stp 23:23:11.542025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27578): Launched 23:23:11.906070 run osmo-stp_10.42.42.5(pid=27579): Launched 23:23:12.164678 run osmo-msc_10.42.42.6: Starting osmo-msc 23:23:12.873498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27581): Launched 23:23:13.236799 run osmo-msc_10.42.42.6(pid=27582): Launched 23:23:13.617500 run osmo-stp_10.42.42.5(pid=27579): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27579)] 23:23:13.908396 run osmo-stp_10.42.42.5(pid=27579): stdout: | (launched: 2022-12-08_23:23:11.837270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:14.081325 run osmo-stp_10.42.42.5(pid=27579): stderr: | [0;m[38;5;43m20221208232312145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232312145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232312145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232312145 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232312148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232312148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232312148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:14.228565 run osmo-stp_10.42.42.5(pid=27579): stdout: | (launched: 2022-12-08_23:23:11.837270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:14.366760 run osmo-stp_10.42.42.5(pid=27579): stderr: | [0;m[38;5;43m20221208232312145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232312145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232312145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232312145 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232312148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232312148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232312148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:14.533030 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27579): Process ended prematurely: osmo-stp_10.42.42.5(pid=27579) [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27579)] [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 23:23:14.543919 tst mo_mt_call_osmux.py:8: Test FAILED (7.6 sec) 23:23:14.574041 run osmo-hlr_10.42.42.2(pid=27576): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27576)] 23:23:14.627737 run osmo-hlr_10.42.42.2(pid=27576): stdout: | (launched: 2022-12-08_23:23:10.515795) 23:23:14.682469 run osmo-hlr_10.42.42.2(pid=27576): stderr: | [0;m[1;31m20221208232310838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232310838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232310838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232310838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232310838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232310838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232310850 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232310858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232310858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232310858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:23:14.758506 run osmo-msc_10.42.42.6(pid=27582): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27582)] 23:23:14.811748 run osmo-msc_10.42.42.6(pid=27582): stdout: | (launched: 2022-12-08_23:23:13.168678) 23:23:14.869619 run osmo-msc_10.42.42.6(pid=27582): stderr: | [0;m[38;5;43m20221208232313679 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208232313679 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f191a15ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208232313680 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208232313680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208232313680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208232313680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208232313690 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208232313691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208232313691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208232313691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:23:14.924093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27575): Terminating (SIGTERM) 23:23:14.968110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27578): Terminating (SIGTERM) 23:23:15.015020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27581): Terminating (SIGTERM) 23:23:15.060914 --- ParallelTerminationStrategy: PID 27575 died... 23:23:15.082045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27575): Terminated: ok {rc=0} 23:23:15.131028 --- ParallelTerminationStrategy: PID 27578 died... 23:23:15.152066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27578): Terminated: ok {rc=0} 23:23:15.201147 --- ParallelTerminationStrategy: PID 27581 died... 23:23:15.221841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27581): Terminated: ok {rc=0} 23:23:15.313261 bus /sierra_3: Setting Powered False 23:23:16.436923 bus /sierra_3: Setting Powered False 23:23:17.593444 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 23:23:18.839237 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:23:18.847156 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 23:23:18.872257 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 23:23:18.900926 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 23:23:18.953890 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 23:23:18.975891 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 23:23:19.005139 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 23:23:19.554734 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 23:23:19.612792 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:19.625056 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:23:19.683990 tst mo_mt_call.py: using LAC 17465 23:23:19.820231 tst mo_mt_call.py: using RAC 125 23:23:19.959891 tst mo_mt_call.py: using CellId 17465 23:23:20.096278 tst mo_mt_call.py: using BVCI 17466 23:23:20.225001 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:20.237860 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:20.250222 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:20.262987 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:20.275747 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:20.288221 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:23:20.415304 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:23:20.541506 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:23:21.091099 run create_hlr_db(pid=27587): Launched 23:23:21.266341 bus /sierra_2: Setting Powered False 23:23:22.334411 run create_hlr_db(pid=27587): Terminated: ok {rc=0} 23:23:22.825439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27589): Launched 23:23:23.190676 run osmo-hlr_10.42.42.2(pid=27590): Launched 23:23:23.451082 run osmo-stp_10.42.42.5: Starting osmo-stp 23:23:24.156770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27593): Launched 23:23:24.474976 run osmo-stp_10.42.42.5(pid=27594): Launched 23:23:24.595387 run osmo-msc_10.42.42.6: Starting osmo-msc 23:23:25.166908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27596): Launched 23:23:25.485293 run osmo-msc_10.42.42.6(pid=27597): Launched 23:23:25.663021 run osmo-stp_10.42.42.5(pid=27594): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27594)] 23:23:25.797686 run osmo-stp_10.42.42.5(pid=27594): stdout: | (launched: 2022-12-08_23:23:24.415076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:25.930757 run osmo-stp_10.42.42.5(pid=27594): stderr: | [0;m[38;5;43m20221208232324589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232324589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232324590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232324590 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232324591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232324591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232324591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:26.061459 run osmo-stp_10.42.42.5(pid=27594): stdout: | (launched: 2022-12-08_23:23:24.415076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:26.187299 run osmo-stp_10.42.42.5(pid=27594): stderr: | [0;m[38;5;43m20221208232324589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232324589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232324590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232324590 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232324591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232324591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232324591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:26.337013 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27594): Process ended prematurely: osmo-stp_10.42.42.5(pid=27594) [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27594)] [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 23:23:26.345904 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 23:23:26.372907 run osmo-hlr_10.42.42.2(pid=27590): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27590)] 23:23:26.421483 run osmo-hlr_10.42.42.2(pid=27590): stdout: | (launched: 2022-12-08_23:23:23.122691) 23:23:26.471650 run osmo-hlr_10.42.42.2(pid=27590): stderr: | [0;m[1;31m20221208232323441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232323441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232323441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232323441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232323442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232323442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232323461 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232323474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232323474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232323474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:23:26.541714 run osmo-msc_10.42.42.6(pid=27597): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27597)] 23:23:26.590002 run osmo-msc_10.42.42.6(pid=27597): stdout: | (launched: 2022-12-08_23:23:25.425478) 23:23:26.639893 run osmo-msc_10.42.42.6(pid=27597): stderr: | [0;m[38;5;43m20221208232325704 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208232325704 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0f63a9bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208232325704 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208232325704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208232325704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208232325704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208232325706 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208232325707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208232325707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208232325707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:23:26.690343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27589): Terminating (SIGTERM) 23:23:26.730348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27593): Terminating (SIGTERM) 23:23:26.770576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27596): Terminating (SIGTERM) 23:23:26.810965 --- ParallelTerminationStrategy: PID 27589 died... 23:23:26.830167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27589): Terminated: ok {rc=0} 23:23:26.874739 --- ParallelTerminationStrategy: PID 27593 died... 23:23:26.893459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27593): Terminated: ok {rc=0} 23:23:26.938044 --- ParallelTerminationStrategy: PID 27596 died... 23:23:26.956677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27596): Terminated: ok {rc=0} 23:23:27.040766 bus /sierra_3: Setting Powered False 23:23:28.139919 bus /sierra_3: Setting Powered False 23:23:29.257218 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:23:30.408552 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:30.420910 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:23:30.479466 tst mo_mt_call_osmux.py: using LAC 17466 23:23:30.611338 tst mo_mt_call_osmux.py: using RAC 126 23:23:30.745140 tst mo_mt_call_osmux.py: using CellId 17466 23:23:30.885649 tst mo_mt_call_osmux.py: using BVCI 17467 23:23:31.017279 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:31.030165 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:31.042133 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:31.055900 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:31.069644 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:31.081768 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:23:31.204096 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:23:31.328816 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:23:31.975858 run create_hlr_db(pid=27599): Launched 23:23:32.144710 bus /sierra_2: Setting Powered False 23:23:33.211146 run create_hlr_db(pid=27599): Terminated: ok {rc=0} 23:23:33.662163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27601): Launched 23:23:33.983188 run osmo-hlr_10.42.42.2(pid=27602): Launched 23:23:34.103465 run osmo-stp_10.42.42.5: Starting osmo-stp 23:23:34.664180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27604): Launched 23:23:34.982752 run osmo-stp_10.42.42.5(pid=27605): Launched 23:23:35.112544 run osmo-msc_10.42.42.6: Starting osmo-msc 23:23:35.726558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27607): Launched 23:23:36.066674 run osmo-msc_10.42.42.6(pid=27608): Launched 23:23:36.253785 run osmo-stp_10.42.42.5(pid=27605): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27605)] 23:23:36.394157 run osmo-stp_10.42.42.5(pid=27605): stdout: | (launched: 2022-12-08_23:23:34.922229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:36.536261 run osmo-stp_10.42.42.5(pid=27605): stderr: | [0;m[38;5;43m20221208232335114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232335114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232335114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232335114 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232335115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232335115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232335115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:36.676441 run osmo-stp_10.42.42.5(pid=27605): stdout: | (launched: 2022-12-08_23:23:34.922229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:36.810304 run osmo-stp_10.42.42.5(pid=27605): stderr: | [0;m[38;5;43m20221208232335114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232335114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232335114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232335114 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232335115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232335115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232335115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:36.970868 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27605): Process ended prematurely: osmo-stp_10.42.42.5(pid=27605) [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27605)] [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:23:36.980361 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 23:23:37.009063 run osmo-hlr_10.42.42.2(pid=27602): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27602)] 23:23:37.059277 run osmo-hlr_10.42.42.2(pid=27602): stdout: | (launched: 2022-12-08_23:23:33.923131) 23:23:37.111703 run osmo-hlr_10.42.42.2(pid=27602): stderr: | [0;m[1;31m20221208232334102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232334102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232334102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232334102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232334102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232334102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232334114 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232334122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232334123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232334123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:23:37.184754 run osmo-msc_10.42.42.6(pid=27608): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27608)] 23:23:37.235055 run osmo-msc_10.42.42.6(pid=27608): stdout: | (launched: 2022-12-08_23:23:36.003115) 23:23:37.287108 run osmo-msc_10.42.42.6(pid=27608): stderr: | [0;m[38;5;43m20221208232336331 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208232336331 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0883e35c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208232336331 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208232336331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208232336331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208232336332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208232336333 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208232336334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208232336334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208232336334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:23:37.339719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27601): Terminating (SIGTERM) 23:23:37.381555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27604): Terminating (SIGTERM) 23:23:37.423585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27607): Terminating (SIGTERM) 23:23:37.465904 --- ParallelTerminationStrategy: PID 27601 died... 23:23:37.486062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27601): Terminated: ok {rc=0} 23:23:37.532552 --- ParallelTerminationStrategy: PID 27604 died... 23:23:37.552311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27604): Terminated: ok {rc=0} 23:23:37.598652 --- ParallelTerminationStrategy: PID 27607 died... 23:23:37.618422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27607): Terminated: ok {rc=0} 23:23:37.705528 bus /sierra_3: Setting Powered False 23:23:38.804759 bus /sierra_3: Setting Powered False 23:23:39.921945 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 23:23:41.157607 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:23:41.164097 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 23:23:41.185743 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 23:23:41.212312 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 23:23:41.265430 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 23:23:41.286358 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 23:23:41.312939 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 23:23:41.861592 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 23:23:41.912433 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:41.923495 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:23:41.978970 tst mo_mt_call.py: using LAC 17467 23:23:42.103618 tst mo_mt_call.py: using RAC 127 23:23:42.228627 tst mo_mt_call.py: using CellId 17467 23:23:42.353388 tst mo_mt_call.py: using BVCI 17468 23:23:42.469759 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:42.480790 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:42.491688 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:42.502744 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:42.513529 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:42.524839 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:23:42.646152 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:23:42.768432 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:23:43.293281 run create_hlr_db(pid=27613): Launched 23:23:43.430698 bus /sierra_2: Setting Powered False 23:23:44.496399 run create_hlr_db(pid=27613): Terminated: ok {rc=0} 23:23:44.948394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27615): Launched 23:23:45.266824 run osmo-hlr_10.42.42.2(pid=27616): Launched 23:23:45.388064 run osmo-stp_10.42.42.5: Starting osmo-stp 23:23:45.964186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27618): Launched 23:23:46.306285 run osmo-stp_10.42.42.5(pid=27619): Launched 23:23:46.548519 run osmo-msc_10.42.42.6: Starting osmo-msc 23:23:47.261464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27621): Launched 23:23:47.578960 run osmo-msc_10.42.42.6(pid=27622): Launched 23:23:47.755606 run osmo-stp_10.42.42.5(pid=27619): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27619)] 23:23:47.889692 run osmo-stp_10.42.42.5(pid=27619): stdout: | (launched: 2022-12-08_23:23:46.241578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:48.022856 run osmo-stp_10.42.42.5(pid=27619): stderr: | [0;m[38;5;43m20221208232346582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232346582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232346583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232346583 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232346584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232346584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232346584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:48.153639 run osmo-stp_10.42.42.5(pid=27619): stdout: | (launched: 2022-12-08_23:23:46.241578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:48.278558 run osmo-stp_10.42.42.5(pid=27619): stderr: | [0;m[38;5;43m20221208232346582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232346582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232346583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232346583 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232346584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232346584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232346584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:48.428164 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27619): Process ended prematurely: osmo-stp_10.42.42.5(pid=27619) [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27619)] [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 23:23:48.437206 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 23:23:48.464465 run osmo-hlr_10.42.42.2(pid=27616): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27616)] 23:23:48.512849 run osmo-hlr_10.42.42.2(pid=27616): stdout: | (launched: 2022-12-08_23:23:45.206862) 23:23:48.562939 run osmo-hlr_10.42.42.2(pid=27616): stderr: | [0;m[1;31m20221208232345388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232345388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232345388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232345388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232345388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232345388 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232345403 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232345413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232345413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232345413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:23:48.632727 run osmo-msc_10.42.42.6(pid=27622): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27622)] 23:23:48.680762 run osmo-msc_10.42.42.6(pid=27622): stdout: | (launched: 2022-12-08_23:23:47.518913) 23:23:48.730664 run osmo-msc_10.42.42.6(pid=27622): stderr: | [0;m[38;5;43m20221208232347795 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208232347796 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fda13cfdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208232347796 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208232347796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208232347796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208232347796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208232347798 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208232347798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208232347798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208232347799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:23:48.780940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27615): Terminating (SIGTERM) 23:23:48.821094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27618): Terminating (SIGTERM) 23:23:48.861270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27621): Terminating (SIGTERM) 23:23:48.901695 --- ParallelTerminationStrategy: PID 27615 died... 23:23:48.920868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27615): Terminated: ok {rc=0} 23:23:48.966039 --- ParallelTerminationStrategy: PID 27618 died... 23:23:48.984466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27618): Terminated: ok {rc=0} 23:23:49.029075 --- ParallelTerminationStrategy: PID 27621 died... 23:23:49.047660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27621): Terminated: ok {rc=0} 23:23:49.132572 bus /sierra_3: Setting Powered False 23:23:50.232300 bus /sierra_3: Setting Powered False 23:23:51.349439 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 23:23:52.501035 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:52.513185 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:23:52.571994 tst mo_mt_call_osmux.py: using LAC 17468 23:23:52.704558 tst mo_mt_call_osmux.py: using RAC 128 23:23:52.836001 tst mo_mt_call_osmux.py: using CellId 17468 23:23:52.959896 tst mo_mt_call_osmux.py: using BVCI 17469 23:23:53.075754 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:53.086893 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:53.098032 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:53.109140 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:53.120321 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:53.131421 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:23:53.252735 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:23:53.376214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:23:53.902650 run create_hlr_db(pid=27624): Launched 23:23:54.039834 bus /sierra_2: Setting Powered False 23:23:55.105534 run create_hlr_db(pid=27624): Terminated: ok {rc=0} 23:23:55.558134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27626): Launched 23:23:55.878267 run osmo-hlr_10.42.42.2(pid=27627): Launched 23:23:55.998790 run osmo-stp_10.42.42.5: Starting osmo-stp 23:23:56.556780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27629): Launched 23:23:56.876487 run osmo-stp_10.42.42.5(pid=27630): Launched 23:23:56.998170 run osmo-msc_10.42.42.6: Starting osmo-msc 23:23:57.568348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27632): Launched 23:23:57.886058 run osmo-msc_10.42.42.6(pid=27633): Launched 23:23:58.061740 run osmo-stp_10.42.42.5(pid=27630): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27630)] 23:23:58.194758 run osmo-stp_10.42.42.5(pid=27630): stdout: | (launched: 2022-12-08_23:23:56.815847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:58.327258 run osmo-stp_10.42.42.5(pid=27630): stderr: | [0;m[38;5;43m20221208232356992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232356992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232356992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232356993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232356993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232356993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232356993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:58.457907 run osmo-stp_10.42.42.5(pid=27630): stdout: | (launched: 2022-12-08_23:23:56.815847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:58.582951 run osmo-stp_10.42.42.5(pid=27630): stderr: | [0;m[38;5;43m20221208232356992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232356992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232356992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232356993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232356993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232356993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232356993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:58.732099 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27630): Process ended prematurely: osmo-stp_10.42.42.5(pid=27630) [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27630)] [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 23:23:58.741503 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 23:23:58.768453 run osmo-hlr_10.42.42.2(pid=27627): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27627)] 23:23:58.815932 run osmo-hlr_10.42.42.2(pid=27627): stdout: | (launched: 2022-12-08_23:23:55.817589) 23:23:58.865347 run osmo-hlr_10.42.42.2(pid=27627): stderr: | [0;m[1;31m20221208232356001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232356001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232356001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232356001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232356001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232356001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232356012 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232356020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232356020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232356020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:23:58.934183 run osmo-msc_10.42.42.6(pid=27633): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27633)] 23:23:58.981484 run osmo-msc_10.42.42.6(pid=27633): stdout: | (launched: 2022-12-08_23:23:57.826097) 23:23:59.030449 run osmo-msc_10.42.42.6(pid=27633): stderr: | [0;m[38;5;43m20221208232358103 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208232358104 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f77212aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208232358104 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208232358104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208232358104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208232358104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208232358107 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208232358108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208232358108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208232358108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:23:59.079720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27626): Terminating (SIGTERM) 23:23:59.119233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27629): Terminating (SIGTERM) 23:23:59.158890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27632): Terminating (SIGTERM) 23:23:59.199044 --- ParallelTerminationStrategy: PID 27626 died... 23:23:59.218088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27626): Terminated: ok {rc=0} 23:23:59.262886 --- ParallelTerminationStrategy: PID 27629 died... 23:23:59.281557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27629): Terminated: ok {rc=0} 23:23:59.326294 --- ParallelTerminationStrategy: PID 27632 died... 23:23:59.344906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27632): Terminated: ok {rc=0} 23:23:59.431164 bus /sierra_3: Setting Powered False 23:24:00.530986 bus /sierra_3: Setting Powered False 23:24:01.658888 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:24:02.914174 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:24:02.921396 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:24:02.942593 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:24:02.970013 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:24:03.023362 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:24:03.044560 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:24:03.071901 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:24:03.622515 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:24:03.675995 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:03.687418 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:24:03.744926 tst mo_mt_call.py: using LAC 17469 23:24:03.877798 tst mo_mt_call.py: using RAC 129 23:24:04.010084 tst mo_mt_call.py: using CellId 17469 23:24:04.142697 tst mo_mt_call.py: using BVCI 17470 23:24:04.266753 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:04.278347 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:04.289666 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:04.300893 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:04.312189 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:04.323500 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:24:04.442450 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:24:04.559684 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:05.052112 run create_hlr_db(pid=27638): Launched 23:24:05.174096 bus /sierra_2: Setting Powered False 23:24:06.236401 run create_hlr_db(pid=27638): Terminated: ok {rc=0} 23:24:06.699217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27640): Launched 23:24:07.040022 run osmo-hlr_10.42.42.2(pid=27641): Launched 23:24:07.169150 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:07.755984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27643): Launched 23:24:08.097220 run osmo-stp_10.42.42.5(pid=27644): Launched 23:24:08.225380 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:08.837767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27646): Launched 23:24:09.178656 run osmo-msc_10.42.42.6(pid=27647): Launched 23:24:09.368809 run osmo-stp_10.42.42.5(pid=27644): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27644)] 23:24:09.510693 run osmo-stp_10.42.42.5(pid=27644): stdout: | (launched: 2022-12-08_23:24:08.033511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:09.652940 run osmo-stp_10.42.42.5(pid=27644): stderr: | [0;m[38;5;43m20221208232408230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232408231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232408231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232408231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232408232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232408232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232408232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:09.794030 run osmo-stp_10.42.42.5(pid=27644): stdout: | (launched: 2022-12-08_23:24:08.033511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:09.928739 run osmo-stp_10.42.42.5(pid=27644): stderr: | [0;m[38;5;43m20221208232408230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232408231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232408231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232408231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232408232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232408232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232408232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:10.090275 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27644): Process ended prematurely: osmo-stp_10.42.42.5(pid=27644) [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27644)] [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:24:10.099811 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 23:24:10.127902 run osmo-hlr_10.42.42.2(pid=27641): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27641)] 23:24:10.178269 run osmo-hlr_10.42.42.2(pid=27641): stdout: | (launched: 2022-12-08_23:24:06.976450) 23:24:10.230201 run osmo-hlr_10.42.42.2(pid=27641): stderr: | [0;m[1;31m20221208232407180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232407180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232407180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232407180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232407180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232407180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232407194 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232407203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232407203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232407203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:10.302655 run osmo-msc_10.42.42.6(pid=27647): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27647)] 23:24:10.353522 run osmo-msc_10.42.42.6(pid=27647): stdout: | (launched: 2022-12-08_23:24:09.114767) 23:24:10.405520 run osmo-msc_10.42.42.6(pid=27647): stderr: | [0;m[38;5;43m20221208232409444 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208232409444 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1ed2ae0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208232409444 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208232409444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208232409445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208232409445 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208232409446 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208232409447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208232409447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208232409447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:10.457969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27640): Terminating (SIGTERM) 23:24:10.500039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27643): Terminating (SIGTERM) 23:24:10.542034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27646): Terminating (SIGTERM) 23:24:10.584455 --- ParallelTerminationStrategy: PID 27640 died... 23:24:10.604340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27640): Terminated: ok {rc=0} 23:24:10.650929 --- ParallelTerminationStrategy: PID 27643 died... 23:24:10.670755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27643): Terminated: ok {rc=0} 23:24:10.717209 --- ParallelTerminationStrategy: PID 27646 died... 23:24:10.736677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27646): Terminated: ok {rc=0} 23:24:10.824458 bus /sierra_3: Setting Powered False 23:24:11.925322 bus /sierra_3: Setting Powered False 23:24:13.042298 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:24:14.188552 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:14.200155 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:24:14.255715 tst mo_mt_call_osmux.py: using LAC 17470 23:24:14.378241 tst mo_mt_call_osmux.py: using RAC 130 23:24:14.501308 tst mo_mt_call_osmux.py: using CellId 17470 23:24:14.622853 tst mo_mt_call_osmux.py: using BVCI 17471 23:24:14.734978 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:14.745952 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:14.756597 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:14.767596 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:14.778626 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:24:14.789654 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:24:14.908814 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:24:15.027406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:15.510547 run create_hlr_db(pid=27649): Launched 23:24:15.628719 bus /sierra_2: Setting Powered False 23:24:16.693658 run create_hlr_db(pid=27649): Terminated: ok {rc=0} 23:24:17.142187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27651): Launched 23:24:17.470138 run osmo-hlr_10.42.42.2(pid=27652): Launched 23:24:17.591555 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:18.130201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27654): Launched 23:24:18.442974 run osmo-stp_10.42.42.5(pid=27655): Launched 23:24:18.561867 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:19.123314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27657): Launched 23:24:19.436580 run osmo-msc_10.42.42.6(pid=27658): Launched 23:24:19.610965 run osmo-stp_10.42.42.5(pid=27655): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27655)] 23:24:19.742919 run osmo-stp_10.42.42.5(pid=27655): stdout: | (launched: 2022-12-08_23:24:18.383944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:19.874304 run osmo-stp_10.42.42.5(pid=27655): stderr: | [0;m[38;5;43m20221208232418559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232418559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232418560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232418560 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232418561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232418561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232418561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:20.003521 run osmo-stp_10.42.42.5(pid=27655): stdout: | (launched: 2022-12-08_23:24:18.383944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:20.127038 run osmo-stp_10.42.42.5(pid=27655): stderr: | [0;m[38;5;43m20221208232418559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232418559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232418560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232418560 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232418561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232418561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232418561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:20.274668 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27655): Process ended prematurely: osmo-stp_10.42.42.5(pid=27655) [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27655)] [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:24:20.283366 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:24:20.310184 run osmo-hlr_10.42.42.2(pid=27652): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27652)] 23:24:20.358259 run osmo-hlr_10.42.42.2(pid=27652): stdout: | (launched: 2022-12-08_23:24:17.411694) 23:24:20.407862 run osmo-hlr_10.42.42.2(pid=27652): stderr: | [0;m[1;31m20221208232417592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232417592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232417592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232417592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232417592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232417592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232417604 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232417612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232417613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232417613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:20.476859 run osmo-msc_10.42.42.6(pid=27658): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27658)] 23:24:20.524334 run osmo-msc_10.42.42.6(pid=27658): stdout: | (launched: 2022-12-08_23:24:19.377609) 23:24:20.573573 run osmo-msc_10.42.42.6(pid=27658): stderr: | [0;m[38;5;43m20221208232419652 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208232419653 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3feda58c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208232419653 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208232419653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208232419653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208232419653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208232419655 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208232419655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208232419655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208232419655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:20.624007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27651): Terminating (SIGTERM) 23:24:20.663614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27654): Terminating (SIGTERM) 23:24:20.703287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27657): Terminating (SIGTERM) 23:24:20.743269 --- ParallelTerminationStrategy: PID 27651 died... 23:24:20.762295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27651): Terminated: ok {rc=0} 23:24:20.806555 --- ParallelTerminationStrategy: PID 27654 died... 23:24:20.825140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27654): Terminated: ok {rc=0} 23:24:20.869561 --- ParallelTerminationStrategy: PID 27657 died... 23:24:20.888025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27657): Terminated: ok {rc=0} 23:24:20.970924 bus /sierra_3: Setting Powered False 23:24:22.069961 bus /sierra_3: Setting Powered False 23:24:23.185911 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:24:24.423191 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:24:24.430116 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:24:24.450922 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:24:24.477867 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:24:24.531807 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:24:24.552807 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:24:24.579765 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:24:25.129758 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:24:25.182271 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:25.193728 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:24:25.251321 tst mo_mt_call.py: using LAC 17471 23:24:25.381272 tst mo_mt_call.py: using RAC 131 23:24:25.510204 tst mo_mt_call.py: using CellId 17471 23:24:25.640320 tst mo_mt_call.py: using BVCI 17472 23:24:25.759913 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:25.771376 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:25.782562 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:25.793755 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:25.804900 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:25.816170 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:24:25.937985 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:24:26.057524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:26.571193 run create_hlr_db(pid=27664): Launched 23:24:26.705480 bus /sierra_2: Setting Powered False 23:24:27.770596 run create_hlr_db(pid=27664): Terminated: ok {rc=0} 23:24:28.211885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27666): Launched 23:24:28.525358 run osmo-hlr_10.42.42.2(pid=27667): Launched 23:24:28.644399 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:29.195526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27669): Launched 23:24:29.507713 run osmo-stp_10.42.42.5(pid=27670): Launched 23:24:29.626517 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:30.189646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27672): Launched 23:24:30.502283 run osmo-msc_10.42.42.6(pid=27673): Launched 23:24:30.676585 run osmo-stp_10.42.42.5(pid=27670): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27670)] 23:24:30.807930 run osmo-stp_10.42.42.5(pid=27670): stdout: | (launched: 2022-12-08_23:24:29.448886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:30.947308 run osmo-stp_10.42.42.5(pid=27670): stderr: | [0;m[38;5;43m20221208232429622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232429622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232429622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232429623 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232429625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232429625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232429625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:31.079469 run osmo-stp_10.42.42.5(pid=27670): stdout: | (launched: 2022-12-08_23:24:29.448886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:31.205904 run osmo-stp_10.42.42.5(pid=27670): stderr: | [0;m[38;5;43m20221208232429622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232429622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232429622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232429623 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232429625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232429625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232429625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:31.357162 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27670): Process ended prematurely: osmo-stp_10.42.42.5(pid=27670) [trial-2351↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27670)] [trial-2351↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:24:31.367055 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 23:24:31.396917 run osmo-hlr_10.42.42.2(pid=27667): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27667)] 23:24:31.447340 run osmo-hlr_10.42.42.2(pid=27667): stdout: | (launched: 2022-12-08_23:24:28.466606) 23:24:31.499273 run osmo-hlr_10.42.42.2(pid=27667): stderr: | [0;m[1;31m20221208232428647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232428647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232428647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232428647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232428647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232428647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232428663 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232428673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232428673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232428673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:31.571523 run osmo-msc_10.42.42.6(pid=27673): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27673)] 23:24:31.621650 run osmo-msc_10.42.42.6(pid=27673): stdout: | (launched: 2022-12-08_23:24:30.443578) 23:24:31.674521 run osmo-msc_10.42.42.6(pid=27673): stderr: | [0;m[38;5;43m20221208232430720 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208232430720 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8fc80ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208232430720 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208232430721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208232430721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208232430721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208232430723 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208232430723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208232430723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208232430723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:31.726699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27666): Terminating (SIGTERM) 23:24:31.769196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27669): Terminating (SIGTERM) 23:24:31.813172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27672): Terminating (SIGTERM) 23:24:31.857353 --- ParallelTerminationStrategy: PID 27666 died... 23:24:31.876822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27666): Terminated: ok {rc=0} 23:24:31.924276 --- ParallelTerminationStrategy: PID 27669 died... 23:24:31.944083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27669): Terminated: ok {rc=0} 23:24:31.991614 --- ParallelTerminationStrategy: PID 27672 died... 23:24:32.011163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27672): Terminated: ok {rc=0} 23:24:32.101216 bus /sierra_3: Setting Powered False 23:24:33.198431 bus /sierra_3: Setting Powered False 23:24:34.313127 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:24:35.459781 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:35.471319 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:24:35.527003 tst mo_mt_call_osmux.py: using LAC 17472 23:24:35.649370 tst mo_mt_call_osmux.py: using RAC 132 23:24:35.775872 tst mo_mt_call_osmux.py: using CellId 17472 23:24:35.897613 tst mo_mt_call_osmux.py: using BVCI 17473 23:24:36.011858 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:36.022843 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:36.033626 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:36.044529 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:36.055511 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:36.066617 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:24:36.185408 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:24:36.302293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:36.785609 run create_hlr_db(pid=27675): Launched 23:24:36.903232 bus /sierra_2: Setting Powered False 23:24:37.964214 run create_hlr_db(pid=27675): Terminated: ok {rc=0} 23:24:38.397590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27677): Launched 23:24:38.709322 run osmo-hlr_10.42.42.2(pid=27678): Launched 23:24:38.827905 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:39.376647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27680): Launched 23:24:39.689649 run osmo-stp_10.42.42.5(pid=27681): Launched 23:24:39.808680 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:40.371408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27683): Launched 23:24:40.684297 run osmo-msc_10.42.42.6(pid=27684): Launched 23:24:40.858712 run osmo-stp_10.42.42.5(pid=27681): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27681)] 23:24:40.989999 run osmo-stp_10.42.42.5(pid=27681): stdout: | (launched: 2022-12-08_23:24:39.631020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:41.120693 run osmo-stp_10.42.42.5(pid=27681): stderr: | [0;m[38;5;43m20221208232439805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232439806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232439806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232439806 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232439807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232439807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232439807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:41.249869 run osmo-stp_10.42.42.5(pid=27681): stdout: | (launched: 2022-12-08_23:24:39.631020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:41.372670 run osmo-stp_10.42.42.5(pid=27681): stderr: | [0;m[38;5;43m20221208232439805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232439806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232439806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232439806 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232439807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232439807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232439807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:41.519664 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27681): Process ended prematurely: osmo-stp_10.42.42.5(pid=27681) [trial-2351↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27681)] [trial-2351↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:24:41.528496 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:24:41.555203 run osmo-hlr_10.42.42.2(pid=27678): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27678)] 23:24:41.602978 run osmo-hlr_10.42.42.2(pid=27678): stdout: | (launched: 2022-12-08_23:24:38.650857) 23:24:41.652321 run osmo-hlr_10.42.42.2(pid=27678): stderr: | [0;m[1;31m20221208232438829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232438829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232438829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232438829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232438830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232438830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232438842 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232438852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232438853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232438853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:41.721091 run osmo-msc_10.42.42.6(pid=27684): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27684)] 23:24:41.768460 run osmo-msc_10.42.42.6(pid=27684): stdout: | (launched: 2022-12-08_23:24:40.625767) 23:24:41.817626 run osmo-msc_10.42.42.6(pid=27684): stderr: | [0;m[38;5;43m20221208232440901 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208232440901 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1374302c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208232440902 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208232440902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208232440902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208232440902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208232440904 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208232440904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208232440904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208232440904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:41.866899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27677): Terminating (SIGTERM) 23:24:41.906348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27680): Terminating (SIGTERM) 23:24:41.945639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27683): Terminating (SIGTERM) 23:24:41.985455 --- ParallelTerminationStrategy: PID 27677 died... 23:24:42.004330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27677): Terminated: ok {rc=0} 23:24:42.048511 --- ParallelTerminationStrategy: PID 27680 died... 23:24:42.067181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27680): Terminated: ok {rc=0} 23:24:42.111628 --- ParallelTerminationStrategy: PID 27683 died... 23:24:42.130094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27683): Terminated: ok {rc=0} 23:24:42.215384 bus /sierra_3: Setting Powered False 23:24:43.313470 bus /sierra_3: Setting Powered False 23:24:44.427293 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:24:45.660510 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:24:45.666436 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:24:45.687495 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 23:24:45.714740 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 23:24:45.771172 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:24:45.792425 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 23:24:45.819520 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 23:24:46.359842 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 23:24:46.413269 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:46.426170 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:24:46.482682 tst mo_mt_call.py: using LAC 17473 23:24:46.611930 tst mo_mt_call.py: using RAC 133 23:24:46.767249 tst mo_mt_call.py: using CellId 17473 23:24:46.927348 tst mo_mt_call.py: using BVCI 17474 23:24:47.072798 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:47.085068 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:47.097611 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:47.109674 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:47.121234 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:47.132671 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:24:47.256701 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:24:47.380843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:47.859257 run create_hlr_db(pid=27689): Launched 23:24:47.976244 bus /sierra_2: Setting Powered False 23:24:49.037797 run create_hlr_db(pid=27689): Terminated: ok {rc=0} 23:24:49.483805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27691): Launched 23:24:49.810999 run osmo-hlr_10.42.42.2(pid=27692): Launched 23:24:49.935644 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:50.499464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27694): Launched 23:24:50.827687 run osmo-stp_10.42.42.5(pid=27695): Launched 23:24:50.952614 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:51.544233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27697): Launched 23:24:51.872624 run osmo-msc_10.42.42.6(pid=27698): Launched 23:24:52.056381 run osmo-stp_10.42.42.5(pid=27695): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27695)] 23:24:52.195659 run osmo-stp_10.42.42.5(pid=27695): stdout: | (launched: 2022-12-08_23:24:50.767403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:52.334866 run osmo-stp_10.42.42.5(pid=27695): stderr: | [0;m[38;5;43m20221208232450962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232450963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232450963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232450963 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232450964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232450964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232450964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:52.473077 run osmo-stp_10.42.42.5(pid=27695): stdout: | (launched: 2022-12-08_23:24:50.767403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:52.603184 run osmo-stp_10.42.42.5(pid=27695): stderr: | [0;m[38;5;43m20221208232450962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232450963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232450963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232450963 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232450964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232450964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232450964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:52.758707 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27695): Process ended prematurely: osmo-stp_10.42.42.5(pid=27695) [trial-2351↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27695)] [trial-2351↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 23:24:52.768363 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 23:24:52.796559 run osmo-hlr_10.42.42.2(pid=27692): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27692)] 23:24:52.846543 run osmo-hlr_10.42.42.2(pid=27692): stdout: | (launched: 2022-12-08_23:24:49.751211) 23:24:52.898646 run osmo-hlr_10.42.42.2(pid=27692): stderr: | [0;m[1;31m20221208232449951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232449951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232449951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232449951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232449951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232449951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232449963 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232449971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232449972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232449972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:52.971460 run osmo-msc_10.42.42.6(pid=27698): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27698)] 23:24:53.021580 run osmo-msc_10.42.42.6(pid=27698): stdout: | (launched: 2022-12-08_23:24:51.812473) 23:24:53.073496 run osmo-msc_10.42.42.6(pid=27698): stderr: | [0;m[38;5;43m20221208232452139 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208232452139 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f11f3699c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208232452139 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208232452139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208232452139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208232452140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208232452141 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208232452142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208232452142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208232452142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:53.125599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27691): Terminating (SIGTERM) 23:24:53.167160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27694): Terminating (SIGTERM) 23:24:53.208730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27697): Terminating (SIGTERM) 23:24:53.250885 --- ParallelTerminationStrategy: PID 27691 died... 23:24:53.270640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27691): Terminated: ok {rc=0} 23:24:53.316885 --- ParallelTerminationStrategy: PID 27694 died... 23:24:53.336719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27694): Terminated: ok {rc=0} 23:24:53.382746 --- ParallelTerminationStrategy: PID 27697 died... 23:24:53.402464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27697): Terminated: ok {rc=0} 23:24:53.489159 bus /sierra_3: Setting Powered False 23:24:54.588144 bus /sierra_3: Setting Powered False 23:24:55.703903 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 23:24:56.852593 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:56.864319 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:24:56.926526 tst mo_mt_call_osmux.py: using LAC 17474 23:24:57.053373 tst mo_mt_call_osmux.py: using RAC 134 23:24:57.178588 tst mo_mt_call_osmux.py: using CellId 17474 23:24:57.305273 tst mo_mt_call_osmux.py: using BVCI 17475 23:24:57.422372 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:57.433702 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:57.444568 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:57.455560 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:57.466527 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:57.477584 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:24:57.591790 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:24:57.705850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:58.173668 run create_hlr_db(pid=27700): Launched 23:24:58.289231 bus /sierra_2: Setting Powered False 23:24:59.349631 run create_hlr_db(pid=27700): Terminated: ok {rc=0} 23:24:59.790915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27702): Launched 23:25:00.115182 run osmo-hlr_10.42.42.2(pid=27703): Launched 23:25:00.238639 run osmo-stp_10.42.42.5: Starting osmo-stp 23:25:00.798926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27705): Launched 23:25:01.169954 run osmo-stp_10.42.42.5(pid=27709): Launched 23:25:01.410432 run osmo-msc_10.42.42.6: Starting osmo-msc 23:25:02.160435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27711): Launched 23:25:02.472886 run osmo-msc_10.42.42.6(pid=27712): Launched 23:25:02.644632 run osmo-stp_10.42.42.5(pid=27709): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27709)] 23:25:02.774846 run osmo-stp_10.42.42.5(pid=27709): stdout: | (launched: 2022-12-08_23:25:01.103143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:02.903696 run osmo-stp_10.42.42.5(pid=27709): stderr: | [0;m[38;5;43m20221208232501435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232501435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232501435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232501435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232501436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232501436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232501436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:03.030236 run osmo-stp_10.42.42.5(pid=27709): stdout: | (launched: 2022-12-08_23:25:01.103143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:03.151152 run osmo-stp_10.42.42.5(pid=27709): stderr: | [0;m[38;5;43m20221208232501435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232501435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232501435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232501435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232501436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232501436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232501436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:03.295710 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27709): Process ended prematurely: osmo-stp_10.42.42.5(pid=27709) [trial-2351↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27709)] [trial-2351↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 23:25:03.304783 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 23:25:03.331692 run osmo-hlr_10.42.42.2(pid=27703): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27703)] 23:25:03.379865 run osmo-hlr_10.42.42.2(pid=27703): stdout: | (launched: 2022-12-08_23:25:00.056850) 23:25:03.429068 run osmo-hlr_10.42.42.2(pid=27703): stderr: | [0;m[1;31m20221208232500256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232500257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232500257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232500257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232500257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232500257 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232500269 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232500277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232500278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232500278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:25:03.497703 run osmo-msc_10.42.42.6(pid=27712): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27712)] 23:25:03.545328 run osmo-msc_10.42.42.6(pid=27712): stdout: | (launched: 2022-12-08_23:25:02.417141) 23:25:03.594487 run osmo-msc_10.42.42.6(pid=27712): stderr: | [0;m[38;5;43m20221208232502689 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208232502689 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fece9115c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208232502689 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208232502689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208232502689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208232502690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208232502691 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208232502692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208232502692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208232502692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:25:03.643950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27702): Terminating (SIGTERM) 23:25:03.683421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27705): Terminating (SIGTERM) 23:25:03.722828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27711): Terminating (SIGTERM) 23:25:03.762460 --- ParallelTerminationStrategy: PID 27702 died... 23:25:03.781522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27702): Terminated: ok {rc=0} 23:25:03.825799 --- ParallelTerminationStrategy: PID 27705 died... 23:25:03.844388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27705): Terminated: ok {rc=0} 23:25:03.888280 --- ParallelTerminationStrategy: PID 27711 died... 23:25:03.906832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27711): Terminated: ok {rc=0} 23:25:03.992068 bus /sierra_3: Setting Powered False 23:25:05.090397 bus /sierra_3: Setting Powered False 23:25:06.205088 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 emergency:oc2g --------------------------------------------------------------------- 23:25:07.432869 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:25:07.437199 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 23:25:07.457485 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 23:25:07.484236 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 23:25:07.565149 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 23:25:07.585175 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 23:25:07.611473 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 23:25:08.193522 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2351 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 23:25:08.198454 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:08.208756 tst emergency:oc2g: Using 1 x bts (candidates: 1) 23:25:08.243944 tst emergency_mo_mt_call.py: using LAC 17475 23:25:08.360424 tst emergency_mo_mt_call.py: using RAC 135 23:25:08.477454 tst emergency_mo_mt_call.py: using CellId 17475 23:25:08.594271 tst emergency_mo_mt_call.py: using BVCI 17476 23:25:08.702335 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:08.712778 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:08.723123 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:08.733742 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:08.744081 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:08.754501 tst emergency:oc2g: Using 1 x modem (candidates: 4) 23:25:08.871805 tst emergency:oc2g: Using 1 x modem (candidates: 4) 23:25:08.985714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:25:09.445936 run create_hlr_db(pid=27718): Launched 23:25:09.558811 bus /sierra_2: Setting Powered False 23:25:10.618762 run create_hlr_db(pid=27718): Terminated: ok {rc=0} 23:25:11.054702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27720): Launched 23:25:11.372373 run osmo-hlr_10.42.42.2(pid=27721): Launched 23:25:11.493502 run osmo-stp_10.42.42.5: Starting osmo-stp 23:25:12.040799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27723): Launched 23:25:12.357905 run osmo-stp_10.42.42.5(pid=27724): Launched 23:25:12.490650 tst emergency_mo_mt_call.py: using MSISDN 6909 23:25:12.656036 run osmo-msc_10.42.42.6: Starting osmo-msc 23:25:13.226005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27726): Launched 23:25:13.543538 run osmo-msc_10.42.42.6(pid=27727): Launched 23:25:13.720714 run osmo-stp_10.42.42.5(pid=27724): ERR: Terminated: ERROR {rc=1} [trial-2351↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27724)] 23:25:13.854136 run osmo-stp_10.42.42.5(pid=27724): stdout: | (launched: 2022-12-08_23:25:12.300139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:13.988528 run osmo-stp_10.42.42.5(pid=27724): stderr: | [0;m[38;5;43m20221208232512493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232512494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232512494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232512494 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232512495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232512495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232512495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:14.122153 run osmo-stp_10.42.42.5(pid=27724): stdout: | (launched: 2022-12-08_23:25:12.300139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:14.248680 run osmo-stp_10.42.42.5(pid=27724): stderr: | [0;m[38;5;43m20221208232512493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232512494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232512494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232512494 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232512495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232512495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232512495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:14.400053 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=27724): Process ended prematurely: osmo-stp_10.42.42.5(pid=27724) [trial-2351↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27724)] [trial-2351↪emergency:oc2g↪emergency_mo_mt_call.py:19] 23:25:14.409153 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 23:25:14.436615 run osmo-hlr_10.42.42.2(pid=27721): ERR: Terminated: ERROR {rc=237} [trial-2351↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27721)] 23:25:14.486889 run osmo-hlr_10.42.42.2(pid=27721): stdout: | (launched: 2022-12-08_23:25:11.314626) 23:25:14.539067 run osmo-hlr_10.42.42.2(pid=27721): stderr: | [0;m[1;31m20221208232511512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232511512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232511512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232511512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232511512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232511512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232511523 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232511533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232511533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232511534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:25:14.610775 run osmo-msc_10.42.42.6(pid=27727): ERR: Terminated: ERROR {rc=2} [trial-2351↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27727)] 23:25:14.660507 run osmo-msc_10.42.42.6(pid=27727): stdout: | (launched: 2022-12-08_23:25:13.485418) 23:25:14.711862 run osmo-msc_10.42.42.6(pid=27727): stderr: | [0;m[38;5;43m20221208232513809 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208232513809 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7e1ec7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208232513810 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208232513810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208232513810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208232513810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208232513812 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208232513812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208232513812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208232513812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:25:14.763393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27720): Terminating (SIGTERM) 23:25:14.804764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27723): Terminating (SIGTERM) 23:25:14.846280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27726): Terminating (SIGTERM) 23:25:14.888181 --- ParallelTerminationStrategy: PID 27720 died... 23:25:14.908153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27720): Terminated: ok {rc=0} 23:25:14.954909 --- ParallelTerminationStrategy: PID 27723 died... 23:25:14.974664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27723): Terminated: ok {rc=0} 23:25:15.020360 --- ParallelTerminationStrategy: PID 27726 died... 23:25:15.039646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27726): Terminated: ok {rc=0} 23:25:15.126965 bus /sierra_3: Setting Powered False 23:25:16.224495 bus /sierra_3: Setting Powered False 23:25:17.343195 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 23:25:18.430556 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:18.442189 tst emergency:oc2g: Using 1 x bts (candidates: 1) 23:25:18.479490 tst emergency_preemptive_call.py: using LAC 17476 23:25:18.604356 tst emergency_preemptive_call.py: using RAC 136 23:25:18.728768 tst emergency_preemptive_call.py: using CellId 17476 23:25:18.854422 tst emergency_preemptive_call.py: using BVCI 17477 23:25:18.969542 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:18.980300 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:18.991090 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:19.001853 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:19.012570 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:19.023200 tst emergency:oc2g: Using 1 x modem (candidates: 4) 23:25:19.140239 tst emergency:oc2g: Using 1 x modem (candidates: 4) 23:25:19.254410 tst emergency:oc2g: Using 1 x modem (candidates: 4) 23:25:19.371484 tst emergency:oc2g: Using 1 x modem (candidates: 4) 23:25:19.483399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:25:19.946835 run create_hlr_db(pid=27729): Launched 23:25:20.061006 bus /sierra_2: Setting Powered False 23:25:21.119555 run create_hlr_db(pid=27729): Terminated: ok {rc=0} 23:25:21.555717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27731): Launched 23:25:21.874540 run osmo-hlr_10.42.42.2(pid=27732): Launched 23:25:21.996374 run osmo-stp_10.42.42.5: Starting osmo-stp 23:25:22.542002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27734): Launched 23:25:22.860809 run osmo-stp_10.42.42.5(pid=27735): Launched 23:25:22.986960 tst emergency_preemptive_call.py: using MSISDN 6910 23:25:23.148104 run osmo-msc_10.42.42.6: Starting osmo-msc 23:25:23.682552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27737): Launched 23:25:23.980508 run osmo-msc_10.42.42.6(pid=27738): Launched 23:25:24.146826 run osmo-stp_10.42.42.5(pid=27735): ERR: Terminated: ERROR {rc=1} [trial-2351↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27735)] 23:25:24.273363 run osmo-stp_10.42.42.5(pid=27735): stdout: | (launched: 2022-12-08_23:25:22.802039) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:24.400408 run osmo-stp_10.42.42.5(pid=27735): stderr: | [0;m[38;5;43m20221208232522974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232522974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232522975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232522975 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232522976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232522976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232522976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:24.524505 run osmo-stp_10.42.42.5(pid=27735): stdout: | (launched: 2022-12-08_23:25:22.802039) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:24.643910 run osmo-stp_10.42.42.5(pid=27735): stderr: | [0;m[38;5;43m20221208232522974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232522974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232522975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232522975 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232522976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232522976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232522976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:24.785961 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=27735): Process ended prematurely: osmo-stp_10.42.42.5(pid=27735) [trial-2351↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27735)] [trial-2351↪emergency:oc2g↪emergency_preemptive_call.py:32] 23:25:24.794344 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 23:25:24.820633 run osmo-hlr_10.42.42.2(pid=27732): ERR: Terminated: ERROR {rc=237} [trial-2351↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27732)] 23:25:24.868314 run osmo-hlr_10.42.42.2(pid=27732): stdout: | (launched: 2022-12-08_23:25:21.816783) 23:25:24.917323 run osmo-hlr_10.42.42.2(pid=27732): stderr: | [0;m[1;31m20221208232522014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232522014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232522014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232522014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232522014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232522014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232522027 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232522035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232522035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232522035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:25:24.985808 run osmo-msc_10.42.42.6(pid=27738): ERR: Terminated: ERROR {rc=2} [trial-2351↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27738)] 23:25:25.032580 run osmo-msc_10.42.42.6(pid=27738): stdout: | (launched: 2022-12-08_23:25:23.925941) 23:25:25.081316 run osmo-msc_10.42.42.6(pid=27738): stderr: | [0;m[38;5;43m20221208232524199 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208232524199 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffb9395ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208232524199 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208232524199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208232524199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208232524200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208232524202 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208232524202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208232524202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208232524202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:25:25.130724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27731): Terminating (SIGTERM) 23:25:25.169708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27734): Terminating (SIGTERM) 23:25:25.209019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27737): Terminating (SIGTERM) 23:25:25.248257 --- ParallelTerminationStrategy: PID 27731 died... 23:25:25.267116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27731): Terminated: ok {rc=0} 23:25:25.310968 --- ParallelTerminationStrategy: PID 27734 died... 23:25:25.329425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27734): Terminated: ok {rc=0} 23:25:25.373508 --- ParallelTerminationStrategy: PID 27737 died... 23:25:25.392154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27737): Terminated: ok {rc=0} 23:25:25.476080 bus /sierra_9: Setting Powered False 23:25:26.573715 bus /sierra_9: Setting Powered False 23:25:27.690132 bus /sierra_8: Setting Powered False 23:25:28.786699 bus /sierra_8: Setting Powered False 23:25:29.901259 bus /sierra_3: Setting Powered False 23:25:31.000163 bus /sierra_3: Setting Powered False 23:25:32.126561 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:oc2g --------------------------------------------------------------------- 23:25:33.386788 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:25:33.391302 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 23:25:33.412177 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 23:25:33.451018 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 23:25:33.538697 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 23:25:33.560259 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 23:25:33.598960 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 23:25:34.187648 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 23:25:34.240552 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:34.251332 tst gprs:oc2g: Using 1 x bts (candidates: 1) 23:25:34.284931 tst cs_paging_gprs_active.py: using LAC 17477 23:25:34.410406 tst cs_paging_gprs_active.py: using RAC 137 23:25:34.535671 tst cs_paging_gprs_active.py: using CellId 17477 23:25:34.666509 tst cs_paging_gprs_active.py: using BVCI 17478 23:25:34.786038 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:34.796767 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:34.807432 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:34.818059 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:34.828483 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:34.839041 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:34.849706 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:34.860260 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:34.870964 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:34.985504 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:35.103439 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:25:35.324249 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:25:35.649671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27743): Launched 23:25:35.930687 run iperf3-srv_10.42.42.10(pid=27744): Launched 23:25:36.052198 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:25:36.271507 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:25:36.595454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27745): Launched 23:25:36.877098 run iperf3-srv_10.42.42.10(pid=27746): Launched 23:25:36.999231 tst cs_paging_gprs_active.py:38: start network... 23:25:37.218161 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:25:37.718328 run create_hlr_db(pid=27747): Launched 23:25:37.848834 bus /sierra_2: Setting Powered False 23:25:38.913194 run create_hlr_db(pid=27747): Terminated: ok {rc=0} 23:25:39.343805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27749): Launched 23:25:39.647459 run osmo-hlr_10.42.42.2(pid=27750): Launched 23:25:39.763752 run osmo-stp_10.42.42.5: Starting osmo-stp 23:25:40.286772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27752): Launched 23:25:40.591760 run osmo-stp_10.42.42.5(pid=27753): Launched 23:25:40.708204 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:25:41.231227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27755): Launched 23:25:41.347416 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:25:41.603127 run patchelf(pid=27756): Launched 23:25:41.772404 run osmo-stp_10.42.42.5(pid=27753): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27753)] 23:25:41.900764 run osmo-stp_10.42.42.5(pid=27753): stdout: | (launched: 2022-12-08_23:25:40.535081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:42.030999 run osmo-stp_10.42.42.5(pid=27753): stderr: | [0;m[38;5;43m20221208232540705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232540705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232540706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232540706 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232540707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232540707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232540707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:42.160823 run osmo-stp_10.42.42.5(pid=27753): stdout: | (launched: 2022-12-08_23:25:40.535081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:42.285215 run osmo-stp_10.42.42.5(pid=27753): stderr: | [0;m[38;5;43m20221208232540705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232540705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232540706 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232540706 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232540707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232540707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232540707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:42.431649 run patchelf(pid=27756): Terminating (SIGINT) 23:25:42.601939 run patchelf(pid=27756): Terminated: ok {rc=0} 23:25:42.724514 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27753): Process ended prematurely: osmo-stp_10.42.42.5(pid=27753) [trial-2351↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27753)] [trial-2351↪gprs:oc2g↪cs_paging_gprs_active.py:38] 23:25:42.734394 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 23:25:42.761707 run osmo-hlr_10.42.42.2(pid=27750): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27750)] 23:25:42.809354 run osmo-hlr_10.42.42.2(pid=27750): stdout: | (launched: 2022-12-08_23:25:39.592288) 23:25:42.858416 run osmo-hlr_10.42.42.2(pid=27750): stderr: | [0;m[1;31m20221208232539770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232539770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232539770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232539770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232539770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232539770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232539783 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232539794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232539794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232539794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:25:42.907558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27743): Terminating (SIGTERM) 23:25:42.946696 run iperf3-srv_10.42.42.10(pid=27744): Terminating (SIGTERM) 23:25:42.987182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27745): Terminating (SIGTERM) 23:25:43.026824 run iperf3-srv_10.42.42.10(pid=27746): Terminating (SIGTERM) 23:25:43.065873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27749): Terminating (SIGTERM) 23:25:43.105056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27752): Terminating (SIGTERM) 23:25:43.143806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27755): Terminating (SIGTERM) 23:25:43.183239 --- ParallelTerminationStrategy: PID 27743 died... 23:25:43.201928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27743): Terminated: ok {rc=0} 23:25:43.245510 --- ParallelTerminationStrategy: PID 27744 died... 23:25:43.263803 run iperf3-srv_10.42.42.10(pid=27744): Terminated {rc=256} 23:25:43.306987 --- ParallelTerminationStrategy: PID 27745 died... 23:25:43.325145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27745): Terminated: ok {rc=0} 23:25:43.368825 --- ParallelTerminationStrategy: PID 27746 died... 23:25:43.387453 run iperf3-srv_10.42.42.10(pid=27746): Terminated {rc=256} 23:25:43.430793 --- ParallelTerminationStrategy: PID 27749 died... 23:25:43.449132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27749): Terminated: ok {rc=0} 23:25:43.492356 --- ParallelTerminationStrategy: PID 27752 died... 23:25:43.510767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27752): Terminated: ok {rc=0} 23:25:43.553810 --- ParallelTerminationStrategy: PID 27755 died... 23:25:43.571933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27755): Terminated: ok {rc=0} 23:25:43.655616 bus /gobi_0: Setting Powered False 23:25:44.753933 bus /gobi_0: Setting Powered False 23:25:45.873148 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:oc2g iperf3.py ---------------------------------------------- 23:25:47.060315 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:47.072313 tst gprs:oc2g: Using 1 x bts (candidates: 1) 23:25:47.107966 tst iperf3.py: using LAC 17478 23:25:47.233578 tst iperf3.py: using RAC 138 23:25:47.354427 tst iperf3.py: using CellId 17478 23:25:47.474022 tst iperf3.py: using BVCI 17479 23:25:47.584861 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:47.595426 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:47.606049 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:47.616256 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:47.628283 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:47.639336 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:47.650467 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:47.661623 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:47.673298 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:47.793857 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:25:48.014435 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:25:48.338605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27757): Launched 23:25:48.621588 run iperf3-srv_10.42.42.10(pid=27758): Launched 23:25:48.743254 tst iperf3.py:8: start network... 23:25:48.962951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:25:49.464806 run create_hlr_db(pid=27759): Launched 23:25:49.596896 bus /gobi_6: Setting Powered False 23:25:50.661258 run create_hlr_db(pid=27759): Terminated: ok {rc=0} 23:25:51.093853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27761): Launched 23:25:51.398169 run osmo-hlr_10.42.42.2(pid=27762): Launched 23:25:51.513648 run osmo-stp_10.42.42.5: Starting osmo-stp 23:25:52.050595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27764): Launched 23:25:52.355200 run osmo-stp_10.42.42.5(pid=27765): Launched 23:25:52.470846 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:25:52.996783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27767): Launched 23:25:53.114533 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:25:53.371143 run patchelf(pid=27768): Launched 23:25:53.540033 run osmo-stp_10.42.42.5(pid=27765): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27765)] 23:25:53.669348 run osmo-stp_10.42.42.5(pid=27765): stdout: | (launched: 2022-12-08_23:25:52.299956) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:53.799835 run osmo-stp_10.42.42.5(pid=27765): stderr: | [0;m[38;5;43m20221208232552470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232552470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232552471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232552471 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232552472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232552472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232552472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:53.957444 run osmo-stp_10.42.42.5(pid=27765): stdout: | (launched: 2022-12-08_23:25:52.299956) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:54.093043 run osmo-stp_10.42.42.5(pid=27765): stderr: | [0;m[38;5;43m20221208232552470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232552470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232552471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232552471 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232552472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232552472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232552472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:54.239771 run patchelf(pid=27768): Terminating (SIGINT) 23:25:54.410448 run patchelf(pid=27768): Terminated: ok {rc=0} 23:25:54.532633 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27765): Process ended prematurely: osmo-stp_10.42.42.5(pid=27765) [trial-2351↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27765)] [trial-2351↪gprs:oc2g↪iperf3.py:8] 23:25:54.542134 tst iperf3.py:8: Test FAILED (7.5 sec) 23:25:54.569257 run osmo-hlr_10.42.42.2(pid=27762): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27762)] 23:25:54.617457 run osmo-hlr_10.42.42.2(pid=27762): stdout: | (launched: 2022-12-08_23:25:51.342901) 23:25:54.666726 run osmo-hlr_10.42.42.2(pid=27762): stderr: | [0;m[1;31m20221208232551520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232551520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232551520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232551520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232551520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232551520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232551532 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232551541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232551541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232551541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:25:54.716571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27757): Terminating (SIGTERM) 23:25:54.755932 run iperf3-srv_10.42.42.10(pid=27758): Terminating (SIGTERM) 23:25:54.795756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27761): Terminating (SIGTERM) 23:25:54.835587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27764): Terminating (SIGTERM) 23:25:54.875270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27767): Terminating (SIGTERM) 23:25:54.915293 --- ParallelTerminationStrategy: PID 27757 died... 23:25:54.934325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27757): Terminated: ok {rc=0} 23:25:54.978692 --- ParallelTerminationStrategy: PID 27758 died... 23:25:54.997239 run iperf3-srv_10.42.42.10(pid=27758): Terminated {rc=256} 23:25:55.041436 --- ParallelTerminationStrategy: PID 27761 died... 23:25:55.059898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27761): Terminated: ok {rc=0} 23:25:55.104292 --- ParallelTerminationStrategy: PID 27764 died... 23:25:55.122948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27764): Terminated: ok {rc=0} 23:25:55.167294 --- ParallelTerminationStrategy: PID 27767 died... 23:25:55.185925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27767): Terminated: ok {rc=0} 23:25:55.268889 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:oc2g iperf3m4.py ---------------------------------------------- 23:25:56.415956 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:56.427469 tst gprs:oc2g: Using 1 x bts (candidates: 1) 23:25:56.463993 tst iperf3m4.py: using LAC 17479 23:25:56.590777 tst iperf3m4.py: using RAC 139 23:25:56.717024 tst iperf3m4.py: using CellId 17479 23:25:56.844297 tst iperf3m4.py: using BVCI 17480 23:25:56.962613 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:56.973474 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:56.984430 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:56.995201 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:57.005742 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:57.016286 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:57.026977 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:57.037938 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:57.048608 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:57.162917 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:57.278892 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:57.392614 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:57.511022 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:25:57.729227 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:25:58.055340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27772): Launched 23:25:58.337570 run iperf3-srv_10.42.42.10(pid=27773): Launched 23:25:58.459161 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:25:58.677620 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:25:59.004726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27774): Launched 23:25:59.286066 run iperf3-srv_10.42.42.10(pid=27775): Launched 23:25:59.407435 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:25:59.625830 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:25:59.951249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27776): Launched 23:26:00.234157 run iperf3-srv_10.42.42.10(pid=27777): Launched 23:26:00.355204 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:26:00.572888 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:00.929656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27778): Launched 23:26:01.237672 run iperf3-srv_10.42.42.10(pid=27779): Launched 23:26:01.378453 tst iperf3m4.py:8: start network... 23:26:01.596352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:26:02.147043 run create_hlr_db(pid=27780): Launched 23:26:02.305078 bus /gobi_6: Setting Powered False 23:26:03.365275 run create_hlr_db(pid=27780): Terminated: ok {rc=0} 23:26:03.807025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27782): Launched 23:26:04.132442 run osmo-hlr_10.42.42.2(pid=27783): Launched 23:26:04.255770 run osmo-stp_10.42.42.5: Starting osmo-stp 23:26:04.811276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27785): Launched 23:26:05.136531 run osmo-stp_10.42.42.5(pid=27786): Launched 23:26:05.260037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:26:05.824225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27788): Launched 23:26:05.948585 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:26:06.222015 run patchelf(pid=27789): Launched 23:26:06.401944 run osmo-stp_10.42.42.5(pid=27786): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27786)] 23:26:06.538591 run osmo-stp_10.42.42.5(pid=27786): stdout: | (launched: 2022-12-08_23:26:05.077297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:06.677323 run osmo-stp_10.42.42.5(pid=27786): stderr: | [0;m[38;5;43m20221208232605273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232605273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232605273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232605274 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232605274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232605274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232605274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:06.815824 run osmo-stp_10.42.42.5(pid=27786): stdout: | (launched: 2022-12-08_23:26:05.077297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:06.948861 run osmo-stp_10.42.42.5(pid=27786): stderr: | [0;m[38;5;43m20221208232605273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232605273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232605273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232605274 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232605274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232605274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232605274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:07.106089 run patchelf(pid=27789): Terminating (SIGINT) 23:26:07.286890 run patchelf(pid=27789): Terminated: ok {rc=0} 23:26:07.417203 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27786): Process ended prematurely: osmo-stp_10.42.42.5(pid=27786) [trial-2351↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27786)] [trial-2351↪gprs:oc2g↪iperf3m4.py:8] 23:26:07.427250 tst iperf3m4.py:8: Test FAILED (11.0 sec) 23:26:07.455785 run osmo-hlr_10.42.42.2(pid=27783): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27783)] 23:26:07.505257 run osmo-hlr_10.42.42.2(pid=27783): stdout: | (launched: 2022-12-08_23:26:04.073775) 23:26:07.556426 run osmo-hlr_10.42.42.2(pid=27783): stderr: | [0;m[1;31m20221208232604275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232604275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232604276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232604276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232604276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232604276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232604289 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232604297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232604297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232604297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:26:07.608075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27772): Terminating (SIGTERM) 23:26:07.649703 run iperf3-srv_10.42.42.10(pid=27773): Terminating (SIGTERM) 23:26:07.691171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27774): Terminating (SIGTERM) 23:26:07.732649 run iperf3-srv_10.42.42.10(pid=27775): Terminating (SIGTERM) 23:26:07.774076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27776): Terminating (SIGTERM) 23:26:07.815653 run iperf3-srv_10.42.42.10(pid=27777): Terminating (SIGTERM) 23:26:07.856882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27778): Terminating (SIGTERM) 23:26:07.898432 run iperf3-srv_10.42.42.10(pid=27779): Terminating (SIGTERM) 23:26:07.940152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27782): Terminating (SIGTERM) 23:26:07.981651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27785): Terminating (SIGTERM) 23:26:08.023243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27788): Terminating (SIGTERM) 23:26:08.065161 --- ParallelTerminationStrategy: PID 27772 died... 23:26:08.085112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27772): Terminated: ok {rc=0} 23:26:08.131066 --- ParallelTerminationStrategy: PID 27773 died... 23:26:08.150466 run iperf3-srv_10.42.42.10(pid=27773): Terminated {rc=256} 23:26:08.196142 --- ParallelTerminationStrategy: PID 27774 died... 23:26:08.215637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27774): Terminated: ok {rc=0} 23:26:08.261360 --- ParallelTerminationStrategy: PID 27775 died... 23:26:08.280723 run iperf3-srv_10.42.42.10(pid=27775): Terminated {rc=256} 23:26:08.326247 --- ParallelTerminationStrategy: PID 27776 died... 23:26:08.345729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27776): Terminated: ok {rc=0} 23:26:08.391526 --- ParallelTerminationStrategy: PID 27777 died... 23:26:08.410895 run iperf3-srv_10.42.42.10(pid=27777): Terminated {rc=256} 23:26:08.456682 --- ParallelTerminationStrategy: PID 27778 died... 23:26:08.476138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27778): Terminated: ok {rc=0} 23:26:08.521911 --- ParallelTerminationStrategy: PID 27779 died... 23:26:08.541499 run iperf3-srv_10.42.42.10(pid=27779): Terminated {rc=256} 23:26:08.587258 --- ParallelTerminationStrategy: PID 27782 died... 23:26:08.606762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27782): Terminated: ok {rc=0} 23:26:08.652481 --- ParallelTerminationStrategy: PID 27785 died... 23:26:08.671954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27785): Terminated: ok {rc=0} 23:26:08.717857 --- ParallelTerminationStrategy: PID 27788 died... 23:26:08.737354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27788): Terminated: ok {rc=0} 23:26:08.824850 bus /gobi_4: Setting Powered False 23:26:09.924467 bus /gobi_4: Setting Powered False 23:26:11.039362 bus /gobi_1: Setting Powered False 23:26:12.137626 bus /gobi_1: Setting Powered False 23:26:13.251106 bus /gobi_0: Setting Powered False 23:26:14.347213 bus /gobi_0: Setting Powered False 23:26:15.462348 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:oc2g ping.py ---------------------------------------------- 23:26:16.563008 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:16.574914 tst gprs:oc2g: Using 1 x bts (candidates: 1) 23:26:16.611829 tst ping.py: using LAC 17480 23:26:16.773096 tst ping.py: using RAC 140 23:26:16.892530 tst ping.py: using CellId 17480 23:26:17.052271 tst ping.py: using BVCI 17481 23:26:17.186576 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:17.198075 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:17.209927 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:17.221706 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:17.233812 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:17.245501 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:17.257472 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:17.268340 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:26:17.385129 tst ping.py:19: start network... 23:26:17.600476 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:26:18.091157 run create_hlr_db(pid=27790): Launched 23:26:18.219732 bus /gobi_6: Setting Powered False 23:26:19.282233 run create_hlr_db(pid=27790): Terminated: ok {rc=0} 23:26:19.725184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27792): Launched 23:26:20.042976 run osmo-hlr_10.42.42.2(pid=27793): Launched 23:26:20.164098 run osmo-stp_10.42.42.5: Starting osmo-stp 23:26:20.715389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27795): Launched 23:26:21.034929 run osmo-stp_10.42.42.5(pid=27796): Launched 23:26:21.155932 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:26:21.702116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27798): Launched 23:26:21.824146 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:26:22.093133 run patchelf(pid=27799): Launched 23:26:22.269944 run osmo-stp_10.42.42.5(pid=27796): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27796)] 23:26:22.404755 run osmo-stp_10.42.42.5(pid=27796): stdout: | (launched: 2022-12-08_23:26:20.976201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:22.541450 run osmo-stp_10.42.42.5(pid=27796): stderr: | [0;m[38;5;43m20221208232621169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232621169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232621169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232621170 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232621170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232621170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232621170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:22.678088 run osmo-stp_10.42.42.5(pid=27796): stdout: | (launched: 2022-12-08_23:26:20.976201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:22.808625 run osmo-stp_10.42.42.5(pid=27796): stderr: | [0;m[38;5;43m20221208232621169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232621169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232621169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232621170 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232621170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232621170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232621170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:22.963465 run patchelf(pid=27799): Terminating (SIGINT) 23:26:23.142114 run patchelf(pid=27799): Terminated: ok {rc=0} 23:26:23.270311 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27796): Process ended prematurely: osmo-stp_10.42.42.5(pid=27796) [trial-2351↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27796)] [trial-2351↪gprs:oc2g↪ping.py:22] 23:26:23.279654 tst ping.py:22: Test FAILED (6.7 sec) 23:26:23.307826 run osmo-hlr_10.42.42.2(pid=27793): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27793)] 23:26:23.357658 run osmo-hlr_10.42.42.2(pid=27793): stdout: | (launched: 2022-12-08_23:26:19.985255) 23:26:23.409226 run osmo-hlr_10.42.42.2(pid=27793): stderr: | [0;m[1;31m20221208232620181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232620181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232620181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232620181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232620182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232620182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232620193 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232620202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232620202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232620202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:26:23.460911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27792): Terminating (SIGTERM) 23:26:23.502611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27795): Terminating (SIGTERM) 23:26:23.544296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27798): Terminating (SIGTERM) 23:26:23.586343 --- ParallelTerminationStrategy: PID 27792 died... 23:26:23.606342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27792): Terminated: ok {rc=0} 23:26:23.652516 --- ParallelTerminationStrategy: PID 27795 died... 23:26:23.672343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27795): Terminated: ok {rc=0} 23:26:23.718435 --- ParallelTerminationStrategy: PID 27798 died... 23:26:23.738016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27798): Terminated: ok {rc=0} 23:26:23.825996 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 23:26:24.913854 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:24.925926 tst gprs:oc2g: Using 1 x bts (candidates: 1) 23:26:24.964022 tst ping_idle_ping.py: using LAC 17481 23:26:25.083327 tst ping_idle_ping.py: using RAC 141 23:26:25.201618 tst ping_idle_ping.py: using CellId 17481 23:26:25.327080 tst ping_idle_ping.py: using BVCI 17482 23:26:25.442831 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:25.453768 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:25.464409 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:25.475212 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:25.485915 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:25.496534 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:25.507877 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:25.518684 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:26:25.633042 tst ping_idle_ping.py:24: start network... 23:26:25.834099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:26:26.297740 run create_hlr_db(pid=27800): Launched 23:26:26.411824 bus /gobi_6: Setting Powered False 23:26:27.471915 run create_hlr_db(pid=27800): Terminated: ok {rc=0} 23:26:27.907455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27802): Launched 23:26:28.226526 run osmo-hlr_10.42.42.2(pid=27803): Launched 23:26:28.347442 run osmo-stp_10.42.42.5: Starting osmo-stp 23:26:28.900679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27805): Launched 23:26:29.220358 run osmo-stp_10.42.42.5(pid=27806): Launched 23:26:29.341649 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:26:29.893145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27808): Launched 23:26:30.015510 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:26:30.283813 run patchelf(pid=27809): Launched 23:26:30.460533 run osmo-stp_10.42.42.5(pid=27806): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27806)] 23:26:30.595320 run osmo-stp_10.42.42.5(pid=27806): stdout: | (launched: 2022-12-08_23:26:29.162724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:30.731843 run osmo-stp_10.42.42.5(pid=27806): stderr: | [0;m[38;5;43m20221208232629352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232629352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232629353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232629353 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232629355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232629356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232629356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:30.880193 run osmo-stp_10.42.42.5(pid=27806): stdout: | (launched: 2022-12-08_23:26:29.162724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:31.011274 run osmo-stp_10.42.42.5(pid=27806): stderr: | [0;m[38;5;43m20221208232629352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232629352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232629353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232629353 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232629355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232629356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232629356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:31.161842 run patchelf(pid=27809): Terminating (SIGINT) 23:26:31.334997 run patchelf(pid=27809): Terminated: ok {rc=0} 23:26:31.461272 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27806): Process ended prematurely: osmo-stp_10.42.42.5(pid=27806) [trial-2351↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27806)] [trial-2351↪gprs:oc2g↪ping_idle_ping.py:27] 23:26:31.471226 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:26:31.501510 run osmo-hlr_10.42.42.2(pid=27803): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27803)] 23:26:31.551622 run osmo-hlr_10.42.42.2(pid=27803): stdout: | (launched: 2022-12-08_23:26:28.168703) 23:26:31.604258 run osmo-hlr_10.42.42.2(pid=27803): stderr: | [0;m[1;31m20221208232628367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232628367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232628367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232628367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232628367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232628367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232628379 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232628389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232628390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232628390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:26:31.656476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27802): Terminating (SIGTERM) 23:26:31.699733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27805): Terminating (SIGTERM) 23:26:31.743957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27808): Terminating (SIGTERM) 23:26:31.788624 --- ParallelTerminationStrategy: PID 27802 died... 23:26:31.809720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27802): Terminated: ok {rc=0} 23:26:31.858461 --- ParallelTerminationStrategy: PID 27805 died... 23:26:31.878095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27805): Terminated: ok {rc=0} 23:26:31.926280 --- ParallelTerminationStrategy: PID 27808 died... 23:26:31.946113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27808): Terminated: ok {rc=0} 23:26:32.035716 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 23:26:33.330462 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:26:33.336266 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 23:26:33.356882 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 23:26:33.395781 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 23:26:33.482418 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 23:26:33.503179 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 23:26:33.542004 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 23:26:34.134767 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 23:26:34.185434 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:34.196237 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:26:34.233198 tst cs_paging_gprs_active.py: using LAC 17482 23:26:34.358446 tst cs_paging_gprs_active.py: using RAC 142 23:26:34.485052 tst cs_paging_gprs_active.py: using CellId 17482 23:26:34.611000 tst cs_paging_gprs_active.py: using BVCI 17483 23:26:34.728242 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:34.739240 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:34.750015 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:34.760656 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:34.771361 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:34.782095 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:34.792913 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:34.803678 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:34.814607 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:34.931039 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:35.048919 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:26:35.265475 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:35.584419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27813): Launched 23:26:35.860111 run iperf3-srv_10.42.42.10(pid=27814): Launched 23:26:35.979329 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:26:36.194190 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:36.512818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27815): Launched 23:26:36.788407 run iperf3-srv_10.42.42.10(pid=27816): Launched 23:26:36.907302 tst cs_paging_gprs_active.py:38: start network... 23:26:37.122674 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:26:37.617576 run create_hlr_db(pid=27817): Launched 23:26:37.746352 bus /gobi_6: Setting Powered False 23:26:38.809820 run create_hlr_db(pid=27817): Terminated: ok {rc=0} 23:26:39.236695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27819): Launched 23:26:39.536826 run osmo-hlr_10.42.42.2(pid=27820): Launched 23:26:39.651843 run osmo-stp_10.42.42.5: Starting osmo-stp 23:26:40.173396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27822): Launched 23:26:40.472042 run osmo-stp_10.42.42.5(pid=27823): Launched 23:26:40.586970 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:26:41.103895 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27825): Launched 23:26:41.218927 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:26:41.471162 run patchelf(pid=27826): Launched 23:26:41.637876 run osmo-stp_10.42.42.5(pid=27823): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27823)] 23:26:41.764798 run osmo-stp_10.42.42.5(pid=27823): stdout: | (launched: 2022-12-08_23:26:40.417689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:41.893494 run osmo-stp_10.42.42.5(pid=27823): stderr: | [0;m[38;5;43m20221208232640586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232640586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232640587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232640587 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232640587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232640588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232640588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:42.021970 run osmo-stp_10.42.42.5(pid=27823): stdout: | (launched: 2022-12-08_23:26:40.417689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:42.145224 run osmo-stp_10.42.42.5(pid=27823): stderr: | [0;m[38;5;43m20221208232640586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232640586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232640587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232640587 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232640587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232640588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232640588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:42.291129 run patchelf(pid=27826): Terminating (SIGINT) 23:26:42.459399 run patchelf(pid=27826): Terminated: ok {rc=0} 23:26:42.580920 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27823): Process ended prematurely: osmo-stp_10.42.42.5(pid=27823) [trial-2351↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27823)] [trial-2351↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 23:26:42.590474 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 23:26:42.617441 run osmo-hlr_10.42.42.2(pid=27820): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27820)] 23:26:42.664646 run osmo-hlr_10.42.42.2(pid=27820): stdout: | (launched: 2022-12-08_23:26:39.482413) 23:26:42.713428 run osmo-hlr_10.42.42.2(pid=27820): stderr: | [0;m[1;31m20221208232639658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232639658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232639658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232639658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232639658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232639658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232639669 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232639677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232639677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232639677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:26:42.762604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27813): Terminating (SIGTERM) 23:26:42.801747 run iperf3-srv_10.42.42.10(pid=27814): Terminating (SIGTERM) 23:26:42.840904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27815): Terminating (SIGTERM) 23:26:42.880071 run iperf3-srv_10.42.42.10(pid=27816): Terminating (SIGTERM) 23:26:42.919042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27819): Terminating (SIGTERM) 23:26:42.958446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27822): Terminating (SIGTERM) 23:26:42.997644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27825): Terminating (SIGTERM) 23:26:43.036917 --- ParallelTerminationStrategy: PID 27813 died... 23:26:43.055617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27813): Terminated: ok {rc=0} 23:26:43.099209 --- ParallelTerminationStrategy: PID 27814 died... 23:26:43.117303 run iperf3-srv_10.42.42.10(pid=27814): Terminated {rc=256} 23:26:43.160370 --- ParallelTerminationStrategy: PID 27815 died... 23:26:43.178469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27815): Terminated: ok {rc=0} 23:26:43.221802 --- ParallelTerminationStrategy: PID 27816 died... 23:26:43.239950 run iperf3-srv_10.42.42.10(pid=27816): Terminated {rc=256} 23:26:43.283128 --- ParallelTerminationStrategy: PID 27819 died... 23:26:43.301139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27819): Terminated: ok {rc=0} 23:26:43.344310 --- ParallelTerminationStrategy: PID 27822 died... 23:26:43.362454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27822): Terminated: ok {rc=0} 23:26:43.405787 --- ParallelTerminationStrategy: PID 27825 died... 23:26:43.424067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27825): Terminated: ok {rc=0} 23:26:43.508577 bus /gobi_0: Setting Powered False 23:26:44.607600 bus /gobi_0: Setting Powered False 23:26:45.721050 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 23:26:46.866685 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:46.879563 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:26:46.917288 tst iperf3.py: using LAC 17483 23:26:47.045470 tst iperf3.py: using RAC 143 23:26:47.168748 tst iperf3.py: using CellId 17483 23:26:47.297442 tst iperf3.py: using BVCI 17484 23:26:47.414253 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:47.425361 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:47.436433 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:47.447543 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:47.458531 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:47.469516 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:47.480402 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:47.491455 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:47.502620 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:47.617512 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:26:47.817767 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:48.117444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27827): Launched 23:26:48.376624 run iperf3-srv_10.42.42.10(pid=27828): Launched 23:26:48.488671 tst iperf3.py:8: start network... 23:26:48.688217 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:26:49.150816 run create_hlr_db(pid=27829): Launched 23:26:49.265343 bus /gobi_6: Setting Powered False 23:26:50.324835 run create_hlr_db(pid=27829): Terminated: ok {rc=0} 23:26:50.758480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27831): Launched 23:26:51.076643 run osmo-hlr_10.42.42.2(pid=27832): Launched 23:26:51.198042 run osmo-stp_10.42.42.5: Starting osmo-stp 23:26:51.746366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27834): Launched 23:26:52.065993 run osmo-stp_10.42.42.5(pid=27835): Launched 23:26:52.187107 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:26:52.736238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27837): Launched 23:26:52.858096 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:26:53.126927 run patchelf(pid=27838): Launched 23:26:53.303903 run osmo-stp_10.42.42.5(pid=27835): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27835)] 23:26:53.439087 run osmo-stp_10.42.42.5(pid=27835): stdout: | (launched: 2022-12-08_23:26:52.008239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:53.575969 run osmo-stp_10.42.42.5(pid=27835): stderr: | [0;m[38;5;43m20221208232652200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232652200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232652200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232652201 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232652201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232652201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232652201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:53.712941 run osmo-stp_10.42.42.5(pid=27835): stdout: | (launched: 2022-12-08_23:26:52.008239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:53.843355 run osmo-stp_10.42.42.5(pid=27835): stderr: | [0;m[38;5;43m20221208232652200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232652200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232652200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232652201 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232652201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232652201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232652201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:53.998258 run patchelf(pid=27838): Terminating (SIGINT) 23:26:54.176138 run patchelf(pid=27838): Terminated: ok {rc=0} 23:26:54.304560 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27835): Process ended prematurely: osmo-stp_10.42.42.5(pid=27835) [trial-2351↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27835)] [trial-2351↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 23:26:54.314868 tst iperf3.py:8: Test FAILED (7.5 sec) 23:26:54.342902 run osmo-hlr_10.42.42.2(pid=27832): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27832)] 23:26:54.392507 run osmo-hlr_10.42.42.2(pid=27832): stdout: | (launched: 2022-12-08_23:26:51.019374) 23:26:54.443981 run osmo-hlr_10.42.42.2(pid=27832): stderr: | [0;m[1;31m20221208232651218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232651218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232651218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232651218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232651218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232651218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232651231 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232651241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232651242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232651242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:26:54.495655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27827): Terminating (SIGTERM) 23:26:54.537872 run iperf3-srv_10.42.42.10(pid=27828): Terminating (SIGTERM) 23:26:54.579530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27831): Terminating (SIGTERM) 23:26:54.621213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27834): Terminating (SIGTERM) 23:26:54.662948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27837): Terminating (SIGTERM) 23:26:54.704764 --- ParallelTerminationStrategy: PID 27827 died... 23:26:54.724556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27827): Terminated: ok {rc=0} 23:26:54.770338 --- ParallelTerminationStrategy: PID 27828 died... 23:26:54.789597 run iperf3-srv_10.42.42.10(pid=27828): Terminated {rc=256} 23:26:54.835139 --- ParallelTerminationStrategy: PID 27831 died... 23:26:54.854474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27831): Terminated: ok {rc=0} 23:26:54.900254 --- ParallelTerminationStrategy: PID 27834 died... 23:26:54.919623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27834): Terminated: ok {rc=0} 23:26:54.965788 --- ParallelTerminationStrategy: PID 27837 died... 23:26:54.985161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27837): Terminated: ok {rc=0} 23:26:55.072647 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 23:26:56.218942 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:56.233052 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:26:56.267023 tst iperf3m4.py: using LAC 17484 23:26:56.385856 tst iperf3m4.py: using RAC 144 23:26:56.514258 tst iperf3m4.py: using CellId 17484 23:26:56.640480 tst iperf3m4.py: using BVCI 17485 23:26:56.756162 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:56.767530 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:56.778649 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:56.789719 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:56.800483 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:56.811302 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:56.822359 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:56.833155 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:56.844056 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:56.964258 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:57.079931 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:57.198752 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:57.316437 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:26:57.531956 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:57.851592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27839): Launched 23:26:58.128546 run iperf3-srv_10.42.42.10(pid=27840): Launched 23:26:58.247739 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:26:58.461919 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:58.780394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27841): Launched 23:26:59.056341 run iperf3-srv_10.42.42.10(pid=27842): Launched 23:26:59.175260 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:26:59.389883 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:59.708058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27843): Launched 23:26:59.984490 run iperf3-srv_10.42.42.10(pid=27844): Launched 23:27:00.103731 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:27:00.318561 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:00.637465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27845): Launched 23:27:00.933648 run iperf3-srv_10.42.42.10(pid=27846): Launched 23:27:01.063251 tst iperf3m4.py:8: start network... 23:27:01.281686 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:27:01.790960 run create_hlr_db(pid=27847): Launched 23:27:01.949264 bus /gobi_6: Setting Powered False 23:27:03.008759 run create_hlr_db(pid=27847): Terminated: ok {rc=0} 23:27:03.487189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27849): Launched 23:27:03.805553 run osmo-hlr_10.42.42.2(pid=27850): Launched 23:27:03.926278 run osmo-stp_10.42.42.5: Starting osmo-stp 23:27:04.474958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27852): Launched 23:27:04.792654 run osmo-stp_10.42.42.5(pid=27853): Launched 23:27:04.913999 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:27:05.432334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27855): Launched 23:27:05.549126 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:27:05.803653 run patchelf(pid=27856): Launched 23:27:05.971403 run osmo-stp_10.42.42.5(pid=27853): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27853)] 23:27:06.099188 run osmo-stp_10.42.42.5(pid=27853): stdout: | (launched: 2022-12-08_23:27:04.735180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:06.228896 run osmo-stp_10.42.42.5(pid=27853): stderr: | [0;m[38;5;43m20221208232704906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232704906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232704906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232704907 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232704907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232704907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232704907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:06.358701 run osmo-stp_10.42.42.5(pid=27853): stdout: | (launched: 2022-12-08_23:27:04.735180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:06.482488 run osmo-stp_10.42.42.5(pid=27853): stderr: | [0;m[38;5;43m20221208232704906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232704906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232704906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232704907 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232704907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232704907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232704907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:06.628494 run patchelf(pid=27856): Terminating (SIGINT) 23:27:06.797204 run patchelf(pid=27856): Terminated: ok {rc=0} 23:27:06.918912 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27853): Process ended prematurely: osmo-stp_10.42.42.5(pid=27853) [trial-2351↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27853)] [trial-2351↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 23:27:06.928438 tst iperf3m4.py:8: Test FAILED (10.7 sec) 23:27:06.955527 run osmo-hlr_10.42.42.2(pid=27850): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27850)] 23:27:07.003436 run osmo-hlr_10.42.42.2(pid=27850): stdout: | (launched: 2022-12-08_23:27:03.747627) 23:27:07.052586 run osmo-hlr_10.42.42.2(pid=27850): stderr: | [0;m[1;31m20221208232703945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232703945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232703945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232703945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232703945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232703946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232703959 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232703969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232703969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232703969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:27:07.101901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27839): Terminating (SIGTERM) 23:27:07.140685 run iperf3-srv_10.42.42.10(pid=27840): Terminating (SIGTERM) 23:27:07.179657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27841): Terminating (SIGTERM) 23:27:07.218571 run iperf3-srv_10.42.42.10(pid=27842): Terminating (SIGTERM) 23:27:07.257436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27843): Terminating (SIGTERM) 23:27:07.296382 run iperf3-srv_10.42.42.10(pid=27844): Terminating (SIGTERM) 23:27:07.335306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27845): Terminating (SIGTERM) 23:27:07.374591 run iperf3-srv_10.42.42.10(pid=27846): Terminating (SIGTERM) 23:27:07.413614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27849): Terminating (SIGTERM) 23:27:07.453111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27852): Terminating (SIGTERM) 23:27:07.492095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27855): Terminating (SIGTERM) 23:27:07.531550 --- ParallelTerminationStrategy: PID 27839 died... 23:27:07.550100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27839): Terminated: ok {rc=0} 23:27:07.594117 --- ParallelTerminationStrategy: PID 27840 died... 23:27:07.612151 run iperf3-srv_10.42.42.10(pid=27840): Terminated {rc=256} 23:27:07.655764 --- ParallelTerminationStrategy: PID 27841 died... 23:27:07.674034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27841): Terminated: ok {rc=0} 23:27:07.717358 --- ParallelTerminationStrategy: PID 27842 died... 23:27:07.735324 run iperf3-srv_10.42.42.10(pid=27842): Terminated {rc=256} 23:27:07.779051 --- ParallelTerminationStrategy: PID 27843 died... 23:27:07.797267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27843): Terminated: ok {rc=0} 23:27:07.840236 --- ParallelTerminationStrategy: PID 27844 died... 23:27:07.859062 run iperf3-srv_10.42.42.10(pid=27844): Terminated {rc=256} 23:27:07.902258 --- ParallelTerminationStrategy: PID 27845 died... 23:27:07.920258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27845): Terminated: ok {rc=0} 23:27:07.963538 --- ParallelTerminationStrategy: PID 27846 died... 23:27:07.982130 run iperf3-srv_10.42.42.10(pid=27846): Terminated {rc=256} 23:27:08.025390 --- ParallelTerminationStrategy: PID 27849 died... 23:27:08.043523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27849): Terminated: ok {rc=0} 23:27:08.086861 --- ParallelTerminationStrategy: PID 27852 died... 23:27:08.105094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27852): Terminated: ok {rc=0} 23:27:08.148796 --- ParallelTerminationStrategy: PID 27855 died... 23:27:08.167473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27855): Terminated: ok {rc=0} 23:27:08.249526 bus /gobi_4: Setting Powered False 23:27:09.346548 bus /gobi_4: Setting Powered False 23:27:10.460852 bus /gobi_1: Setting Powered False 23:27:11.557684 bus /gobi_1: Setting Powered False 23:27:12.671183 bus /gobi_0: Setting Powered False 23:27:13.767432 bus /gobi_0: Setting Powered False 23:27:14.881525 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 23:27:15.979973 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:15.991698 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:27:16.031889 tst ping.py: using LAC 17485 23:27:16.185187 tst ping.py: using RAC 145 23:27:16.304279 tst ping.py: using CellId 17485 23:27:16.464336 tst ping.py: using BVCI 17486 23:27:16.610627 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:16.625096 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:16.638620 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:16.649622 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:16.660605 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:16.671972 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:16.683279 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:16.694576 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:27:16.809311 tst ping.py:19: start network... 23:27:17.010520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:27:17.470242 run create_hlr_db(pid=27857): Launched 23:27:17.581584 bus /gobi_6: Setting Powered False 23:27:18.640422 run create_hlr_db(pid=27857): Terminated: ok {rc=0} 23:27:19.050149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27859): Launched 23:27:19.343067 run osmo-hlr_10.42.42.2(pid=27860): Launched 23:27:19.454725 run osmo-stp_10.42.42.5: Starting osmo-stp 23:27:19.975323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27862): Launched 23:27:20.270204 run osmo-stp_10.42.42.5(pid=27863): Launched 23:27:20.382164 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:27:20.887162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27865): Launched 23:27:20.999788 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:27:21.247450 run patchelf(pid=27866): Launched 23:27:21.411335 run osmo-stp_10.42.42.5(pid=27863): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27863)] 23:27:21.536924 run osmo-stp_10.42.42.5(pid=27863): stdout: | (launched: 2022-12-08_23:27:20.216291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:21.664075 run osmo-stp_10.42.42.5(pid=27863): stderr: | [0;m[38;5;43m20221208232720386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232720386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232720386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232720386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232720387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232720387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232720387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:21.790925 run osmo-stp_10.42.42.5(pid=27863): stdout: | (launched: 2022-12-08_23:27:20.216291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:21.911767 run osmo-stp_10.42.42.5(pid=27863): stderr: | [0;m[38;5;43m20221208232720386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232720386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232720386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232720386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232720387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232720387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232720387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:22.054845 run patchelf(pid=27866): Terminating (SIGINT) 23:27:22.220459 run patchelf(pid=27866): Terminated: ok {rc=0} 23:27:22.339771 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27863): Process ended prematurely: osmo-stp_10.42.42.5(pid=27863) [trial-2351↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27863)] [trial-2351↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 23:27:22.348603 tst ping.py:22: Test FAILED (6.4 sec) 23:27:22.375401 run osmo-hlr_10.42.42.2(pid=27860): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27860)] 23:27:22.423179 run osmo-hlr_10.42.42.2(pid=27860): stdout: | (launched: 2022-12-08_23:27:19.289586) 23:27:22.472143 run osmo-hlr_10.42.42.2(pid=27860): stderr: | [0;m[1;31m20221208232719463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232719463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232719463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232719463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232719463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232719463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232719475 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232719484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232719484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232719484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:27:22.521639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27859): Terminating (SIGTERM) 23:27:22.561385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27862): Terminating (SIGTERM) 23:27:22.600983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27865): Terminating (SIGTERM) 23:27:22.640699 --- ParallelTerminationStrategy: PID 27859 died... 23:27:22.659661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27859): Terminated: ok {rc=0} 23:27:22.703767 --- ParallelTerminationStrategy: PID 27862 died... 23:27:22.722335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27862): Terminated: ok {rc=0} 23:27:22.766078 --- ParallelTerminationStrategy: PID 27865 died... 23:27:22.784310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27865): Terminated: ok {rc=0} 23:27:22.866916 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 23:27:23.953433 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:23.965339 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:27:24.004577 tst ping_idle_ping.py: using LAC 17486 23:27:24.129184 tst ping_idle_ping.py: using RAC 146 23:27:24.256395 tst ping_idle_ping.py: using CellId 17486 23:27:24.379165 tst ping_idle_ping.py: using BVCI 17487 23:27:24.494037 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:24.505121 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:24.516022 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:24.527148 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:24.538018 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:24.548733 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:24.560508 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:24.571696 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:27:24.684600 tst ping_idle_ping.py:24: start network... 23:27:24.883123 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:27:25.342665 run create_hlr_db(pid=27867): Launched 23:27:25.456271 bus /gobi_6: Setting Powered False 23:27:26.515578 run create_hlr_db(pid=27867): Terminated: ok {rc=0} 23:27:26.948525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27869): Launched 23:27:27.264052 run osmo-hlr_10.42.42.2(pid=27870): Launched 23:27:27.384646 run osmo-stp_10.42.42.5: Starting osmo-stp 23:27:27.928715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27872): Launched 23:27:28.244151 run osmo-stp_10.42.42.5(pid=27873): Launched 23:27:28.364210 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:27:28.908066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27875): Launched 23:27:29.029786 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:27:29.295784 run patchelf(pid=27876): Launched 23:27:29.471481 run osmo-stp_10.42.42.5(pid=27873): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27873)] 23:27:29.606094 run osmo-stp_10.42.42.5(pid=27873): stdout: | (launched: 2022-12-08_23:27:28.187295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:29.742017 run osmo-stp_10.42.42.5(pid=27873): stderr: | [0;m[38;5;43m20221208232728378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232728378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232728378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232728378 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232728379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232728379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232728379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:29.877586 run osmo-stp_10.42.42.5(pid=27873): stdout: | (launched: 2022-12-08_23:27:28.187295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:30.007459 run osmo-stp_10.42.42.5(pid=27873): stderr: | [0;m[38;5;43m20221208232728378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232728378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232728378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232728378 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232728379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232728379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232728379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:30.160857 run patchelf(pid=27876): Terminating (SIGINT) 23:27:30.337895 run patchelf(pid=27876): Terminated: ok {rc=0} 23:27:30.465513 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27873): Process ended prematurely: osmo-stp_10.42.42.5(pid=27873) [trial-2351↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27873)] [trial-2351↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 23:27:30.475051 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:27:30.502762 run osmo-hlr_10.42.42.2(pid=27870): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27870)] 23:27:30.552622 run osmo-hlr_10.42.42.2(pid=27870): stdout: | (launched: 2022-12-08_23:27:27.207325) 23:27:30.604338 run osmo-hlr_10.42.42.2(pid=27870): stderr: | [0;m[1;31m20221208232727404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232727404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232727404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232727404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232727404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232727404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232727419 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232727428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232727428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232727428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:27:30.656258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27869): Terminating (SIGTERM) 23:27:30.698231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27872): Terminating (SIGTERM) 23:27:30.740163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27875): Terminating (SIGTERM) 23:27:30.782447 --- ParallelTerminationStrategy: PID 27869 died... 23:27:30.802538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27869): Terminated: ok {rc=0} 23:27:30.869941 --- ParallelTerminationStrategy: PID 27872 died... 23:27:30.892522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27872): Terminated: ok {rc=0} 23:27:30.957749 --- ParallelTerminationStrategy: PID 27875 died... 23:27:30.977723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27875): Terminated: ok {rc=0} 23:27:31.066938 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 23:27:32.357719 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:27:32.363931 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 23:27:32.385245 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 23:27:32.423413 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 23:27:32.508991 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 23:27:32.529577 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 23:27:32.567278 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 23:27:33.161857 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 23:27:33.212480 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:33.223353 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:27:33.281292 tst cs_paging_gprs_active.py: using LAC 17487 23:27:33.398699 tst cs_paging_gprs_active.py: using RAC 147 23:27:33.516147 tst cs_paging_gprs_active.py: using CellId 17487 23:27:33.642709 tst cs_paging_gprs_active.py: using BVCI 17488 23:27:33.761509 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:33.772775 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:33.783630 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:33.795200 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:33.806699 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:33.818254 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:33.829913 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:33.841115 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:33.852504 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:33.967922 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:34.083096 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:27:34.287186 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:34.588497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27880): Launched 23:27:34.849645 run iperf3-srv_10.42.42.10(pid=27881): Launched 23:27:34.962468 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:27:35.163965 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:35.465033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27882): Launched 23:27:35.727248 run iperf3-srv_10.42.42.10(pid=27885): Launched 23:27:35.845727 tst cs_paging_gprs_active.py:38: start network... 23:27:36.048201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:27:36.513672 run create_hlr_db(pid=27888): Launched 23:27:36.628755 bus /gobi_6: Setting Powered False 23:27:37.688092 run create_hlr_db(pid=27888): Terminated: ok {rc=0} 23:27:38.126427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27890): Launched 23:27:38.445943 run osmo-hlr_10.42.42.2(pid=27891): Launched 23:27:38.568909 run osmo-stp_10.42.42.5: Starting osmo-stp 23:27:39.123656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27893): Launched 23:27:39.443119 run osmo-stp_10.42.42.5(pid=27894): Launched 23:27:39.565467 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:27:40.120235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27896): Launched 23:27:40.243203 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:27:40.513302 run patchelf(pid=27897): Launched 23:27:40.691414 run osmo-stp_10.42.42.5(pid=27894): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27894)] 23:27:40.827783 run osmo-stp_10.42.42.5(pid=27894): stdout: | (launched: 2022-12-08_23:27:39.385749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:40.965509 run osmo-stp_10.42.42.5(pid=27894): stderr: | [0;m[38;5;43m20221208232739575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232739575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232739576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232739576 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232739578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232739579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232739579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:41.104437 run osmo-stp_10.42.42.5(pid=27894): stdout: | (launched: 2022-12-08_23:27:39.385749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:41.235960 run osmo-stp_10.42.42.5(pid=27894): stderr: | [0;m[38;5;43m20221208232739575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232739575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232739576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232739576 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232739578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232739579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232739579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:41.391942 run patchelf(pid=27897): Terminating (SIGINT) 23:27:41.572055 run patchelf(pid=27897): Terminated: ok {rc=0} 23:27:41.702994 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27894): Process ended prematurely: osmo-stp_10.42.42.5(pid=27894) [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27894)] [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 23:27:41.713282 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 23:27:41.741366 run osmo-hlr_10.42.42.2(pid=27891): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27891)] 23:27:41.791059 run osmo-hlr_10.42.42.2(pid=27891): stdout: | (launched: 2022-12-08_23:27:38.388300) 23:27:41.842453 run osmo-hlr_10.42.42.2(pid=27891): stderr: | [0;m[1;31m20221208232738585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232738585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232738585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232738585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232738585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232738585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232738598 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232738606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232738606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232738607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:27:41.894406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27880): Terminating (SIGTERM) 23:27:41.935801 run iperf3-srv_10.42.42.10(pid=27881): Terminating (SIGTERM) 23:27:41.978490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27882): Terminating (SIGTERM) 23:27:42.020460 run iperf3-srv_10.42.42.10(pid=27885): Terminating (SIGTERM) 23:27:42.061862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27890): Terminating (SIGTERM) 23:27:42.103396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27893): Terminating (SIGTERM) 23:27:42.144625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27896): Terminating (SIGTERM) 23:27:42.186095 --- ParallelTerminationStrategy: PID 27880 died... 23:27:42.205728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27880): Terminated: ok {rc=0} 23:27:42.251190 --- ParallelTerminationStrategy: PID 27881 died... 23:27:42.270413 run iperf3-srv_10.42.42.10(pid=27881): Terminated {rc=256} 23:27:42.315613 --- ParallelTerminationStrategy: PID 27882 died... 23:27:42.334817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27882): Terminated: ok {rc=0} 23:27:42.379819 --- ParallelTerminationStrategy: PID 27885 died... 23:27:42.398954 run iperf3-srv_10.42.42.10(pid=27885): Terminated {rc=256} 23:27:42.444037 --- ParallelTerminationStrategy: PID 27890 died... 23:27:42.463356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27890): Terminated: ok {rc=0} 23:27:42.508579 --- ParallelTerminationStrategy: PID 27893 died... 23:27:42.527859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27893): Terminated: ok {rc=0} 23:27:42.573124 --- ParallelTerminationStrategy: PID 27896 died... 23:27:42.592348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27896): Terminated: ok {rc=0} 23:27:42.677971 bus /gobi_0: Setting Powered False 23:27:43.775272 bus /gobi_0: Setting Powered False 23:27:44.890439 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 23:27:46.061544 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:46.077050 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:27:46.153509 tst iperf3.py: using LAC 17488 23:27:46.281677 tst iperf3.py: using RAC 148 23:27:46.409494 tst iperf3.py: using CellId 17488 23:27:46.535469 tst iperf3.py: using BVCI 17489 23:27:46.695933 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:46.711270 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:46.725738 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:46.740801 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:46.754502 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:46.766192 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:46.781859 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:46.799396 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:46.816219 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:46.962884 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:27:47.209968 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:47.518405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27899): Launched 23:27:47.780599 run iperf3-srv_10.42.42.10(pid=27900): Launched 23:27:47.894192 tst iperf3.py:8: start network... 23:27:48.095812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:27:48.560083 run create_hlr_db(pid=27901): Launched 23:27:48.675556 bus /gobi_6: Setting Powered False 23:27:49.735182 run create_hlr_db(pid=27901): Terminated: ok {rc=0} 23:27:50.153459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27903): Launched 23:27:50.453557 run osmo-hlr_10.42.42.2(pid=27904): Launched 23:27:50.568428 run osmo-stp_10.42.42.5: Starting osmo-stp 23:27:51.084838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27906): Launched 23:27:51.383626 run osmo-stp_10.42.42.5(pid=27907): Launched 23:27:51.498480 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:27:52.015163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27909): Launched 23:27:52.129985 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:27:52.381606 run patchelf(pid=27910): Launched 23:27:52.547678 run osmo-stp_10.42.42.5(pid=27907): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27907)] 23:27:52.674324 run osmo-stp_10.42.42.5(pid=27907): stdout: | (launched: 2022-12-08_23:27:51.329334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:52.803009 run osmo-stp_10.42.42.5(pid=27907): stderr: | [0;m[38;5;43m20221208232751499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232751500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232751500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232751500 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232751501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232751501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232751501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:52.931783 run osmo-stp_10.42.42.5(pid=27907): stdout: | (launched: 2022-12-08_23:27:51.329334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:53.054524 run osmo-stp_10.42.42.5(pid=27907): stderr: | [0;m[38;5;43m20221208232751499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232751500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232751500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232751500 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232751501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232751501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232751501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:53.199548 run patchelf(pid=27910): Terminating (SIGINT) 23:27:53.366726 run patchelf(pid=27910): Terminated: ok {rc=0} 23:27:53.488082 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27907): Process ended prematurely: osmo-stp_10.42.42.5(pid=27907) [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27907)] [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 23:27:53.497599 tst iperf3.py:8: Test FAILED (7.5 sec) 23:27:53.524394 run osmo-hlr_10.42.42.2(pid=27904): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27904)] 23:27:53.571726 run osmo-hlr_10.42.42.2(pid=27904): stdout: | (launched: 2022-12-08_23:27:50.399418) 23:27:53.620533 run osmo-hlr_10.42.42.2(pid=27904): stderr: | [0;m[1;31m20221208232750575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232750575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232750575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232750575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232750575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232750575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232750587 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232750596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232750597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232750597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:27:53.669772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27899): Terminating (SIGTERM) 23:27:53.708853 run iperf3-srv_10.42.42.10(pid=27900): Terminating (SIGTERM) 23:27:53.747555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27903): Terminating (SIGTERM) 23:27:53.787074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27906): Terminating (SIGTERM) 23:27:53.826352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27909): Terminating (SIGTERM) 23:27:53.865580 --- ParallelTerminationStrategy: PID 27899 died... 23:27:53.884100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27899): Terminated: ok {rc=0} 23:27:53.927801 --- ParallelTerminationStrategy: PID 27900 died... 23:27:53.945878 run iperf3-srv_10.42.42.10(pid=27900): Terminated {rc=256} 23:27:53.988787 --- ParallelTerminationStrategy: PID 27903 died... 23:27:54.006902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27903): Terminated: ok {rc=0} 23:27:54.050532 --- ParallelTerminationStrategy: PID 27906 died... 23:27:54.068566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27906): Terminated: ok {rc=0} 23:27:54.112239 --- ParallelTerminationStrategy: PID 27909 died... 23:27:54.130359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27909): Terminated: ok {rc=0} 23:27:54.214835 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 23:27:55.359866 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:55.371221 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:27:55.428585 tst iperf3m4.py: using LAC 17489 23:27:55.548560 tst iperf3m4.py: using RAC 149 23:27:55.675658 tst iperf3m4.py: using CellId 17489 23:27:55.802789 tst iperf3m4.py: using BVCI 17490 23:27:55.919136 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:55.930639 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:55.941849 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:55.953766 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:55.965498 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:55.976816 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:55.988545 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:56.000337 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:56.012013 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:56.130150 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:56.247977 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:56.363593 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:56.481031 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:27:56.682839 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:56.984030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27911): Launched 23:27:57.246617 run iperf3-srv_10.42.42.10(pid=27912): Launched 23:27:57.360028 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:27:57.561441 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:57.862468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27913): Launched 23:27:58.123671 run iperf3-srv_10.42.42.10(pid=27914): Launched 23:27:58.236823 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:27:58.437660 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:58.738572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27915): Launched 23:27:59.000323 run iperf3-srv_10.42.42.10(pid=27916): Launched 23:27:59.120636 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:27:59.336134 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:59.657387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27917): Launched 23:27:59.936366 run iperf3-srv_10.42.42.10(pid=27918): Launched 23:28:00.057026 tst iperf3m4.py:8: start network... 23:28:00.272627 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:00.767847 run create_hlr_db(pid=27919): Launched 23:28:00.933658 bus /gobi_6: Setting Powered False 23:28:01.995948 run create_hlr_db(pid=27919): Terminated: ok {rc=0} 23:28:02.459924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27921): Launched 23:28:02.778696 run osmo-hlr_10.42.42.2(pid=27922): Launched 23:28:02.899651 run osmo-stp_10.42.42.5: Starting osmo-stp 23:28:03.451962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27924): Launched 23:28:03.770974 run osmo-stp_10.42.42.5(pid=27925): Launched 23:28:03.893426 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:28:04.444543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27927): Launched 23:28:04.566684 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:28:04.835760 run patchelf(pid=27928): Launched 23:28:05.014490 run osmo-stp_10.42.42.5(pid=27925): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27925)] 23:28:05.150413 run osmo-stp_10.42.42.5(pid=27925): stdout: | (launched: 2022-12-08_23:28:03.713180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:05.287787 run osmo-stp_10.42.42.5(pid=27925): stderr: | [0;m[38;5;43m20221208232803904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232803904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232803904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232803905 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232803905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232803905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232803905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:05.425090 run osmo-stp_10.42.42.5(pid=27925): stdout: | (launched: 2022-12-08_23:28:03.713180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:05.555849 run osmo-stp_10.42.42.5(pid=27925): stderr: | [0;m[38;5;43m20221208232803904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232803904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232803904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232803905 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232803905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232803905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232803905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:05.711022 run patchelf(pid=27928): Terminating (SIGINT) 23:28:05.890460 run patchelf(pid=27928): Terminated: ok {rc=0} 23:28:06.019995 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27925): Process ended prematurely: osmo-stp_10.42.42.5(pid=27925) [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27925)] [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 23:28:06.030099 tst iperf3m4.py:8: Test FAILED (10.7 sec) 23:28:06.058606 run osmo-hlr_10.42.42.2(pid=27922): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27922)] 23:28:06.108157 run osmo-hlr_10.42.42.2(pid=27922): stdout: | (launched: 2022-12-08_23:28:02.720887) 23:28:06.159302 run osmo-hlr_10.42.42.2(pid=27922): stderr: | [0;m[1;31m20221208232802918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232802918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232802918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232802918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232802918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232802918 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232802930 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232802939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232802939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232802939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:28:06.210778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27911): Terminating (SIGTERM) 23:28:06.252185 run iperf3-srv_10.42.42.10(pid=27912): Terminating (SIGTERM) 23:28:06.293647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27913): Terminating (SIGTERM) 23:28:06.335129 run iperf3-srv_10.42.42.10(pid=27914): Terminating (SIGTERM) 23:28:06.376373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27915): Terminating (SIGTERM) 23:28:06.417976 run iperf3-srv_10.42.42.10(pid=27916): Terminating (SIGTERM) 23:28:06.459410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27917): Terminating (SIGTERM) 23:28:06.500778 run iperf3-srv_10.42.42.10(pid=27918): Terminating (SIGTERM) 23:28:06.542115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27921): Terminating (SIGTERM) 23:28:06.583442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27924): Terminating (SIGTERM) 23:28:06.624778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27927): Terminating (SIGTERM) 23:28:06.666364 --- ParallelTerminationStrategy: PID 27911 died... 23:28:06.686074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27911): Terminated: ok {rc=0} 23:28:06.732137 --- ParallelTerminationStrategy: PID 27912 died... 23:28:06.751419 run iperf3-srv_10.42.42.10(pid=27912): Terminated {rc=256} 23:28:06.796856 --- ParallelTerminationStrategy: PID 27913 died... 23:28:06.816605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27913): Terminated: ok {rc=0} 23:28:06.862392 --- ParallelTerminationStrategy: PID 27914 died... 23:28:06.881721 run iperf3-srv_10.42.42.10(pid=27914): Terminated {rc=256} 23:28:06.927236 --- ParallelTerminationStrategy: PID 27915 died... 23:28:06.946573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27915): Terminated: ok {rc=0} 23:28:06.992090 --- ParallelTerminationStrategy: PID 27916 died... 23:28:07.011638 run iperf3-srv_10.42.42.10(pid=27916): Terminated {rc=256} 23:28:07.057434 --- ParallelTerminationStrategy: PID 27917 died... 23:28:07.076669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27917): Terminated: ok {rc=0} 23:28:07.122202 --- ParallelTerminationStrategy: PID 27918 died... 23:28:07.141489 run iperf3-srv_10.42.42.10(pid=27918): Terminated {rc=256} 23:28:07.186828 --- ParallelTerminationStrategy: PID 27921 died... 23:28:07.206163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27921): Terminated: ok {rc=0} 23:28:07.251845 --- ParallelTerminationStrategy: PID 27924 died... 23:28:07.271312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27924): Terminated: ok {rc=0} 23:28:07.317195 --- ParallelTerminationStrategy: PID 27927 died... 23:28:07.336497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27927): Terminated: ok {rc=0} 23:28:07.422630 bus /gobi_4: Setting Powered False 23:28:08.521723 bus /gobi_4: Setting Powered False 23:28:09.637621 bus /gobi_1: Setting Powered False 23:28:10.735963 bus /gobi_1: Setting Powered False 23:28:11.853550 bus /gobi_0: Setting Powered False 23:28:12.951289 bus /gobi_0: Setting Powered False 23:28:14.065784 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 23:28:15.167650 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:15.178929 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:28:15.235312 tst ping.py: using LAC 17490 23:28:15.352013 tst ping.py: using RAC 150 23:28:15.467323 tst ping.py: using CellId 17490 23:28:15.583726 tst ping.py: using BVCI 17491 23:28:15.689998 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:15.701216 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:15.711711 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:15.722721 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:15.733693 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:15.744388 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:15.755411 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:15.766463 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:28:15.890610 tst ping.py:19: start network... 23:28:16.128180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:16.664202 run create_hlr_db(pid=27929): Launched 23:28:16.810814 bus /gobi_6: Setting Powered False 23:28:17.870481 run create_hlr_db(pid=27929): Terminated: ok {rc=0} 23:28:18.283141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27931): Launched 23:28:18.577169 run osmo-hlr_10.42.42.2(pid=27932): Launched 23:28:18.690118 run osmo-stp_10.42.42.5: Starting osmo-stp 23:28:19.197844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27934): Launched 23:28:19.491886 run osmo-stp_10.42.42.5(pid=27935): Launched 23:28:19.604337 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:28:20.115619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27937): Launched 23:28:20.229034 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:28:20.478080 run patchelf(pid=27938): Launched 23:28:20.642812 run osmo-stp_10.42.42.5(pid=27935): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27935)] 23:28:20.768343 run osmo-stp_10.42.42.5(pid=27935): stdout: | (launched: 2022-12-08_23:28:19.438089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:20.895950 run osmo-stp_10.42.42.5(pid=27935): stderr: | [0;m[38;5;43m20221208232819608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232819609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232819609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232819609 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232819610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232819610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232819610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:21.023715 run osmo-stp_10.42.42.5(pid=27935): stdout: | (launched: 2022-12-08_23:28:19.438089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:21.145543 run osmo-stp_10.42.42.5(pid=27935): stderr: | [0;m[38;5;43m20221208232819608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232819609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232819609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232819609 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232819610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232819610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232819610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:21.289572 run patchelf(pid=27938): Terminating (SIGINT) 23:28:21.455648 run patchelf(pid=27938): Terminated: ok {rc=0} 23:28:21.575626 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27935): Process ended prematurely: osmo-stp_10.42.42.5(pid=27935) [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27935)] [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 23:28:21.584647 tst ping.py:22: Test FAILED (6.4 sec) 23:28:21.611673 run osmo-hlr_10.42.42.2(pid=27932): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27932)] 23:28:21.659775 run osmo-hlr_10.42.42.2(pid=27932): stdout: | (launched: 2022-12-08_23:28:18.523762) 23:28:21.709211 run osmo-hlr_10.42.42.2(pid=27932): stderr: | [0;m[1;31m20221208232818698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232818698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232818698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232818698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232818698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232818698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232818725 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232818735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232818735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232818736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:28:21.758975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27931): Terminating (SIGTERM) 23:28:21.798889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27934): Terminating (SIGTERM) 23:28:21.839096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27937): Terminating (SIGTERM) 23:28:21.879352 --- ParallelTerminationStrategy: PID 27931 died... 23:28:21.898643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27931): Terminated: ok {rc=0} 23:28:21.943102 --- ParallelTerminationStrategy: PID 27934 died... 23:28:21.961800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27934): Terminated: ok {rc=0} 23:28:22.006301 --- ParallelTerminationStrategy: PID 27937 died... 23:28:22.024911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27937): Terminated: ok {rc=0} 23:28:22.108341 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 23:28:23.194622 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:23.206613 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:28:23.269773 tst ping_idle_ping.py: using LAC 17491 23:28:23.393503 tst ping_idle_ping.py: using RAC 151 23:28:23.520881 tst ping_idle_ping.py: using CellId 17491 23:28:23.645301 tst ping_idle_ping.py: using BVCI 17492 23:28:23.761768 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:23.773027 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:23.784045 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:23.795446 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:23.806587 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:23.817865 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:23.829259 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:23.840389 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:28:23.952928 tst ping_idle_ping.py:24: start network... 23:28:24.153214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:24.613177 run create_hlr_db(pid=27939): Launched 23:28:24.726797 bus /gobi_6: Setting Powered False 23:28:25.786174 run create_hlr_db(pid=27939): Terminated: ok {rc=0} 23:28:26.220521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27941): Launched 23:28:26.536055 run osmo-hlr_10.42.42.2(pid=27942): Launched 23:28:26.657192 run osmo-stp_10.42.42.5: Starting osmo-stp 23:28:27.201536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27944): Launched 23:28:27.516019 run osmo-stp_10.42.42.5(pid=27945): Launched 23:28:27.636533 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:28:28.181933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27947): Launched 23:28:28.302644 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:28:28.568486 run patchelf(pid=27948): Launched 23:28:28.744694 run osmo-stp_10.42.42.5(pid=27945): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27945)] 23:28:28.878973 run osmo-stp_10.42.42.5(pid=27945): stdout: | (launched: 2022-12-08_23:28:27.459075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:29.015260 run osmo-stp_10.42.42.5(pid=27945): stderr: | [0;m[38;5;43m20221208232827649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232827649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232827650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232827650 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232827650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232827651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232827651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:29.150967 run osmo-stp_10.42.42.5(pid=27945): stdout: | (launched: 2022-12-08_23:28:27.459075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:29.280126 run osmo-stp_10.42.42.5(pid=27945): stderr: | [0;m[38;5;43m20221208232827649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232827649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232827650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232827650 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232827650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232827651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232827651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:29.434080 run patchelf(pid=27948): Terminating (SIGINT) 23:28:29.610626 run patchelf(pid=27948): Terminated: ok {rc=0} 23:28:29.738314 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27945): Process ended prematurely: osmo-stp_10.42.42.5(pid=27945) [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27945)] [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 23:28:29.747879 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:28:29.776097 run osmo-hlr_10.42.42.2(pid=27942): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27942)] 23:28:29.825727 run osmo-hlr_10.42.42.2(pid=27942): stdout: | (launched: 2022-12-08_23:28:26.479039) 23:28:29.877267 run osmo-hlr_10.42.42.2(pid=27942): stderr: | [0;m[1;31m20221208232826679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232826679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232826679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232826679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232826679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232826679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232826702 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232826713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232826714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232826714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:28:29.929286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27941): Terminating (SIGTERM) 23:28:29.971190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27944): Terminating (SIGTERM) 23:28:30.013617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27947): Terminating (SIGTERM) 23:28:30.055976 --- ParallelTerminationStrategy: PID 27941 died... 23:28:30.076098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27941): Terminated: ok {rc=0} 23:28:30.122807 --- ParallelTerminationStrategy: PID 27944 died... 23:28:30.142404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27944): Terminated: ok {rc=0} 23:28:30.188553 --- ParallelTerminationStrategy: PID 27947 died... 23:28:30.208255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27947): Terminated: ok {rc=0} 23:28:30.296641 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:28:31.602051 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:28:31.609217 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:28:31.631043 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 23:28:31.672702 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 23:28:31.762044 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:28:31.783842 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 23:28:31.825491 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 23:28:32.415666 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 23:28:32.467834 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:32.479119 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:28:32.537399 tst cs_paging_gprs_active.py: using LAC 17492 23:28:32.657108 tst cs_paging_gprs_active.py: using RAC 152 23:28:32.784201 tst cs_paging_gprs_active.py: using CellId 17492 23:28:32.912737 tst cs_paging_gprs_active.py: using BVCI 17493 23:28:33.031335 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:33.042774 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:33.053856 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:33.065568 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:33.076871 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:33.088393 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:33.100026 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:33.111302 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:33.122842 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:33.237314 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:33.351836 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:28:33.554307 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:33.854648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27953): Launched 23:28:34.116900 run iperf3-srv_10.42.42.10(pid=27954): Launched 23:28:34.230371 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:28:34.432899 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:34.734355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27955): Launched 23:28:34.995949 run iperf3-srv_10.42.42.10(pid=27956): Launched 23:28:35.108929 tst cs_paging_gprs_active.py:38: start network... 23:28:35.311080 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:35.777305 run create_hlr_db(pid=27957): Launched 23:28:35.894415 bus /gobi_6: Setting Powered False 23:28:36.954567 run create_hlr_db(pid=27957): Terminated: ok {rc=0} 23:28:37.391954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27959): Launched 23:28:37.712473 run osmo-hlr_10.42.42.2(pid=27960): Launched 23:28:37.835065 run osmo-stp_10.42.42.5: Starting osmo-stp 23:28:38.387485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27962): Launched 23:28:38.707638 run osmo-stp_10.42.42.5(pid=27963): Launched 23:28:38.829578 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:28:39.380733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27965): Launched 23:28:39.503006 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:28:39.771791 run patchelf(pid=27966): Launched 23:28:39.951944 run osmo-stp_10.42.42.5(pid=27963): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27963)] 23:28:40.081142 run osmo-stp_10.42.42.5(pid=27963): stdout: | (launched: 2022-12-08_23:28:38.649870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:40.210977 run osmo-stp_10.42.42.5(pid=27963): stderr: | [0;m[38;5;43m20221208232838842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232838843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232838843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232838843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232838844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232838844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232838844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:40.340194 run osmo-stp_10.42.42.5(pid=27963): stdout: | (launched: 2022-12-08_23:28:38.649870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:40.463929 run osmo-stp_10.42.42.5(pid=27963): stderr: | [0;m[38;5;43m20221208232838842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232838843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232838843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232838843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232838844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232838844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232838844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:40.610956 run patchelf(pid=27966): Terminating (SIGINT) 23:28:40.779737 run patchelf(pid=27966): Terminated: ok {rc=0} 23:28:40.901612 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27963): Process ended prematurely: osmo-stp_10.42.42.5(pid=27963) [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27963)] [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 23:28:40.911083 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 23:28:40.937925 run osmo-hlr_10.42.42.2(pid=27960): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27960)] 23:28:40.985347 run osmo-hlr_10.42.42.2(pid=27960): stdout: | (launched: 2022-12-08_23:28:37.654837) 23:28:41.034038 run osmo-hlr_10.42.42.2(pid=27960): stderr: | [0;m[1;31m20221208232837854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232837854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232837854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232837854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232837854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232837854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232837867 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232837875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232837875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232837875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:28:41.083240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27953): Terminating (SIGTERM) 23:28:41.122589 run iperf3-srv_10.42.42.10(pid=27954): Terminating (SIGTERM) 23:28:41.161873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27955): Terminating (SIGTERM) 23:28:41.201238 run iperf3-srv_10.42.42.10(pid=27956): Terminating (SIGTERM) 23:28:41.240529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27959): Terminating (SIGTERM) 23:28:41.279858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27962): Terminating (SIGTERM) 23:28:41.318934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27965): Terminating (SIGTERM) 23:28:41.358237 --- ParallelTerminationStrategy: PID 27953 died... 23:28:41.377144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27953): Terminated: ok {rc=0} 23:28:41.420798 --- ParallelTerminationStrategy: PID 27954 died... 23:28:41.438993 run iperf3-srv_10.42.42.10(pid=27954): Terminated {rc=256} 23:28:41.482152 --- ParallelTerminationStrategy: PID 27955 died... 23:28:41.500336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27955): Terminated: ok {rc=0} 23:28:41.543715 --- ParallelTerminationStrategy: PID 27956 died... 23:28:41.562548 run iperf3-srv_10.42.42.10(pid=27956): Terminated {rc=256} 23:28:41.605855 --- ParallelTerminationStrategy: PID 27959 died... 23:28:41.623947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27959): Terminated: ok {rc=0} 23:28:41.667283 --- ParallelTerminationStrategy: PID 27962 died... 23:28:41.685441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27962): Terminated: ok {rc=0} 23:28:41.728774 --- ParallelTerminationStrategy: PID 27965 died... 23:28:41.747035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27965): Terminated: ok {rc=0} 23:28:41.831547 bus /gobi_0: Setting Powered False 23:28:42.928824 bus /gobi_0: Setting Powered False 23:28:44.039610 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 23:28:45.185895 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:45.197578 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:28:45.263947 tst iperf3.py: using LAC 17493 23:28:45.380878 tst iperf3.py: using RAC 153 23:28:45.497296 tst iperf3.py: using CellId 17493 23:28:45.619789 tst iperf3.py: using BVCI 17494 23:28:45.737895 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:45.749427 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:45.760447 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:45.772249 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:45.783787 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:45.794817 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:45.807050 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:45.818543 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:45.830096 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:45.957121 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:28:46.195694 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:46.512497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27967): Launched 23:28:46.806355 run iperf3-srv_10.42.42.10(pid=27968): Launched 23:28:46.928288 tst iperf3.py:8: start network... 23:28:47.136917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:47.609624 run create_hlr_db(pid=27969): Launched 23:28:47.726822 bus /gobi_6: Setting Powered False 23:28:48.786924 run create_hlr_db(pid=27969): Terminated: ok {rc=0} 23:28:49.225397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27971): Launched 23:28:49.546448 run osmo-hlr_10.42.42.2(pid=27972): Launched 23:28:49.669795 run osmo-stp_10.42.42.5: Starting osmo-stp 23:28:50.221216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27974): Launched 23:28:50.540471 run osmo-stp_10.42.42.5(pid=27975): Launched 23:28:50.664049 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:28:51.217314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27977): Launched 23:28:51.340477 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:28:51.610443 run patchelf(pid=27978): Launched 23:28:51.788403 run osmo-stp_10.42.42.5(pid=27975): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27975)] 23:28:51.924324 run osmo-stp_10.42.42.5(pid=27975): stdout: | (launched: 2022-12-08_23:28:50.482851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:52.062890 run osmo-stp_10.42.42.5(pid=27975): stderr: | [0;m[38;5;43m20221208232850675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232850675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232850675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232850676 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232850676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232850676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232850676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:52.201131 run osmo-stp_10.42.42.5(pid=27975): stdout: | (launched: 2022-12-08_23:28:50.482851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:52.333045 run osmo-stp_10.42.42.5(pid=27975): stderr: | [0;m[38;5;43m20221208232850675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232850675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232850675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232850676 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232850676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232850676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232850676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:52.488231 run patchelf(pid=27978): Terminating (SIGINT) 23:28:52.668059 run patchelf(pid=27978): Terminated: ok {rc=0} 23:28:52.799393 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27975): Process ended prematurely: osmo-stp_10.42.42.5(pid=27975) [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27975)] [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 23:28:52.809667 tst iperf3.py:8: Test FAILED (7.7 sec) 23:28:52.837532 run osmo-hlr_10.42.42.2(pid=27972): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27972)] 23:28:52.886547 run osmo-hlr_10.42.42.2(pid=27972): stdout: | (launched: 2022-12-08_23:28:49.488667) 23:28:52.937452 run osmo-hlr_10.42.42.2(pid=27972): stderr: | [0;m[1;31m20221208232849687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232849687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232849687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232849687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232849687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232849687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232849700 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232849708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232849708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232849708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:28:52.988793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27967): Terminating (SIGTERM) 23:28:53.030390 run iperf3-srv_10.42.42.10(pid=27968): Terminating (SIGTERM) 23:28:53.071452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27971): Terminating (SIGTERM) 23:28:53.112654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27974): Terminating (SIGTERM) 23:28:53.153815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27977): Terminating (SIGTERM) 23:28:53.195147 --- ParallelTerminationStrategy: PID 27967 died... 23:28:53.214779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27967): Terminated: ok {rc=0} 23:28:53.260172 --- ParallelTerminationStrategy: PID 27968 died... 23:28:53.279370 run iperf3-srv_10.42.42.10(pid=27968): Terminated {rc=256} 23:28:53.324279 --- ParallelTerminationStrategy: PID 27971 died... 23:28:53.343543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27971): Terminated: ok {rc=0} 23:28:53.389122 --- ParallelTerminationStrategy: PID 27974 died... 23:28:53.408159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27974): Terminated: ok {rc=0} 23:28:53.453850 --- ParallelTerminationStrategy: PID 27977 died... 23:28:53.473082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27977): Terminated: ok {rc=0} 23:28:53.558849 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 23:28:54.709955 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:54.722047 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:28:54.781288 tst iperf3m4.py: using LAC 17494 23:28:54.906541 tst iperf3m4.py: using RAC 154 23:28:55.025377 tst iperf3m4.py: using CellId 17494 23:28:55.142275 tst iperf3m4.py: using BVCI 17495 23:28:55.251724 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:55.262728 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:55.273450 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:55.284528 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:55.295478 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:55.306392 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:55.317031 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:55.328716 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:55.339865 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:55.458698 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:55.578234 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:55.694213 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:55.810528 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:28:56.011894 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:56.313642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27979): Launched 23:28:56.575530 run iperf3-srv_10.42.42.10(pid=27980): Launched 23:28:56.689391 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:28:56.890895 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:57.191931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27981): Launched 23:28:57.453459 run iperf3-srv_10.42.42.10(pid=27982): Launched 23:28:57.566221 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:28:57.766805 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:58.067643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27983): Launched 23:28:58.328942 run iperf3-srv_10.42.42.10(pid=27984): Launched 23:28:58.441626 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:28:58.642546 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:58.943788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27985): Launched 23:28:59.205351 run iperf3-srv_10.42.42.10(pid=27986): Launched 23:28:59.318254 tst iperf3m4.py:8: start network... 23:28:59.519135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:59.984222 run create_hlr_db(pid=27987): Launched 23:29:00.098757 bus /gobi_6: Setting Powered False 23:29:01.158073 run create_hlr_db(pid=27987): Terminated: ok {rc=0} 23:29:01.597816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27989): Launched 23:29:01.917908 run osmo-hlr_10.42.42.2(pid=27990): Launched 23:29:02.134142 run osmo-stp_10.42.42.5: Starting osmo-stp 23:29:02.734088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27992): Launched 23:29:03.054561 run osmo-stp_10.42.42.5(pid=27993): Launched 23:29:03.175917 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:29:03.728856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27995): Launched 23:29:03.851009 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:29:04.121713 run patchelf(pid=27996): Launched 23:29:04.299225 run osmo-stp_10.42.42.5(pid=27993): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27993)] 23:29:04.435451 run osmo-stp_10.42.42.5(pid=27993): stdout: | (launched: 2022-12-08_23:29:02.995998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:04.572825 run osmo-stp_10.42.42.5(pid=27993): stderr: | [0;m[38;5;43m20221208232903188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232903188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232903189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232903189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232903191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232903191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232903192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:04.710126 run osmo-stp_10.42.42.5(pid=27993): stdout: | (launched: 2022-12-08_23:29:02.995998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:04.841054 run osmo-stp_10.42.42.5(pid=27993): stderr: | [0;m[38;5;43m20221208232903188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232903188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232903189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232903189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232903191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232903191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232903192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:04.996084 run patchelf(pid=27996): Terminating (SIGINT) 23:29:05.175372 run patchelf(pid=27996): Terminated: ok {rc=0} 23:29:05.304550 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27993): Process ended prematurely: osmo-stp_10.42.42.5(pid=27993) [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27993)] [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 23:29:05.314753 tst iperf3m4.py:8: Test FAILED (10.6 sec) 23:29:05.343157 run osmo-hlr_10.42.42.2(pid=27990): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27990)] 23:29:05.392689 run osmo-hlr_10.42.42.2(pid=27990): stdout: | (launched: 2022-12-08_23:29:01.860340) 23:29:05.444233 run osmo-hlr_10.42.42.2(pid=27990): stderr: | [0;m[1;31m20221208232902108 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232902109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232902109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232902109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232902109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232902109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232902123 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232902146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232902146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232902147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:29:05.495851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27979): Terminating (SIGTERM) 23:29:05.537349 run iperf3-srv_10.42.42.10(pid=27980): Terminating (SIGTERM) 23:29:05.578759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27981): Terminating (SIGTERM) 23:29:05.620161 run iperf3-srv_10.42.42.10(pid=27982): Terminating (SIGTERM) 23:29:05.661476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27983): Terminating (SIGTERM) 23:29:05.702991 run iperf3-srv_10.42.42.10(pid=27984): Terminating (SIGTERM) 23:29:05.744309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27985): Terminating (SIGTERM) 23:29:05.785912 run iperf3-srv_10.42.42.10(pid=27986): Terminating (SIGTERM) 23:29:05.827256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27989): Terminating (SIGTERM) 23:29:05.868656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27992): Terminating (SIGTERM) 23:29:05.910063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27995): Terminating (SIGTERM) 23:29:05.951772 --- ParallelTerminationStrategy: PID 27979 died... 23:29:05.971339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27979): Terminated: ok {rc=0} 23:29:06.016892 --- ParallelTerminationStrategy: PID 27980 died... 23:29:06.036430 run iperf3-srv_10.42.42.10(pid=27980): Terminated {rc=256} 23:29:06.081799 --- ParallelTerminationStrategy: PID 27981 died... 23:29:06.101208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27981): Terminated: ok {rc=0} 23:29:06.146394 --- ParallelTerminationStrategy: PID 27982 died... 23:29:06.165582 run iperf3-srv_10.42.42.10(pid=27982): Terminated {rc=256} 23:29:06.210779 --- ParallelTerminationStrategy: PID 27983 died... 23:29:06.229941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27983): Terminated: ok {rc=0} 23:29:06.275443 --- ParallelTerminationStrategy: PID 27984 died... 23:29:06.294555 run iperf3-srv_10.42.42.10(pid=27984): Terminated {rc=256} 23:29:06.340025 --- ParallelTerminationStrategy: PID 27985 died... 23:29:06.359668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27985): Terminated: ok {rc=0} 23:29:06.405414 --- ParallelTerminationStrategy: PID 27986 died... 23:29:06.424512 run iperf3-srv_10.42.42.10(pid=27986): Terminated {rc=256} 23:29:06.469971 --- ParallelTerminationStrategy: PID 27989 died... 23:29:06.489291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27989): Terminated: ok {rc=0} 23:29:06.534847 --- ParallelTerminationStrategy: PID 27992 died... 23:29:06.554047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27992): Terminated: ok {rc=0} 23:29:06.599627 --- ParallelTerminationStrategy: PID 27995 died... 23:29:06.618948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27995): Terminated: ok {rc=0} 23:29:06.704792 bus /gobi_4: Setting Powered False 23:29:07.803122 bus /gobi_4: Setting Powered False 23:29:08.917854 bus /gobi_1: Setting Powered False 23:29:10.017039 bus /gobi_1: Setting Powered False 23:29:11.131922 bus /gobi_0: Setting Powered False 23:29:12.229411 bus /gobi_0: Setting Powered False 23:29:13.344862 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 23:29:14.447083 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:14.458752 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:29:14.516284 tst ping.py: using LAC 17495 23:29:14.640803 tst ping.py: using RAC 155 23:29:14.763094 tst ping.py: using CellId 17495 23:29:14.885401 tst ping.py: using BVCI 17496 23:29:14.998824 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:15.010049 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:15.021002 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:15.032299 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:15.043320 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:15.054272 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:15.065417 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:15.076326 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:29:15.192096 tst ping.py:19: start network... 23:29:15.403684 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:29:15.888328 run create_hlr_db(pid=27997): Launched 23:29:16.033468 bus /gobi_6: Setting Powered False 23:29:17.091687 run create_hlr_db(pid=27997): Terminated: ok {rc=0} 23:29:17.512624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27999): Launched 23:29:17.808130 run osmo-hlr_10.42.42.2(pid=28000): Launched 23:29:17.920815 run osmo-stp_10.42.42.5: Starting osmo-stp 23:29:18.446750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28002): Launched 23:29:18.741842 run osmo-stp_10.42.42.5(pid=28003): Launched 23:29:18.854177 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:29:19.362897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28005): Launched 23:29:19.476470 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:29:19.724649 run patchelf(pid=28006): Launched 23:29:19.889283 run osmo-stp_10.42.42.5(pid=28003): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28003)] 23:29:20.015141 run osmo-stp_10.42.42.5(pid=28003): stdout: | (launched: 2022-12-08_23:29:18.687931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:20.142834 run osmo-stp_10.42.42.5(pid=28003): stderr: | [0;m[38;5;43m20221208232918856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232918856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232918856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232918856 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232918859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232918859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232918859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:20.270342 run osmo-stp_10.42.42.5(pid=28003): stdout: | (launched: 2022-12-08_23:29:18.687931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:20.391724 run osmo-stp_10.42.42.5(pid=28003): stderr: | [0;m[38;5;43m20221208232918856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232918856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232918856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232918856 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232918859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232918859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232918859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:20.535611 run patchelf(pid=28006): Terminating (SIGINT) 23:29:20.701279 run patchelf(pid=28006): Terminated: ok {rc=0} 23:29:20.820481 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28003): Process ended prematurely: osmo-stp_10.42.42.5(pid=28003) [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28003)] [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 23:29:20.829316 tst ping.py:22: Test FAILED (6.4 sec) 23:29:20.855992 run osmo-hlr_10.42.42.2(pid=28000): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28000)] 23:29:20.903847 run osmo-hlr_10.42.42.2(pid=28000): stdout: | (launched: 2022-12-08_23:29:17.754603) 23:29:20.953103 run osmo-hlr_10.42.42.2(pid=28000): stderr: | [0;m[1;31m20221208232917927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232917927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232917927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232917927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232917927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232917927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232917939 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232917947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232917948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232917948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:29:21.002885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27999): Terminating (SIGTERM) 23:29:21.042965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28002): Terminating (SIGTERM) 23:29:21.082788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28005): Terminating (SIGTERM) 23:29:21.122910 --- ParallelTerminationStrategy: PID 27999 died... 23:29:21.141886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27999): Terminated: ok {rc=0} 23:29:21.186000 --- ParallelTerminationStrategy: PID 28002 died... 23:29:21.205050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28002): Terminated: ok {rc=0} 23:29:21.249661 --- ParallelTerminationStrategy: PID 28005 died... 23:29:21.268261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28005): Terminated: ok {rc=0} 23:29:21.352161 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 23:29:22.437525 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:22.449828 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:29:22.509493 tst ping_idle_ping.py: using LAC 17496 23:29:22.626139 tst ping_idle_ping.py: using RAC 156 23:29:22.742007 tst ping_idle_ping.py: using CellId 17496 23:29:22.858000 tst ping_idle_ping.py: using BVCI 17497 23:29:22.964675 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:22.975456 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:22.985943 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:22.996638 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:23.007385 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:23.018028 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:23.028820 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:23.039633 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:29:23.156165 tst ping_idle_ping.py:24: start network... 23:29:23.369413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:29:23.862969 run create_hlr_db(pid=28007): Launched 23:29:23.990957 bus /gobi_6: Setting Powered False 23:29:25.053097 run create_hlr_db(pid=28007): Terminated: ok {rc=0} 23:29:25.490668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28009): Launched 23:29:25.804541 run osmo-hlr_10.42.42.2(pid=28010): Launched 23:29:25.919422 run osmo-stp_10.42.42.5: Starting osmo-stp 23:29:26.440675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28012): Launched 23:29:26.737351 run osmo-stp_10.42.42.5(pid=28013): Launched 23:29:26.851090 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:29:27.362465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28015): Launched 23:29:27.476381 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:29:27.726135 run patchelf(pid=28016): Launched 23:29:27.891243 run osmo-stp_10.42.42.5(pid=28013): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28013)] 23:29:28.017553 run osmo-stp_10.42.42.5(pid=28013): stdout: | (launched: 2022-12-08_23:29:26.683977) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:28.145591 run osmo-stp_10.42.42.5(pid=28013): stderr: | [0;m[38;5;43m20221208232926852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232926852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232926852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232926853 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232926853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232926853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232926853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:28.273276 run osmo-stp_10.42.42.5(pid=28013): stdout: | (launched: 2022-12-08_23:29:26.683977) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:28.395345 run osmo-stp_10.42.42.5(pid=28013): stderr: | [0;m[38;5;43m20221208232926852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232926852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232926852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232926853 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232926853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232926853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232926853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:28.539476 run patchelf(pid=28016): Terminating (SIGINT) 23:29:28.706232 run patchelf(pid=28016): Terminated: ok {rc=0} 23:29:28.826358 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28013): Process ended prematurely: osmo-stp_10.42.42.5(pid=28013) [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28013)] [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 23:29:28.835101 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 23:29:28.861711 run osmo-hlr_10.42.42.2(pid=28010): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28010)] 23:29:28.909355 run osmo-hlr_10.42.42.2(pid=28010): stdout: | (launched: 2022-12-08_23:29:25.747622) 23:29:28.958343 run osmo-hlr_10.42.42.2(pid=28010): stderr: | [0;m[1;31m20221208232925923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232925923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232925923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232925923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232925923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232925924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232925936 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232925946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232925946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232925946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:29:29.007747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28009): Terminating (SIGTERM) 23:29:29.047208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28012): Terminating (SIGTERM) 23:29:29.086688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28015): Terminating (SIGTERM) 23:29:29.126451 --- ParallelTerminationStrategy: PID 28009 died... 23:29:29.145102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28009): Terminated: ok {rc=0} 23:29:29.188576 --- ParallelTerminationStrategy: PID 28012 died... 23:29:29.206978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28012): Terminated: ok {rc=0} 23:29:29.250458 --- ParallelTerminationStrategy: PID 28015 died... 23:29:29.268739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28015): Terminated: ok {rc=0} 23:29:29.354655 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:29:30.638002 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:29:30.644781 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:29:30.665901 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 23:29:30.700444 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:29:30.753445 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:29:30.774305 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 23:29:30.808511 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:29:31.364855 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2351 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 23:29:31.370787 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:31.385979 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:29:31.452349 tst switch_tch_pdch.py: using LAC 17497 23:29:31.588130 tst switch_tch_pdch.py: using RAC 157 23:29:31.767100 tst switch_tch_pdch.py: using CellId 17497 23:29:31.885684 tst switch_tch_pdch.py: using BVCI 17498 23:29:32.046404 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:32.062710 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:32.080065 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:32.093985 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:32.112525 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:32.129810 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:32.147684 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:32.165104 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:29:32.292483 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:29:32.408512 tst switch_tch_pdch.py:51: start network... 23:29:32.606265 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:29:33.061619 run create_hlr_db(pid=28020): Launched 23:29:33.175226 bus /gobi_6: Setting Powered False 23:29:34.234421 run create_hlr_db(pid=28020): Terminated: ok {rc=0} 23:29:34.646733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28022): Launched 23:29:34.940127 run osmo-hlr_10.42.42.2(pid=28023): Launched 23:29:35.052381 run osmo-stp_10.42.42.5: Starting osmo-stp 23:29:35.573160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28025): Launched 23:29:35.868137 run osmo-stp_10.42.42.5(pid=28026): Launched 23:29:35.980761 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:29:36.489265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28028): Launched 23:29:36.602958 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:29:36.851961 run patchelf(pid=28029): Launched 23:29:37.016085 run osmo-stp_10.42.42.5(pid=28026): ERR: Terminated: ERROR {rc=1} [trial-2351↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28026)] 23:29:37.141848 run osmo-stp_10.42.42.5(pid=28026): stdout: | (launched: 2022-12-08_23:29:35.814383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:37.269257 run osmo-stp_10.42.42.5(pid=28026): stderr: | [0;m[38;5;43m20221208232935983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232935983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232935984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232935984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232935984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232935985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232935985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:37.396339 run osmo-stp_10.42.42.5(pid=28026): stdout: | (launched: 2022-12-08_23:29:35.814383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:37.517522 run osmo-stp_10.42.42.5(pid=28026): stderr: | [0;m[38;5;43m20221208232935983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232935983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232935984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232935984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232935984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232935985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232935985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:37.660861 run patchelf(pid=28029): Terminating (SIGINT) 23:29:37.826246 run patchelf(pid=28029): Terminated: ok {rc=0} 23:29:37.945806 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28026): Process ended prematurely: osmo-stp_10.42.42.5(pid=28026) [trial-2351↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28026)] [trial-2351↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 23:29:37.954519 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 23:29:37.981057 run osmo-hlr_10.42.42.2(pid=28023): ERR: Terminated: ERROR {rc=237} [trial-2351↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28023)] 23:29:38.028839 run osmo-hlr_10.42.42.2(pid=28023): stdout: | (launched: 2022-12-08_23:29:34.887086) 23:29:38.077813 run osmo-hlr_10.42.42.2(pid=28023): stderr: | [0;m[1;31m20221208232935062 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232935062 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232935062 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232935062 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232935062 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232935062 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232935074 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232935082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232935083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232935083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:29:38.126967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28022): Terminating (SIGTERM) 23:29:38.166342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28025): Terminating (SIGTERM) 23:29:38.205998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28028): Terminating (SIGTERM) 23:29:38.245496 --- ParallelTerminationStrategy: PID 28022 died... 23:29:38.264087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28022): Terminated: ok {rc=0} 23:29:38.307844 --- ParallelTerminationStrategy: PID 28025 died... 23:29:38.325972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28025): Terminated: ok {rc=0} 23:29:38.369480 --- ParallelTerminationStrategy: PID 28028 died... 23:29:38.387671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28028): Terminated: ok {rc=0} 23:29:38.472734 bus /gobi_0: Setting Powered False 23:29:39.569295 bus /gobi_0: Setting Powered False 23:29:40.682439 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 23:29:41.914172 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:29:41.921361 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 23:29:41.942343 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 23:29:41.977228 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 23:29:42.031819 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 23:29:42.053085 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 23:29:42.087536 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 23:29:42.641343 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2351 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 23:29:42.646478 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:42.657802 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 23:29:42.714741 tst switch_tch_pdch.py: using LAC 17498 23:29:42.836812 tst switch_tch_pdch.py: using RAC 158 23:29:42.959337 tst switch_tch_pdch.py: using CellId 17498 23:29:43.082553 tst switch_tch_pdch.py: using BVCI 17499 23:29:43.195819 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:43.207030 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:43.217982 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:43.228858 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:43.239754 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:43.250651 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:43.261775 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:43.273017 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:29:43.391954 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:29:43.509030 tst switch_tch_pdch.py:51: start network... 23:29:43.720516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:29:44.178002 run create_hlr_db(pid=28033): Launched 23:29:44.304861 bus /gobi_6: Setting Powered False 23:29:45.367264 run create_hlr_db(pid=28033): Terminated: ok {rc=0} 23:29:45.762532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28035): Launched 23:29:46.107144 run osmo-hlr_10.42.42.2(pid=28036): Launched 23:29:46.312102 run osmo-stp_10.42.42.5: Starting osmo-stp 23:29:46.946847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28038): Launched 23:29:47.272937 run osmo-stp_10.42.42.5(pid=28039): Launched 23:29:47.393073 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:29:47.909298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28041): Launched 23:29:48.029239 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:29:48.293283 run patchelf(pid=28042): Launched 23:29:48.467248 run osmo-stp_10.42.42.5(pid=28039): ERR: Terminated: ERROR {rc=1} [trial-2351↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28039)] 23:29:48.599831 run osmo-stp_10.42.42.5(pid=28039): stdout: | (launched: 2022-12-08_23:29:47.216255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:48.734748 run osmo-stp_10.42.42.5(pid=28039): stderr: | [0;m[38;5;43m20221208232947405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232947405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232947405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232947405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232947406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232947406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232947406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:48.868932 run osmo-stp_10.42.42.5(pid=28039): stdout: | (launched: 2022-12-08_23:29:47.216255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:48.997222 run osmo-stp_10.42.42.5(pid=28039): stderr: | [0;m[38;5;43m20221208232947405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208232947405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208232947405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208232947405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208232947406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208232947406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208232947406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:49.149889 run patchelf(pid=28042): Terminating (SIGINT) 23:29:49.324061 run patchelf(pid=28042): Terminated: ok {rc=0} 23:29:49.450330 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28039): Process ended prematurely: osmo-stp_10.42.42.5(pid=28039) [trial-2351↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28039)] [trial-2351↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 23:29:49.459771 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 23:29:49.486979 run osmo-hlr_10.42.42.2(pid=28036): ERR: Terminated: ERROR {rc=237} [trial-2351↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28036)] 23:29:49.535744 run osmo-hlr_10.42.42.2(pid=28036): stdout: | (launched: 2022-12-08_23:29:46.039553) 23:29:49.586379 run osmo-hlr_10.42.42.2(pid=28036): stderr: | [0;m[1;31m20221208232946326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208232946326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208232946326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208232946326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208232946326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208232946326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208232946337 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208232946353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208232946353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208232946353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:29:49.637453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28035): Terminating (SIGTERM) 23:29:49.678613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28038): Terminating (SIGTERM) 23:29:49.719617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28041): Terminating (SIGTERM) 23:29:49.760819 --- ParallelTerminationStrategy: PID 28035 died... 23:29:49.780320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28035): Terminated: ok {rc=0} 23:29:49.826261 --- ParallelTerminationStrategy: PID 28038 died... 23:29:49.845226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28038): Terminated: ok {rc=0} 23:29:49.890249 --- ParallelTerminationStrategy: PID 28041 died... 23:29:49.909392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28041): Terminated: ok {rc=0} 23:29:49.996700 bus /gobi_0: Setting Powered False 23:29:51.093447 bus /gobi_0: Setting Powered False 23:29:52.208044 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 nitb_sms:trx-b200 --------------------------------------------------------------------- 23:29:53.443504 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:29:53.447871 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 23:29:53.481242 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 23:29:53.488074 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 23:29:53.539962 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 23:29:53.573217 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 23:29:53.580023 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 23:29:54.121815 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 23:29:54.126891 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 23:29:54.137973 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 23:29:54.186589 tst mo_mt_sms.py: using LAC 17499 23:29:54.312231 tst mo_mt_sms.py: using RAC 159 23:29:54.434918 tst mo_mt_sms.py: using CellId 17499 23:29:54.557351 tst mo_mt_sms.py: using BVCI 17500 23:29:54.670705 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 23:29:54.788103 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 23:29:54.904712 tst mo_mt_sms.py:9: start nitb and bts... 23:29:55.118412 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:29:55.756222 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28048): Launched 23:29:56.070160 run osmo-nitb_10.42.42.2(pid=28049): Launched 23:29:56.243372 run osmo-nitb_10.42.42.2(pid=28049): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28049)] 23:29:56.384268 run osmo-nitb_10.42.42.2(pid=28049): stdout: | (launched: 2022-12-08_23:29:56.013466) 23:29:56.527227 run osmo-nitb_10.42.42.2(pid=28049): stderr: | (launched: 2022-12-08_23:29:56.060370) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:29:56.669904 run osmo-nitb_10.42.42.2(pid=28049): stdout: | (launched: 2022-12-08_23:29:56.013466) 23:29:56.806580 run osmo-nitb_10.42.42.2(pid=28049): stderr: | (launched: 2022-12-08_23:29:56.060370) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6f22fc268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28049): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28049) [trial-2351↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28049)] 23:29:57.188125 tst osmo-nitb_10.42.42.2(pid=28049): stdout: | (launched: 2022-12-08_23:29:56.013466) 23:29:57.314589 tst osmo-nitb_10.42.42.2(pid=28049): stderr: | (launched: 2022-12-08_23:29:56.060370) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:29:57.463681 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=28049): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28049) [trial-2351↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28049)] [trial-2351↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 23:29:57.472564 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 23:29:57.479504 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28048): Terminating (SIGTERM) 23:29:57.689235 --- ParallelTerminationStrategy: PID 28048 died... 23:29:57.710021 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28048): Terminated: ok {rc=0} 23:29:57.796441 bus /sierra_3: Setting Powered False 23:29:58.895309 bus /sierra_3: Setting Powered False 23:30:00.011111 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 sms:trx-b200 --------------------------------------------------------------------- 23:30:01.215273 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:30:01.219550 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 23:30:01.254311 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 23:30:01.282583 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 23:30:01.334972 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 23:30:01.381054 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 23:30:01.418760 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 23:30:01.984057 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 23:30:01.989834 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:02.002277 tst sms:trx-b200: Using 1 x bts (candidates: 1) 23:30:02.056737 tst mo_mt_sms.py: using LAC 17500 23:30:02.187192 tst mo_mt_sms.py: using RAC 160 23:30:02.313369 tst mo_mt_sms.py: using CellId 17500 23:30:02.437887 tst mo_mt_sms.py: using BVCI 17501 23:30:02.551526 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:02.562428 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:02.573222 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:02.583853 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:02.594513 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:02.605142 tst sms:trx-b200: Using 1 x modem (candidates: 2) 23:30:02.722052 tst sms:trx-b200: Using 1 x modem (candidates: 2) 23:30:02.836527 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:30:03.293658 run create_hlr_db(pid=28056): Launched 23:30:03.406698 bus /sierra_2: Setting Powered False 23:30:04.466917 run create_hlr_db(pid=28056): Terminated: ok {rc=0} 23:30:04.880002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28058): Launched 23:30:05.175395 run osmo-hlr_10.42.42.2(pid=28059): Launched 23:30:05.287917 run osmo-stp_10.42.42.5: Starting osmo-stp 23:30:05.808067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28061): Launched 23:30:06.101631 run osmo-stp_10.42.42.5(pid=28062): Launched 23:30:06.213362 run osmo-msc_10.42.42.6: Starting osmo-msc 23:30:06.745538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28064): Launched 23:30:07.040325 run osmo-msc_10.42.42.6(pid=28065): Launched 23:30:07.205407 run osmo-stp_10.42.42.5(pid=28062): ERR: Terminated: ERROR {rc=1} [trial-2351↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28062)] 23:30:07.330810 run osmo-stp_10.42.42.5(pid=28062): stdout: | (launched: 2022-12-08_23:30:06.048129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:07.456545 run osmo-stp_10.42.42.5(pid=28062): stderr: | [0;m[38;5;43m20221208233006217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233006217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233006217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233006218 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233006220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233006220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233006220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:07.589380 run osmo-stp_10.42.42.5(pid=28062): stdout: | (launched: 2022-12-08_23:30:06.048129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:07.714711 run osmo-stp_10.42.42.5(pid=28062): stderr: | [0;m[38;5;43m20221208233006217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233006217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233006217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233006218 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233006220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233006220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233006220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:07.864255 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=28062): Process ended prematurely: osmo-stp_10.42.42.5(pid=28062) [trial-2351↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28062)] [trial-2351↪sms:trx-b200↪mo_mt_sms.py:16] 23:30:07.873035 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 23:30:07.900619 run osmo-hlr_10.42.42.2(pid=28059): ERR: Terminated: ERROR {rc=237} [trial-2351↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28059)] 23:30:07.951762 run osmo-hlr_10.42.42.2(pid=28059): stdout: | (launched: 2022-12-08_23:30:05.121696) 23:30:08.004154 run osmo-hlr_10.42.42.2(pid=28059): stderr: | [0;m[1;31m20221208233005297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233005297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233005297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233005297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233005297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233005297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233005313 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233005322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233005322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233005322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:30:08.077221 run osmo-msc_10.42.42.6(pid=28065): ERR: Terminated: ERROR {rc=2} [trial-2351↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28065)] 23:30:08.127701 run osmo-msc_10.42.42.6(pid=28065): stdout: | (launched: 2022-12-08_23:30:06.986641) 23:30:08.179769 run osmo-msc_10.42.42.6(pid=28065): stderr: | [0;m[38;5;43m20221208233007261 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233007261 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa083cfbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233007261 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233007261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233007261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233007261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233007263 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233007263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233007264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233007264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:30:08.232177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28058): Terminating (SIGTERM) 23:30:08.274335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28061): Terminating (SIGTERM) 23:30:08.316593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28064): Terminating (SIGTERM) 23:30:08.358490 --- ParallelTerminationStrategy: PID 28058 died... 23:30:08.378626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28058): Terminated: ok {rc=0} 23:30:08.425340 --- ParallelTerminationStrategy: PID 28061 died... 23:30:08.444435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28061): Terminated: ok {rc=0} 23:30:08.491163 --- ParallelTerminationStrategy: PID 28064 died... 23:30:08.510317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28064): Terminated: ok {rc=0} 23:30:08.597314 bus /sierra_3: Setting Powered False 23:30:09.694997 bus /sierra_3: Setting Powered False 23:30:10.810347 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 nitb_ussd:trx-b200 --------------------------------------------------------------------- 23:30:12.039404 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:30:12.043335 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 23:30:12.076920 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 23:30:12.083858 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 23:30:12.118651 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 23:30:12.151961 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 23:30:12.158808 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 23:30:12.678851 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2351 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 23:30:12.684073 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 23:30:12.695275 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 23:30:12.745751 tst assert_extension.py: using LAC 17501 23:30:12.868616 tst assert_extension.py: using RAC 161 23:30:12.991931 tst assert_extension.py: using CellId 17501 23:30:13.114915 tst assert_extension.py: using BVCI 17502 23:30:13.228220 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 23:30:13.341482 tst assert_extension.py:10: start nitb and bts... 23:30:13.539084 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:30:14.139207 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28070): Launched 23:30:14.432361 run osmo-nitb_10.42.42.2(pid=28071): Launched 23:30:14.595237 run osmo-nitb_10.42.42.2(pid=28071): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28071)] 23:30:14.727552 run osmo-nitb_10.42.42.2(pid=28071): stdout: | (launched: 2022-12-08_23:30:14.378933) 23:30:14.861657 run osmo-nitb_10.42.42.2(pid=28071): stderr: | (launched: 2022-12-08_23:30:14.422550) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:30:14.996123 run osmo-nitb_10.42.42.2(pid=28071): stdout: | (launched: 2022-12-08_23:30:14.378933) 23:30:15.125145 run osmo-nitb_10.42.42.2(pid=28071): stderr: | (launched: 2022-12-08_23:30:14.422550) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6f22fc268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28071): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28071) [trial-2351↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28071)] 23:30:15.543236 tst osmo-nitb_10.42.42.2(pid=28071): stdout: | (launched: 2022-12-08_23:30:14.378933) 23:30:15.662385 tst osmo-nitb_10.42.42.2(pid=28071): stderr: | (launched: 2022-12-08_23:30:14.422550) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:30:15.802245 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=28071): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28071) [trial-2351↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28071)] [trial-2351↪nitb_ussd:trx-b200↪assert_extension.py:12] 23:30:15.810497 tst assert_extension.py:12: Test FAILED (3.1 sec) 23:30:15.816893 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28070): Terminating (SIGTERM) 23:30:16.043055 --- ParallelTerminationStrategy: PID 28070 died... 23:30:16.062748 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28070): Terminated: ok {rc=0} 23:30:16.149220 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 ussd:trx-b200 --------------------------------------------------------------------- 23:30:17.334301 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:30:17.338802 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 23:30:17.372026 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 23:30:17.398867 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 23:30:17.434184 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 23:30:17.467794 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 23:30:17.494819 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 23:30:18.022939 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2351 ussd:trx-b200 assert_extension.py ---------------------------------------------- 23:30:18.028296 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:18.039188 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 23:30:18.087664 tst assert_extension.py: using LAC 17502 23:30:18.210516 tst assert_extension.py: using RAC 162 23:30:18.334522 tst assert_extension.py: using CellId 17502 23:30:18.457205 tst assert_extension.py: using BVCI 17503 23:30:18.570779 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:18.581711 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:18.592427 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:18.603199 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:18.613906 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:18.624561 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 23:30:18.738412 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:30:19.195038 run create_hlr_db(pid=28075): Launched 23:30:19.308065 bus /sierra_2: Setting Powered False 23:30:20.367314 run create_hlr_db(pid=28075): Terminated: ok {rc=0} 23:30:20.797773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28077): Launched 23:30:21.112800 run osmo-hlr_10.42.42.2(pid=28078): Launched 23:30:21.233034 run osmo-stp_10.42.42.5: Starting osmo-stp 23:30:21.775724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28080): Launched 23:30:22.089517 run osmo-stp_10.42.42.5(pid=28081): Launched 23:30:22.209207 run osmo-msc_10.42.42.6: Starting osmo-msc 23:30:22.773604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28083): Launched 23:30:23.087782 run osmo-msc_10.42.42.6(pid=28084): Launched 23:30:23.263378 run osmo-stp_10.42.42.5(pid=28081): ERR: Terminated: ERROR {rc=1} [trial-2351↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28081)] 23:30:23.396452 run osmo-stp_10.42.42.5(pid=28081): stdout: | (launched: 2022-12-08_23:30:22.032292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:23.530012 run osmo-stp_10.42.42.5(pid=28081): stderr: | [0;m[38;5;43m20221208233022222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233022222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233022222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233022223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233022225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233022225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233022225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:23.662872 run osmo-stp_10.42.42.5(pid=28081): stdout: | (launched: 2022-12-08_23:30:22.032292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:23.788080 run osmo-stp_10.42.42.5(pid=28081): stderr: | [0;m[38;5;43m20221208233022222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233022222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233022222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233022223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233022225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233022225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233022225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:23.937859 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=28081): Process ended prematurely: osmo-stp_10.42.42.5(pid=28081) [trial-2351↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28081)] [trial-2351↪ussd:trx-b200↪assert_extension.py:17] 23:30:23.946915 tst assert_extension.py:17: Test FAILED (5.9 sec) 23:30:23.973952 run osmo-hlr_10.42.42.2(pid=28078): ERR: Terminated: ERROR {rc=237} [trial-2351↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28078)] 23:30:24.023306 run osmo-hlr_10.42.42.2(pid=28078): stdout: | (launched: 2022-12-08_23:30:21.055988) 23:30:24.075048 run osmo-hlr_10.42.42.2(pid=28078): stderr: | [0;m[1;31m20221208233021254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233021254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233021254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233021254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233021254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233021254 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233021267 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233021277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233021277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233021278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:30:24.146375 run osmo-msc_10.42.42.6(pid=28084): ERR: Terminated: ERROR {rc=2} [trial-2351↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28084)] 23:30:24.195584 run osmo-msc_10.42.42.6(pid=28084): stdout: | (launched: 2022-12-08_23:30:23.030666) 23:30:24.246650 run osmo-msc_10.42.42.6(pid=28084): stderr: | [0;m[38;5;43m20221208233023352 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233023352 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd5651a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233023352 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233023352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233023353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233023353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233023355 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233023355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233023355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233023355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:30:24.298201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28077): Terminating (SIGTERM) 23:30:24.339393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28080): Terminating (SIGTERM) 23:30:24.380726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28083): Terminating (SIGTERM) 23:30:24.422417 --- ParallelTerminationStrategy: PID 28077 died... 23:30:24.442302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28077): Terminated: ok {rc=0} 23:30:24.488558 --- ParallelTerminationStrategy: PID 28080 died... 23:30:24.507984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28080): Terminated: ok {rc=0} 23:30:24.553771 --- ParallelTerminationStrategy: PID 28083 died... 23:30:24.573262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28083): Terminated: ok {rc=0} 23:30:24.660372 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 23:30:25.872264 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:30:25.879025 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 23:30:25.912301 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 23:30:25.939162 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 23:30:25.989423 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 23:30:26.022538 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 23:30:26.049296 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 23:30:26.602884 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 23:30:26.654240 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:26.665581 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:30:26.734495 tst mo_mt_call.py: using LAC 17503 23:30:26.862042 tst mo_mt_call.py: using RAC 163 23:30:26.987607 tst mo_mt_call.py: using CellId 17503 23:30:27.107937 tst mo_mt_call.py: using BVCI 17504 23:30:27.217085 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:27.228069 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:27.238888 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:27.250717 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:27.262496 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:27.274066 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:30:27.392145 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:30:27.511240 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:30:28.006689 run create_hlr_db(pid=28089): Launched 23:30:28.137714 bus /sierra_2: Setting Powered False 23:30:29.200916 run create_hlr_db(pid=28089): Terminated: ok {rc=0} 23:30:29.628409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28091): Launched 23:30:29.928660 run osmo-hlr_10.42.42.2(pid=28092): Launched 23:30:30.044169 run osmo-stp_10.42.42.5: Starting osmo-stp 23:30:30.581374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28094): Launched 23:30:30.909717 run osmo-stp_10.42.42.5(pid=28095): Launched 23:30:31.088603 run osmo-msc_10.42.42.6: Starting osmo-msc 23:30:31.858916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28097): Launched 23:30:32.234916 run osmo-msc_10.42.42.6(pid=28098): Launched 23:30:32.481331 run osmo-stp_10.42.42.5(pid=28095): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28095)] 23:30:32.615490 run osmo-stp_10.42.42.5(pid=28095): stdout: | (launched: 2022-12-08_23:30:30.826553) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:32.751816 run osmo-stp_10.42.42.5(pid=28095): stderr: | [0;m[38;5;43m20221208233031243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233031243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233031245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233031246 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233031247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233031247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233031247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:32.885844 run osmo-stp_10.42.42.5(pid=28095): stdout: | (launched: 2022-12-08_23:30:30.826553) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:33.013096 run osmo-stp_10.42.42.5(pid=28095): stderr: | [0;m[38;5;43m20221208233031243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233031243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233031245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233031246 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233031247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233031247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233031247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:33.166207 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28095): Process ended prematurely: osmo-stp_10.42.42.5(pid=28095) [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28095)] [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 23:30:33.175800 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 23:30:33.203518 run osmo-hlr_10.42.42.2(pid=28092): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28092)] 23:30:33.253348 run osmo-hlr_10.42.42.2(pid=28092): stdout: | (launched: 2022-12-08_23:30:29.874157) 23:30:33.304829 run osmo-hlr_10.42.42.2(pid=28092): stderr: | [0;m[1;31m20221208233030050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233030051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233030051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233030051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233030051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233030051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233030069 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233030078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233030078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233030078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:30:33.376429 run osmo-msc_10.42.42.6(pid=28098): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28098)] 23:30:33.426619 run osmo-msc_10.42.42.6(pid=28098): stdout: | (launched: 2022-12-08_23:30:32.169464) 23:30:33.477838 run osmo-msc_10.42.42.6(pid=28098): stderr: | [0;m[38;5;43m20221208233032492 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233032492 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe87f9bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233032492 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233032492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233032492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233032492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233032494 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233032494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233032495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233032495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:30:33.529708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28091): Terminating (SIGTERM) 23:30:33.571187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28094): Terminating (SIGTERM) 23:30:33.612543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28097): Terminating (SIGTERM) 23:30:33.654334 --- ParallelTerminationStrategy: PID 28091 died... 23:30:33.673902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28091): Terminated: ok {rc=0} 23:30:33.719871 --- ParallelTerminationStrategy: PID 28094 died... 23:30:33.739248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28094): Terminated: ok {rc=0} 23:30:33.785397 --- ParallelTerminationStrategy: PID 28097 died... 23:30:33.804838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28097): Terminated: ok {rc=0} 23:30:33.892078 bus /sierra_3: Setting Powered False 23:30:34.991275 bus /sierra_3: Setting Powered False 23:30:36.106231 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 23:30:37.255340 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:37.267413 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:30:37.339286 tst mo_mt_call_osmux.py: using LAC 17504 23:30:37.466913 tst mo_mt_call_osmux.py: using RAC 164 23:30:37.594298 tst mo_mt_call_osmux.py: using CellId 17504 23:30:37.721478 tst mo_mt_call_osmux.py: using BVCI 17505 23:30:37.833419 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:37.844358 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:37.855353 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:37.866610 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:37.878121 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:37.889349 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:30:38.007012 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:30:38.128459 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:30:38.624051 run create_hlr_db(pid=28100): Launched 23:30:38.755103 bus /sierra_2: Setting Powered False 23:30:39.818327 run create_hlr_db(pid=28100): Terminated: ok {rc=0} 23:30:40.263448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28102): Launched 23:30:40.585280 run osmo-hlr_10.42.42.2(pid=28103): Launched 23:30:40.707458 run osmo-stp_10.42.42.5: Starting osmo-stp 23:30:41.260463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28105): Launched 23:30:41.580369 run osmo-stp_10.42.42.5(pid=28106): Launched 23:30:41.702631 run osmo-msc_10.42.42.6: Starting osmo-msc 23:30:42.281719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28108): Launched 23:30:42.601152 run osmo-msc_10.42.42.6(pid=28109): Launched 23:30:42.779547 run osmo-stp_10.42.42.5(pid=28106): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28106)] 23:30:42.914313 run osmo-stp_10.42.42.5(pid=28106): stdout: | (launched: 2022-12-08_23:30:41.522777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:43.050351 run osmo-stp_10.42.42.5(pid=28106): stderr: | [0;m[38;5;43m20221208233041714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233041715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233041715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233041715 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233041716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233041716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233041716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:43.186147 run osmo-stp_10.42.42.5(pid=28106): stdout: | (launched: 2022-12-08_23:30:41.522777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:43.313286 run osmo-stp_10.42.42.5(pid=28106): stderr: | [0;m[38;5;43m20221208233041714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233041715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233041715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233041715 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233041716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233041716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233041716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:43.465233 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28106): Process ended prematurely: osmo-stp_10.42.42.5(pid=28106) [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28106)] [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 23:30:43.475183 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 23:30:43.502842 run osmo-hlr_10.42.42.2(pid=28103): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28103)] 23:30:43.552807 run osmo-hlr_10.42.42.2(pid=28103): stdout: | (launched: 2022-12-08_23:30:40.527364) 23:30:43.604558 run osmo-hlr_10.42.42.2(pid=28103): stderr: | [0;m[1;31m20221208233040726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233040726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233040726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233040726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233040726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233040727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233040740 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233040748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233040748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233040748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:30:43.676305 run osmo-msc_10.42.42.6(pid=28109): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28109)] 23:30:43.725858 run osmo-msc_10.42.42.6(pid=28109): stdout: | (launched: 2022-12-08_23:30:42.542888) 23:30:43.777218 run osmo-msc_10.42.42.6(pid=28109): stderr: | [0;m[38;5;43m20221208233042865 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233042866 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff29a577c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233042866 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233042866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233042866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233042866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233042868 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233042868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233042868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233042868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:30:43.828835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28102): Terminating (SIGTERM) 23:30:43.870547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28105): Terminating (SIGTERM) 23:30:43.912144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28108): Terminating (SIGTERM) 23:30:43.954022 --- ParallelTerminationStrategy: PID 28102 died... 23:30:43.973413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28102): Terminated: ok {rc=0} 23:30:44.019172 --- ParallelTerminationStrategy: PID 28105 died... 23:30:44.038593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28105): Terminated: ok {rc=0} 23:30:44.084673 --- ParallelTerminationStrategy: PID 28108 died... 23:30:44.104075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28108): Terminated: ok {rc=0} 23:30:44.190916 bus /sierra_3: Setting Powered False 23:30:45.285489 bus /sierra_3: Setting Powered False 23:30:46.404183 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 23:30:47.661919 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:30:47.668784 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 23:30:47.701661 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 23:30:47.727877 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 23:30:47.780601 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 23:30:47.813877 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 23:30:47.840170 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 23:30:48.386893 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 23:30:48.435937 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:48.447015 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:30:48.515194 tst mo_mt_call.py: using LAC 17505 23:30:48.634220 tst mo_mt_call.py: using RAC 165 23:30:48.754012 tst mo_mt_call.py: using CellId 17505 23:30:48.874370 tst mo_mt_call.py: using BVCI 17506 23:30:48.984266 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:48.995139 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:49.006003 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:49.017137 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:49.028445 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:49.039748 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:30:49.155404 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:30:49.269997 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:30:49.733712 run create_hlr_db(pid=28114): Launched 23:30:49.866522 bus /sierra_2: Setting Powered False 23:30:50.929323 run create_hlr_db(pid=28114): Terminated: ok {rc=0} 23:30:51.373916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28116): Launched 23:30:51.692125 run osmo-hlr_10.42.42.2(pid=28117): Launched 23:30:51.813128 run osmo-stp_10.42.42.5: Starting osmo-stp 23:30:52.360897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28119): Launched 23:30:52.679736 run osmo-stp_10.42.42.5(pid=28120): Launched 23:30:52.801080 run osmo-msc_10.42.42.6: Starting osmo-msc 23:30:53.378847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28122): Launched 23:30:53.698614 run osmo-msc_10.42.42.6(pid=28123): Launched 23:30:53.876123 run osmo-stp_10.42.42.5(pid=28120): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28120)] 23:30:54.010776 run osmo-stp_10.42.42.5(pid=28120): stdout: | (launched: 2022-12-08_23:30:52.622179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:54.146735 run osmo-stp_10.42.42.5(pid=28120): stderr: | [0;m[38;5;43m20221208233052815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233052816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233052816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233052816 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233052817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233052817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233052817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:54.281560 run osmo-stp_10.42.42.5(pid=28120): stdout: | (launched: 2022-12-08_23:30:52.622179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:54.408868 run osmo-stp_10.42.42.5(pid=28120): stderr: | [0;m[38;5;43m20221208233052815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233052816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233052816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233052816 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233052817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233052817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233052817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:54.561222 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28120): Process ended prematurely: osmo-stp_10.42.42.5(pid=28120) [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28120)] [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 23:30:54.570986 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 23:30:54.598792 run osmo-hlr_10.42.42.2(pid=28117): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28117)] 23:30:54.648585 run osmo-hlr_10.42.42.2(pid=28117): stdout: | (launched: 2022-12-08_23:30:51.634552) 23:30:54.700106 run osmo-hlr_10.42.42.2(pid=28117): stderr: | [0;m[1;31m20221208233051835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233051835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233051835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233051835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233051835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233051835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233051849 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233051859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233051859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233051859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:30:54.771307 run osmo-msc_10.42.42.6(pid=28123): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28123)] 23:30:54.820929 run osmo-msc_10.42.42.6(pid=28123): stdout: | (launched: 2022-12-08_23:30:53.640724) 23:30:54.871891 run osmo-msc_10.42.42.6(pid=28123): stderr: | [0;m[38;5;43m20221208233053962 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233053962 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f09f57fec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233053962 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233053962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233053962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233053962 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233053964 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233053964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233053964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233053965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:30:54.923089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28116): Terminating (SIGTERM) 23:30:54.964269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28119): Terminating (SIGTERM) 23:30:55.005868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28122): Terminating (SIGTERM) 23:30:55.047569 --- ParallelTerminationStrategy: PID 28116 died... 23:30:55.066952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28116): Terminated: ok {rc=0} 23:30:55.113132 --- ParallelTerminationStrategy: PID 28119 died... 23:30:55.132543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28119): Terminated: ok {rc=0} 23:30:55.178805 --- ParallelTerminationStrategy: PID 28122 died... 23:30:55.198326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28122): Terminated: ok {rc=0} 23:30:55.286498 bus /sierra_3: Setting Powered False 23:30:56.385495 bus /sierra_3: Setting Powered False 23:30:57.500550 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 23:30:58.649004 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:58.661151 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:30:58.732455 tst mo_mt_call_osmux.py: using LAC 17506 23:30:58.859603 tst mo_mt_call_osmux.py: using RAC 166 23:30:58.985046 tst mo_mt_call_osmux.py: using CellId 17506 23:30:59.111534 tst mo_mt_call_osmux.py: using BVCI 17507 23:30:59.229798 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:59.241428 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:59.253145 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:59.264671 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:59.276248 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:59.287729 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:30:59.407300 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:30:59.524126 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:30:59.990257 run create_hlr_db(pid=28125): Launched 23:31:00.105917 bus /sierra_2: Setting Powered False 23:31:01.183732 run create_hlr_db(pid=28125): Terminated: ok {rc=0} 23:31:01.685370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28127): Launched 23:31:02.034478 run osmo-hlr_10.42.42.2(pid=28128): Launched 23:31:02.254469 run osmo-stp_10.42.42.5: Starting osmo-stp 23:31:02.778235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28130): Launched 23:31:03.077942 run osmo-stp_10.42.42.5(pid=28131): Launched 23:31:03.192631 run osmo-msc_10.42.42.6: Starting osmo-msc 23:31:03.741089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28133): Launched 23:31:04.042377 run osmo-msc_10.42.42.6(pid=28134): Launched 23:31:04.211113 run osmo-stp_10.42.42.5(pid=28131): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28131)] 23:31:04.339080 run osmo-stp_10.42.42.5(pid=28131): stdout: | (launched: 2022-12-08_23:31:03.023442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:04.467530 run osmo-stp_10.42.42.5(pid=28131): stderr: | [0;m[38;5;43m20221208233103194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233103194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233103194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233103195 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233103195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233103195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233103195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:04.593273 run osmo-stp_10.42.42.5(pid=28131): stdout: | (launched: 2022-12-08_23:31:03.023442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:04.712904 run osmo-stp_10.42.42.5(pid=28131): stderr: | [0;m[38;5;43m20221208233103194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233103194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233103194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233103195 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233103195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233103195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233103195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:04.856460 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28131): Process ended prematurely: osmo-stp_10.42.42.5(pid=28131) [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28131)] [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 23:31:04.865599 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 23:31:04.892130 run osmo-hlr_10.42.42.2(pid=28128): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28128)] 23:31:04.939901 run osmo-hlr_10.42.42.2(pid=28128): stdout: | (launched: 2022-12-08_23:31:01.964139) 23:31:04.988872 run osmo-hlr_10.42.42.2(pid=28128): stderr: | [0;m[1;31m20221208233102183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233102183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233102183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233102183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233102183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233102183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233102203 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233102229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233102230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233102230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:31:05.057438 run osmo-msc_10.42.42.6(pid=28134): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28134)] 23:31:05.104714 run osmo-msc_10.42.42.6(pid=28134): stdout: | (launched: 2022-12-08_23:31:03.987443) 23:31:05.153510 run osmo-msc_10.42.42.6(pid=28134): stderr: | [0;m[38;5;43m20221208233104261 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233104262 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff569616c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233104262 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233104262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233104262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233104262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233104264 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233104264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233104264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233104265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:31:05.202713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28127): Terminating (SIGTERM) 23:31:05.241543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28130): Terminating (SIGTERM) 23:31:05.281197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28133): Terminating (SIGTERM) 23:31:05.321433 --- ParallelTerminationStrategy: PID 28127 died... 23:31:05.340260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28127): Terminated: ok {rc=0} 23:31:05.384017 --- ParallelTerminationStrategy: PID 28130 died... 23:31:05.402360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28130): Terminated: ok {rc=0} 23:31:05.445722 --- ParallelTerminationStrategy: PID 28133 died... 23:31:05.463962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28133): Terminated: ok {rc=0} 23:31:05.548401 bus /sierra_3: Setting Powered False 23:31:06.648062 bus /sierra_3: Setting Powered False 23:31:07.763984 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 23:31:09.008870 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:31:09.015510 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 23:31:09.049052 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 23:31:09.074905 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 23:31:09.126243 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 23:31:09.158628 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 23:31:09.184843 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 23:31:09.733812 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 23:31:09.782474 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:09.793572 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:31:09.861406 tst mo_mt_call.py: using LAC 17507 23:31:09.980381 tst mo_mt_call.py: using RAC 167 23:31:10.097462 tst mo_mt_call.py: using CellId 17507 23:31:10.217604 tst mo_mt_call.py: using BVCI 17508 23:31:10.326375 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:10.337506 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:10.348184 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:10.359048 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:10.370474 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:10.381712 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:31:10.499172 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:31:10.617994 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:31:11.116511 run create_hlr_db(pid=28139): Launched 23:31:11.247011 bus /sierra_2: Setting Powered False 23:31:12.310089 run create_hlr_db(pid=28139): Terminated: ok {rc=0} 23:31:12.737473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28141): Launched 23:31:13.036424 run osmo-hlr_10.42.42.2(pid=28142): Launched 23:31:13.150953 run osmo-stp_10.42.42.5: Starting osmo-stp 23:31:13.667841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28144): Launched 23:31:13.967416 run osmo-stp_10.42.42.5(pid=28145): Launched 23:31:14.082031 run osmo-msc_10.42.42.6: Starting osmo-msc 23:31:14.623743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28147): Launched 23:31:14.924091 run osmo-msc_10.42.42.6(pid=28148): Launched 23:31:15.092382 run osmo-stp_10.42.42.5(pid=28145): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28145)] 23:31:15.220374 run osmo-stp_10.42.42.5(pid=28145): stdout: | (launched: 2022-12-08_23:31:13.912816) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:15.348438 run osmo-stp_10.42.42.5(pid=28145): stderr: | [0;m[38;5;43m20221208233114082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233114082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233114082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233114083 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233114085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233114085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233114085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:15.474482 run osmo-stp_10.42.42.5(pid=28145): stdout: | (launched: 2022-12-08_23:31:13.912816) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:15.594096 run osmo-stp_10.42.42.5(pid=28145): stderr: | [0;m[38;5;43m20221208233114082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233114082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233114082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233114083 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233114085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233114085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233114085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:15.736852 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28145): Process ended prematurely: osmo-stp_10.42.42.5(pid=28145) [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28145)] [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 23:31:15.745922 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:31:15.772164 run osmo-hlr_10.42.42.2(pid=28142): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28142)] 23:31:15.819313 run osmo-hlr_10.42.42.2(pid=28142): stdout: | (launched: 2022-12-08_23:31:12.982208) 23:31:15.878563 run osmo-hlr_10.42.42.2(pid=28142): stderr: | [0;m[1;31m20221208233113157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233113157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233113157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233113157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233113157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233113157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233113171 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233113181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233113181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233113181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:31:15.948612 run osmo-msc_10.42.42.6(pid=28148): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28148)] 23:31:15.997701 run osmo-msc_10.42.42.6(pid=28148): stdout: | (launched: 2022-12-08_23:31:14.869654) 23:31:16.048286 run osmo-msc_10.42.42.6(pid=28148): stderr: | [0;m[38;5;43m20221208233115142 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233115142 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fae336d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233115142 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233115142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233115142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233115143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233115145 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233115145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233115145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233115145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:31:16.099740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28141): Terminating (SIGTERM) 23:31:16.143322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28144): Terminating (SIGTERM) 23:31:16.186673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28147): Terminating (SIGTERM) 23:31:16.229646 --- ParallelTerminationStrategy: PID 28141 died... 23:31:16.249047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28141): Terminated: ok {rc=0} 23:31:16.295223 --- ParallelTerminationStrategy: PID 28144 died... 23:31:16.314177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28144): Terminated: ok {rc=0} 23:31:16.361352 --- ParallelTerminationStrategy: PID 28147 died... 23:31:16.380692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28147): Terminated: ok {rc=0} 23:31:16.467208 bus /sierra_3: Setting Powered False 23:31:17.562409 bus /sierra_3: Setting Powered False 23:31:18.677547 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:31:19.823498 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:19.835172 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:31:19.904031 tst mo_mt_call_osmux.py: using LAC 17508 23:31:20.026910 tst mo_mt_call_osmux.py: using RAC 168 23:31:20.144664 tst mo_mt_call_osmux.py: using CellId 17508 23:31:20.261442 tst mo_mt_call_osmux.py: using BVCI 17509 23:31:20.378849 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:20.390504 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:20.401972 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:20.416337 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:20.427633 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:20.439193 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:31:20.558056 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:31:20.674694 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:31:21.141504 run create_hlr_db(pid=28150): Launched 23:31:21.256518 bus /sierra_2: Setting Powered False 23:31:22.316831 run create_hlr_db(pid=28150): Terminated: ok {rc=0} 23:31:22.734250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28152): Launched 23:31:23.034058 run osmo-hlr_10.42.42.2(pid=28153): Launched 23:31:23.148737 run osmo-stp_10.42.42.5: Starting osmo-stp 23:31:23.682668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28155): Launched 23:31:23.982128 run osmo-stp_10.42.42.5(pid=28156): Launched 23:31:24.097216 run osmo-msc_10.42.42.6: Starting osmo-msc 23:31:24.639388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28158): Launched 23:31:24.940613 run osmo-msc_10.42.42.6(pid=28159): Launched 23:31:25.109942 run osmo-stp_10.42.42.5(pid=28156): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28156)] 23:31:25.238243 run osmo-stp_10.42.42.5(pid=28156): stdout: | (launched: 2022-12-08_23:31:23.927806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:25.366454 run osmo-stp_10.42.42.5(pid=28156): stderr: | [0;m[38;5;43m20221208233124099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233124099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233124099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233124099 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233124100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233124100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233124100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:25.492755 run osmo-stp_10.42.42.5(pid=28156): stdout: | (launched: 2022-12-08_23:31:23.927806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:25.612402 run osmo-stp_10.42.42.5(pid=28156): stderr: | [0;m[38;5;43m20221208233124099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233124099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233124099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233124099 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233124100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233124100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233124100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:25.755790 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28156): Process ended prematurely: osmo-stp_10.42.42.5(pid=28156) [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28156)] [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:31:25.764600 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:31:25.791150 run osmo-hlr_10.42.42.2(pid=28153): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28153)] 23:31:25.839241 run osmo-hlr_10.42.42.2(pid=28153): stdout: | (launched: 2022-12-08_23:31:22.979681) 23:31:25.889129 run osmo-hlr_10.42.42.2(pid=28153): stderr: | [0;m[1;31m20221208233123153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233123153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233123153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233123153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233123153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233123153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233123167 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233123175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233123176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233123176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:31:25.957592 run osmo-msc_10.42.42.6(pid=28159): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28159)] 23:31:26.005260 run osmo-msc_10.42.42.6(pid=28159): stdout: | (launched: 2022-12-08_23:31:24.885767) 23:31:26.054207 run osmo-msc_10.42.42.6(pid=28159): stderr: | [0;m[38;5;43m20221208233125159 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233125159 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6311e6ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233125159 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233125159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233125159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233125159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233125162 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233125162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233125162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233125162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:31:26.103801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28152): Terminating (SIGTERM) 23:31:26.143212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28155): Terminating (SIGTERM) 23:31:26.182626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28158): Terminating (SIGTERM) 23:31:26.222204 --- ParallelTerminationStrategy: PID 28152 died... 23:31:26.240616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28152): Terminated: ok {rc=0} 23:31:26.285133 --- ParallelTerminationStrategy: PID 28155 died... 23:31:26.303391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28155): Terminated: ok {rc=0} 23:31:26.347122 --- ParallelTerminationStrategy: PID 28158 died... 23:31:26.365624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28158): Terminated: ok {rc=0} 23:31:26.451232 bus /sierra_3: Setting Powered False 23:31:27.550697 bus /sierra_3: Setting Powered False 23:31:28.663001 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 23:31:29.910028 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:31:29.916357 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 23:31:29.949687 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 23:31:29.975900 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 23:31:30.026608 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 23:31:30.059098 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 23:31:30.085372 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 23:31:30.634600 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 23:31:30.682775 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:30.693694 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:31:30.761429 tst mo_mt_call.py: using LAC 17509 23:31:30.895798 tst mo_mt_call.py: using RAC 169 23:31:31.033969 tst mo_mt_call.py: using CellId 17509 23:31:31.156186 tst mo_mt_call.py: using BVCI 17510 23:31:31.269662 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:31.281568 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:31.293446 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:31.305863 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:31.318384 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:31.331314 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:31:31.450244 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:31:31.567577 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:31:32.063398 run create_hlr_db(pid=28165): Launched 23:31:32.217871 bus /sierra_2: Setting Powered False 23:31:33.277881 run create_hlr_db(pid=28165): Terminated: ok {rc=0} 23:31:33.695179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28167): Launched 23:31:33.995716 run osmo-hlr_10.42.42.2(pid=28168): Launched 23:31:34.109846 run osmo-stp_10.42.42.5: Starting osmo-stp 23:31:34.624725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28170): Launched 23:31:34.925300 run osmo-stp_10.42.42.5(pid=28171): Launched 23:31:35.040102 run osmo-msc_10.42.42.6: Starting osmo-msc 23:31:35.584749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28173): Launched 23:31:35.883949 run osmo-msc_10.42.42.6(pid=28174): Launched 23:31:36.052028 run osmo-stp_10.42.42.5(pid=28171): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28171)] 23:31:36.179691 run osmo-stp_10.42.42.5(pid=28171): stdout: | (launched: 2022-12-08_23:31:34.870805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:36.307602 run osmo-stp_10.42.42.5(pid=28171): stderr: | [0;m[38;5;43m20221208233135039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233135039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233135039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233135039 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233135042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233135042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233135042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:36.432690 run osmo-stp_10.42.42.5(pid=28171): stdout: | (launched: 2022-12-08_23:31:34.870805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:36.552087 run osmo-stp_10.42.42.5(pid=28171): stderr: | [0;m[38;5;43m20221208233135039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233135039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233135039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233135039 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233135042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233135042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233135042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:36.694972 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28171): Process ended prematurely: osmo-stp_10.42.42.5(pid=28171) [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28171)] [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 23:31:36.703882 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:31:36.730237 run osmo-hlr_10.42.42.2(pid=28168): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28168)] 23:31:36.777521 run osmo-hlr_10.42.42.2(pid=28168): stdout: | (launched: 2022-12-08_23:31:33.941357) 23:31:36.826232 run osmo-hlr_10.42.42.2(pid=28168): stderr: | [0;m[1;31m20221208233134118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233134118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233134118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233134118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233134118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233134118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233134130 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233134139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233134139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233134139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:31:36.893587 run osmo-msc_10.42.42.6(pid=28174): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28174)] 23:31:36.940188 run osmo-msc_10.42.42.6(pid=28174): stdout: | (launched: 2022-12-08_23:31:35.829768) 23:31:36.988736 run osmo-msc_10.42.42.6(pid=28174): stderr: | [0;m[38;5;43m20221208233136099 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233136099 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0388efcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233136100 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233136100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233136100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233136100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233136102 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233136102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233136102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233136102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:31:37.037618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28167): Terminating (SIGTERM) 23:31:37.076599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28170): Terminating (SIGTERM) 23:31:37.115607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28173): Terminating (SIGTERM) 23:31:37.154866 --- ParallelTerminationStrategy: PID 28167 died... 23:31:37.173619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28167): Terminated: ok {rc=0} 23:31:37.217212 --- ParallelTerminationStrategy: PID 28170 died... 23:31:37.235644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28170): Terminated: ok {rc=0} 23:31:37.279604 --- ParallelTerminationStrategy: PID 28173 died... 23:31:37.298054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28173): Terminated: ok {rc=0} 23:31:37.380599 bus /sierra_3: Setting Powered False 23:31:38.477830 bus /sierra_3: Setting Powered False 23:31:39.592720 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 23:31:40.740665 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:40.752701 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:31:40.826538 tst mo_mt_call_osmux.py: using LAC 17510 23:31:40.951119 tst mo_mt_call_osmux.py: using RAC 170 23:31:41.074194 tst mo_mt_call_osmux.py: using CellId 17510 23:31:41.198542 tst mo_mt_call_osmux.py: using BVCI 17511 23:31:41.314581 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:41.326191 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:41.337581 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:41.348896 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:41.360612 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:41.372046 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:31:41.492471 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:31:41.609353 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:31:42.075288 run create_hlr_db(pid=28176): Launched 23:31:42.191431 bus /sierra_2: Setting Powered False 23:31:43.252197 run create_hlr_db(pid=28176): Terminated: ok {rc=0} 23:31:43.671020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28178): Launched 23:31:43.971412 run osmo-hlr_10.42.42.2(pid=28179): Launched 23:31:44.086731 run osmo-stp_10.42.42.5: Starting osmo-stp 23:31:44.615319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28181): Launched 23:31:44.915624 run osmo-stp_10.42.42.5(pid=28182): Launched 23:31:45.030068 run osmo-msc_10.42.42.6: Starting osmo-msc 23:31:45.573100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28184): Launched 23:31:45.881671 run osmo-msc_10.42.42.6(pid=28185): Launched 23:31:46.331213 run osmo-stp_10.42.42.5(pid=28182): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28182)] 23:31:46.646872 run osmo-stp_10.42.42.5(pid=28182): stdout: | (launched: 2022-12-08_23:31:44.861263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:46.779948 run osmo-stp_10.42.42.5(pid=28182): stderr: | [0;m[38;5;43m20221208233145031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233145031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233145032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233145032 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233145033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233145033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233145033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:46.908477 run osmo-stp_10.42.42.5(pid=28182): stdout: | (launched: 2022-12-08_23:31:44.861263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:47.030685 run osmo-stp_10.42.42.5(pid=28182): stderr: | [0;m[38;5;43m20221208233145031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233145031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233145032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233145032 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233145033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233145033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233145033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:47.177570 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28182): Process ended prematurely: osmo-stp_10.42.42.5(pid=28182) [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28182)] [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 23:31:47.187332 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 23:31:47.216895 run osmo-hlr_10.42.42.2(pid=28179): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28179)] 23:31:47.266899 run osmo-hlr_10.42.42.2(pid=28179): stdout: | (launched: 2022-12-08_23:31:43.916724) 23:31:47.318458 run osmo-hlr_10.42.42.2(pid=28179): stderr: | [0;m[1;31m20221208233144094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233144094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233144095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233144095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233144095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233144095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233144107 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233144115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233144116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233144116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:31:47.389734 run osmo-msc_10.42.42.6(pid=28185): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28185)] 23:31:47.439985 run osmo-msc_10.42.42.6(pid=28185): stdout: | (launched: 2022-12-08_23:31:45.820518) 23:31:47.490518 run osmo-msc_10.42.42.6(pid=28185): stderr: | [0;m[38;5;43m20221208233146224 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233146224 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1140b8fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233146224 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233146224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233146226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233146226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233146228 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233146228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233146228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233146229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:31:47.540729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28178): Terminating (SIGTERM) 23:31:47.581558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28181): Terminating (SIGTERM) 23:31:47.621994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28184): Terminating (SIGTERM) 23:31:47.663104 --- ParallelTerminationStrategy: PID 28178 died... 23:31:47.682142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28178): Terminated: ok {rc=0} 23:31:47.727828 --- ParallelTerminationStrategy: PID 28181 died... 23:31:47.746530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28181): Terminated: ok {rc=0} 23:31:47.791981 --- ParallelTerminationStrategy: PID 28184 died... 23:31:47.810600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28184): Terminated: ok {rc=0} 23:31:47.895872 bus /sierra_3: Setting Powered False 23:31:48.992917 bus /sierra_3: Setting Powered False 23:31:50.107885 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:31:51.358424 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:31:51.365328 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:31:51.399360 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:31:51.426378 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:31:51.478650 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:31:51.512472 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:31:51.539846 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:31:52.090705 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:31:52.142784 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:52.154389 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:31:52.224658 tst mo_mt_call.py: using LAC 17511 23:31:52.349979 tst mo_mt_call.py: using RAC 171 23:31:52.479395 tst mo_mt_call.py: using CellId 17511 23:31:52.606811 tst mo_mt_call.py: using BVCI 17512 23:31:52.717517 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:52.728316 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:52.739205 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:52.750878 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:52.762448 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:52.773880 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:31:52.894084 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:31:53.012833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:31:53.509393 run create_hlr_db(pid=28190): Launched 23:31:53.640122 bus /sierra_2: Setting Powered False 23:31:54.702989 run create_hlr_db(pid=28190): Terminated: ok {rc=0} 23:31:55.132089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28192): Launched 23:31:55.433433 run osmo-hlr_10.42.42.2(pid=28193): Launched 23:31:55.548249 run osmo-stp_10.42.42.5: Starting osmo-stp 23:31:56.080426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28195): Launched 23:31:56.381395 run osmo-stp_10.42.42.5(pid=28196): Launched 23:31:56.495841 run osmo-msc_10.42.42.6: Starting osmo-msc 23:31:57.036493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28198): Launched 23:31:57.336472 run osmo-msc_10.42.42.6(pid=28199): Launched 23:31:57.505208 run osmo-stp_10.42.42.5(pid=28196): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28196)] 23:31:57.633552 run osmo-stp_10.42.42.5(pid=28196): stdout: | (launched: 2022-12-08_23:31:56.326840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:57.761952 run osmo-stp_10.42.42.5(pid=28196): stderr: | [0;m[38;5;43m20221208233156495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233156495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233156496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233156496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233156498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233156498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233156499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:57.887136 run osmo-stp_10.42.42.5(pid=28196): stdout: | (launched: 2022-12-08_23:31:56.326840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:58.006485 run osmo-stp_10.42.42.5(pid=28196): stderr: | [0;m[38;5;43m20221208233156495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233156495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233156496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233156496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233156498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233156498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233156499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:58.149507 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28196): Process ended prematurely: osmo-stp_10.42.42.5(pid=28196) [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28196)] [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:31:58.158228 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:31:58.184376 run osmo-hlr_10.42.42.2(pid=28193): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28193)] 23:31:58.231503 run osmo-hlr_10.42.42.2(pid=28193): stdout: | (launched: 2022-12-08_23:31:55.379020) 23:31:58.280679 run osmo-hlr_10.42.42.2(pid=28193): stderr: | [0;m[1;31m20221208233155552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233155552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233155552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233155553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233155553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233155553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233155564 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233155573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233155573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233155573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:31:58.348600 run osmo-msc_10.42.42.6(pid=28199): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28199)] 23:31:58.395480 run osmo-msc_10.42.42.6(pid=28199): stdout: | (launched: 2022-12-08_23:31:57.281862) 23:31:58.444184 run osmo-msc_10.42.42.6(pid=28199): stderr: | [0;m[38;5;43m20221208233157552 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233157552 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f75951f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233157552 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233157552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233157552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233157553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233157554 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233157555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233157555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233157555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:31:58.493368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28192): Terminating (SIGTERM) 23:31:58.532332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28195): Terminating (SIGTERM) 23:31:58.571208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28198): Terminating (SIGTERM) 23:31:58.610435 --- ParallelTerminationStrategy: PID 28192 died... 23:31:58.629104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28192): Terminated: ok {rc=0} 23:31:58.672551 --- ParallelTerminationStrategy: PID 28195 died... 23:31:58.690711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28195): Terminated: ok {rc=0} 23:31:58.734104 --- ParallelTerminationStrategy: PID 28198 died... 23:31:58.752206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28198): Terminated: ok {rc=0} 23:31:58.835381 bus /sierra_3: Setting Powered False 23:31:59.931852 bus /sierra_3: Setting Powered False 23:32:01.051007 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:32:02.207351 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:32:02.219824 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:32:02.306014 tst mo_mt_call_osmux.py: using LAC 17512 23:32:02.427184 tst mo_mt_call_osmux.py: using RAC 172 23:32:02.543424 tst mo_mt_call_osmux.py: using CellId 17512 23:32:02.659379 tst mo_mt_call_osmux.py: using BVCI 17513 23:32:02.768546 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:32:02.779486 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:32:02.790198 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:32:02.801128 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:32:02.812131 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:32:02.823082 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:32:02.936813 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:32:03.054714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:32:03.553715 run create_hlr_db(pid=28201): Launched 23:32:03.685064 bus /sierra_2: Setting Powered False 23:32:04.748737 run create_hlr_db(pid=28201): Terminated: ok {rc=0} 23:32:05.178356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28203): Launched 23:32:05.479147 run osmo-hlr_10.42.42.2(pid=28204): Launched 23:32:05.594092 run osmo-stp_10.42.42.5: Starting osmo-stp 23:32:06.113087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28206): Launched 23:32:06.435272 run osmo-stp_10.42.42.5(pid=28207): Launched 23:32:06.557077 run osmo-msc_10.42.42.6: Starting osmo-msc 23:32:07.138219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28209): Launched 23:32:07.459906 run osmo-msc_10.42.42.6(pid=28210): Launched 23:32:07.639374 run osmo-stp_10.42.42.5(pid=28207): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28207)] 23:32:07.774796 run osmo-stp_10.42.42.5(pid=28207): stdout: | (launched: 2022-12-08_23:32:06.377503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:07.911313 run osmo-stp_10.42.42.5(pid=28207): stderr: | [0;m[38;5;43m20221208233206568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233206568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233206568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233206569 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233206569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233206569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233206569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:08.046206 run osmo-stp_10.42.42.5(pid=28207): stdout: | (launched: 2022-12-08_23:32:06.377503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:08.174723 run osmo-stp_10.42.42.5(pid=28207): stderr: | [0;m[38;5;43m20221208233206568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233206568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233206568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233206569 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233206569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233206569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233206569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:08.327700 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28207): Process ended prematurely: osmo-stp_10.42.42.5(pid=28207) [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28207)] [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:32:08.337531 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:32:08.365267 run osmo-hlr_10.42.42.2(pid=28204): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28204)] 23:32:08.414918 run osmo-hlr_10.42.42.2(pid=28204): stdout: | (launched: 2022-12-08_23:32:05.424587) 23:32:08.466327 run osmo-hlr_10.42.42.2(pid=28204): stderr: | [0;m[1;31m20221208233205601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233205601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233205601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233205601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233205601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233205601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233205613 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233205622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233205623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233205623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:32:08.538167 run osmo-msc_10.42.42.6(pid=28210): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28210)] 23:32:08.587647 run osmo-msc_10.42.42.6(pid=28210): stdout: | (launched: 2022-12-08_23:32:07.401779) 23:32:08.638737 run osmo-msc_10.42.42.6(pid=28210): stderr: | [0;m[38;5;43m20221208233207725 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233207725 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f58f6e26c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233207725 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233207725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233207725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233207725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233207727 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233207728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233207728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233207728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:32:08.690189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28203): Terminating (SIGTERM) 23:32:08.731585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28206): Terminating (SIGTERM) 23:32:08.773639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28209): Terminating (SIGTERM) 23:32:08.815546 --- ParallelTerminationStrategy: PID 28203 died... 23:32:08.835300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28203): Terminated: ok {rc=0} 23:32:08.881217 --- ParallelTerminationStrategy: PID 28206 died... 23:32:08.900527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28206): Terminated: ok {rc=0} 23:32:08.946020 --- ParallelTerminationStrategy: PID 28209 died... 23:32:08.965377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28209): Terminated: ok {rc=0} 23:32:09.051961 bus /sierra_3: Setting Powered False 23:32:10.151125 bus /sierra_3: Setting Powered False 23:32:11.265624 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:32:12.511404 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:32:12.517823 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:32:12.551104 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:32:12.577125 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:32:12.631204 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:32:12.665553 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:32:12.691650 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:32:13.242117 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:32:13.290153 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:13.301153 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:32:13.369159 tst mo_mt_call.py: using LAC 17513 23:32:13.485266 tst mo_mt_call.py: using RAC 173 23:32:13.603639 tst mo_mt_call.py: using CellId 17513 23:32:13.720004 tst mo_mt_call.py: using BVCI 17514 23:32:13.829129 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:13.840328 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:13.851163 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:13.862206 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:13.873278 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:13.884193 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:32:14.001218 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:32:14.120384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:32:14.617961 run create_hlr_db(pid=28215): Launched 23:32:14.748114 bus /sierra_2: Setting Powered False 23:32:15.812029 run create_hlr_db(pid=28215): Terminated: ok {rc=0} 23:32:16.302097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28217): Launched 23:32:16.637532 run osmo-hlr_10.42.42.2(pid=28218): Launched 23:32:16.775487 run osmo-stp_10.42.42.5: Starting osmo-stp 23:32:17.472699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28220): Launched 23:32:17.772576 run osmo-stp_10.42.42.5(pid=28221): Launched 23:32:17.887974 run osmo-msc_10.42.42.6: Starting osmo-msc 23:32:18.430755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28223): Launched 23:32:18.730319 run osmo-msc_10.42.42.6(pid=28224): Launched 23:32:18.897981 run osmo-stp_10.42.42.5(pid=28221): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28221)] 23:32:19.025751 run osmo-stp_10.42.42.5(pid=28221): stdout: | (launched: 2022-12-08_23:32:17.718475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:19.153519 run osmo-stp_10.42.42.5(pid=28221): stderr: | [0;m[38;5;43m20221208233217888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233217889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233217889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233217889 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233217890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233217890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233217890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:19.279025 run osmo-stp_10.42.42.5(pid=28221): stdout: | (launched: 2022-12-08_23:32:17.718475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:19.399209 run osmo-stp_10.42.42.5(pid=28221): stderr: | [0;m[38;5;43m20221208233217888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233217889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233217889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233217889 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233217890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233217890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233217890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:19.542348 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28221): Process ended prematurely: osmo-stp_10.42.42.5(pid=28221) [trial-2351↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28221)] [trial-2351↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:32:19.551066 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 23:32:19.577622 run osmo-hlr_10.42.42.2(pid=28218): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28218)] 23:32:19.624776 run osmo-hlr_10.42.42.2(pid=28218): stdout: | (launched: 2022-12-08_23:32:16.573215) 23:32:19.673701 run osmo-hlr_10.42.42.2(pid=28218): stderr: | [0;m[1;31m20221208233216938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233216938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233216938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233216938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233216938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233216938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233216950 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233216966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233216967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233216967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:32:19.741838 run osmo-msc_10.42.42.6(pid=28224): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28224)] 23:32:19.788761 run osmo-msc_10.42.42.6(pid=28224): stdout: | (launched: 2022-12-08_23:32:18.675935) 23:32:19.837405 run osmo-msc_10.42.42.6(pid=28224): stderr: | [0;m[38;5;43m20221208233218946 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233218946 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbf51ddcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233218946 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233218946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233218947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233218947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233218948 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233218949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233218950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233218950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:32:19.886701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28217): Terminating (SIGTERM) 23:32:19.925815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28220): Terminating (SIGTERM) 23:32:19.964897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28223): Terminating (SIGTERM) 23:32:20.004450 --- ParallelTerminationStrategy: PID 28217 died... 23:32:20.023257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28217): Terminated: ok {rc=0} 23:32:20.067080 --- ParallelTerminationStrategy: PID 28220 died... 23:32:20.085192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28220): Terminated: ok {rc=0} 23:32:20.129231 --- ParallelTerminationStrategy: PID 28223 died... 23:32:20.147448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28223): Terminated: ok {rc=0} 23:32:20.229249 bus /sierra_3: Setting Powered False 23:32:21.326383 bus /sierra_3: Setting Powered False 23:32:22.441273 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:32:23.588468 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:23.600717 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:32:23.672828 tst mo_mt_call_osmux.py: using LAC 17514 23:32:23.800117 tst mo_mt_call_osmux.py: using RAC 174 23:32:23.924765 tst mo_mt_call_osmux.py: using CellId 17514 23:32:24.050287 tst mo_mt_call_osmux.py: using BVCI 17515 23:32:24.167902 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:24.179536 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:24.190770 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:24.202002 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:24.213367 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:24.224597 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:32:24.342441 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:32:24.458428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:32:24.925180 run create_hlr_db(pid=28226): Launched 23:32:25.041178 bus /sierra_2: Setting Powered False 23:32:26.101731 run create_hlr_db(pid=28226): Terminated: ok {rc=0} 23:32:26.519647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28228): Launched 23:32:26.820338 run osmo-hlr_10.42.42.2(pid=28229): Launched 23:32:26.936015 run osmo-stp_10.42.42.5: Starting osmo-stp 23:32:27.467726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28231): Launched 23:32:27.768002 run osmo-stp_10.42.42.5(pid=28232): Launched 23:32:27.882955 run osmo-msc_10.42.42.6: Starting osmo-msc 23:32:28.426727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28234): Launched 23:32:28.726801 run osmo-msc_10.42.42.6(pid=28235): Launched 23:32:28.895946 run osmo-stp_10.42.42.5(pid=28232): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28232)] 23:32:29.023789 run osmo-stp_10.42.42.5(pid=28232): stdout: | (launched: 2022-12-08_23:32:27.713328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:29.151951 run osmo-stp_10.42.42.5(pid=28232): stderr: | [0;m[38;5;43m20221208233227887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233227887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233227887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233227887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233227888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233227888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233227888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:29.277769 run osmo-stp_10.42.42.5(pid=28232): stdout: | (launched: 2022-12-08_23:32:27.713328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:29.397311 run osmo-stp_10.42.42.5(pid=28232): stderr: | [0;m[38;5;43m20221208233227887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233227887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233227887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233227887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233227888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233227888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233227888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:29.540227 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28232): Process ended prematurely: osmo-stp_10.42.42.5(pid=28232) [trial-2351↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28232)] [trial-2351↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:32:29.549154 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:32:29.575463 run osmo-hlr_10.42.42.2(pid=28229): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28229)] 23:32:29.623035 run osmo-hlr_10.42.42.2(pid=28229): stdout: | (launched: 2022-12-08_23:32:26.765612) 23:32:29.672113 run osmo-hlr_10.42.42.2(pid=28229): stderr: | [0;m[1;31m20221208233226939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233226940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233226940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233226940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233226940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233226940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233226952 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233226960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233226961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233226961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:32:29.740387 run osmo-msc_10.42.42.6(pid=28235): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28235)] 23:32:29.787747 run osmo-msc_10.42.42.6(pid=28235): stdout: | (launched: 2022-12-08_23:32:28.672209) 23:32:29.836560 run osmo-msc_10.42.42.6(pid=28235): stderr: | [0;m[38;5;43m20221208233228945 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233228945 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f59ab27ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233228945 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233228945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233228946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233228946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233228948 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233228948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233228948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233228948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:32:29.885746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28228): Terminating (SIGTERM) 23:32:29.924787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28231): Terminating (SIGTERM) 23:32:29.964199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28234): Terminating (SIGTERM) 23:32:30.004051 --- ParallelTerminationStrategy: PID 28228 died... 23:32:30.023294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28228): Terminated: ok {rc=0} 23:32:30.066893 --- ParallelTerminationStrategy: PID 28231 died... 23:32:30.085244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28231): Terminated: ok {rc=0} 23:32:30.128926 --- ParallelTerminationStrategy: PID 28234 died... 23:32:30.147644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28234): Terminated: ok {rc=0} 23:32:30.233447 bus /sierra_3: Setting Powered False 23:32:31.356387 bus /sierra_3: Setting Powered False 23:32:32.486028 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:32:33.733091 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:32:33.738766 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:32:33.772361 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 23:32:33.798320 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 23:32:33.849624 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:32:33.882972 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 23:32:33.909411 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 23:32:34.460927 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 23:32:34.512610 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:34.524063 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:32:34.596065 tst mo_mt_call.py: using LAC 17515 23:32:34.723729 tst mo_mt_call.py: using RAC 175 23:32:34.844142 tst mo_mt_call.py: using CellId 17515 23:32:34.962691 tst mo_mt_call.py: using BVCI 17516 23:32:35.073144 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:35.083925 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:35.094610 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:35.105647 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:35.116207 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:35.127006 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:32:35.245776 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:32:35.360044 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:32:35.829440 run create_hlr_db(pid=28243): Launched 23:32:35.944321 bus /sierra_2: Setting Powered False 23:32:37.004932 run create_hlr_db(pid=28243): Terminated: ok {rc=0} 23:32:37.423822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28245): Launched 23:32:37.724801 run osmo-hlr_10.42.42.2(pid=28246): Launched 23:32:37.839532 run osmo-stp_10.42.42.5: Starting osmo-stp 23:32:38.369917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28248): Launched 23:32:38.670322 run osmo-stp_10.42.42.5(pid=28249): Launched 23:32:38.786707 run osmo-msc_10.42.42.6: Starting osmo-msc 23:32:39.330527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28251): Launched 23:32:39.631911 run osmo-msc_10.42.42.6(pid=28252): Launched 23:32:39.801248 run osmo-stp_10.42.42.5(pid=28249): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28249)] 23:32:39.929680 run osmo-stp_10.42.42.5(pid=28249): stdout: | (launched: 2022-12-08_23:32:38.615495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:40.059592 run osmo-stp_10.42.42.5(pid=28249): stderr: | [0;m[38;5;43m20221208233238784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233238784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233238784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233238785 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233238785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233238785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233238785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:40.185619 run osmo-stp_10.42.42.5(pid=28249): stdout: | (launched: 2022-12-08_23:32:38.615495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:40.305362 run osmo-stp_10.42.42.5(pid=28249): stderr: | [0;m[38;5;43m20221208233238784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233238784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233238784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233238785 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233238785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233238785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233238785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:40.448800 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28249): Process ended prematurely: osmo-stp_10.42.42.5(pid=28249) [trial-2351↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28249)] [trial-2351↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 23:32:40.457627 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:32:40.483885 run osmo-hlr_10.42.42.2(pid=28246): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28246)] 23:32:40.531500 run osmo-hlr_10.42.42.2(pid=28246): stdout: | (launched: 2022-12-08_23:32:37.670094) 23:32:40.580478 run osmo-hlr_10.42.42.2(pid=28246): stderr: | [0;m[1;31m20221208233237845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233237845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233237845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233237845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233237845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233237845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233237860 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233237870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233237870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233237870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:32:40.648708 run osmo-msc_10.42.42.6(pid=28252): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28252)] 23:32:40.696219 run osmo-msc_10.42.42.6(pid=28252): stdout: | (launched: 2022-12-08_23:32:39.577108) 23:32:40.745300 run osmo-msc_10.42.42.6(pid=28252): stderr: | [0;m[38;5;43m20221208233239850 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233239851 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feb0ff24c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233239851 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233239851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233239851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233239851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233239853 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233239854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233239854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233239854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:32:40.795419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28245): Terminating (SIGTERM) 23:32:40.834845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28248): Terminating (SIGTERM) 23:32:40.874139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28251): Terminating (SIGTERM) 23:32:40.913613 --- ParallelTerminationStrategy: PID 28245 died... 23:32:40.932232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28245): Terminated: ok {rc=0} 23:32:40.976564 --- ParallelTerminationStrategy: PID 28248 died... 23:32:40.994914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28248): Terminated: ok {rc=0} 23:32:41.038553 --- ParallelTerminationStrategy: PID 28251 died... 23:32:41.056932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28251): Terminated: ok {rc=0} 23:32:41.143072 bus /sierra_3: Setting Powered False 23:32:42.241149 bus /sierra_3: Setting Powered False 23:32:43.355219 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 23:32:44.503414 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:44.515197 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:32:44.587085 tst mo_mt_call_osmux.py: using LAC 17516 23:32:44.712712 tst mo_mt_call_osmux.py: using RAC 176 23:32:44.840336 tst mo_mt_call_osmux.py: using CellId 17516 23:32:44.959978 tst mo_mt_call_osmux.py: using BVCI 17517 23:32:45.070247 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:45.081358 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:45.092281 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:45.103948 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:45.115524 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:45.127163 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:32:45.243456 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:32:45.356786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:32:45.822291 run create_hlr_db(pid=28254): Launched 23:32:45.969263 bus /sierra_2: Setting Powered False 23:32:47.028440 run create_hlr_db(pid=28254): Terminated: ok {rc=0} 23:32:47.473964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28256): Launched 23:32:47.795603 run osmo-hlr_10.42.42.2(pid=28257): Launched 23:32:47.917433 run osmo-stp_10.42.42.5: Starting osmo-stp 23:32:48.474608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28259): Launched 23:32:48.795222 run osmo-stp_10.42.42.5(pid=28260): Launched 23:32:48.916935 run osmo-msc_10.42.42.6: Starting osmo-msc 23:32:49.497351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28262): Launched 23:32:49.818395 run osmo-msc_10.42.42.6(pid=28263): Launched 23:32:49.996786 run osmo-stp_10.42.42.5(pid=28260): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28260)] 23:32:50.132125 run osmo-stp_10.42.42.5(pid=28260): stdout: | (launched: 2022-12-08_23:32:48.737403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:50.268398 run osmo-stp_10.42.42.5(pid=28260): stderr: | [0;m[38;5;43m20221208233248929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233248929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233248930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233248930 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233248930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233248931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233248931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:50.403735 run osmo-stp_10.42.42.5(pid=28260): stdout: | (launched: 2022-12-08_23:32:48.737403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:50.531495 run osmo-stp_10.42.42.5(pid=28260): stderr: | [0;m[38;5;43m20221208233248929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233248929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233248930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233248930 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233248930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233248931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233248931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:50.684123 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28260): Process ended prematurely: osmo-stp_10.42.42.5(pid=28260) [trial-2351↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28260)] [trial-2351↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 23:32:50.693795 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:32:50.721501 run osmo-hlr_10.42.42.2(pid=28257): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28257)] 23:32:50.771328 run osmo-hlr_10.42.42.2(pid=28257): stdout: | (launched: 2022-12-08_23:32:47.737867) 23:32:50.822949 run osmo-hlr_10.42.42.2(pid=28257): stderr: | [0;m[1;31m20221208233247935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233247935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233247935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233247935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233247935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233247935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233247947 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233247956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233247956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233247956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:32:50.894563 run osmo-msc_10.42.42.6(pid=28263): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28263)] 23:32:50.944368 run osmo-msc_10.42.42.6(pid=28263): stdout: | (launched: 2022-12-08_23:32:49.759989) 23:32:50.995505 run osmo-msc_10.42.42.6(pid=28263): stderr: | [0;m[38;5;43m20221208233250080 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233250081 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4ef4adbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233250081 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233250081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233250081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233250081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233250083 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233250083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233250083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233250083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:32:51.047187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28256): Terminating (SIGTERM) 23:32:51.088429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28259): Terminating (SIGTERM) 23:32:51.129933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28262): Terminating (SIGTERM) 23:32:51.172045 --- ParallelTerminationStrategy: PID 28256 died... 23:32:51.191936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28256): Terminated: ok {rc=0} 23:32:51.238068 --- ParallelTerminationStrategy: PID 28259 died... 23:32:51.257384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28259): Terminated: ok {rc=0} 23:32:51.303588 --- ParallelTerminationStrategy: PID 28262 died... 23:32:51.323121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28262): Terminated: ok {rc=0} 23:32:51.410338 bus /sierra_3: Setting Powered False 23:32:52.509137 bus /sierra_3: Setting Powered False 23:32:53.624573 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 23:32:54.877611 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:32:54.883019 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 23:32:54.916459 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 23:32:54.943320 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 23:32:54.994663 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 23:32:55.027941 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 23:32:55.054625 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 23:32:55.604807 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 23:32:55.656336 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:55.667616 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 23:32:55.718772 tst mo_mt_call.py: using LAC 17517 23:32:55.844934 tst mo_mt_call.py: using RAC 177 23:32:55.971806 tst mo_mt_call.py: using CellId 17517 23:32:56.093158 tst mo_mt_call.py: using BVCI 17518 23:32:56.211266 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:56.222798 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:56.234064 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:56.245380 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:56.256386 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:56.267586 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 23:32:56.382227 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 23:32:56.501196 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:32:56.998488 run create_hlr_db(pid=28268): Launched 23:32:57.127682 bus /sierra_2: Setting Powered False 23:32:58.192274 run create_hlr_db(pid=28268): Terminated: ok {rc=0} 23:32:58.639272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28271): Launched 23:32:58.959570 run osmo-hlr_10.42.42.2(pid=28272): Launched 23:32:59.081922 run osmo-stp_10.42.42.5: Starting osmo-stp 23:32:59.637572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28274): Launched 23:32:59.957206 run osmo-stp_10.42.42.5(pid=28275): Launched 23:33:00.079577 run osmo-msc_10.42.42.6: Starting osmo-msc 23:33:00.661310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28277): Launched 23:33:01.019611 run osmo-msc_10.42.42.6(pid=28278): Launched 23:33:01.555066 run osmo-stp_10.42.42.5(pid=28275): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28275)] 23:33:01.760493 run osmo-stp_10.42.42.5(pid=28275): stdout: | (launched: 2022-12-08_23:32:59.899194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:01.892768 run osmo-stp_10.42.42.5(pid=28275): stderr: | [0;m[38;5;43m20221208233300092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233300092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233300093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233300093 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233300093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233300094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233300094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:02.023522 run osmo-stp_10.42.42.5(pid=28275): stdout: | (launched: 2022-12-08_23:32:59.899194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:02.146886 run osmo-stp_10.42.42.5(pid=28275): stderr: | [0;m[38;5;43m20221208233300092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233300092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233300093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233300093 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233300093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233300094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233300094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:02.295746 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28275): Process ended prematurely: osmo-stp_10.42.42.5(pid=28275) [trial-2351↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28275)] [trial-2351↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 23:33:02.304780 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 23:33:02.331608 run osmo-hlr_10.42.42.2(pid=28272): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28272)] 23:33:02.379114 run osmo-hlr_10.42.42.2(pid=28272): stdout: | (launched: 2022-12-08_23:32:58.901900) 23:33:02.428314 run osmo-hlr_10.42.42.2(pid=28272): stderr: | [0;m[1;31m20221208233259100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233259100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233259100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233259100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233259100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233259100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233259113 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233259121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233259121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233259121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:33:02.496856 run osmo-msc_10.42.42.6(pid=28278): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28278)] 23:33:02.544304 run osmo-msc_10.42.42.6(pid=28278): stdout: | (launched: 2022-12-08_23:33:00.947209) 23:33:02.593706 run osmo-msc_10.42.42.6(pid=28278): stderr: | [0;m[38;5;43m20221208233301437 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233301437 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f60fee50c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233301437 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233301437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233301438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233301438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233301444 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233301445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233301445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233301445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:33:02.643188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28271): Terminating (SIGTERM) 23:33:02.682678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28274): Terminating (SIGTERM) 23:33:02.722414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28277): Terminating (SIGTERM) 23:33:02.762626 --- ParallelTerminationStrategy: PID 28271 died... 23:33:02.780930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28271): Terminated: ok {rc=0} 23:33:02.825356 --- ParallelTerminationStrategy: PID 28274 died... 23:33:02.843844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28274): Terminated: ok {rc=0} 23:33:02.888057 --- ParallelTerminationStrategy: PID 28277 died... 23:33:02.906659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28277): Terminated: ok {rc=0} 23:33:02.992274 bus /sierra_3: Setting Powered False 23:33:04.092096 bus /sierra_3: Setting Powered False 23:33:05.207699 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 23:33:06.355856 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:33:06.367610 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 23:33:06.419204 tst mo_mt_call_osmux.py: using LAC 17518 23:33:06.540706 tst mo_mt_call_osmux.py: using RAC 178 23:33:06.659301 tst mo_mt_call_osmux.py: using CellId 17518 23:33:06.779380 tst mo_mt_call_osmux.py: using BVCI 17519 23:33:06.890353 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:33:06.901395 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:33:06.911956 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:33:06.922806 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:33:06.933703 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:33:06.944449 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 23:33:07.062912 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 23:33:07.177632 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:33:07.647277 run create_hlr_db(pid=28281): Launched 23:33:07.762169 bus /sierra_2: Setting Powered False 23:33:08.821838 run create_hlr_db(pid=28281): Terminated: ok {rc=0} 23:33:09.261476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28283): Launched 23:33:09.582150 run osmo-hlr_10.42.42.2(pid=28284): Launched 23:33:09.704634 run osmo-stp_10.42.42.5: Starting osmo-stp 23:33:10.262025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28286): Launched 23:33:10.583527 run osmo-stp_10.42.42.5(pid=28287): Launched 23:33:10.705624 run osmo-msc_10.42.42.6: Starting osmo-msc 23:33:11.285760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28289): Launched 23:33:11.593231 run osmo-msc_10.42.42.6(pid=28290): Launched 23:33:11.763616 run osmo-stp_10.42.42.5(pid=28287): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28287)] 23:33:11.893492 run osmo-stp_10.42.42.5(pid=28287): stdout: | (launched: 2022-12-08_23:33:10.525614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:12.022735 run osmo-stp_10.42.42.5(pid=28287): stderr: | [0;m[38;5;43m20221208233310718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233310718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233310718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233310719 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233310719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233310719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233310719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:12.148728 run osmo-stp_10.42.42.5(pid=28287): stdout: | (launched: 2022-12-08_23:33:10.525614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:12.268659 run osmo-stp_10.42.42.5(pid=28287): stderr: | [0;m[38;5;43m20221208233310718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233310718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233310718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233310719 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233310719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233310719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233310719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:12.412674 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28287): Process ended prematurely: osmo-stp_10.42.42.5(pid=28287) [trial-2351↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28287)] [trial-2351↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 23:33:12.421774 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:33:12.448052 run osmo-hlr_10.42.42.2(pid=28284): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28284)] 23:33:12.495653 run osmo-hlr_10.42.42.2(pid=28284): stdout: | (launched: 2022-12-08_23:33:09.524118) 23:33:12.544629 run osmo-hlr_10.42.42.2(pid=28284): stderr: | [0;m[1;31m20221208233309721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233309721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233309721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233309721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233309721 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233309722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233309734 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233309742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233309742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233309742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:33:12.612985 run osmo-msc_10.42.42.6(pid=28290): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28290)] 23:33:12.660288 run osmo-msc_10.42.42.6(pid=28290): stdout: | (launched: 2022-12-08_23:33:11.538656) 23:33:12.709271 run osmo-msc_10.42.42.6(pid=28290): stderr: | [0;m[38;5;43m20221208233311807 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233311808 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f84dd280c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233311808 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233311808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233311808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233311808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233311812 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233311813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233311813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233311813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:33:12.758738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28283): Terminating (SIGTERM) 23:33:12.798009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28286): Terminating (SIGTERM) 23:33:12.837706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28289): Terminating (SIGTERM) 23:33:12.877939 --- ParallelTerminationStrategy: PID 28283 died... 23:33:12.896534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28283): Terminated: ok {rc=0} 23:33:12.940340 --- ParallelTerminationStrategy: PID 28286 died... 23:33:12.958993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28286): Terminated: ok {rc=0} 23:33:13.002794 --- ParallelTerminationStrategy: PID 28289 died... 23:33:13.021236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28289): Terminated: ok {rc=0} 23:33:13.104344 bus /sierra_3: Setting Powered False 23:33:14.199088 bus /sierra_3: Setting Powered False 23:33:15.312677 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 23:33:16.568213 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:33:16.575024 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 23:33:16.612009 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 23:33:16.639279 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 23:33:16.692825 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 23:33:16.740728 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 23:33:16.775717 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 23:33:17.314825 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 23:33:17.365631 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:17.376852 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:33:17.432390 tst mo_mt_call.py: using LAC 17519 23:33:17.551445 tst mo_mt_call.py: using RAC 179 23:33:17.669076 tst mo_mt_call.py: using CellId 17519 23:33:17.786623 tst mo_mt_call.py: using BVCI 17520 23:33:17.896106 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:17.907171 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:17.918086 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:17.929487 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:17.940531 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:17.951683 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:33:18.069818 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:33:18.185390 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:33:18.653255 run create_hlr_db(pid=28295): Launched 23:33:18.770127 bus /sierra_2: Setting Powered False 23:33:19.830947 run create_hlr_db(pid=28295): Terminated: ok {rc=0} 23:33:20.251187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28297): Launched 23:33:20.553302 run osmo-hlr_10.42.42.2(pid=28298): Launched 23:33:20.669096 run osmo-stp_10.42.42.5: Starting osmo-stp 23:33:21.190755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28300): Launched 23:33:21.492698 run osmo-stp_10.42.42.5(pid=28301): Launched 23:33:21.607752 run osmo-msc_10.42.42.6: Starting osmo-msc 23:33:22.154647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28303): Launched 23:33:22.457431 run osmo-msc_10.42.42.6(pid=28304): Launched 23:33:22.625696 run osmo-stp_10.42.42.5(pid=28301): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28301)] 23:33:22.754959 run osmo-stp_10.42.42.5(pid=28301): stdout: | (launched: 2022-12-08_23:33:21.437709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:22.883410 run osmo-stp_10.42.42.5(pid=28301): stderr: | [0;m[38;5;43m20221208233321607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233321607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233321607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233321607 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233321610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233321610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233321610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:23.009160 run osmo-stp_10.42.42.5(pid=28301): stdout: | (launched: 2022-12-08_23:33:21.437709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:23.128594 run osmo-stp_10.42.42.5(pid=28301): stderr: | [0;m[38;5;43m20221208233321607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233321607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233321607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233321607 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233321610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233321610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233321610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:23.271980 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28301): Process ended prematurely: osmo-stp_10.42.42.5(pid=28301) [trial-2351↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28301)] [trial-2351↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 23:33:23.280918 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:33:23.307415 run osmo-hlr_10.42.42.2(pid=28298): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28298)] 23:33:23.355454 run osmo-hlr_10.42.42.2(pid=28298): stdout: | (launched: 2022-12-08_23:33:20.498823) 23:33:23.404928 run osmo-hlr_10.42.42.2(pid=28298): stderr: | [0;m[1;31m20221208233320672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233320672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233320672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233320672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233320672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233320672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233320684 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233320693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233320693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233320693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:33:23.473793 run osmo-msc_10.42.42.6(pid=28304): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28304)] 23:33:23.521275 run osmo-msc_10.42.42.6(pid=28304): stdout: | (launched: 2022-12-08_23:33:22.402253) 23:33:23.570501 run osmo-msc_10.42.42.6(pid=28304): stderr: | [0;m[38;5;43m20221208233322674 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233322674 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3dee13ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233322674 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233322674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233322674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233322674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233322676 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233322677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233322677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233322677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:33:23.620196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28297): Terminating (SIGTERM) 23:33:23.659825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28300): Terminating (SIGTERM) 23:33:23.699518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28303): Terminating (SIGTERM) 23:33:23.739471 --- ParallelTerminationStrategy: PID 28297 died... 23:33:23.758400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28297): Terminated: ok {rc=0} 23:33:23.802683 --- ParallelTerminationStrategy: PID 28300 died... 23:33:23.821247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28300): Terminated: ok {rc=0} 23:33:23.865219 --- ParallelTerminationStrategy: PID 28303 died... 23:33:23.883697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28303): Terminated: ok {rc=0} 23:33:23.969184 bus /sierra_3: Setting Powered False 23:33:25.067361 bus /sierra_3: Setting Powered False 23:33:26.183506 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 23:33:27.329246 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:27.340860 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:33:27.393967 tst mo_mt_call_osmux.py: using LAC 17520 23:33:27.514291 tst mo_mt_call_osmux.py: using RAC 180 23:33:27.634013 tst mo_mt_call_osmux.py: using CellId 17520 23:33:27.754431 tst mo_mt_call_osmux.py: using BVCI 17521 23:33:27.866182 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:27.877445 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:27.888529 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:27.900285 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:27.912018 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:27.923661 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:33:28.042091 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:33:28.167818 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:33:28.666066 run create_hlr_db(pid=28306): Launched 23:33:28.796514 bus /sierra_2: Setting Powered False 23:33:29.860092 run create_hlr_db(pid=28306): Terminated: ok {rc=0} 23:33:30.305942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28308): Launched 23:33:30.626780 run osmo-hlr_10.42.42.2(pid=28309): Launched 23:33:30.748395 run osmo-stp_10.42.42.5: Starting osmo-stp 23:33:31.359084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28311): Launched 23:33:31.690917 run osmo-stp_10.42.42.5(pid=28312): Launched 23:33:32.016851 run osmo-msc_10.42.42.6: Starting osmo-msc 23:33:32.629338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28314): Launched 23:33:32.948025 run osmo-msc_10.42.42.6(pid=28315): Launched 23:33:33.125553 run osmo-stp_10.42.42.5(pid=28312): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28312)] 23:33:33.260037 run osmo-stp_10.42.42.5(pid=28312): stdout: | (launched: 2022-12-08_23:33:31.628068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:33.395435 run osmo-stp_10.42.42.5(pid=28312): stderr: | [0;m[38;5;43m20221208233331833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233331833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233331833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233331834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233331834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233331834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233331834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:33.529762 run osmo-stp_10.42.42.5(pid=28312): stdout: | (launched: 2022-12-08_23:33:31.628068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:33.656561 run osmo-stp_10.42.42.5(pid=28312): stderr: | [0;m[38;5;43m20221208233331833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233331833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233331833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233331834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233331834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233331834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233331834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:33.808756 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28312): Process ended prematurely: osmo-stp_10.42.42.5(pid=28312) [trial-2351↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28312)] [trial-2351↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 23:33:33.818525 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 23:33:33.845879 run osmo-hlr_10.42.42.2(pid=28309): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28309)] 23:33:33.895141 run osmo-hlr_10.42.42.2(pid=28309): stdout: | (launched: 2022-12-08_23:33:30.569102) 23:33:33.946075 run osmo-hlr_10.42.42.2(pid=28309): stderr: | [0;m[1;31m20221208233330767 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233330767 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233330767 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233330767 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233330767 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233330767 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233330779 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233330787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233330788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233330788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:33:34.017375 run osmo-msc_10.42.42.6(pid=28315): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28315)] 23:33:34.066327 run osmo-msc_10.42.42.6(pid=28315): stdout: | (launched: 2022-12-08_23:33:32.890389) 23:33:34.117110 run osmo-msc_10.42.42.6(pid=28315): stderr: | [0;m[38;5;43m20221208233333213 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233333214 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe60fe07c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233333214 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233333214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233333214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233333214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233333216 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233333216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233333216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233333216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:33:34.168447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28308): Terminating (SIGTERM) 23:33:34.209335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28311): Terminating (SIGTERM) 23:33:34.250448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28314): Terminating (SIGTERM) 23:33:34.291799 --- ParallelTerminationStrategy: PID 28308 died... 23:33:34.311430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28308): Terminated: ok {rc=0} 23:33:34.356783 --- ParallelTerminationStrategy: PID 28311 died... 23:33:34.376001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28311): Terminated: ok {rc=0} 23:33:34.421963 --- ParallelTerminationStrategy: PID 28314 died... 23:33:34.441150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28314): Terminated: ok {rc=0} 23:33:34.528168 bus /sierra_3: Setting Powered False 23:33:35.626043 bus /sierra_3: Setting Powered False 23:33:36.740177 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 emergency:trx-b200 --------------------------------------------------------------------- 23:33:37.992253 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:33:37.996876 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 23:33:38.030549 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 23:33:38.057560 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 23:33:38.142274 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 23:33:38.176379 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 23:33:38.203423 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 23:33:38.787013 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2351 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 23:33:38.792127 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:38.803075 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 23:33:38.852645 tst emergency_mo_mt_call.py: using LAC 17521 23:33:38.980257 tst emergency_mo_mt_call.py: using RAC 181 23:33:39.103638 tst emergency_mo_mt_call.py: using CellId 17521 23:33:39.225947 tst emergency_mo_mt_call.py: using BVCI 17522 23:33:39.339683 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:39.350764 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:39.361595 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:39.372293 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:39.383089 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:39.393916 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 23:33:39.506618 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 23:33:39.624659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:33:40.083568 run create_hlr_db(pid=28321): Launched 23:33:40.197335 bus /sierra_2: Setting Powered False 23:33:41.255672 run create_hlr_db(pid=28321): Terminated: ok {rc=0} 23:33:41.687736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28323): Launched 23:33:42.002859 run osmo-hlr_10.42.42.2(pid=28324): Launched 23:33:42.122924 run osmo-stp_10.42.42.5: Starting osmo-stp 23:33:42.673009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28326): Launched 23:33:42.987646 run osmo-stp_10.42.42.5(pid=28327): Launched 23:33:43.116926 tst emergency_mo_mt_call.py: using MSISDN 6911 23:33:43.279015 run osmo-msc_10.42.42.6: Starting osmo-msc 23:33:43.846523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28329): Launched 23:33:44.160886 run osmo-msc_10.42.42.6(pid=28330): Launched 23:33:44.337710 run osmo-stp_10.42.42.5(pid=28327): ERR: Terminated: ERROR {rc=1} [trial-2351↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28327)] 23:33:44.471667 run osmo-stp_10.42.42.5(pid=28327): stdout: | (launched: 2022-12-08_23:33:42.930919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:44.605914 run osmo-stp_10.42.42.5(pid=28327): stderr: | [0;m[38;5;43m20221208233343120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233343120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233343121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233343121 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233343123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233343124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233343124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:44.737541 run osmo-stp_10.42.42.5(pid=28327): stdout: | (launched: 2022-12-08_23:33:42.930919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:44.863216 run osmo-stp_10.42.42.5(pid=28327): stderr: | [0;m[38;5;43m20221208233343120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233343120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233343121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233343121 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233343123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233343124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233343124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:45.013283 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=28327): Process ended prematurely: osmo-stp_10.42.42.5(pid=28327) [trial-2351↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28327)] [trial-2351↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 23:33:45.022358 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 23:33:45.049385 run osmo-hlr_10.42.42.2(pid=28324): ERR: Terminated: ERROR {rc=237} [trial-2351↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28324)] 23:33:45.098746 run osmo-hlr_10.42.42.2(pid=28324): stdout: | (launched: 2022-12-08_23:33:41.945974) 23:33:45.149888 run osmo-hlr_10.42.42.2(pid=28324): stderr: | [0;m[1;31m20221208233342142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233342142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233342142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233342142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233342142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233342142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233342155 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233342163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233342163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233342163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:33:45.221493 run osmo-msc_10.42.42.6(pid=28330): ERR: Terminated: ERROR {rc=2} [trial-2351↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28330)] 23:33:45.270727 run osmo-msc_10.42.42.6(pid=28330): stdout: | (launched: 2022-12-08_23:33:44.103974) 23:33:45.321766 run osmo-msc_10.42.42.6(pid=28330): stderr: | [0;m[38;5;43m20221208233344426 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233344426 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4aabb2fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233344426 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233344426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233344427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233344427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233344429 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233344429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233344429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233344429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:33:45.373056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28323): Terminating (SIGTERM) 23:33:45.414123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28326): Terminating (SIGTERM) 23:33:45.455519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28329): Terminating (SIGTERM) 23:33:45.497109 --- ParallelTerminationStrategy: PID 28323 died... 23:33:45.516748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28323): Terminated: ok {rc=0} 23:33:45.562345 --- ParallelTerminationStrategy: PID 28326 died... 23:33:45.581568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28326): Terminated: ok {rc=0} 23:33:45.627577 --- ParallelTerminationStrategy: PID 28329 died... 23:33:45.646916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28329): Terminated: ok {rc=0} 23:33:45.733827 bus /sierra_3: Setting Powered False 23:33:46.831733 bus /sierra_3: Setting Powered False 23:33:47.950483 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 23:33:49.038565 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:49.051445 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 23:33:49.104405 tst emergency_preemptive_call.py: using LAC 17522 23:33:49.230271 tst emergency_preemptive_call.py: using RAC 182 23:33:49.353372 tst emergency_preemptive_call.py: using CellId 17522 23:33:49.476631 tst emergency_preemptive_call.py: using BVCI 17523 23:33:49.590369 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:49.601488 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:49.612256 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:49.623472 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:49.634375 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:49.645202 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 23:33:49.765284 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 23:33:49.879831 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 23:33:49.997766 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 23:33:50.114154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:33:50.573603 run create_hlr_db(pid=28332): Launched 23:33:50.687890 bus /sierra_2: Setting Powered False 23:33:51.746777 run create_hlr_db(pid=28332): Terminated: ok {rc=0} 23:33:52.160496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28334): Launched 23:33:52.456708 run osmo-hlr_10.42.42.2(pid=28335): Launched 23:33:52.570147 run osmo-stp_10.42.42.5: Starting osmo-stp 23:33:53.083108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28337): Launched 23:33:53.378407 run osmo-stp_10.42.42.5(pid=28338): Launched 23:33:53.504209 tst emergency_preemptive_call.py: using MSISDN 6912 23:33:53.656899 run osmo-msc_10.42.42.6: Starting osmo-msc 23:33:54.185615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28340): Launched 23:33:54.480723 run osmo-msc_10.42.42.6(pid=28341): Launched 23:33:54.647020 run osmo-stp_10.42.42.5(pid=28338): ERR: Terminated: ERROR {rc=1} [trial-2351↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28338)] 23:33:54.772908 run osmo-stp_10.42.42.5(pid=28338): stdout: | (launched: 2022-12-08_23:33:53.324463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:54.899441 run osmo-stp_10.42.42.5(pid=28338): stderr: | [0;m[38;5;43m20221208233353492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233353492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233353493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233353493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233353495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233353495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233353495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:55.023554 run osmo-stp_10.42.42.5(pid=28338): stdout: | (launched: 2022-12-08_23:33:53.324463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:55.141507 run osmo-stp_10.42.42.5(pid=28338): stderr: | [0;m[38;5;43m20221208233353492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233353492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233353493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233353493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233353495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233353495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233353495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:55.282539 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=28338): Process ended prematurely: osmo-stp_10.42.42.5(pid=28338) [trial-2351↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28338)] [trial-2351↪emergency:trx-b200↪emergency_preemptive_call.py:32] 23:33:55.290995 tst emergency_preemptive_call.py:32: Test FAILED (6.2 sec) 23:33:55.317589 run osmo-hlr_10.42.42.2(pid=28335): ERR: Terminated: ERROR {rc=237} [trial-2351↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28335)] 23:33:55.365559 run osmo-hlr_10.42.42.2(pid=28335): stdout: | (launched: 2022-12-08_23:33:52.402669) 23:33:55.414822 run osmo-hlr_10.42.42.2(pid=28335): stderr: | [0;m[1;31m20221208233352577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233352577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233352577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233352577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233352577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233352577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233352589 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233352599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233352599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233352599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:33:55.483748 run osmo-msc_10.42.42.6(pid=28341): ERR: Terminated: ERROR {rc=2} [trial-2351↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28341)] 23:33:55.531189 run osmo-msc_10.42.42.6(pid=28341): stdout: | (launched: 2022-12-08_23:33:54.427225) 23:33:55.580513 run osmo-msc_10.42.42.6(pid=28341): stderr: | [0;m[38;5;43m20221208233354698 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233354698 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fee65134c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233354698 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233354698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233354699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233354699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233354701 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233354702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233354702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233354702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:33:55.630085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28334): Terminating (SIGTERM) 23:33:55.669702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28337): Terminating (SIGTERM) 23:33:55.709317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28340): Terminating (SIGTERM) 23:33:55.749815 --- ParallelTerminationStrategy: PID 28334 died... 23:33:55.768546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28334): Terminated: ok {rc=0} 23:33:55.812935 --- ParallelTerminationStrategy: PID 28337 died... 23:33:55.831785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28337): Terminated: ok {rc=0} 23:33:55.876125 --- ParallelTerminationStrategy: PID 28340 died... 23:33:55.894537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28340): Terminated: ok {rc=0} 23:33:55.979954 bus /sierra_9: Setting Powered False 23:33:57.079077 bus /sierra_9: Setting Powered False 23:33:58.193438 bus /sierra_8: Setting Powered False 23:33:59.291160 bus /sierra_8: Setting Powered False 23:34:00.403754 bus /sierra_3: Setting Powered False 23:34:01.500287 bus /sierra_3: Setting Powered False 23:34:02.617983 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-b200 --------------------------------------------------------------------- 23:34:03.902629 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:34:03.907385 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 23:34:03.941006 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 23:34:03.979738 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 23:34:04.067035 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 23:34:04.100289 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 23:34:04.139517 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 23:34:04.729601 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 23:34:04.781958 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:04.792839 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 23:34:04.841833 tst cs_paging_gprs_active.py: using LAC 17523 23:34:04.969392 tst cs_paging_gprs_active.py: using RAC 183 23:34:05.095547 tst cs_paging_gprs_active.py: using CellId 17523 23:34:05.221132 tst cs_paging_gprs_active.py: using BVCI 17524 23:34:05.332819 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:05.343533 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:05.354456 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:05.365302 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:05.376013 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:05.387102 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:05.397618 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:05.408091 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:05.421745 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:05.537130 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:05.656619 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:34:05.874929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:06.197511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28346): Launched 23:34:06.476670 run iperf3-srv_10.42.42.10(pid=28347): Launched 23:34:06.597277 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:34:06.815151 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:07.137218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28348): Launched 23:34:07.417344 run iperf3-srv_10.42.42.10(pid=28349): Launched 23:34:07.537947 tst cs_paging_gprs_active.py:38: start network... 23:34:07.754750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:34:08.252663 run create_hlr_db(pid=28350): Launched 23:34:08.383006 bus /sierra_2: Setting Powered False 23:34:09.445999 run create_hlr_db(pid=28350): Terminated: ok {rc=0} 23:34:09.874458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28352): Launched 23:34:10.175576 run osmo-hlr_10.42.42.2(pid=28353): Launched 23:34:10.291118 run osmo-stp_10.42.42.5: Starting osmo-stp 23:34:10.823825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28355): Launched 23:34:11.124524 run osmo-stp_10.42.42.5(pid=28356): Launched 23:34:11.239819 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:34:11.760059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28358): Launched 23:34:11.876835 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:34:12.137042 run patchelf(pid=28359): Launched 23:34:12.305973 run osmo-stp_10.42.42.5(pid=28356): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28356)] 23:34:12.434253 run osmo-stp_10.42.42.5(pid=28356): stdout: | (launched: 2022-12-08_23:34:11.069523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:12.563948 run osmo-stp_10.42.42.5(pid=28356): stderr: | [0;m[38;5;43m20221208233411241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233411241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233411241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233411242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233411242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233411242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233411242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:12.693640 run osmo-stp_10.42.42.5(pid=28356): stdout: | (launched: 2022-12-08_23:34:11.069523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:12.818511 run osmo-stp_10.42.42.5(pid=28356): stderr: | [0;m[38;5;43m20221208233411241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233411241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233411241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233411242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233411242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233411242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233411242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:12.965607 run patchelf(pid=28359): Terminating (SIGINT) 23:34:13.134968 run patchelf(pid=28359): Terminated: ok {rc=0} 23:34:13.257392 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28356): Process ended prematurely: osmo-stp_10.42.42.5(pid=28356) [trial-2351↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28356)] [trial-2351↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 23:34:13.266995 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 23:34:13.294492 run osmo-hlr_10.42.42.2(pid=28353): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28353)] 23:34:13.341973 run osmo-hlr_10.42.42.2(pid=28353): stdout: | (launched: 2022-12-08_23:34:10.120919) 23:34:13.391065 run osmo-hlr_10.42.42.2(pid=28353): stderr: | [0;m[1;31m20221208233410297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233410297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233410297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233410297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233410297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233410297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233410310 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233410319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233410319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233410319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:34:13.440764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28346): Terminating (SIGTERM) 23:34:13.480384 run iperf3-srv_10.42.42.10(pid=28347): Terminating (SIGTERM) 23:34:13.519998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28348): Terminating (SIGTERM) 23:34:13.559560 run iperf3-srv_10.42.42.10(pid=28349): Terminating (SIGTERM) 23:34:13.598923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28352): Terminating (SIGTERM) 23:34:13.638580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28355): Terminating (SIGTERM) 23:34:13.678123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28358): Terminating (SIGTERM) 23:34:13.717745 --- ParallelTerminationStrategy: PID 28346 died... 23:34:13.736474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28346): Terminated: ok {rc=0} 23:34:13.780598 --- ParallelTerminationStrategy: PID 28347 died... 23:34:13.798999 run iperf3-srv_10.42.42.10(pid=28347): Terminated {rc=256} 23:34:13.842662 --- ParallelTerminationStrategy: PID 28348 died... 23:34:13.861020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28348): Terminated: ok {rc=0} 23:34:13.904745 --- ParallelTerminationStrategy: PID 28349 died... 23:34:13.923201 run iperf3-srv_10.42.42.10(pid=28349): Terminated {rc=256} 23:34:13.966872 --- ParallelTerminationStrategy: PID 28352 died... 23:34:13.985278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28352): Terminated: ok {rc=0} 23:34:14.029531 --- ParallelTerminationStrategy: PID 28355 died... 23:34:14.047819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28355): Terminated: ok {rc=0} 23:34:14.091888 --- ParallelTerminationStrategy: PID 28358 died... 23:34:14.110279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28358): Terminated: ok {rc=0} 23:34:14.193129 bus /gobi_0: Setting Powered False 23:34:15.290165 bus /gobi_0: Setting Powered False 23:34:16.402424 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-b200 iperf3.py ---------------------------------------------- 23:34:17.548925 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:17.560075 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 23:34:17.610950 tst iperf3.py: using LAC 17524 23:34:17.729473 tst iperf3.py: using RAC 184 23:34:17.848075 tst iperf3.py: using CellId 17524 23:34:17.966990 tst iperf3.py: using BVCI 17525 23:34:18.078304 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:18.088807 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:18.099157 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:18.109878 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:18.120379 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:18.130829 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:18.141671 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:18.152205 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:18.163239 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:18.280557 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:34:18.497856 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:18.820136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28360): Launched 23:34:19.100121 run iperf3-srv_10.42.42.10(pid=28361): Launched 23:34:19.220909 tst iperf3.py:8: start network... 23:34:19.438186 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:34:19.933448 run create_hlr_db(pid=28362): Launched 23:34:20.064038 bus /gobi_6: Setting Powered False 23:34:21.128111 run create_hlr_db(pid=28362): Terminated: ok {rc=0} 23:34:21.574593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28364): Launched 23:34:21.895224 run osmo-hlr_10.42.42.2(pid=28365): Launched 23:34:22.017364 run osmo-stp_10.42.42.5: Starting osmo-stp 23:34:22.570714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28367): Launched 23:34:22.893671 run osmo-stp_10.42.42.5(pid=28368): Launched 23:34:23.017127 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:34:23.571837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28370): Launched 23:34:23.695569 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:34:23.966391 run patchelf(pid=28371): Launched 23:34:24.145529 run osmo-stp_10.42.42.5(pid=28368): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28368)] 23:34:24.282343 run osmo-stp_10.42.42.5(pid=28368): stdout: | (launched: 2022-12-08_23:34:22.835200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:24.421291 run osmo-stp_10.42.42.5(pid=28368): stderr: | [0;m[38;5;43m20221208233423030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233423030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233423030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233423031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233423031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233423031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233423031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:24.559539 run osmo-stp_10.42.42.5(pid=28368): stdout: | (launched: 2022-12-08_23:34:22.835200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:24.691638 run osmo-stp_10.42.42.5(pid=28368): stderr: | [0;m[38;5;43m20221208233423030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233423030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233423030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233423031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233423031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233423031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233423031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:24.847840 run patchelf(pid=28371): Terminating (SIGINT) 23:34:25.028201 run patchelf(pid=28371): Terminated: ok {rc=0} 23:34:25.157994 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28368): Process ended prematurely: osmo-stp_10.42.42.5(pid=28368) [trial-2351↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28368)] [trial-2351↪gprs:trx-b200↪iperf3.py:8] 23:34:25.168087 tst iperf3.py:8: Test FAILED (7.7 sec) 23:34:25.196710 run osmo-hlr_10.42.42.2(pid=28365): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28365)] 23:34:25.245758 run osmo-hlr_10.42.42.2(pid=28365): stdout: | (launched: 2022-12-08_23:34:21.837272) 23:34:25.296622 run osmo-hlr_10.42.42.2(pid=28365): stderr: | [0;m[1;31m20221208233422036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233422036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233422036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233422036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233422036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233422036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233422048 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233422057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233422057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233422057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:34:25.347750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28360): Terminating (SIGTERM) 23:34:25.389291 run iperf3-srv_10.42.42.10(pid=28361): Terminating (SIGTERM) 23:34:25.430698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28364): Terminating (SIGTERM) 23:34:25.472176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28367): Terminating (SIGTERM) 23:34:25.513642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28370): Terminating (SIGTERM) 23:34:25.555935 --- ParallelTerminationStrategy: PID 28360 died... 23:34:25.575738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28360): Terminated: ok {rc=0} 23:34:25.623149 --- ParallelTerminationStrategy: PID 28361 died... 23:34:25.642489 run iperf3-srv_10.42.42.10(pid=28361): Terminated {rc=256} 23:34:25.687828 --- ParallelTerminationStrategy: PID 28364 died... 23:34:25.706898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28364): Terminated: ok {rc=0} 23:34:25.752375 --- ParallelTerminationStrategy: PID 28367 died... 23:34:25.772090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28367): Terminated: ok {rc=0} 23:34:25.817864 --- ParallelTerminationStrategy: PID 28370 died... 23:34:25.837246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28370): Terminated: ok {rc=0} 23:34:25.923712 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 23:34:27.073866 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:27.085489 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 23:34:27.139666 tst iperf3m4.py: using LAC 17525 23:34:27.265621 tst iperf3m4.py: using RAC 185 23:34:27.389647 tst iperf3m4.py: using CellId 17525 23:34:27.514462 tst iperf3m4.py: using BVCI 17526 23:34:27.630670 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:27.641847 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:27.652733 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:27.663753 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:27.674675 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:27.685545 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:27.696540 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:27.707488 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:27.718490 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:27.836596 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:27.954155 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:28.070511 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:28.185951 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:34:28.387904 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:28.690997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28372): Launched 23:34:28.953791 run iperf3-srv_10.42.42.10(pid=28373): Launched 23:34:29.067199 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:34:29.269080 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:29.572053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28374): Launched 23:34:29.835252 run iperf3-srv_10.42.42.10(pid=28375): Launched 23:34:29.948857 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:34:30.151223 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:30.454687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28376): Launched 23:34:30.717203 run iperf3-srv_10.42.42.10(pid=28377): Launched 23:34:30.833816 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:34:31.054688 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:31.381910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28378): Launched 23:34:31.656551 run iperf3-srv_10.42.42.10(pid=28379): Launched 23:34:31.785404 tst iperf3m4.py:8: start network... 23:34:31.992831 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:34:32.467429 run create_hlr_db(pid=28380): Launched 23:34:32.584089 bus /gobi_6: Setting Powered False 23:34:33.644854 run create_hlr_db(pid=28380): Terminated: ok {rc=0} 23:34:34.083910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28382): Launched 23:34:34.406561 run osmo-hlr_10.42.42.2(pid=28383): Launched 23:34:34.528565 run osmo-stp_10.42.42.5: Starting osmo-stp 23:34:35.084436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28385): Launched 23:34:35.406708 run osmo-stp_10.42.42.5(pid=28386): Launched 23:34:35.528871 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:34:36.084167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28388): Launched 23:34:36.207726 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:34:36.479550 run patchelf(pid=28389): Launched 23:34:36.658442 run osmo-stp_10.42.42.5(pid=28386): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28386)] 23:34:36.795432 run osmo-stp_10.42.42.5(pid=28386): stdout: | (launched: 2022-12-08_23:34:35.348178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:36.934423 run osmo-stp_10.42.42.5(pid=28386): stderr: | [0;m[38;5;43m20221208233435541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233435541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233435541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233435542 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233435542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233435542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233435542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:37.073790 run osmo-stp_10.42.42.5(pid=28386): stdout: | (launched: 2022-12-08_23:34:35.348178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:37.206860 run osmo-stp_10.42.42.5(pid=28386): stderr: | [0;m[38;5;43m20221208233435541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233435541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233435541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233435542 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233435542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233435542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233435542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:37.364197 run patchelf(pid=28389): Terminating (SIGINT) 23:34:37.545279 run patchelf(pid=28389): Terminated: ok {rc=0} 23:34:37.675776 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28386): Process ended prematurely: osmo-stp_10.42.42.5(pid=28386) [trial-2351↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28386)] [trial-2351↪gprs:trx-b200↪iperf3m4.py:8] 23:34:37.686225 tst iperf3m4.py:8: Test FAILED (10.7 sec) 23:34:37.714927 run osmo-hlr_10.42.42.2(pid=28383): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28383)] 23:34:37.764342 run osmo-hlr_10.42.42.2(pid=28383): stdout: | (launched: 2022-12-08_23:34:34.348336) 23:34:37.815335 run osmo-hlr_10.42.42.2(pid=28383): stderr: | [0;m[1;31m20221208233434547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233434547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233434547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233434547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233434547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233434547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233434562 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233434572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233434572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233434572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:34:37.866953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28372): Terminating (SIGTERM) 23:34:37.908590 run iperf3-srv_10.42.42.10(pid=28373): Terminating (SIGTERM) 23:34:37.950193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28374): Terminating (SIGTERM) 23:34:37.991806 run iperf3-srv_10.42.42.10(pid=28375): Terminating (SIGTERM) 23:34:38.033549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28376): Terminating (SIGTERM) 23:34:38.075343 run iperf3-srv_10.42.42.10(pid=28377): Terminating (SIGTERM) 23:34:38.116901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28378): Terminating (SIGTERM) 23:34:38.158745 run iperf3-srv_10.42.42.10(pid=28379): Terminating (SIGTERM) 23:34:38.200569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28382): Terminating (SIGTERM) 23:34:38.242573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28385): Terminating (SIGTERM) 23:34:38.284268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28388): Terminating (SIGTERM) 23:34:38.326327 --- ParallelTerminationStrategy: PID 28372 died... 23:34:38.346118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28372): Terminated: ok {rc=0} 23:34:38.391995 --- ParallelTerminationStrategy: PID 28373 died... 23:34:38.411383 run iperf3-srv_10.42.42.10(pid=28373): Terminated {rc=256} 23:34:38.456937 --- ParallelTerminationStrategy: PID 28374 died... 23:34:38.476282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28374): Terminated: ok {rc=0} 23:34:38.522058 --- ParallelTerminationStrategy: PID 28375 died... 23:34:38.541429 run iperf3-srv_10.42.42.10(pid=28375): Terminated {rc=256} 23:34:38.587187 --- ParallelTerminationStrategy: PID 28376 died... 23:34:38.606616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28376): Terminated: ok {rc=0} 23:34:38.652351 --- ParallelTerminationStrategy: PID 28377 died... 23:34:38.671745 run iperf3-srv_10.42.42.10(pid=28377): Terminated {rc=256} 23:34:38.717273 --- ParallelTerminationStrategy: PID 28378 died... 23:34:38.736581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28378): Terminated: ok {rc=0} 23:34:38.782332 --- ParallelTerminationStrategy: PID 28379 died... 23:34:38.801693 run iperf3-srv_10.42.42.10(pid=28379): Terminated {rc=256} 23:34:38.847307 --- ParallelTerminationStrategy: PID 28382 died... 23:34:38.866684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28382): Terminated: ok {rc=0} 23:34:38.912226 --- ParallelTerminationStrategy: PID 28385 died... 23:34:38.931850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28385): Terminated: ok {rc=0} 23:34:38.977631 --- ParallelTerminationStrategy: PID 28388 died... 23:34:38.997418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28388): Terminated: ok {rc=0} 23:34:39.083933 bus /gobi_4: Setting Powered False 23:34:40.182588 bus /gobi_4: Setting Powered False 23:34:41.300023 bus /gobi_1: Setting Powered False 23:34:42.397701 bus /gobi_1: Setting Powered False 23:34:43.511503 bus /gobi_0: Setting Powered False 23:34:44.608734 bus /gobi_0: Setting Powered False 23:34:45.726646 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-b200 ping.py ---------------------------------------------- 23:34:46.834098 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:46.849634 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 23:34:46.909327 tst ping.py: using LAC 17526 23:34:47.030497 tst ping.py: using RAC 186 23:34:47.149976 tst ping.py: using CellId 17526 23:34:47.269288 tst ping.py: using BVCI 17527 23:34:47.378412 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:47.388844 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:47.399235 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:47.410232 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:47.421206 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:47.432270 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:47.443347 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:47.454460 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:47.567709 tst ping.py:19: start network... 23:34:47.766538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:34:48.223048 run create_hlr_db(pid=28390): Launched 23:34:48.336127 bus /gobi_6: Setting Powered False 23:34:49.395573 run create_hlr_db(pid=28390): Terminated: ok {rc=0} 23:34:49.808869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28392): Launched 23:34:50.105069 run osmo-hlr_10.42.42.2(pid=28393): Launched 23:34:50.218541 run osmo-stp_10.42.42.5: Starting osmo-stp 23:34:50.740291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28395): Launched 23:34:51.037142 run osmo-stp_10.42.42.5(pid=28396): Launched 23:34:51.150672 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:34:51.661246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28398): Launched 23:34:51.783846 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:34:52.050536 run patchelf(pid=28399): Launched 23:34:52.226595 run osmo-stp_10.42.42.5(pid=28396): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28396)] 23:34:52.360863 run osmo-stp_10.42.42.5(pid=28396): stdout: | (launched: 2022-12-08_23:34:50.983110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:52.497106 run osmo-stp_10.42.42.5(pid=28396): stderr: | [0;m[38;5;43m20221208233451151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233451151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233451152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233451152 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233451154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233451154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233451154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:52.633287 run osmo-stp_10.42.42.5(pid=28396): stdout: | (launched: 2022-12-08_23:34:50.983110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:52.763201 run osmo-stp_10.42.42.5(pid=28396): stderr: | [0;m[38;5;43m20221208233451151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233451151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233451152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233451152 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233451154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233451154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233451154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:52.916610 run patchelf(pid=28399): Terminating (SIGINT) 23:34:53.093759 run patchelf(pid=28399): Terminated: ok {rc=0} 23:34:53.223082 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28396): Process ended prematurely: osmo-stp_10.42.42.5(pid=28396) [trial-2351↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28396)] [trial-2351↪gprs:trx-b200↪ping.py:22] 23:34:53.232666 tst ping.py:22: Test FAILED (6.4 sec) 23:34:53.261354 run osmo-hlr_10.42.42.2(pid=28393): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28393)] 23:34:53.311330 run osmo-hlr_10.42.42.2(pid=28393): stdout: | (launched: 2022-12-08_23:34:50.050864) 23:34:53.363357 run osmo-hlr_10.42.42.2(pid=28393): stderr: | [0;m[1;31m20221208233450226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233450226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233450226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233450226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233450226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233450226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233450237 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233450246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233450246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233450246 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:34:53.415474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28392): Terminating (SIGTERM) 23:34:53.457481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28395): Terminating (SIGTERM) 23:34:53.499551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28398): Terminating (SIGTERM) 23:34:53.541633 --- ParallelTerminationStrategy: PID 28392 died... 23:34:53.561196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28392): Terminated: ok {rc=0} 23:34:53.607577 --- ParallelTerminationStrategy: PID 28395 died... 23:34:53.627255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28395): Terminated: ok {rc=0} 23:34:53.673505 --- ParallelTerminationStrategy: PID 28398 died... 23:34:53.693144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28398): Terminated: ok {rc=0} 23:34:53.780450 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 23:34:54.868344 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:54.880054 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 23:34:54.931857 tst ping_idle_ping.py: using LAC 17527 23:34:55.058320 tst ping_idle_ping.py: using RAC 187 23:34:55.185386 tst ping_idle_ping.py: using CellId 17527 23:34:55.310395 tst ping_idle_ping.py: using BVCI 17528 23:34:55.426782 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:55.438089 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:55.449282 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:55.460567 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:55.471746 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:55.482966 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:55.494374 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:55.505697 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:55.620046 tst ping_idle_ping.py:24: start network... 23:34:55.820294 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:34:56.282589 run create_hlr_db(pid=28400): Launched 23:34:56.395947 bus /gobi_6: Setting Powered False 23:34:57.455180 run create_hlr_db(pid=28400): Terminated: ok {rc=0} 23:34:57.889310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28402): Launched 23:34:58.205103 run osmo-hlr_10.42.42.2(pid=28403): Launched 23:34:58.326005 run osmo-stp_10.42.42.5: Starting osmo-stp 23:34:58.870913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28405): Launched 23:34:59.186824 run osmo-stp_10.42.42.5(pid=28406): Launched 23:34:59.307519 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:34:59.852730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28408): Launched 23:34:59.974166 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:35:00.241266 run patchelf(pid=28409): Launched 23:35:00.417347 run osmo-stp_10.42.42.5(pid=28406): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28406)] 23:35:00.551689 run osmo-stp_10.42.42.5(pid=28406): stdout: | (launched: 2022-12-08_23:34:59.129014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:00.688444 run osmo-stp_10.42.42.5(pid=28406): stderr: | [0;m[38;5;43m20221208233459320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233459320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233459320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233459321 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233459323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233459323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233459323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:00.824649 run osmo-stp_10.42.42.5(pid=28406): stdout: | (launched: 2022-12-08_23:34:59.129014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:00.963839 run osmo-stp_10.42.42.5(pid=28406): stderr: | [0;m[38;5;43m20221208233459320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233459320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233459320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233459321 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233459323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233459323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233459323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:01.114313 run patchelf(pid=28409): Terminating (SIGINT) 23:35:01.304589 run patchelf(pid=28409): Terminated: ok {rc=0} 23:35:01.432565 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28406): Process ended prematurely: osmo-stp_10.42.42.5(pid=28406) [trial-2351↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28406)] [trial-2351↪gprs:trx-b200↪ping_idle_ping.py:27] 23:35:01.442677 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 23:35:01.472788 run osmo-hlr_10.42.42.2(pid=28403): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28403)] 23:35:01.522782 run osmo-hlr_10.42.42.2(pid=28403): stdout: | (launched: 2022-12-08_23:34:58.147879) 23:35:01.574283 run osmo-hlr_10.42.42.2(pid=28403): stderr: | [0;m[1;31m20221208233458346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233458347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233458347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233458347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233458347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233458347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233458359 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233458370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233458370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233458370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:35:01.627226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28402): Terminating (SIGTERM) 23:35:01.670190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28405): Terminating (SIGTERM) 23:35:01.714577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28408): Terminating (SIGTERM) 23:35:01.759019 --- ParallelTerminationStrategy: PID 28402 died... 23:35:01.778771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28402): Terminated: ok {rc=0} 23:35:01.829078 --- ParallelTerminationStrategy: PID 28405 died... 23:35:01.848502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28405): Terminated: ok {rc=0} 23:35:01.896337 --- ParallelTerminationStrategy: PID 28408 died... 23:35:01.915865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28408): Terminated: ok {rc=0} 23:35:02.009067 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 23:35:03.319357 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:35:03.324794 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 23:35:03.359996 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 23:35:03.398269 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 23:35:03.483010 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 23:35:03.515740 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 23:35:03.553987 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 23:35:04.144858 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 23:35:04.198875 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:04.210470 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:35:04.261780 tst cs_paging_gprs_active.py: using LAC 17528 23:35:04.393149 tst cs_paging_gprs_active.py: using RAC 188 23:35:04.518566 tst cs_paging_gprs_active.py: using CellId 17528 23:35:04.643257 tst cs_paging_gprs_active.py: using BVCI 17529 23:35:04.760481 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:04.771673 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:04.782614 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:04.793816 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:04.804863 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:04.815850 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:04.826901 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:04.837917 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:04.849693 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:04.965487 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:05.084425 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:35:05.304451 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:05.627158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28424): Launched 23:35:05.907387 run iperf3-srv_10.42.42.10(pid=28425): Launched 23:35:06.028609 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:35:06.247383 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:06.570810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28426): Launched 23:35:06.850577 run iperf3-srv_10.42.42.10(pid=28427): Launched 23:35:06.970987 tst cs_paging_gprs_active.py:38: start network... 23:35:07.189231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:35:07.691044 run create_hlr_db(pid=28428): Launched 23:35:07.821414 bus /gobi_6: Setting Powered False 23:35:08.884562 run create_hlr_db(pid=28428): Terminated: ok {rc=0} 23:35:09.315254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28430): Launched 23:35:09.618689 run osmo-hlr_10.42.42.2(pid=28431): Launched 23:35:09.734479 run osmo-stp_10.42.42.5: Starting osmo-stp 23:35:10.267265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28433): Launched 23:35:10.570023 run osmo-stp_10.42.42.5(pid=28434): Launched 23:35:10.685485 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:35:11.207201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28436): Launched 23:35:11.324094 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:35:11.579620 run patchelf(pid=28437): Launched 23:35:11.747857 run osmo-stp_10.42.42.5(pid=28434): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28434)] 23:35:11.875734 run osmo-stp_10.42.42.5(pid=28434): stdout: | (launched: 2022-12-08_23:35:10.514837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:12.004743 run osmo-stp_10.42.42.5(pid=28434): stderr: | [0;m[38;5;43m20221208233510684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233510685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233510685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233510685 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233510687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233510688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233510688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:12.134137 run osmo-stp_10.42.42.5(pid=28434): stdout: | (launched: 2022-12-08_23:35:10.514837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:12.259217 run osmo-stp_10.42.42.5(pid=28434): stderr: | [0;m[38;5;43m20221208233510684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233510685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233510685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233510685 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233510687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233510688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233510688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:12.416075 run patchelf(pid=28437): Terminating (SIGINT) 23:35:12.590518 run patchelf(pid=28437): Terminated: ok {rc=0} 23:35:12.717134 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28434): Process ended prematurely: osmo-stp_10.42.42.5(pid=28434) [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28434)] [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 23:35:12.727454 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 23:35:12.757351 run osmo-hlr_10.42.42.2(pid=28431): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28431)] 23:35:12.807663 run osmo-hlr_10.42.42.2(pid=28431): stdout: | (launched: 2022-12-08_23:35:09.563140) 23:35:12.859499 run osmo-hlr_10.42.42.2(pid=28431): stderr: | [0;m[1;31m20221208233509739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233509739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233509739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233509739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233509739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233509739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233509753 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233509762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233509762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233509762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:35:12.911354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28424): Terminating (SIGTERM) 23:35:12.953949 run iperf3-srv_10.42.42.10(pid=28425): Terminating (SIGTERM) 23:35:12.998807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28426): Terminating (SIGTERM) 23:35:13.041637 run iperf3-srv_10.42.42.10(pid=28427): Terminating (SIGTERM) 23:35:13.086534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28430): Terminating (SIGTERM) 23:35:13.129472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28433): Terminating (SIGTERM) 23:35:13.173606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28436): Terminating (SIGTERM) 23:35:13.217382 --- ParallelTerminationStrategy: PID 28424 died... 23:35:13.236808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28424): Terminated: ok {rc=0} 23:35:13.284097 --- ParallelTerminationStrategy: PID 28425 died... 23:35:13.303409 run iperf3-srv_10.42.42.10(pid=28425): Terminated {rc=256} 23:35:13.350342 --- ParallelTerminationStrategy: PID 28426 died... 23:35:13.369626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28426): Terminated: ok {rc=0} 23:35:13.416352 --- ParallelTerminationStrategy: PID 28427 died... 23:35:13.435384 run iperf3-srv_10.42.42.10(pid=28427): Terminated {rc=256} 23:35:13.481924 --- ParallelTerminationStrategy: PID 28430 died... 23:35:13.501295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28430): Terminated: ok {rc=0} 23:35:13.548377 --- ParallelTerminationStrategy: PID 28433 died... 23:35:13.569116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28433): Terminated: ok {rc=0} 23:35:13.617682 --- ParallelTerminationStrategy: PID 28436 died... 23:35:13.637821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28436): Terminated: ok {rc=0} 23:35:13.727494 bus /gobi_0: Setting Powered False 23:35:14.825546 bus /gobi_0: Setting Powered False 23:35:15.967023 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 23:35:17.151544 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:17.162981 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:35:17.216604 tst iperf3.py: using LAC 17529 23:35:17.339526 tst iperf3.py: using RAC 189 23:35:17.459739 tst iperf3.py: using CellId 17529 23:35:17.587842 tst iperf3.py: using BVCI 17530 23:35:17.699548 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:17.710438 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:17.721078 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:17.731710 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:17.742452 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:17.753342 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:17.764155 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:17.774791 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:17.785701 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:17.903517 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:35:18.118286 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:18.422055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28789): Launched 23:35:18.685566 run iperf3-srv_10.42.42.10(pid=28790): Launched 23:35:18.799103 tst iperf3.py:8: start network... 23:35:19.001333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:35:19.468936 run create_hlr_db(pid=28791): Launched 23:35:19.583898 bus /gobi_6: Setting Powered False 23:35:20.644514 run create_hlr_db(pid=28791): Terminated: ok {rc=0} 23:35:21.063897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28793): Launched 23:35:21.366317 run osmo-hlr_10.42.42.2(pid=28794): Launched 23:35:21.481604 run osmo-stp_10.42.42.5: Starting osmo-stp 23:35:22.012871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28796): Launched 23:35:22.314387 run osmo-stp_10.42.42.5(pid=28797): Launched 23:35:22.430363 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:35:22.973718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28816): Launched 23:35:23.109953 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:35:23.401690 run patchelf(pid=28901): Launched 23:35:23.594753 run osmo-stp_10.42.42.5(pid=28797): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28797)] 23:35:23.736415 run osmo-stp_10.42.42.5(pid=28797): stdout: | (launched: 2022-12-08_23:35:22.259213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:23.869126 run osmo-stp_10.42.42.5(pid=28797): stderr: | [0;m[38;5;43m20221208233522431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233522431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233522432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233522432 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233522433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233522433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233522433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:24.004800 run osmo-stp_10.42.42.5(pid=28797): stdout: | (launched: 2022-12-08_23:35:22.259213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:24.131548 run osmo-stp_10.42.42.5(pid=28797): stderr: | [0;m[38;5;43m20221208233522431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233522431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233522432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233522432 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233522433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233522433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233522433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:24.280729 run patchelf(pid=28901): Terminating (SIGINT) 23:35:24.452529 run patchelf(pid=28901): Terminated: ok {rc=0} 23:35:24.576919 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28797): Process ended prematurely: osmo-stp_10.42.42.5(pid=28797) [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28797)] [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 23:35:24.587456 tst iperf3.py:8: Test FAILED (7.5 sec) 23:35:24.617809 run osmo-hlr_10.42.42.2(pid=28794): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28794)] 23:35:24.667571 run osmo-hlr_10.42.42.2(pid=28794): stdout: | (launched: 2022-12-08_23:35:21.310825) 23:35:24.718987 run osmo-hlr_10.42.42.2(pid=28794): stderr: | [0;m[1;31m20221208233521489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233521490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233521490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233521490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233521490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233521490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233521502 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233521512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233521512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233521512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:35:24.771065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28789): Terminating (SIGTERM) 23:35:24.813019 run iperf3-srv_10.42.42.10(pid=28790): Terminating (SIGTERM) 23:35:24.856137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28793): Terminating (SIGTERM) 23:35:24.898705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28796): Terminating (SIGTERM) 23:35:24.941955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28816): Terminating (SIGTERM) 23:35:24.984067 --- ParallelTerminationStrategy: PID 28789 died... 23:35:25.003535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28789): Terminated: ok {rc=0} 23:35:25.050620 --- ParallelTerminationStrategy: PID 28790 died... 23:35:25.070242 run iperf3-srv_10.42.42.10(pid=28790): Terminated {rc=256} 23:35:25.117142 --- ParallelTerminationStrategy: PID 28793 died... 23:35:25.136447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28793): Terminated: ok {rc=0} 23:35:25.183301 --- ParallelTerminationStrategy: PID 28796 died... 23:35:25.202747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28796): Terminated: ok {rc=0} 23:35:25.249556 --- ParallelTerminationStrategy: PID 28816 died... 23:35:25.269053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28816): Terminated: ok {rc=0} 23:35:25.356853 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 23:35:26.507979 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:26.521007 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:35:26.569789 tst iperf3m4.py: using LAC 17530 23:35:26.694029 tst iperf3m4.py: using RAC 190 23:35:26.819433 tst iperf3m4.py: using CellId 17530 23:35:26.944276 tst iperf3m4.py: using BVCI 17531 23:35:27.063442 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:27.075203 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:27.086839 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:27.098627 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:27.110264 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:27.122012 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:27.133967 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:27.146652 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:27.158540 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:27.278274 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:27.402365 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:27.525982 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:27.646483 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:35:27.858792 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:28.190402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28977): Launched 23:35:28.479024 run iperf3-srv_10.42.42.10(pid=28979): Launched 23:35:28.605696 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:35:28.808476 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:29.111522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28980): Launched 23:35:29.374562 run iperf3-srv_10.42.42.10(pid=28981): Launched 23:35:29.488644 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:35:29.691194 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:29.994143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28982): Launched 23:35:30.256209 run iperf3-srv_10.42.42.10(pid=28983): Launched 23:35:30.369821 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:35:30.572092 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:30.890519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28984): Launched 23:35:31.167393 run iperf3-srv_10.42.42.10(pid=28985): Launched 23:35:31.284215 tst iperf3m4.py:8: start network... 23:35:31.492090 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:35:31.983359 run create_hlr_db(pid=28986): Launched 23:35:32.134994 bus /gobi_6: Setting Powered False 23:35:33.195292 run create_hlr_db(pid=28986): Terminated: ok {rc=0} 23:35:33.616512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28988): Launched 23:35:33.920323 run osmo-hlr_10.42.42.2(pid=28989): Launched 23:35:34.036263 run osmo-stp_10.42.42.5: Starting osmo-stp 23:35:34.568687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28991): Launched 23:35:34.870974 run osmo-stp_10.42.42.5(pid=28992): Launched 23:35:34.985897 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:35:35.512560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28994): Launched 23:35:35.636825 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:35:35.909956 run patchelf(pid=28995): Launched 23:35:36.089243 run osmo-stp_10.42.42.5(pid=28992): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28992)] 23:35:36.226647 run osmo-stp_10.42.42.5(pid=28992): stdout: | (launched: 2022-12-08_23:35:34.815938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:36.365606 run osmo-stp_10.42.42.5(pid=28992): stderr: | [0;m[38;5;43m20221208233534984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233534985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233534985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233534985 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233534986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233534986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233534986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:36.504072 run osmo-stp_10.42.42.5(pid=28992): stdout: | (launched: 2022-12-08_23:35:34.815938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:36.636413 run osmo-stp_10.42.42.5(pid=28992): stderr: | [0;m[38;5;43m20221208233534984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233534985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233534985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233534985 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233534986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233534986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233534986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:36.793222 run patchelf(pid=28995): Terminating (SIGINT) 23:35:36.973622 run patchelf(pid=28995): Terminated: ok {rc=0} 23:35:37.103941 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28992): Process ended prematurely: osmo-stp_10.42.42.5(pid=28992) [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28992)] [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 23:35:37.114055 tst iperf3m4.py:8: Test FAILED (10.6 sec) 23:35:37.142814 run osmo-hlr_10.42.42.2(pid=28989): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28989)] 23:35:37.192701 run osmo-hlr_10.42.42.2(pid=28989): stdout: | (launched: 2022-12-08_23:35:33.864755) 23:35:37.244303 run osmo-hlr_10.42.42.2(pid=28989): stderr: | [0;m[1;31m20221208233534042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233534042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233534042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233534042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233534042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233534042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233534055 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233534063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233534063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233534063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:35:37.298814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28977): Terminating (SIGTERM) 23:35:37.340062 run iperf3-srv_10.42.42.10(pid=28979): Terminating (SIGTERM) 23:35:37.381735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28980): Terminating (SIGTERM) 23:35:37.423398 run iperf3-srv_10.42.42.10(pid=28981): Terminating (SIGTERM) 23:35:37.465067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28982): Terminating (SIGTERM) 23:35:37.506846 run iperf3-srv_10.42.42.10(pid=28983): Terminating (SIGTERM) 23:35:37.548213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28984): Terminating (SIGTERM) 23:35:37.589819 run iperf3-srv_10.42.42.10(pid=28985): Terminating (SIGTERM) 23:35:37.631090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28988): Terminating (SIGTERM) 23:35:37.672629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28991): Terminating (SIGTERM) 23:35:37.714241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28994): Terminating (SIGTERM) 23:35:37.755988 --- ParallelTerminationStrategy: PID 28977 died... 23:35:37.775805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28977): Terminated: ok {rc=0} 23:35:37.822177 --- ParallelTerminationStrategy: PID 28979 died... 23:35:37.841576 run iperf3-srv_10.42.42.10(pid=28979): Terminated {rc=256} 23:35:37.887530 --- ParallelTerminationStrategy: PID 28980 died... 23:35:37.906999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28980): Terminated: ok {rc=0} 23:35:37.952677 --- ParallelTerminationStrategy: PID 28981 died... 23:35:37.972122 run iperf3-srv_10.42.42.10(pid=28981): Terminated {rc=256} 23:35:38.017803 --- ParallelTerminationStrategy: PID 28982 died... 23:35:38.037208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28982): Terminated: ok {rc=0} 23:35:38.082935 --- ParallelTerminationStrategy: PID 28983 died... 23:35:38.102343 run iperf3-srv_10.42.42.10(pid=28983): Terminated {rc=256} 23:35:38.147908 --- ParallelTerminationStrategy: PID 28984 died... 23:35:38.167239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28984): Terminated: ok {rc=0} 23:35:38.212833 --- ParallelTerminationStrategy: PID 28985 died... 23:35:38.233051 run iperf3-srv_10.42.42.10(pid=28985): Terminated {rc=256} 23:35:38.278923 --- ParallelTerminationStrategy: PID 28988 died... 23:35:38.298408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28988): Terminated: ok {rc=0} 23:35:38.344066 --- ParallelTerminationStrategy: PID 28991 died... 23:35:38.363577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28991): Terminated: ok {rc=0} 23:35:38.409230 --- ParallelTerminationStrategy: PID 28994 died... 23:35:38.428552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28994): Terminated: ok {rc=0} 23:35:38.515105 bus /gobi_4: Setting Powered False 23:35:39.614128 bus /gobi_4: Setting Powered False 23:35:40.730632 bus /gobi_1: Setting Powered False 23:35:41.829162 bus /gobi_1: Setting Powered False 23:35:42.944733 bus /gobi_0: Setting Powered False 23:35:44.041762 bus /gobi_0: Setting Powered False 23:35:45.156582 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 23:35:46.258549 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:46.271343 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:35:46.322474 tst ping.py: using LAC 17531 23:35:46.444296 tst ping.py: using RAC 191 23:35:46.606289 tst ping.py: using CellId 17531 23:35:46.730733 tst ping.py: using BVCI 17532 23:35:46.843152 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:46.854907 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:46.866514 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:46.878835 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:46.891102 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:46.904615 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:46.917524 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:46.929158 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:47.047831 tst ping.py:19: start network... 23:35:47.253389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:35:47.713841 run create_hlr_db(pid=28996): Launched 23:35:47.843067 bus /gobi_6: Setting Powered False 23:35:48.905645 run create_hlr_db(pid=28996): Terminated: ok {rc=0} 23:35:49.347409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28998): Launched 23:35:49.663688 run osmo-hlr_10.42.42.2(pid=28999): Launched 23:35:49.784919 run osmo-stp_10.42.42.5: Starting osmo-stp 23:35:50.336153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29001): Launched 23:35:50.651668 run osmo-stp_10.42.42.5(pid=29002): Launched 23:35:50.771336 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:35:51.315862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29004): Launched 23:35:51.437612 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:35:51.705206 run patchelf(pid=29005): Launched 23:35:51.881298 run osmo-stp_10.42.42.5(pid=29002): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29002)] 23:35:52.015596 run osmo-stp_10.42.42.5(pid=29002): stdout: | (launched: 2022-12-08_23:35:50.594629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:52.151577 run osmo-stp_10.42.42.5(pid=29002): stderr: | [0;m[38;5;43m20221208233550786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233550786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233550786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233550787 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233550787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233550787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233550787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:52.287977 run osmo-stp_10.42.42.5(pid=29002): stdout: | (launched: 2022-12-08_23:35:50.594629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:52.417827 run osmo-stp_10.42.42.5(pid=29002): stderr: | [0;m[38;5;43m20221208233550786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233550786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233550786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233550787 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233550787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233550787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233550787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:52.571109 run patchelf(pid=29005): Terminating (SIGINT) 23:35:52.747953 run patchelf(pid=29005): Terminated: ok {rc=0} 23:35:52.875637 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29002): Process ended prematurely: osmo-stp_10.42.42.5(pid=29002) [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29002)] [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 23:35:52.885246 tst ping.py:22: Test FAILED (6.6 sec) 23:35:52.913053 run osmo-hlr_10.42.42.2(pid=28999): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28999)] 23:35:52.962300 run osmo-hlr_10.42.42.2(pid=28999): stdout: | (launched: 2022-12-08_23:35:49.606422) 23:35:53.013521 run osmo-hlr_10.42.42.2(pid=28999): stderr: | [0;m[1;31m20221208233549805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233549805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233549805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233549805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233549805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233549805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233549818 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233549827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233549827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233549827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:35:53.064716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28998): Terminating (SIGTERM) 23:35:53.106114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29001): Terminating (SIGTERM) 23:35:53.147184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29004): Terminating (SIGTERM) 23:35:53.189215 --- ParallelTerminationStrategy: PID 28998 died... 23:35:53.209045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28998): Terminated: ok {rc=0} 23:35:53.255223 --- ParallelTerminationStrategy: PID 29001 died... 23:35:53.274411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29001): Terminated: ok {rc=0} 23:35:53.320339 --- ParallelTerminationStrategy: PID 29004 died... 23:35:53.339919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29004): Terminated: ok {rc=0} 23:35:53.427065 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 23:35:54.514782 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:54.526989 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:35:54.579749 tst ping_idle_ping.py: using LAC 17532 23:35:54.705089 tst ping_idle_ping.py: using RAC 192 23:35:54.829714 tst ping_idle_ping.py: using CellId 17532 23:35:54.953021 tst ping_idle_ping.py: using BVCI 17533 23:35:55.067381 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:55.078702 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:55.089722 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:55.100744 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:55.111833 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:55.122860 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:55.134080 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:55.145008 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:55.258461 tst ping_idle_ping.py:24: start network... 23:35:55.458779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:35:55.921775 run create_hlr_db(pid=29006): Launched 23:35:56.035900 bus /gobi_6: Setting Powered False 23:35:57.095070 run create_hlr_db(pid=29006): Terminated: ok {rc=0} 23:35:57.530655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29008): Launched 23:35:57.848405 run osmo-hlr_10.42.42.2(pid=29009): Launched 23:35:57.969290 run osmo-stp_10.42.42.5: Starting osmo-stp 23:35:58.514823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29011): Launched 23:35:58.831377 run osmo-stp_10.42.42.5(pid=29012): Launched 23:35:58.952533 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:35:59.500616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29014): Launched 23:35:59.622648 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:35:59.890479 run patchelf(pid=29015): Launched 23:36:00.066516 run osmo-stp_10.42.42.5(pid=29012): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29012)] 23:36:00.200820 run osmo-stp_10.42.42.5(pid=29012): stdout: | (launched: 2022-12-08_23:35:58.774180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:00.337657 run osmo-stp_10.42.42.5(pid=29012): stderr: | [0;m[38;5;43m20221208233558967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233558967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233558968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233558968 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233558968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233558969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233558969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:00.473740 run osmo-stp_10.42.42.5(pid=29012): stdout: | (launched: 2022-12-08_23:35:58.774180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:00.603475 run osmo-stp_10.42.42.5(pid=29012): stderr: | [0;m[38;5;43m20221208233558967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233558967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233558968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233558968 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233558968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233558969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233558969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:00.757018 run patchelf(pid=29015): Terminating (SIGINT) 23:36:00.953807 run patchelf(pid=29015): Terminated: ok {rc=0} 23:36:01.084196 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29012): Process ended prematurely: osmo-stp_10.42.42.5(pid=29012) [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29012)] [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 23:36:01.094440 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 23:36:01.123168 run osmo-hlr_10.42.42.2(pid=29009): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29009)] 23:36:01.173207 run osmo-hlr_10.42.42.2(pid=29009): stdout: | (launched: 2022-12-08_23:35:57.791248) 23:36:01.225390 run osmo-hlr_10.42.42.2(pid=29009): stderr: | [0;m[1;31m20221208233557987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233557987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233557987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233557987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233557987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233557987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233557999 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233558007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233558007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233558007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:36:01.279015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29008): Terminating (SIGTERM) 23:36:01.321518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29011): Terminating (SIGTERM) 23:36:01.364066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29014): Terminating (SIGTERM) 23:36:01.407699 --- ParallelTerminationStrategy: PID 29008 died... 23:36:01.427962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29008): Terminated: ok {rc=0} 23:36:01.476327 --- ParallelTerminationStrategy: PID 29011 died... 23:36:01.496404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29011): Terminated: ok {rc=0} 23:36:01.543253 --- ParallelTerminationStrategy: PID 29014 died... 23:36:01.563381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29014): Terminated: ok {rc=0} 23:36:01.653419 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 23:36:03.006302 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:36:03.013665 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 23:36:03.049110 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 23:36:03.087306 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 23:36:03.171239 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 23:36:03.203725 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 23:36:03.242681 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 23:36:03.834836 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 23:36:03.885285 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:03.896137 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:36:03.963154 tst cs_paging_gprs_active.py: using LAC 17533 23:36:04.080862 tst cs_paging_gprs_active.py: using RAC 193 23:36:04.198563 tst cs_paging_gprs_active.py: using CellId 17533 23:36:04.318698 tst cs_paging_gprs_active.py: using BVCI 17534 23:36:04.430581 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:04.441560 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:04.452171 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:04.462935 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:04.473824 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:04.484713 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:04.495635 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:04.506537 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:04.517653 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:04.635174 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:04.753972 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:36:04.973225 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:05.297828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29019): Launched 23:36:05.577947 run iperf3-srv_10.42.42.10(pid=29020): Launched 23:36:05.699392 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:36:05.918118 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:06.241813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29021): Launched 23:36:06.521472 run iperf3-srv_10.42.42.10(pid=29022): Launched 23:36:06.642185 tst cs_paging_gprs_active.py:38: start network... 23:36:06.860263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:36:07.359671 run create_hlr_db(pid=29023): Launched 23:36:07.490739 bus /gobi_6: Setting Powered False 23:36:08.554686 run create_hlr_db(pid=29023): Terminated: ok {rc=0} 23:36:08.984671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29025): Launched 23:36:09.287904 run osmo-hlr_10.42.42.2(pid=29026): Launched 23:36:09.404620 run osmo-stp_10.42.42.5: Starting osmo-stp 23:36:09.926784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29028): Launched 23:36:10.229283 run osmo-stp_10.42.42.5(pid=29029): Launched 23:36:10.345502 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:36:10.867593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29031): Launched 23:36:10.984022 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:36:11.240078 run patchelf(pid=29032): Launched 23:36:11.408801 run osmo-stp_10.42.42.5(pid=29029): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29029)] 23:36:11.537716 run osmo-stp_10.42.42.5(pid=29029): stdout: | (launched: 2022-12-08_23:36:10.174274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:11.667357 run osmo-stp_10.42.42.5(pid=29029): stderr: | [0;m[38;5;43m20221208233610343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233610343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233610343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233610344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233610345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233610345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233610345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:11.797116 run osmo-stp_10.42.42.5(pid=29029): stdout: | (launched: 2022-12-08_23:36:10.174274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:11.921688 run osmo-stp_10.42.42.5(pid=29029): stderr: | [0;m[38;5;43m20221208233610343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233610343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233610343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233610344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233610345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233610345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233610345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:12.068490 run patchelf(pid=29032): Terminating (SIGINT) 23:36:12.237997 run patchelf(pid=29032): Terminated: ok {rc=0} 23:36:12.360336 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29029): Process ended prematurely: osmo-stp_10.42.42.5(pid=29029) [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29029)] [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 23:36:12.369888 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 23:36:12.397209 run osmo-hlr_10.42.42.2(pid=29026): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29026)] 23:36:12.444765 run osmo-hlr_10.42.42.2(pid=29026): stdout: | (launched: 2022-12-08_23:36:09.233097) 23:36:12.493731 run osmo-hlr_10.42.42.2(pid=29026): stderr: | [0;m[1;31m20221208233609409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233609409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233609409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233609409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233609409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233609409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233609423 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233609433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233609433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233609433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:36:12.543267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29019): Terminating (SIGTERM) 23:36:12.583087 run iperf3-srv_10.42.42.10(pid=29020): Terminating (SIGTERM) 23:36:12.622610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29021): Terminating (SIGTERM) 23:36:12.662179 run iperf3-srv_10.42.42.10(pid=29022): Terminating (SIGTERM) 23:36:12.701542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29025): Terminating (SIGTERM) 23:36:12.741018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29028): Terminating (SIGTERM) 23:36:12.780499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29031): Terminating (SIGTERM) 23:36:12.820225 --- ParallelTerminationStrategy: PID 29019 died... 23:36:12.839024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29019): Terminated: ok {rc=0} 23:36:12.883980 --- ParallelTerminationStrategy: PID 29020 died... 23:36:12.902301 run iperf3-srv_10.42.42.10(pid=29020): Terminated {rc=256} 23:36:12.945862 --- ParallelTerminationStrategy: PID 29021 died... 23:36:12.964243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29021): Terminated: ok {rc=0} 23:36:13.007983 --- ParallelTerminationStrategy: PID 29022 died... 23:36:13.026693 run iperf3-srv_10.42.42.10(pid=29022): Terminated {rc=256} 23:36:13.070101 --- ParallelTerminationStrategy: PID 29025 died... 23:36:13.088756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29025): Terminated: ok {rc=0} 23:36:13.132852 --- ParallelTerminationStrategy: PID 29028 died... 23:36:13.151489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29028): Terminated: ok {rc=0} 23:36:13.194989 --- ParallelTerminationStrategy: PID 29031 died... 23:36:13.213328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29031): Terminated: ok {rc=0} 23:36:13.296094 bus /gobi_0: Setting Powered False 23:36:14.392693 bus /gobi_0: Setting Powered False 23:36:15.508086 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 23:36:16.656933 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:16.669941 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:36:16.743862 tst iperf3.py: using LAC 17534 23:36:16.873045 tst iperf3.py: using RAC 194 23:36:17.004568 tst iperf3.py: using CellId 17534 23:36:17.132334 tst iperf3.py: using BVCI 17535 23:36:17.255141 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:17.266631 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:17.277900 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:17.289560 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:17.300832 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:17.312133 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:17.323540 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:17.334745 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:17.346214 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:17.459769 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:36:17.662002 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:17.963333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29034): Launched 23:36:18.226451 run iperf3-srv_10.42.42.10(pid=29035): Launched 23:36:18.339277 tst iperf3.py:8: start network... 23:36:18.541215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:36:19.007154 run create_hlr_db(pid=29036): Launched 23:36:19.121950 bus /gobi_6: Setting Powered False 23:36:20.181907 run create_hlr_db(pid=29036): Terminated: ok {rc=0} 23:36:20.600328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29038): Launched 23:36:20.901462 run osmo-hlr_10.42.42.2(pid=29039): Launched 23:36:21.016188 run osmo-stp_10.42.42.5: Starting osmo-stp 23:36:21.548148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29041): Launched 23:36:21.850973 run osmo-stp_10.42.42.5(pid=29042): Launched 23:36:21.969805 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:36:22.506055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29044): Launched 23:36:22.622396 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:36:22.877046 run patchelf(pid=29045): Launched 23:36:23.044740 run osmo-stp_10.42.42.5(pid=29042): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29042)] 23:36:23.173249 run osmo-stp_10.42.42.5(pid=29042): stdout: | (launched: 2022-12-08_23:36:21.795508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:23.303065 run osmo-stp_10.42.42.5(pid=29042): stderr: | [0;m[38;5;43m20221208233622027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233622028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233622028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233622028 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233622029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233622029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233622029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:23.433724 run osmo-stp_10.42.42.5(pid=29042): stdout: | (launched: 2022-12-08_23:36:21.795508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:23.557480 run osmo-stp_10.42.42.5(pid=29042): stderr: | [0;m[38;5;43m20221208233622027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233622028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233622028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233622028 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233622029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233622029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233622029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:23.704463 run patchelf(pid=29045): Terminating (SIGINT) 23:36:23.874308 run patchelf(pid=29045): Terminated: ok {rc=0} 23:36:23.996270 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29042): Process ended prematurely: osmo-stp_10.42.42.5(pid=29042) [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29042)] [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 23:36:24.005792 tst iperf3.py:8: Test FAILED (7.4 sec) 23:36:24.033121 run osmo-hlr_10.42.42.2(pid=29039): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29039)] 23:36:24.080424 run osmo-hlr_10.42.42.2(pid=29039): stdout: | (launched: 2022-12-08_23:36:20.846711) 23:36:24.129409 run osmo-hlr_10.42.42.2(pid=29039): stderr: | [0;m[1;31m20221208233621023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233621023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233621023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233621023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233621023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233621023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233621039 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233621048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233621049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233621049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:36:24.178926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29034): Terminating (SIGTERM) 23:36:24.218454 run iperf3-srv_10.42.42.10(pid=29035): Terminating (SIGTERM) 23:36:24.257787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29038): Terminating (SIGTERM) 23:36:24.297185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29041): Terminating (SIGTERM) 23:36:24.336515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29044): Terminating (SIGTERM) 23:36:24.376103 --- ParallelTerminationStrategy: PID 29034 died... 23:36:24.394696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29034): Terminated: ok {rc=0} 23:36:24.438673 --- ParallelTerminationStrategy: PID 29035 died... 23:36:24.456890 run iperf3-srv_10.42.42.10(pid=29035): Terminated {rc=256} 23:36:24.501212 --- ParallelTerminationStrategy: PID 29038 died... 23:36:24.519386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29038): Terminated: ok {rc=0} 23:36:24.562840 --- ParallelTerminationStrategy: PID 29041 died... 23:36:24.581560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29041): Terminated: ok {rc=0} 23:36:24.625186 --- ParallelTerminationStrategy: PID 29044 died... 23:36:24.643377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29044): Terminated: ok {rc=0} 23:36:24.729944 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 23:36:25.877147 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:25.888477 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:36:25.958441 tst iperf3m4.py: using LAC 17535 23:36:26.078601 tst iperf3m4.py: using RAC 195 23:36:26.196808 tst iperf3m4.py: using CellId 17535 23:36:26.315235 tst iperf3m4.py: using BVCI 17536 23:36:26.424788 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:26.435578 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:26.446205 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:26.456925 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:26.467651 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:26.478402 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:26.489484 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:26.500242 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:26.511090 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:26.625985 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:26.743584 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:26.858588 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:26.977597 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:36:27.187398 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:27.491407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29046): Launched 23:36:27.755658 run iperf3-srv_10.42.42.10(pid=29047): Launched 23:36:27.870809 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:36:28.074566 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:28.378567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29048): Launched 23:36:28.642351 run iperf3-srv_10.42.42.10(pid=29049): Launched 23:36:28.756686 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:36:28.959753 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:29.263485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29050): Launched 23:36:29.527235 run iperf3-srv_10.42.42.10(pid=29051): Launched 23:36:29.640774 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:36:29.843645 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:30.147167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29052): Launched 23:36:30.411064 run iperf3-srv_10.42.42.10(pid=29053): Launched 23:36:30.524429 tst iperf3m4.py:8: start network... 23:36:30.726855 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:36:31.230993 run create_hlr_db(pid=29054): Launched 23:36:31.403560 bus /gobi_6: Setting Powered False 23:36:32.463425 run create_hlr_db(pid=29054): Terminated: ok {rc=0} 23:36:32.908943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29056): Launched 23:36:33.231242 run osmo-hlr_10.42.42.2(pid=29057): Launched 23:36:33.354504 run osmo-stp_10.42.42.5: Starting osmo-stp 23:36:33.914435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29059): Launched 23:36:34.236699 run osmo-stp_10.42.42.5(pid=29060): Launched 23:36:34.360196 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:36:34.915171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29062): Launched 23:36:35.039302 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:36:35.313225 run patchelf(pid=29063): Launched 23:36:35.492262 run osmo-stp_10.42.42.5(pid=29060): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29060)] 23:36:35.629038 run osmo-stp_10.42.42.5(pid=29060): stdout: | (launched: 2022-12-08_23:36:34.178373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:35.767253 run osmo-stp_10.42.42.5(pid=29060): stderr: | [0;m[38;5;43m20221208233634371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233634371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233634371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233634372 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233634372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233634372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233634372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:35.905908 run osmo-stp_10.42.42.5(pid=29060): stdout: | (launched: 2022-12-08_23:36:34.178373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:36.038171 run osmo-stp_10.42.42.5(pid=29060): stderr: | [0;m[38;5;43m20221208233634371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233634371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233634371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233634372 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233634372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233634372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233634372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:36.194938 run patchelf(pid=29063): Terminating (SIGINT) 23:36:36.376182 run patchelf(pid=29063): Terminated: ok {rc=0} 23:36:36.506717 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29060): Process ended prematurely: osmo-stp_10.42.42.5(pid=29060) [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29060)] [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 23:36:36.516774 tst iperf3m4.py:8: Test FAILED (10.7 sec) 23:36:36.545625 run osmo-hlr_10.42.42.2(pid=29057): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29057)] 23:36:36.595788 run osmo-hlr_10.42.42.2(pid=29057): stdout: | (launched: 2022-12-08_23:36:33.173166) 23:36:36.647741 run osmo-hlr_10.42.42.2(pid=29057): stderr: | [0;m[1;31m20221208233633372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233633372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233633372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233633372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233633372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233633372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233633384 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233633394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233633394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233633394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:36:36.699952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29046): Terminating (SIGTERM) 23:36:36.742123 run iperf3-srv_10.42.42.10(pid=29047): Terminating (SIGTERM) 23:36:36.784123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29048): Terminating (SIGTERM) 23:36:36.826322 run iperf3-srv_10.42.42.10(pid=29049): Terminating (SIGTERM) 23:36:36.868383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29050): Terminating (SIGTERM) 23:36:36.910506 run iperf3-srv_10.42.42.10(pid=29051): Terminating (SIGTERM) 23:36:36.952406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29052): Terminating (SIGTERM) 23:36:36.994450 run iperf3-srv_10.42.42.10(pid=29053): Terminating (SIGTERM) 23:36:37.036239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29056): Terminating (SIGTERM) 23:36:37.078268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29059): Terminating (SIGTERM) 23:36:37.120264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29062): Terminating (SIGTERM) 23:36:37.162367 --- ParallelTerminationStrategy: PID 29046 died... 23:36:37.182327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29046): Terminated: ok {rc=0} 23:36:37.228629 --- ParallelTerminationStrategy: PID 29047 died... 23:36:37.248548 run iperf3-srv_10.42.42.10(pid=29047): Terminated {rc=256} 23:36:37.294131 --- ParallelTerminationStrategy: PID 29048 died... 23:36:37.313631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29048): Terminated: ok {rc=0} 23:36:37.359466 --- ParallelTerminationStrategy: PID 29049 died... 23:36:37.378983 run iperf3-srv_10.42.42.10(pid=29049): Terminated {rc=256} 23:36:37.424541 --- ParallelTerminationStrategy: PID 29050 died... 23:36:37.443932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29050): Terminated: ok {rc=0} 23:36:37.489815 --- ParallelTerminationStrategy: PID 29051 died... 23:36:37.509308 run iperf3-srv_10.42.42.10(pid=29051): Terminated {rc=256} 23:36:37.554911 --- ParallelTerminationStrategy: PID 29052 died... 23:36:37.574332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29052): Terminated: ok {rc=0} 23:36:37.620313 --- ParallelTerminationStrategy: PID 29053 died... 23:36:37.639730 run iperf3-srv_10.42.42.10(pid=29053): Terminated {rc=256} 23:36:37.685415 --- ParallelTerminationStrategy: PID 29056 died... 23:36:37.704727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29056): Terminated: ok {rc=0} 23:36:37.750211 --- ParallelTerminationStrategy: PID 29059 died... 23:36:37.769773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29059): Terminated: ok {rc=0} 23:36:37.815172 --- ParallelTerminationStrategy: PID 29062 died... 23:36:37.834708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29062): Terminated: ok {rc=0} 23:36:37.920996 bus /gobi_4: Setting Powered False 23:36:39.020400 bus /gobi_4: Setting Powered False 23:36:40.135190 bus /gobi_1: Setting Powered False 23:36:41.233177 bus /gobi_1: Setting Powered False 23:36:42.348886 bus /gobi_0: Setting Powered False 23:36:43.445766 bus /gobi_0: Setting Powered False 23:36:44.560476 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 23:36:45.662618 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:45.674683 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:36:45.746201 tst ping.py: using LAC 17536 23:36:45.877412 tst ping.py: using RAC 196 23:36:46.031184 tst ping.py: using CellId 17536 23:36:46.154659 tst ping.py: using BVCI 17537 23:36:46.307208 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:46.319221 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:46.330978 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:46.345226 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:46.358013 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:46.370135 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:46.388617 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:46.401425 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:46.520417 tst ping.py:19: start network... 23:36:46.725220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:36:47.205812 run create_hlr_db(pid=29064): Launched 23:36:47.361851 bus /gobi_6: Setting Powered False 23:36:48.424203 run create_hlr_db(pid=29064): Terminated: ok {rc=0} 23:36:48.865706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29066): Launched 23:36:49.180622 run osmo-hlr_10.42.42.2(pid=29067): Launched 23:36:49.302123 run osmo-stp_10.42.42.5: Starting osmo-stp 23:36:49.851891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29069): Launched 23:36:50.168153 run osmo-stp_10.42.42.5(pid=29070): Launched 23:36:50.289083 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:36:50.834952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29072): Launched 23:36:50.956766 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:36:51.223995 run patchelf(pid=29073): Launched 23:36:51.400275 run osmo-stp_10.42.42.5(pid=29070): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29070)] 23:36:51.534865 run osmo-stp_10.42.42.5(pid=29070): stdout: | (launched: 2022-12-08_23:36:50.111077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:51.671028 run osmo-stp_10.42.42.5(pid=29070): stderr: | [0;m[38;5;43m20221208233650304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233650304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233650304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233650305 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233650305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233650305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233650305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:51.806824 run osmo-stp_10.42.42.5(pid=29070): stdout: | (launched: 2022-12-08_23:36:50.111077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:51.936606 run osmo-stp_10.42.42.5(pid=29070): stderr: | [0;m[38;5;43m20221208233650304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233650304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233650304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233650305 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233650305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233650305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233650305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:52.091155 run patchelf(pid=29073): Terminating (SIGINT) 23:36:52.268655 run patchelf(pid=29073): Terminated: ok {rc=0} 23:36:52.396918 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29070): Process ended prematurely: osmo-stp_10.42.42.5(pid=29070) [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29070)] [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 23:36:52.406523 tst ping.py:22: Test FAILED (6.7 sec) 23:36:52.434738 run osmo-hlr_10.42.42.2(pid=29067): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29067)] 23:36:52.484561 run osmo-hlr_10.42.42.2(pid=29067): stdout: | (launched: 2022-12-08_23:36:49.123900) 23:36:52.536221 run osmo-hlr_10.42.42.2(pid=29067): stderr: | [0;m[1;31m20221208233649322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233649322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233649322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233649322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233649322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233649323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233649336 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233649346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233649346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233649346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:36:52.588221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29066): Terminating (SIGTERM) 23:36:52.630046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29069): Terminating (SIGTERM) 23:36:52.671964 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29072): Terminating (SIGTERM) 23:36:52.714047 --- ParallelTerminationStrategy: PID 29066 died... 23:36:52.733945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29066): Terminated: ok {rc=0} 23:36:52.780039 --- ParallelTerminationStrategy: PID 29069 died... 23:36:52.799595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29069): Terminated: ok {rc=0} 23:36:52.845252 --- ParallelTerminationStrategy: PID 29072 died... 23:36:52.864672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29072): Terminated: ok {rc=0} 23:36:52.952018 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 23:36:54.038491 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:54.050956 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:36:54.125403 tst ping_idle_ping.py: using LAC 17537 23:36:54.250819 tst ping_idle_ping.py: using RAC 197 23:36:54.375454 tst ping_idle_ping.py: using CellId 17537 23:36:54.495239 tst ping_idle_ping.py: using BVCI 17538 23:36:54.611631 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:54.623240 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:54.634475 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:54.646030 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:54.657402 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:54.668790 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:54.680271 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:54.691736 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:54.805922 tst ping_idle_ping.py:24: start network... 23:36:55.006775 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:36:55.473535 run create_hlr_db(pid=29074): Launched 23:36:55.587059 bus /gobi_6: Setting Powered False 23:36:56.646816 run create_hlr_db(pid=29074): Terminated: ok {rc=0} 23:36:57.080872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29076): Launched 23:36:57.398111 run osmo-hlr_10.42.42.2(pid=29077): Launched 23:36:57.519024 run osmo-stp_10.42.42.5: Starting osmo-stp 23:36:58.066033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29079): Launched 23:36:58.383464 run osmo-stp_10.42.42.5(pid=29080): Launched 23:36:58.504268 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:36:59.051710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29082): Launched 23:36:59.173925 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:36:59.442012 run patchelf(pid=29083): Launched 23:36:59.618988 run osmo-stp_10.42.42.5(pid=29080): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29080)] 23:36:59.753437 run osmo-stp_10.42.42.5(pid=29080): stdout: | (launched: 2022-12-08_23:36:58.326199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:59.889767 run osmo-stp_10.42.42.5(pid=29080): stderr: | [0;m[38;5;43m20221208233658517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233658517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233658517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233658518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233658518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233658518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233658518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:00.025871 run osmo-stp_10.42.42.5(pid=29080): stdout: | (launched: 2022-12-08_23:36:58.326199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:00.156718 run osmo-stp_10.42.42.5(pid=29080): stderr: | [0;m[38;5;43m20221208233658517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233658517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233658517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233658518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233658518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233658518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233658518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:00.311372 run patchelf(pid=29083): Terminating (SIGINT) 23:37:00.488692 run patchelf(pid=29083): Terminated: ok {rc=0} 23:37:00.616609 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29080): Process ended prematurely: osmo-stp_10.42.42.5(pid=29080) [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29080)] [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 23:37:00.626204 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 23:37:00.654312 run osmo-hlr_10.42.42.2(pid=29077): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29077)] 23:37:00.704206 run osmo-hlr_10.42.42.2(pid=29077): stdout: | (launched: 2022-12-08_23:36:57.341031) 23:37:00.755759 run osmo-hlr_10.42.42.2(pid=29077): stderr: | [0;m[1;31m20221208233657538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233657538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233657538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233657538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233657539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233657539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233657591 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233657600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233657601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233657601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:37:00.807730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29076): Terminating (SIGTERM) 23:37:00.856672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29079): Terminating (SIGTERM) 23:37:00.901286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29082): Terminating (SIGTERM) 23:37:00.946577 --- ParallelTerminationStrategy: PID 29076 died... 23:37:00.966597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29076): Terminated: ok {rc=0} 23:37:01.014840 --- ParallelTerminationStrategy: PID 29079 died... 23:37:01.035547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29079): Terminated: ok {rc=0} 23:37:01.084008 --- ParallelTerminationStrategy: PID 29082 died... 23:37:01.109928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29082): Terminated: ok {rc=0} 23:37:01.222566 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:37:02.537384 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:37:02.543895 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:37:02.577866 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 23:37:02.617133 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 23:37:02.704903 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:37:02.738624 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 23:37:02.777846 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 23:37:03.369539 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 23:37:03.420483 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:03.431234 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:37:03.501460 tst cs_paging_gprs_active.py: using LAC 17538 23:37:03.628815 tst cs_paging_gprs_active.py: using RAC 198 23:37:03.755677 tst cs_paging_gprs_active.py: using CellId 17538 23:37:03.882417 tst cs_paging_gprs_active.py: using BVCI 17539 23:37:04.002103 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:04.013476 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:04.024578 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:04.035778 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:04.047025 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:04.058275 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:04.069569 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:04.080671 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:04.091977 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:04.208722 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:04.326886 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:37:04.546729 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:04.870334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29087): Launched 23:37:05.151906 run iperf3-srv_10.42.42.10(pid=29088): Launched 23:37:05.273940 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:37:05.492831 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:05.816870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29089): Launched 23:37:06.097322 run iperf3-srv_10.42.42.10(pid=29090): Launched 23:37:06.218806 tst cs_paging_gprs_active.py:38: start network... 23:37:06.436919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:37:06.936777 run create_hlr_db(pid=29091): Launched 23:37:07.067183 bus /gobi_6: Setting Powered False 23:37:08.130769 run create_hlr_db(pid=29091): Terminated: ok {rc=0} 23:37:08.562955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29093): Launched 23:37:08.865596 run osmo-hlr_10.42.42.2(pid=29094): Launched 23:37:08.980893 run osmo-stp_10.42.42.5: Starting osmo-stp 23:37:09.514539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29096): Launched 23:37:09.818352 run osmo-stp_10.42.42.5(pid=29097): Launched 23:37:09.934097 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:37:10.458611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29099): Launched 23:37:10.575457 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:37:10.831751 run patchelf(pid=29100): Launched 23:37:11.001417 run osmo-stp_10.42.42.5(pid=29097): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29097)] 23:37:11.130693 run osmo-stp_10.42.42.5(pid=29097): stdout: | (launched: 2022-12-08_23:37:09.763080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:11.260912 run osmo-stp_10.42.42.5(pid=29097): stderr: | [0;m[38;5;43m20221208233709934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233709934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233709934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233709934 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233709935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233709935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233709935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:11.392123 run osmo-stp_10.42.42.5(pid=29097): stdout: | (launched: 2022-12-08_23:37:09.763080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:11.517247 run osmo-stp_10.42.42.5(pid=29097): stderr: | [0;m[38;5;43m20221208233709934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233709934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233709934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233709934 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233709935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233709935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233709935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:11.666268 run patchelf(pid=29100): Terminating (SIGINT) 23:37:11.836699 run patchelf(pid=29100): Terminated: ok {rc=0} 23:37:11.960415 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29097): Process ended prematurely: osmo-stp_10.42.42.5(pid=29097) [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29097)] [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 23:37:11.969965 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 23:37:11.998124 run osmo-hlr_10.42.42.2(pid=29094): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29094)] 23:37:12.045793 run osmo-hlr_10.42.42.2(pid=29094): stdout: | (launched: 2022-12-08_23:37:08.810854) 23:37:12.095260 run osmo-hlr_10.42.42.2(pid=29094): stderr: | [0;m[1;31m20221208233708985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233708985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233708985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233708985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233708985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233708985 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233708997 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233709006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233709006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233709006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:37:12.145228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29087): Terminating (SIGTERM) 23:37:12.185030 run iperf3-srv_10.42.42.10(pid=29088): Terminating (SIGTERM) 23:37:12.225341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29089): Terminating (SIGTERM) 23:37:12.265827 run iperf3-srv_10.42.42.10(pid=29090): Terminating (SIGTERM) 23:37:12.305737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29093): Terminating (SIGTERM) 23:37:12.345820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29096): Terminating (SIGTERM) 23:37:12.386364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29099): Terminating (SIGTERM) 23:37:12.427042 --- ParallelTerminationStrategy: PID 29087 died... 23:37:12.446154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29087): Terminated: ok {rc=0} 23:37:12.491214 --- ParallelTerminationStrategy: PID 29088 died... 23:37:12.509755 run iperf3-srv_10.42.42.10(pid=29088): Terminated {rc=256} 23:37:12.554791 --- ParallelTerminationStrategy: PID 29089 died... 23:37:12.573460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29089): Terminated: ok {rc=0} 23:37:12.618481 --- ParallelTerminationStrategy: PID 29090 died... 23:37:12.636997 run iperf3-srv_10.42.42.10(pid=29090): Terminated {rc=256} 23:37:12.681720 --- ParallelTerminationStrategy: PID 29093 died... 23:37:12.700245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29093): Terminated: ok {rc=0} 23:37:12.744761 --- ParallelTerminationStrategy: PID 29096 died... 23:37:12.763272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29096): Terminated: ok {rc=0} 23:37:12.807033 --- ParallelTerminationStrategy: PID 29099 died... 23:37:12.825664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29099): Terminated: ok {rc=0} 23:37:12.911409 bus /gobi_0: Setting Powered False 23:37:14.008937 bus /gobi_0: Setting Powered False 23:37:15.122608 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 23:37:16.271598 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:16.284426 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:37:16.359215 tst iperf3.py: using LAC 17539 23:37:16.517684 tst iperf3.py: using RAC 199 23:37:16.650797 tst iperf3.py: using CellId 17539 23:37:16.789090 tst iperf3.py: using BVCI 17540 23:37:16.910297 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:16.922149 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:16.933774 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:16.945658 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:16.957269 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:16.969705 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:16.982527 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:16.994023 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:17.006034 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:17.126089 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:37:17.346316 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:17.670209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29101): Launched 23:37:17.949876 run iperf3-srv_10.42.42.10(pid=29102): Launched 23:37:18.071170 tst iperf3.py:8: start network... 23:37:18.290687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:37:18.790569 run create_hlr_db(pid=29103): Launched 23:37:18.921734 bus /gobi_6: Setting Powered False 23:37:19.984832 run create_hlr_db(pid=29103): Terminated: ok {rc=0} 23:37:20.432790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29105): Launched 23:37:20.755256 run osmo-hlr_10.42.42.2(pid=29106): Launched 23:37:20.877796 run osmo-stp_10.42.42.5: Starting osmo-stp 23:37:21.431973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29108): Launched 23:37:21.753698 run osmo-stp_10.42.42.5(pid=29109): Launched 23:37:21.876377 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:37:22.433021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29111): Launched 23:37:22.556440 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:37:22.829272 run patchelf(pid=29112): Launched 23:37:23.007940 run osmo-stp_10.42.42.5(pid=29109): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29109)] 23:37:23.144713 run osmo-stp_10.42.42.5(pid=29109): stdout: | (launched: 2022-12-08_23:37:21.695224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:23.283533 run osmo-stp_10.42.42.5(pid=29109): stderr: | [0;m[38;5;43m20221208233721887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233721887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233721887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233721888 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233721890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233721890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233721890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:23.422400 run osmo-stp_10.42.42.5(pid=29109): stdout: | (launched: 2022-12-08_23:37:21.695224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:23.554707 run osmo-stp_10.42.42.5(pid=29109): stderr: | [0;m[38;5;43m20221208233721887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233721887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233721887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233721888 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233721890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233721890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233721890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:23.711278 run patchelf(pid=29112): Terminating (SIGINT) 23:37:23.891029 run patchelf(pid=29112): Terminated: ok {rc=0} 23:37:24.021090 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29109): Process ended prematurely: osmo-stp_10.42.42.5(pid=29109) [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29109)] [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 23:37:24.031179 tst iperf3.py:8: Test FAILED (7.8 sec) 23:37:24.059455 run osmo-hlr_10.42.42.2(pid=29106): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29106)] 23:37:24.108898 run osmo-hlr_10.42.42.2(pid=29106): stdout: | (launched: 2022-12-08_23:37:20.696407) 23:37:24.160647 run osmo-hlr_10.42.42.2(pid=29106): stderr: | [0;m[1;31m20221208233720896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233720896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233720896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233720896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233720896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233720896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233720907 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233720915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233720915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233720915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:37:24.212537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29101): Terminating (SIGTERM) 23:37:24.254189 run iperf3-srv_10.42.42.10(pid=29102): Terminating (SIGTERM) 23:37:24.296095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29105): Terminating (SIGTERM) 23:37:24.338490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29108): Terminating (SIGTERM) 23:37:24.380379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29111): Terminating (SIGTERM) 23:37:24.422252 --- ParallelTerminationStrategy: PID 29101 died... 23:37:24.442075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29101): Terminated: ok {rc=0} 23:37:24.489438 --- ParallelTerminationStrategy: PID 29102 died... 23:37:24.508652 run iperf3-srv_10.42.42.10(pid=29102): Terminated {rc=256} 23:37:24.554888 --- ParallelTerminationStrategy: PID 29105 died... 23:37:24.574361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29105): Terminated: ok {rc=0} 23:37:24.620201 --- ParallelTerminationStrategy: PID 29108 died... 23:37:24.639659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29108): Terminated: ok {rc=0} 23:37:24.685879 --- ParallelTerminationStrategy: PID 29111 died... 23:37:24.705389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29111): Terminated: ok {rc=0} 23:37:24.792169 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 23:37:25.939713 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:25.951726 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:37:26.022591 tst iperf3m4.py: using LAC 17540 23:37:26.151182 tst iperf3m4.py: using RAC 200 23:37:26.276917 tst iperf3m4.py: using CellId 17540 23:37:26.397945 tst iperf3m4.py: using BVCI 17541 23:37:26.518168 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:26.529655 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:26.540809 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:26.552195 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:26.563569 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:26.574941 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:26.586449 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:26.597747 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:26.609448 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:26.725398 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:26.845132 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:26.961997 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:27.077874 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:37:27.283023 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:27.587487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29113): Launched 23:37:27.852423 run iperf3-srv_10.42.42.10(pid=29114): Launched 23:37:27.966523 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:37:28.169410 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:28.473434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29115): Launched 23:37:28.737186 run iperf3-srv_10.42.42.10(pid=29116): Launched 23:37:28.851352 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:37:29.054690 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:29.358324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29117): Launched 23:37:29.621582 run iperf3-srv_10.42.42.10(pid=29118): Launched 23:37:29.734928 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:37:29.937967 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:30.240760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29119): Launched 23:37:30.505184 run iperf3-srv_10.42.42.10(pid=29120): Launched 23:37:30.618751 tst iperf3m4.py:8: start network... 23:37:30.821185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:37:31.311896 run create_hlr_db(pid=29121): Launched 23:37:31.463781 bus /gobi_6: Setting Powered False 23:37:32.523686 run create_hlr_db(pid=29121): Terminated: ok {rc=0} 23:37:32.945461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29123): Launched 23:37:33.247399 run osmo-hlr_10.42.42.2(pid=29124): Launched 23:37:33.363280 run osmo-stp_10.42.42.5: Starting osmo-stp 23:37:33.883878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29126): Launched 23:37:34.185617 run osmo-stp_10.42.42.5(pid=29127): Launched 23:37:34.301489 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:37:34.823788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29129): Launched 23:37:34.939657 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:37:35.194366 run patchelf(pid=29130): Launched 23:37:35.362749 run osmo-stp_10.42.42.5(pid=29127): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29127)] 23:37:35.491433 run osmo-stp_10.42.42.5(pid=29127): stdout: | (launched: 2022-12-08_23:37:34.130494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:35.622389 run osmo-stp_10.42.42.5(pid=29127): stderr: | [0;m[38;5;43m20221208233734302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233734302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233734302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233734303 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233734303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233734303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233734303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:35.753834 run osmo-stp_10.42.42.5(pid=29127): stdout: | (launched: 2022-12-08_23:37:34.130494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:35.878208 run osmo-stp_10.42.42.5(pid=29127): stderr: | [0;m[38;5;43m20221208233734302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233734302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233734302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233734303 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233734303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233734303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233734303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:36.024730 run patchelf(pid=29130): Terminating (SIGINT) 23:37:36.194369 run patchelf(pid=29130): Terminated: ok {rc=0} 23:37:36.316742 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29127): Process ended prematurely: osmo-stp_10.42.42.5(pid=29127) [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29127)] [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 23:37:36.326280 tst iperf3m4.py:8: Test FAILED (10.4 sec) 23:37:36.354126 run osmo-hlr_10.42.42.2(pid=29124): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29124)] 23:37:36.401553 run osmo-hlr_10.42.42.2(pid=29124): stdout: | (launched: 2022-12-08_23:37:33.192341) 23:37:36.450669 run osmo-hlr_10.42.42.2(pid=29124): stderr: | [0;m[1;31m20221208233733369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233733369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233733369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233733369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233733369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233733370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233733389 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233733398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233733398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233733398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:37:36.499964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29113): Terminating (SIGTERM) 23:37:36.539389 run iperf3-srv_10.42.42.10(pid=29114): Terminating (SIGTERM) 23:37:36.578543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29115): Terminating (SIGTERM) 23:37:36.618007 run iperf3-srv_10.42.42.10(pid=29116): Terminating (SIGTERM) 23:37:36.657297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29117): Terminating (SIGTERM) 23:37:36.697162 run iperf3-srv_10.42.42.10(pid=29118): Terminating (SIGTERM) 23:37:36.736646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29119): Terminating (SIGTERM) 23:37:36.775885 run iperf3-srv_10.42.42.10(pid=29120): Terminating (SIGTERM) 23:37:36.815137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29123): Terminating (SIGTERM) 23:37:36.855276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29126): Terminating (SIGTERM) 23:37:36.894581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29129): Terminating (SIGTERM) 23:37:36.934116 --- ParallelTerminationStrategy: PID 29113 died... 23:37:36.952709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29113): Terminated: ok {rc=0} 23:37:36.996724 --- ParallelTerminationStrategy: PID 29114 died... 23:37:37.014923 run iperf3-srv_10.42.42.10(pid=29114): Terminated {rc=256} 23:37:37.058756 --- ParallelTerminationStrategy: PID 29115 died... 23:37:37.077027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29115): Terminated: ok {rc=0} 23:37:37.121186 --- ParallelTerminationStrategy: PID 29116 died... 23:37:37.139394 run iperf3-srv_10.42.42.10(pid=29116): Terminated {rc=256} 23:37:37.183475 --- ParallelTerminationStrategy: PID 29117 died... 23:37:37.201856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29117): Terminated: ok {rc=0} 23:37:37.245631 --- ParallelTerminationStrategy: PID 29118 died... 23:37:37.263766 run iperf3-srv_10.42.42.10(pid=29118): Terminated {rc=256} 23:37:37.307301 --- ParallelTerminationStrategy: PID 29119 died... 23:37:37.325606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29119): Terminated: ok {rc=0} 23:37:37.369282 --- ParallelTerminationStrategy: PID 29120 died... 23:37:37.387574 run iperf3-srv_10.42.42.10(pid=29120): Terminated {rc=256} 23:37:37.431192 --- ParallelTerminationStrategy: PID 29123 died... 23:37:37.449485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29123): Terminated: ok {rc=0} 23:37:37.493301 --- ParallelTerminationStrategy: PID 29126 died... 23:37:37.511532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29126): Terminated: ok {rc=0} 23:37:37.555939 --- ParallelTerminationStrategy: PID 29129 died... 23:37:37.574442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29129): Terminated: ok {rc=0} 23:37:37.658956 bus /gobi_4: Setting Powered False 23:37:38.759004 bus /gobi_4: Setting Powered False 23:37:39.870921 bus /gobi_1: Setting Powered False 23:37:40.969271 bus /gobi_1: Setting Powered False 23:37:42.084586 bus /gobi_0: Setting Powered False 23:37:43.182135 bus /gobi_0: Setting Powered False 23:37:44.297737 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 23:37:45.399879 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:45.411681 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:37:45.483770 tst ping.py: using LAC 17541 23:37:45.609836 tst ping.py: using RAC 201 23:37:45.738722 tst ping.py: using CellId 17541 23:37:45.875494 tst ping.py: using BVCI 17542 23:37:46.005643 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:46.019041 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:46.030798 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:46.042906 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:46.055096 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:46.066835 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:46.079067 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:46.091115 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:46.207729 tst ping.py:19: start network... 23:37:46.418877 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:37:46.919642 run create_hlr_db(pid=29138): Launched 23:37:47.081462 bus /gobi_6: Setting Powered False 23:37:48.140469 run create_hlr_db(pid=29138): Terminated: ok {rc=0} 23:37:48.602213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29140): Launched 23:37:48.918364 run osmo-hlr_10.42.42.2(pid=29141): Launched 23:37:49.038680 run osmo-stp_10.42.42.5: Starting osmo-stp 23:37:49.591871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29143): Launched 23:37:49.908886 run osmo-stp_10.42.42.5(pid=29144): Launched 23:37:50.030719 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:37:50.579393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29146): Launched 23:37:50.700503 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:37:50.967194 run patchelf(pid=29147): Launched 23:37:51.143163 run osmo-stp_10.42.42.5(pid=29144): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29144)] 23:37:51.277351 run osmo-stp_10.42.42.5(pid=29144): stdout: | (launched: 2022-12-08_23:37:49.851638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:51.413824 run osmo-stp_10.42.42.5(pid=29144): stderr: | [0;m[38;5;43m20221208233750045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233750045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233750045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233750046 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233750046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233750046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233750046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:51.549700 run osmo-stp_10.42.42.5(pid=29144): stdout: | (launched: 2022-12-08_23:37:49.851638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:51.679109 run osmo-stp_10.42.42.5(pid=29144): stderr: | [0;m[38;5;43m20221208233750045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233750045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233750045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233750046 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233750046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233750046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233750046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:51.832589 run patchelf(pid=29147): Terminating (SIGINT) 23:37:52.009801 run patchelf(pid=29147): Terminated: ok {rc=0} 23:37:52.137559 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29144): Process ended prematurely: osmo-stp_10.42.42.5(pid=29144) [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29144)] [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 23:37:52.147035 tst ping.py:22: Test FAILED (6.7 sec) 23:37:52.174944 run osmo-hlr_10.42.42.2(pid=29141): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29141)] 23:37:52.224415 run osmo-hlr_10.42.42.2(pid=29141): stdout: | (launched: 2022-12-08_23:37:48.861342) 23:37:52.275925 run osmo-hlr_10.42.42.2(pid=29141): stderr: | [0;m[1;31m20221208233749059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233749059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233749059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233749059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233749059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233749059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233749072 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233749082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233749082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233749082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:37:52.328231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29140): Terminating (SIGTERM) 23:37:52.370061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29143): Terminating (SIGTERM) 23:37:52.411718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29146): Terminating (SIGTERM) 23:37:52.453604 --- ParallelTerminationStrategy: PID 29140 died... 23:37:52.473468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29140): Terminated: ok {rc=0} 23:37:52.519287 --- ParallelTerminationStrategy: PID 29143 died... 23:37:52.538887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29143): Terminated: ok {rc=0} 23:37:52.584698 --- ParallelTerminationStrategy: PID 29146 died... 23:37:52.604065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29146): Terminated: ok {rc=0} 23:37:52.690114 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 23:37:53.777978 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:53.790386 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:37:53.866117 tst ping_idle_ping.py: using LAC 17542 23:37:53.989681 tst ping_idle_ping.py: using RAC 202 23:37:54.111694 tst ping_idle_ping.py: using CellId 17542 23:37:54.237479 tst ping_idle_ping.py: using BVCI 17543 23:37:54.353161 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:54.364444 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:54.375651 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:54.386754 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:54.397905 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:54.409019 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:54.420043 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:54.431010 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:54.547018 tst ping_idle_ping.py:24: start network... 23:37:54.760896 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:37:55.254396 run create_hlr_db(pid=29148): Launched 23:37:55.384164 bus /gobi_6: Setting Powered False 23:37:56.447406 run create_hlr_db(pid=29148): Terminated: ok {rc=0} 23:37:56.889440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29150): Launched 23:37:57.205439 run osmo-hlr_10.42.42.2(pid=29151): Launched 23:37:57.327163 run osmo-stp_10.42.42.5: Starting osmo-stp 23:37:57.878127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29153): Launched 23:37:58.194458 run osmo-stp_10.42.42.5(pid=29154): Launched 23:37:58.315295 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:37:58.862133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29156): Launched 23:37:58.983653 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:37:59.250523 run patchelf(pid=29157): Launched 23:37:59.427342 run osmo-stp_10.42.42.5(pid=29154): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29154)] 23:37:59.561864 run osmo-stp_10.42.42.5(pid=29154): stdout: | (launched: 2022-12-08_23:37:58.137373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:59.697792 run osmo-stp_10.42.42.5(pid=29154): stderr: | [0;m[38;5;43m20221208233758327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233758327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233758327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233758328 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233758330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233758330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233758330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:59.833636 run osmo-stp_10.42.42.5(pid=29154): stdout: | (launched: 2022-12-08_23:37:58.137373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:59.963277 run osmo-stp_10.42.42.5(pid=29154): stderr: | [0;m[38;5;43m20221208233758327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233758327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233758327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233758328 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233758330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233758330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233758330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:00.117188 run patchelf(pid=29157): Terminating (SIGINT) 23:38:00.295175 run patchelf(pid=29157): Terminated: ok {rc=0} 23:38:00.423371 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29154): Process ended prematurely: osmo-stp_10.42.42.5(pid=29154) [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29154)] [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 23:38:00.432777 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 23:38:00.460714 run osmo-hlr_10.42.42.2(pid=29151): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29151)] 23:38:00.509827 run osmo-hlr_10.42.42.2(pid=29151): stdout: | (launched: 2022-12-08_23:37:57.148217) 23:38:00.560817 run osmo-hlr_10.42.42.2(pid=29151): stderr: | [0;m[1;31m20221208233757346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233757347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233757347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233757347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233757347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233757347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233757359 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233757367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233757368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233757368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:38:00.612576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29150): Terminating (SIGTERM) 23:38:00.653739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29153): Terminating (SIGTERM) 23:38:00.694846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29156): Terminating (SIGTERM) 23:38:00.736289 --- ParallelTerminationStrategy: PID 29150 died... 23:38:00.755900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29150): Terminated: ok {rc=0} 23:38:00.801425 --- ParallelTerminationStrategy: PID 29153 died... 23:38:00.820629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29153): Terminated: ok {rc=0} 23:38:00.875476 --- ParallelTerminationStrategy: PID 29156 died... 23:38:00.895822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29156): Terminated: ok {rc=0} 23:38:00.984647 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 23:38:02.414891 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:38:02.422138 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 23:38:02.468815 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 23:38:02.530095 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 23:38:02.644539 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 23:38:02.707176 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 23:38:02.776854 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 23:38:03.386023 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 23:38:03.457971 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:03.470364 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:38:03.536523 tst cs_paging_gprs_active.py: using LAC 17543 23:38:03.697760 tst cs_paging_gprs_active.py: using RAC 203 23:38:03.858311 tst cs_paging_gprs_active.py: using CellId 17543 23:38:04.020382 tst cs_paging_gprs_active.py: using BVCI 17544 23:38:04.149339 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:04.162087 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:04.178198 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:04.194593 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:04.206924 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:04.219270 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:04.231513 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:04.243471 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:04.255842 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:04.378836 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:04.501975 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:38:04.726645 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:38:05.053976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29430): Launched 23:38:05.345519 run iperf3-srv_10.42.42.10(pid=29431): Launched 23:38:05.479676 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:38:05.694215 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:38:06.024454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29434): Launched 23:38:06.309709 run iperf3-srv_10.42.42.10(pid=29435): Launched 23:38:06.443908 tst cs_paging_gprs_active.py:38: start network... 23:38:06.667188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:38:07.178246 run create_hlr_db(pid=29436): Launched 23:38:07.339256 bus /gobi_6: Setting Powered False 23:38:08.401214 run create_hlr_db(pid=29436): Terminated: ok {rc=0} 23:38:08.848512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29438): Launched 23:38:09.180356 run osmo-hlr_10.42.42.2(pid=29439): Launched 23:38:09.426279 run osmo-stp_10.42.42.5: Starting osmo-stp 23:38:10.172997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29441): Launched 23:38:10.507542 run osmo-stp_10.42.42.5(pid=29442): Launched 23:38:10.760207 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:38:11.469372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29445): Launched 23:38:11.604082 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:38:11.878149 run patchelf(pid=29446): Launched 23:38:12.069751 run osmo-stp_10.42.42.5(pid=29442): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29442)] 23:38:12.203823 run osmo-stp_10.42.42.5(pid=29442): stdout: | (launched: 2022-12-08_23:38:10.444670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:12.341133 run osmo-stp_10.42.42.5(pid=29442): stderr: | [0;m[38;5;43m20221208233810784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233810785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233810785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233810785 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233810786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233810786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233810786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:12.478335 run osmo-stp_10.42.42.5(pid=29442): stdout: | (launched: 2022-12-08_23:38:10.444670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:12.611249 run osmo-stp_10.42.42.5(pid=29442): stderr: | [0;m[38;5;43m20221208233810784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233810785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233810785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233810785 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233810786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233810786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233810786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:12.767732 run patchelf(pid=29446): Terminating (SIGINT) 23:38:12.945661 run patchelf(pid=29446): Terminated: ok {rc=0} 23:38:13.075617 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29442): Process ended prematurely: osmo-stp_10.42.42.5(pid=29442) [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29442)] [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 23:38:13.086609 tst cs_paging_gprs_active.py:38: Test FAILED (9.7 sec) 23:38:13.117816 run osmo-hlr_10.42.42.2(pid=29439): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29439)] 23:38:13.168364 run osmo-hlr_10.42.42.2(pid=29439): stdout: | (launched: 2022-12-08_23:38:09.116792) 23:38:13.221288 run osmo-hlr_10.42.42.2(pid=29439): stderr: | [0;m[1;31m20221208233809471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233809471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233809471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233809472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233809472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233809472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233809505 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233809522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233809522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233809523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:38:13.275235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29430): Terminating (SIGTERM) 23:38:13.319087 run iperf3-srv_10.42.42.10(pid=29431): Terminating (SIGTERM) 23:38:13.365422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29434): Terminating (SIGTERM) 23:38:13.409075 run iperf3-srv_10.42.42.10(pid=29435): Terminating (SIGTERM) 23:38:13.455925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29438): Terminating (SIGTERM) 23:38:13.499264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29441): Terminating (SIGTERM) 23:38:13.543630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29445): Terminating (SIGTERM) 23:38:13.590250 --- ParallelTerminationStrategy: PID 29430 died... 23:38:13.609958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29430): Terminated: ok {rc=0} 23:38:13.660706 --- ParallelTerminationStrategy: PID 29431 died... 23:38:13.681133 run iperf3-srv_10.42.42.10(pid=29431): Terminated {rc=256} 23:38:13.728600 --- ParallelTerminationStrategy: PID 29434 died... 23:38:13.748438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29434): Terminated: ok {rc=0} 23:38:13.796156 --- ParallelTerminationStrategy: PID 29435 died... 23:38:13.816219 run iperf3-srv_10.42.42.10(pid=29435): Terminated {rc=256} 23:38:13.864567 --- ParallelTerminationStrategy: PID 29438 died... 23:38:13.884510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29438): Terminated: ok {rc=0} 23:38:13.932086 --- ParallelTerminationStrategy: PID 29441 died... 23:38:13.951829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29441): Terminated: ok {rc=0} 23:38:13.999523 --- ParallelTerminationStrategy: PID 29445 died... 23:38:14.019032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29445): Terminated: ok {rc=0} 23:38:14.108084 bus /gobi_0: Setting Powered False 23:38:15.209128 bus /gobi_0: Setting Powered False 23:38:16.344054 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 23:38:17.523510 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:17.536265 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:38:17.595151 tst iperf3.py: using LAC 17544 23:38:17.720788 tst iperf3.py: using RAC 204 23:38:17.845076 tst iperf3.py: using CellId 17544 23:38:17.968534 tst iperf3.py: using BVCI 17545 23:38:18.084181 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:18.096790 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:18.108830 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:18.123127 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:18.135105 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:18.148117 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:18.162825 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:18.174669 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:18.188686 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:18.308829 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:38:18.521813 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:38:18.853699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29447): Launched 23:38:19.140060 run iperf3-srv_10.42.42.10(pid=29448): Launched 23:38:19.272819 tst iperf3.py:8: start network... 23:38:19.485400 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:38:19.983326 run create_hlr_db(pid=29449): Launched 23:38:20.143447 bus /gobi_6: Setting Powered False 23:38:21.204149 run create_hlr_db(pid=29449): Terminated: ok {rc=0} 23:38:21.660691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29451): Launched 23:38:22.009680 run osmo-hlr_10.42.42.2(pid=29452): Launched 23:38:22.256305 run osmo-stp_10.42.42.5: Starting osmo-stp 23:38:22.883370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29454): Launched 23:38:23.215078 run osmo-stp_10.42.42.5(pid=29455): Launched 23:38:23.412495 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:38:23.945700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29458): Launched 23:38:24.062319 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:38:24.317553 run patchelf(pid=29459): Launched 23:38:24.486271 run osmo-stp_10.42.42.5(pid=29455): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29455)] 23:38:24.614379 run osmo-stp_10.42.42.5(pid=29455): stdout: | (launched: 2022-12-08_23:38:23.152365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:24.744488 run osmo-stp_10.42.42.5(pid=29455): stderr: | [0;m[38;5;43m20221208233823421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233823421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233823421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233823422 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233823422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233823422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233823422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:24.875348 run osmo-stp_10.42.42.5(pid=29455): stdout: | (launched: 2022-12-08_23:38:23.152365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:24.999602 run osmo-stp_10.42.42.5(pid=29455): stderr: | [0;m[38;5;43m20221208233823421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233823421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233823421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233823422 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233823422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233823422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233823422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:25.146641 run patchelf(pid=29459): Terminating (SIGINT) 23:38:25.316148 run patchelf(pid=29459): Terminated: ok {rc=0} 23:38:25.438687 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29455): Process ended prematurely: osmo-stp_10.42.42.5(pid=29455) [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29455)] [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 23:38:25.448263 tst iperf3.py:8: Test FAILED (8.0 sec) 23:38:25.475554 run osmo-hlr_10.42.42.2(pid=29452): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29452)] 23:38:25.523227 run osmo-hlr_10.42.42.2(pid=29452): stdout: | (launched: 2022-12-08_23:38:21.938052) 23:38:25.572387 run osmo-hlr_10.42.42.2(pid=29452): stderr: | [0;m[1;31m20221208233822251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233822251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233822251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233822251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233822251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233822251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233822268 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233822284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233822285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233822285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:38:25.621867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29447): Terminating (SIGTERM) 23:38:25.661683 run iperf3-srv_10.42.42.10(pid=29448): Terminating (SIGTERM) 23:38:25.701322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29451): Terminating (SIGTERM) 23:38:25.741467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29454): Terminating (SIGTERM) 23:38:25.781455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29458): Terminating (SIGTERM) 23:38:25.821437 --- ParallelTerminationStrategy: PID 29447 died... 23:38:25.840152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29447): Terminated: ok {rc=0} 23:38:25.884516 --- ParallelTerminationStrategy: PID 29448 died... 23:38:25.902997 run iperf3-srv_10.42.42.10(pid=29448): Terminated {rc=256} 23:38:25.947378 --- ParallelTerminationStrategy: PID 29451 died... 23:38:25.965928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29451): Terminated: ok {rc=0} 23:38:26.010047 --- ParallelTerminationStrategy: PID 29454 died... 23:38:26.028601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29454): Terminated: ok {rc=0} 23:38:26.072448 --- ParallelTerminationStrategy: PID 29458 died... 23:38:26.090997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29458): Terminated: ok {rc=0} 23:38:26.173408 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 23:38:27.321459 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:27.333736 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:38:27.387102 tst iperf3m4.py: using LAC 17545 23:38:27.515293 tst iperf3m4.py: using RAC 205 23:38:27.643542 tst iperf3m4.py: using CellId 17545 23:38:27.771939 tst iperf3m4.py: using BVCI 17546 23:38:27.883435 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:27.894827 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:27.905975 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:27.917553 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:27.929169 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:27.940661 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:27.952233 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:27.963709 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:27.975025 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:28.094685 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:28.215566 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:28.334189 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:28.453118 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:38:28.671292 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:38:28.995391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29460): Launched 23:38:29.276157 run iperf3-srv_10.42.42.10(pid=29461): Launched 23:38:29.397716 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:38:29.615261 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:38:29.938990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29462): Launched 23:38:30.219373 run iperf3-srv_10.42.42.10(pid=29463): Launched 23:38:30.341049 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:38:30.558577 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:38:30.885759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29464): Launched 23:38:31.179941 run iperf3-srv_10.42.42.10(pid=29465): Launched 23:38:31.309880 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:38:31.519937 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:38:31.842670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29466): Launched 23:38:32.189438 run iperf3-srv_10.42.42.10(pid=29467): Launched 23:38:32.316049 tst iperf3m4.py:8: start network... 23:38:32.533359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:38:33.033772 run create_hlr_db(pid=29468): Launched 23:38:33.164390 bus /gobi_6: Setting Powered False 23:38:34.228246 run create_hlr_db(pid=29468): Terminated: ok {rc=0} 23:38:34.676440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29470): Launched 23:38:34.998924 run osmo-hlr_10.42.42.2(pid=29471): Launched 23:38:35.122267 run osmo-stp_10.42.42.5: Starting osmo-stp 23:38:35.683305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29473): Launched 23:38:36.006556 run osmo-stp_10.42.42.5(pid=29474): Launched 23:38:36.129903 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:38:36.686495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29476): Launched 23:38:36.810648 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:38:37.082525 run patchelf(pid=29477): Launched 23:38:37.261133 run osmo-stp_10.42.42.5(pid=29474): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29474)] 23:38:37.397870 run osmo-stp_10.42.42.5(pid=29474): stdout: | (launched: 2022-12-08_23:38:35.948294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:37.536030 run osmo-stp_10.42.42.5(pid=29474): stderr: | [0;m[38;5;43m20221208233836140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233836140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233836141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233836141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233836141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233836142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233836142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:37.674153 run osmo-stp_10.42.42.5(pid=29474): stdout: | (launched: 2022-12-08_23:38:35.948294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:37.806052 run osmo-stp_10.42.42.5(pid=29474): stderr: | [0;m[38;5;43m20221208233836140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233836140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233836141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233836141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233836141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233836142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233836142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:37.962493 run patchelf(pid=29477): Terminating (SIGINT) 23:38:38.142391 run patchelf(pid=29477): Terminated: ok {rc=0} 23:38:38.272231 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29474): Process ended prematurely: osmo-stp_10.42.42.5(pid=29474) [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29474)] [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 23:38:38.282680 tst iperf3m4.py:8: Test FAILED (11.0 sec) 23:38:38.311527 run osmo-hlr_10.42.42.2(pid=29471): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29471)] 23:38:38.361151 run osmo-hlr_10.42.42.2(pid=29471): stdout: | (launched: 2022-12-08_23:38:34.940433) 23:38:38.412189 run osmo-hlr_10.42.42.2(pid=29471): stderr: | [0;m[1;31m20221208233835139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233835139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233835139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233835140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233835140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233835140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233835154 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233835162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233835163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233835163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:38:38.463513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29460): Terminating (SIGTERM) 23:38:38.505014 run iperf3-srv_10.42.42.10(pid=29461): Terminating (SIGTERM) 23:38:38.546389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29462): Terminating (SIGTERM) 23:38:38.587699 run iperf3-srv_10.42.42.10(pid=29463): Terminating (SIGTERM) 23:38:38.628855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29464): Terminating (SIGTERM) 23:38:38.670828 run iperf3-srv_10.42.42.10(pid=29465): Terminating (SIGTERM) 23:38:38.712089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29466): Terminating (SIGTERM) 23:38:38.753590 run iperf3-srv_10.42.42.10(pid=29467): Terminating (SIGTERM) 23:38:38.794667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29470): Terminating (SIGTERM) 23:38:38.835895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29473): Terminating (SIGTERM) 23:38:38.877182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29476): Terminating (SIGTERM) 23:38:38.919047 --- ParallelTerminationStrategy: PID 29460 died... 23:38:38.938703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29460): Terminated: ok {rc=0} 23:38:38.984215 --- ParallelTerminationStrategy: PID 29461 died... 23:38:39.003426 run iperf3-srv_10.42.42.10(pid=29461): Terminated {rc=256} 23:38:39.049159 --- ParallelTerminationStrategy: PID 29462 died... 23:38:39.068309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29462): Terminated: ok {rc=0} 23:38:39.113715 --- ParallelTerminationStrategy: PID 29463 died... 23:38:39.133122 run iperf3-srv_10.42.42.10(pid=29463): Terminated {rc=256} 23:38:39.178299 --- ParallelTerminationStrategy: PID 29464 died... 23:38:39.197668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29464): Terminated: ok {rc=0} 23:38:39.242933 --- ParallelTerminationStrategy: PID 29465 died... 23:38:39.262257 run iperf3-srv_10.42.42.10(pid=29465): Terminated {rc=256} 23:38:39.307627 --- ParallelTerminationStrategy: PID 29466 died... 23:38:39.326870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29466): Terminated: ok {rc=0} 23:38:39.372210 --- ParallelTerminationStrategy: PID 29467 died... 23:38:39.391502 run iperf3-srv_10.42.42.10(pid=29467): Terminated {rc=256} 23:38:39.437076 --- ParallelTerminationStrategy: PID 29470 died... 23:38:39.456470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29470): Terminated: ok {rc=0} 23:38:39.502258 --- ParallelTerminationStrategy: PID 29473 died... 23:38:39.521728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29473): Terminated: ok {rc=0} 23:38:39.567115 --- ParallelTerminationStrategy: PID 29476 died... 23:38:39.586505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29476): Terminated: ok {rc=0} 23:38:39.673339 bus /gobi_4: Setting Powered False 23:38:40.772373 bus /gobi_4: Setting Powered False 23:38:41.893521 bus /gobi_1: Setting Powered False 23:38:42.990461 bus /gobi_1: Setting Powered False 23:38:44.104709 bus /gobi_0: Setting Powered False 23:38:45.201710 bus /gobi_0: Setting Powered False 23:38:46.320646 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 23:38:47.421422 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:47.433323 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:38:47.487196 tst ping.py: using LAC 17546 23:38:47.606255 tst ping.py: using RAC 206 23:38:47.730252 tst ping.py: using CellId 17546 23:38:47.856487 tst ping.py: using BVCI 17547 23:38:47.972430 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:47.984120 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:47.995686 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:48.007554 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:48.018971 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:48.030452 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:48.042118 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:48.053552 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:48.171882 tst ping.py:19: start network... 23:38:48.385521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:38:48.874755 run create_hlr_db(pid=29479): Launched 23:38:49.003695 bus /gobi_6: Setting Powered False 23:38:50.067275 run create_hlr_db(pid=29479): Terminated: ok {rc=0} 23:38:50.492873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29481): Launched 23:38:50.791278 run osmo-hlr_10.42.42.2(pid=29482): Launched 23:38:50.904487 run osmo-stp_10.42.42.5: Starting osmo-stp 23:38:51.433369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29484): Launched 23:38:51.751345 run osmo-stp_10.42.42.5(pid=29485): Launched 23:38:51.871340 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:38:52.418727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29487): Launched 23:38:52.539587 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:38:52.806203 run patchelf(pid=29488): Launched 23:38:52.981881 run osmo-stp_10.42.42.5(pid=29485): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29485)] 23:38:53.116632 run osmo-stp_10.42.42.5(pid=29485): stdout: | (launched: 2022-12-08_23:38:51.694170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:53.252284 run osmo-stp_10.42.42.5(pid=29485): stderr: | [0;m[38;5;43m20221208233851888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233851888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233851889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233851889 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233851889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233851890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233851890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:53.389084 run osmo-stp_10.42.42.5(pid=29485): stdout: | (launched: 2022-12-08_23:38:51.694170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:53.518710 run osmo-stp_10.42.42.5(pid=29485): stderr: | [0;m[38;5;43m20221208233851888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233851888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233851889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233851889 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233851889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233851890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233851890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:53.672641 run patchelf(pid=29488): Terminating (SIGINT) 23:38:53.849808 run patchelf(pid=29488): Terminated: ok {rc=0} 23:38:53.977548 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29485): Process ended prematurely: osmo-stp_10.42.42.5(pid=29485) [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29485)] [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 23:38:53.987134 tst ping.py:22: Test FAILED (6.6 sec) 23:38:54.015275 run osmo-hlr_10.42.42.2(pid=29482): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29482)] 23:38:54.064828 run osmo-hlr_10.42.42.2(pid=29482): stdout: | (launched: 2022-12-08_23:38:50.736708) 23:38:54.116180 run osmo-hlr_10.42.42.2(pid=29482): stderr: | [0;m[1;31m20221208233850911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233850911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233850911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233850911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233850911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233850911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233850922 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233850931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233850931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233850931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:38:54.168333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29481): Terminating (SIGTERM) 23:38:54.209769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29484): Terminating (SIGTERM) 23:38:54.251124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29487): Terminating (SIGTERM) 23:38:54.292734 --- ParallelTerminationStrategy: PID 29481 died... 23:38:54.312775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29481): Terminated: ok {rc=0} 23:38:54.359210 --- ParallelTerminationStrategy: PID 29484 died... 23:38:54.378692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29484): Terminated: ok {rc=0} 23:38:54.424511 --- ParallelTerminationStrategy: PID 29487 died... 23:38:54.443994 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29487): Terminated: ok {rc=0} 23:38:54.531189 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 23:38:55.619218 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:55.631634 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:38:55.686383 tst ping_idle_ping.py: using LAC 17547 23:38:55.812244 tst ping_idle_ping.py: using RAC 207 23:38:55.936252 tst ping_idle_ping.py: using CellId 17547 23:38:56.060589 tst ping_idle_ping.py: using BVCI 17548 23:38:56.175368 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:56.187034 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:56.198536 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:56.210021 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:56.221473 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:56.232833 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:56.244462 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:56.255851 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:56.370270 tst ping_idle_ping.py:24: start network... 23:38:56.570875 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:38:57.034501 run create_hlr_db(pid=29489): Launched 23:38:57.163777 bus /gobi_6: Setting Powered False 23:38:58.226331 run create_hlr_db(pid=29489): Terminated: ok {rc=0} 23:38:58.652681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29491): Launched 23:38:58.949687 run osmo-hlr_10.42.42.2(pid=29492): Launched 23:38:59.063572 run osmo-stp_10.42.42.5: Starting osmo-stp 23:38:59.574812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29494): Launched 23:38:59.872867 run osmo-stp_10.42.42.5(pid=29495): Launched 23:38:59.987183 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:39:00.501505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29497): Launched 23:39:00.616319 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:39:00.880054 run patchelf(pid=29498): Launched 23:39:01.080418 run osmo-stp_10.42.42.5(pid=29495): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29495)] 23:39:01.218730 run osmo-stp_10.42.42.5(pid=29495): stdout: | (launched: 2022-12-08_23:38:59.818487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:01.360407 run osmo-stp_10.42.42.5(pid=29495): stderr: | [0;m[38;5;43m20221208233859988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233859988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233859989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233859989 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233859989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233859990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233859990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:01.502300 run osmo-stp_10.42.42.5(pid=29495): stdout: | (launched: 2022-12-08_23:38:59.818487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:01.638622 run osmo-stp_10.42.42.5(pid=29495): stderr: | [0;m[38;5;43m20221208233859988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233859988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233859989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233859989 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233859989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233859990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233859990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:01.796451 run patchelf(pid=29498): Terminating (SIGINT) 23:39:01.979665 run patchelf(pid=29498): Terminated: ok {rc=0} 23:39:02.111561 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29495): Process ended prematurely: osmo-stp_10.42.42.5(pid=29495) [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29495)] [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 23:39:02.122074 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:39:02.150980 run osmo-hlr_10.42.42.2(pid=29492): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29492)] 23:39:02.200368 run osmo-hlr_10.42.42.2(pid=29492): stdout: | (launched: 2022-12-08_23:38:58.895794) 23:39:02.251536 run osmo-hlr_10.42.42.2(pid=29492): stderr: | [0;m[1;31m20221208233859072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233859072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233859072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233859072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233859072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233859072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233859084 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233859094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233859094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233859094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:39:02.303100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29491): Terminating (SIGTERM) 23:39:02.345335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29494): Terminating (SIGTERM) 23:39:02.386657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29497): Terminating (SIGTERM) 23:39:02.428192 --- ParallelTerminationStrategy: PID 29491 died... 23:39:02.447954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29491): Terminated: ok {rc=0} 23:39:02.493410 --- ParallelTerminationStrategy: PID 29494 died... 23:39:02.512670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29494): Terminated: ok {rc=0} 23:39:02.558858 --- ParallelTerminationStrategy: PID 29497 died... 23:39:02.578212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29497): Terminated: ok {rc=0} 23:39:02.664657 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:39:03.967412 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:39:03.974359 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:39:04.008389 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 23:39:04.042416 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:39:04.095127 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:39:04.129549 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 23:39:04.165098 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:39:04.721873 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2351 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 23:39:04.727636 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:39:04.739777 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:39:04.807710 tst switch_tch_pdch.py: using LAC 17548 23:39:04.925369 tst switch_tch_pdch.py: using RAC 208 23:39:05.041640 tst switch_tch_pdch.py: using CellId 17548 23:39:05.167535 tst switch_tch_pdch.py: using BVCI 17549 23:39:05.282475 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:39:05.294312 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:39:05.305912 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:39:05.318052 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:39:05.329816 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:39:05.341512 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:39:05.353459 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:39:05.365495 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:39:05.481918 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:39:05.599693 tst switch_tch_pdch.py:51: start network... 23:39:05.798918 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:39:06.259381 run create_hlr_db(pid=29502): Launched 23:39:06.372609 bus /gobi_6: Setting Powered False 23:39:07.431719 run create_hlr_db(pid=29502): Terminated: ok {rc=0} 23:39:07.866016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29504): Launched 23:39:08.181856 run osmo-hlr_10.42.42.2(pid=29505): Launched 23:39:08.302007 run osmo-stp_10.42.42.5: Starting osmo-stp 23:39:08.846770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29507): Launched 23:39:09.162238 run osmo-stp_10.42.42.5(pid=29508): Launched 23:39:09.282612 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:39:09.830246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29510): Launched 23:39:09.951184 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:39:10.217632 run patchelf(pid=29511): Launched 23:39:10.393928 run osmo-stp_10.42.42.5(pid=29508): ERR: Terminated: ERROR {rc=1} [trial-2351↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29508)] 23:39:10.528181 run osmo-stp_10.42.42.5(pid=29508): stdout: | (launched: 2022-12-08_23:39:09.104711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:10.664644 run osmo-stp_10.42.42.5(pid=29508): stderr: | [0;m[38;5;43m20221208233909297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233909297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233909298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233909298 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233909298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233909298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233909299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:10.800849 run osmo-stp_10.42.42.5(pid=29508): stdout: | (launched: 2022-12-08_23:39:09.104711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:10.930802 run osmo-stp_10.42.42.5(pid=29508): stderr: | [0;m[38;5;43m20221208233909297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233909297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233909298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233909298 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233909298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233909298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233909299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:11.085114 run patchelf(pid=29511): Terminating (SIGINT) 23:39:11.263101 run patchelf(pid=29511): Terminated: ok {rc=0} 23:39:11.391643 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29508): Process ended prematurely: osmo-stp_10.42.42.5(pid=29508) [trial-2351↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29508)] [trial-2351↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 23:39:11.401149 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 23:39:11.429092 run osmo-hlr_10.42.42.2(pid=29505): ERR: Terminated: ERROR {rc=237} [trial-2351↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29505)] 23:39:11.478319 run osmo-hlr_10.42.42.2(pid=29505): stdout: | (launched: 2022-12-08_23:39:08.124592) 23:39:11.529335 run osmo-hlr_10.42.42.2(pid=29505): stderr: | [0;m[1;31m20221208233908323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233908323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233908323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233908324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233908324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233908324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233908337 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233908346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233908347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233908347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:39:11.580535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29504): Terminating (SIGTERM) 23:39:11.622373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29507): Terminating (SIGTERM) 23:39:11.664043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29510): Terminating (SIGTERM) 23:39:11.706016 --- ParallelTerminationStrategy: PID 29504 died... 23:39:11.725864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29504): Terminated: ok {rc=0} 23:39:11.772116 --- ParallelTerminationStrategy: PID 29507 died... 23:39:11.791697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29507): Terminated: ok {rc=0} 23:39:11.837583 --- ParallelTerminationStrategy: PID 29510 died... 23:39:11.857051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29510): Terminated: ok {rc=0} 23:39:11.943274 bus /gobi_0: Setting Powered False 23:39:13.040872 bus /gobi_0: Setting Powered False 23:39:14.155056 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 23:39:15.402070 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:39:15.407741 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 23:39:15.440737 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 23:39:15.474678 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 23:39:15.527628 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 23:39:15.561745 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 23:39:15.597015 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 23:39:16.147962 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2351 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 23:39:16.154390 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:39:16.166216 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 23:39:16.237736 tst switch_tch_pdch.py: using LAC 17549 23:39:16.356338 tst switch_tch_pdch.py: using RAC 209 23:39:16.482555 tst switch_tch_pdch.py: using CellId 17549 23:39:16.606988 tst switch_tch_pdch.py: using BVCI 17550 23:39:16.742970 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:39:16.754843 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:39:16.766577 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:39:16.779962 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:39:16.792844 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:39:16.805902 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:39:16.818825 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:39:16.830951 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:39:16.978323 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:39:17.114644 tst switch_tch_pdch.py:51: start network... 23:39:17.318333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:39:17.751445 run create_hlr_db(pid=29516): Launched 23:39:17.863637 bus /gobi_6: Setting Powered False 23:39:18.922689 run create_hlr_db(pid=29516): Terminated: ok {rc=0} 23:39:19.312117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29518): Launched 23:39:19.608195 run osmo-hlr_10.42.42.2(pid=29519): Launched 23:39:19.721488 run osmo-stp_10.42.42.5: Starting osmo-stp 23:39:20.205820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29521): Launched 23:39:20.502738 run osmo-stp_10.42.42.5(pid=29522): Launched 23:39:20.616017 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:39:21.102287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29524): Launched 23:39:21.216268 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:39:21.468263 run patchelf(pid=29525): Launched 23:39:21.633346 run osmo-stp_10.42.42.5(pid=29522): ERR: Terminated: ERROR {rc=1} [trial-2351↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29522)] 23:39:21.759182 run osmo-stp_10.42.42.5(pid=29522): stdout: | (launched: 2022-12-08_23:39:20.448559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:21.886734 run osmo-stp_10.42.42.5(pid=29522): stderr: | [0;m[38;5;43m20221208233920617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233920617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233920618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233920618 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233920619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233920619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233920619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:22.014080 run osmo-stp_10.42.42.5(pid=29522): stdout: | (launched: 2022-12-08_23:39:20.448559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:22.135936 run osmo-stp_10.42.42.5(pid=29522): stderr: | [0;m[38;5;43m20221208233920617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233920617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233920618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233920618 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233920619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233920619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233920619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:22.279785 run patchelf(pid=29525): Terminating (SIGINT) 23:39:22.446332 run patchelf(pid=29525): Terminated: ok {rc=0} 23:39:22.566587 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29522): Process ended prematurely: osmo-stp_10.42.42.5(pid=29522) [trial-2351↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29522)] [trial-2351↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 23:39:22.575469 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 23:39:22.602158 run osmo-hlr_10.42.42.2(pid=29519): ERR: Terminated: ERROR {rc=237} [trial-2351↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29519)] 23:39:22.649468 run osmo-hlr_10.42.42.2(pid=29519): stdout: | (launched: 2022-12-08_23:39:19.554007) 23:39:22.698198 run osmo-hlr_10.42.42.2(pid=29519): stderr: | [0;m[1;31m20221208233919731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233919731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233919731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233919731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233919731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233919731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233919743 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233919751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233919752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233919752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:39:22.747165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29518): Terminating (SIGTERM) 23:39:22.786450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29521): Terminating (SIGTERM) 23:39:22.826207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29524): Terminating (SIGTERM) 23:39:22.865591 --- ParallelTerminationStrategy: PID 29518 died... 23:39:22.884094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29518): Terminated: ok {rc=0} 23:39:22.928529 --- ParallelTerminationStrategy: PID 29521 died... 23:39:22.946861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29521): Terminated: ok {rc=0} 23:39:22.990691 --- ParallelTerminationStrategy: PID 29524 died... 23:39:23.008932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29524): Terminated: ok {rc=0} 23:39:23.093429 bus /gobi_0: Setting Powered False 23:39:24.193248 bus /gobi_0: Setting Powered False 23:39:25.310547 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 23:39:26.559419 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:39:26.563254 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 23:39:26.596994 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 23:39:26.603595 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:39:26.653880 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 23:39:26.686595 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 23:39:26.693198 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:39:27.230906 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 23:39:27.235822 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 23:39:27.246564 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:39:27.293715 tst mo_mt_sms.py: using LAC 17550 23:39:27.411734 tst mo_mt_sms.py: using RAC 210 23:39:27.527749 tst mo_mt_sms.py: using CellId 17550 23:39:27.648443 tst mo_mt_sms.py: using BVCI 17551 23:39:27.756922 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:39:27.873229 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:39:27.987195 tst mo_mt_sms.py:9: start nitb and bts... 23:39:28.187469 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:39:28.792632 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29530): Launched 23:39:29.089702 run osmo-nitb_10.42.42.2(pid=29531): Launched 23:39:29.253665 run osmo-nitb_10.42.42.2(pid=29531): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29531)] 23:39:29.387826 run osmo-nitb_10.42.42.2(pid=29531): stdout: | (launched: 2022-12-08_23:39:29.035510) 23:39:29.522798 run osmo-nitb_10.42.42.2(pid=29531): stderr: | (launched: 2022-12-08_23:39:29.079632) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:39:29.657563 run osmo-nitb_10.42.42.2(pid=29531): stdout: | (launched: 2022-12-08_23:39:29.035510) 23:39:29.786852 run osmo-nitb_10.42.42.2(pid=29531): stderr: | (launched: 2022-12-08_23:39:29.079632) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6f22fc268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29531): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29531) [trial-2351↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29531)] 23:39:30.200863 tst osmo-nitb_10.42.42.2(pid=29531): stdout: | (launched: 2022-12-08_23:39:29.035510) 23:39:30.320520 tst osmo-nitb_10.42.42.2(pid=29531): stderr: | (launched: 2022-12-08_23:39:29.079632) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:39:30.461957 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=29531): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29531) [trial-2351↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29531)] [trial-2351↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 23:39:30.470427 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 23:39:30.477132 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29530): Terminating (SIGTERM) 23:39:30.686217 --- ParallelTerminationStrategy: PID 29530 died... 23:39:30.706833 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29530): Terminated: ok {rc=0} 23:39:30.792212 bus /sierra_3: Setting Powered False 23:39:31.892732 bus /sierra_3: Setting Powered False 23:39:33.008091 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 sms:trx-sysmocell5000 --------------------------------------------------------------------- 23:39:34.208512 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:39:34.212647 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 23:39:34.246681 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:39:34.273692 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:39:34.326482 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 23:39:34.361376 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:39:34.388585 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:39:34.934193 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 23:39:34.939240 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:34.950270 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:39:34.998849 tst mo_mt_sms.py: using LAC 17551 23:39:35.124605 tst mo_mt_sms.py: using RAC 211 23:39:35.251425 tst mo_mt_sms.py: using CellId 17551 23:39:35.376150 tst mo_mt_sms.py: using BVCI 17552 23:39:35.490662 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:35.501668 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:35.512504 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:35.523353 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:35.534175 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:35.545165 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:39:35.657633 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:39:35.774502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:39:36.264614 run create_hlr_db(pid=29535): Launched 23:39:36.393831 bus /sierra_2: Setting Powered False 23:39:37.456846 run create_hlr_db(pid=29535): Terminated: ok {rc=0} 23:39:37.880846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29537): Launched 23:39:38.177224 run osmo-hlr_10.42.42.2(pid=29538): Launched 23:39:38.289832 run osmo-stp_10.42.42.5: Starting osmo-stp 23:39:38.803876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29540): Launched 23:39:39.100535 run osmo-stp_10.42.42.5(pid=29541): Launched 23:39:39.214198 run osmo-msc_10.42.42.6: Starting osmo-msc 23:39:39.751088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29543): Launched 23:39:40.048049 run osmo-msc_10.42.42.6(pid=29544): Launched 23:39:40.214829 run osmo-stp_10.42.42.5(pid=29541): ERR: Terminated: ERROR {rc=1} [trial-2351↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29541)] 23:39:40.341192 run osmo-stp_10.42.42.5(pid=29541): stdout: | (launched: 2022-12-08_23:39:39.046077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:40.467635 run osmo-stp_10.42.42.5(pid=29541): stderr: | [0;m[38;5;43m20221208233939216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233939216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233939217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233939217 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233939217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233939217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233939218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:40.591210 run osmo-stp_10.42.42.5(pid=29541): stdout: | (launched: 2022-12-08_23:39:39.046077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:40.709914 run osmo-stp_10.42.42.5(pid=29541): stderr: | [0;m[38;5;43m20221208233939216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233939216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233939217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233939217 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233939217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233939217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233939218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:40.851541 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=29541): Process ended prematurely: osmo-stp_10.42.42.5(pid=29541) [trial-2351↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29541)] [trial-2351↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 23:39:40.859919 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 23:39:40.886168 run osmo-hlr_10.42.42.2(pid=29538): ERR: Terminated: ERROR {rc=237} [trial-2351↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29538)] 23:39:40.933799 run osmo-hlr_10.42.42.2(pid=29538): stdout: | (launched: 2022-12-08_23:39:38.123078) 23:39:40.982980 run osmo-hlr_10.42.42.2(pid=29538): stderr: | [0;m[1;31m20221208233938299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233938299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233938299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233938299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233938299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233938299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233938313 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233938322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233938322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233938323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:39:41.051514 run osmo-msc_10.42.42.6(pid=29544): ERR: Terminated: ERROR {rc=2} [trial-2351↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29544)] 23:39:41.098979 run osmo-msc_10.42.42.6(pid=29544): stdout: | (launched: 2022-12-08_23:39:39.993632) 23:39:41.147800 run osmo-msc_10.42.42.6(pid=29544): stderr: | [0;m[38;5;43m20221208233940264 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233940264 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f248f217c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233940264 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233940264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233940264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233940264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233940266 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233940267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233940267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233940267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:39:41.197163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29537): Terminating (SIGTERM) 23:39:41.236435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29540): Terminating (SIGTERM) 23:39:41.275813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29543): Terminating (SIGTERM) 23:39:41.315368 --- ParallelTerminationStrategy: PID 29537 died... 23:39:41.334129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29537): Terminated: ok {rc=0} 23:39:41.378156 --- ParallelTerminationStrategy: PID 29540 died... 23:39:41.396590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29540): Terminated: ok {rc=0} 23:39:41.440718 --- ParallelTerminationStrategy: PID 29543 died... 23:39:41.459486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29543): Terminated: ok {rc=0} 23:39:41.545483 bus /sierra_3: Setting Powered False 23:39:42.643058 bus /sierra_3: Setting Powered False 23:39:43.755015 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 23:39:44.987001 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:39:44.991422 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 23:39:45.025846 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 23:39:45.033284 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 23:39:45.068756 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 23:39:45.103053 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 23:39:45.110109 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 23:39:45.630762 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2351 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 23:39:45.636058 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 23:39:45.647353 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:39:45.697729 tst assert_extension.py: using LAC 17552 23:39:45.822335 tst assert_extension.py: using RAC 212 23:39:45.963337 tst assert_extension.py: using CellId 17552 23:39:46.083300 tst assert_extension.py: using BVCI 17553 23:39:46.236014 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 23:39:46.363210 tst assert_extension.py:10: start nitb and bts... 23:39:46.582102 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:39:47.239177 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29549): Launched 23:39:47.557666 run osmo-nitb_10.42.42.2(pid=29550): Launched 23:39:47.732146 run osmo-nitb_10.42.42.2(pid=29550): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29550)] 23:39:47.873947 run osmo-nitb_10.42.42.2(pid=29550): stdout: | (launched: 2022-12-08_23:39:47.500525) 23:39:48.017944 run osmo-nitb_10.42.42.2(pid=29550): stderr: | (launched: 2022-12-08_23:39:47.547520) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:39:48.161478 run osmo-nitb_10.42.42.2(pid=29550): stdout: | (launched: 2022-12-08_23:39:47.500525) 23:39:48.298893 run osmo-nitb_10.42.42.2(pid=29550): stderr: | (launched: 2022-12-08_23:39:47.547520) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6f22fc268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29550): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29550) [trial-2351↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29550)] 23:39:48.676482 tst osmo-nitb_10.42.42.2(pid=29550): stdout: | (launched: 2022-12-08_23:39:47.500525) 23:39:48.804268 tst osmo-nitb_10.42.42.2(pid=29550): stderr: | (launched: 2022-12-08_23:39:47.547520) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:39:48.955069 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=29550): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29550) [trial-2351↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29550)] [trial-2351↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 23:39:48.964191 tst assert_extension.py:12: Test FAILED (3.3 sec) 23:39:48.971524 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29549): Terminating (SIGTERM) 23:39:49.182341 --- ParallelTerminationStrategy: PID 29549 died... 23:39:49.204141 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29549): Terminated: ok {rc=0} 23:39:49.290893 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 23:39:50.465736 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:39:50.469464 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 23:39:50.502875 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:39:50.529242 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 23:39:50.567607 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 23:39:50.602801 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:39:50.629085 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 23:39:51.155597 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2351 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 23:39:51.160702 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:51.171415 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:39:51.222069 tst assert_extension.py: using LAC 17553 23:39:51.339007 tst assert_extension.py: using RAC 213 23:39:51.453444 tst assert_extension.py: using CellId 17553 23:39:51.570878 tst assert_extension.py: using BVCI 17554 23:39:51.679596 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:51.690184 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:51.700617 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:51.711292 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:51.721944 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:51.732536 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 23:39:51.849889 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:39:52.340146 run create_hlr_db(pid=29554): Launched 23:39:52.470070 bus /sierra_2: Setting Powered False 23:39:53.534002 run create_hlr_db(pid=29554): Terminated: ok {rc=0} 23:39:53.975896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29556): Launched 23:39:54.292929 run osmo-hlr_10.42.42.2(pid=29557): Launched 23:39:54.414709 run osmo-stp_10.42.42.5: Starting osmo-stp 23:39:55.047316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29559): Launched 23:39:55.359002 run osmo-stp_10.42.42.5(pid=29560): Launched 23:39:55.477578 run osmo-msc_10.42.42.6: Starting osmo-msc 23:39:56.039406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29562): Launched 23:39:56.350600 run osmo-msc_10.42.42.6(pid=29563): Launched 23:39:56.524108 run osmo-stp_10.42.42.5(pid=29560): ERR: Terminated: ERROR {rc=1} [trial-2351↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29560)] 23:39:56.655981 run osmo-stp_10.42.42.5(pid=29560): stdout: | (launched: 2022-12-08_23:39:55.302290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:56.788875 run osmo-stp_10.42.42.5(pid=29560): stderr: | [0;m[38;5;43m20221208233955492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233955492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233955492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233955493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233955493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233955493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233955493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:56.920696 run osmo-stp_10.42.42.5(pid=29560): stdout: | (launched: 2022-12-08_23:39:55.302290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:57.045428 run osmo-stp_10.42.42.5(pid=29560): stderr: | [0;m[38;5;43m20221208233955492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208233955492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208233955492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208233955493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208233955493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208233955493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208233955493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:57.194329 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=29560): Process ended prematurely: osmo-stp_10.42.42.5(pid=29560) [trial-2351↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29560)] [trial-2351↪ussd:trx-sysmocell5000↪assert_extension.py:17] 23:39:57.203374 tst assert_extension.py:17: Test FAILED (6.0 sec) 23:39:57.230627 run osmo-hlr_10.42.42.2(pid=29557): ERR: Terminated: ERROR {rc=237} [trial-2351↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29557)] 23:39:57.280346 run osmo-hlr_10.42.42.2(pid=29557): stdout: | (launched: 2022-12-08_23:39:54.235625) 23:39:57.331875 run osmo-hlr_10.42.42.2(pid=29557): stderr: | [0;m[1;31m20221208233954434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208233954434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208233954434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208233954434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208233954434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208233954434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208233954447 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208233954455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208233954456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208233954456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:39:57.403872 run osmo-msc_10.42.42.6(pid=29563): ERR: Terminated: ERROR {rc=2} [trial-2351↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29563)] 23:39:57.453288 run osmo-msc_10.42.42.6(pid=29563): stdout: | (launched: 2022-12-08_23:39:56.294013) 23:39:57.504283 run osmo-msc_10.42.42.6(pid=29563): stderr: | [0;m[38;5;43m20221208233956616 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208233956616 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1370604c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208233956616 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208233956616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208233956616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208233956616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208233956618 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208233956618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208233956619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208233956619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:39:57.556394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29556): Terminating (SIGTERM) 23:39:57.597730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29559): Terminating (SIGTERM) 23:39:57.639054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29562): Terminating (SIGTERM) 23:39:57.680451 --- ParallelTerminationStrategy: PID 29556 died... 23:39:57.700237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29556): Terminated: ok {rc=0} 23:39:57.745831 --- ParallelTerminationStrategy: PID 29559 died... 23:39:57.764874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29559): Terminated: ok {rc=0} 23:39:57.810098 --- ParallelTerminationStrategy: PID 29562 died... 23:39:57.829215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29562): Terminated: ok {rc=0} 23:39:57.914737 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 23:39:59.128818 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:39:59.135881 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 23:39:59.170528 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 23:39:59.197483 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 23:39:59.247897 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 23:39:59.282029 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 23:39:59.309174 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 23:39:59.862933 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 23:39:59.914906 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:39:59.926567 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:39:59.996334 tst mo_mt_call.py: using LAC 17554 23:40:00.119755 tst mo_mt_call.py: using RAC 214 23:40:00.237676 tst mo_mt_call.py: using CellId 17554 23:40:00.355481 tst mo_mt_call.py: using BVCI 17555 23:40:00.465299 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:40:00.476381 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:40:00.487160 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:40:00.498201 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:40:00.509718 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:40:00.520679 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:40:00.637367 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:40:00.752064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:40:01.291011 run create_hlr_db(pid=29568): Launched 23:40:01.456451 bus /sierra_2: Setting Powered False 23:40:02.520040 run create_hlr_db(pid=29568): Terminated: ok {rc=0} 23:40:02.956655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29573): Launched 23:40:03.256350 run osmo-hlr_10.42.42.2(pid=29574): Launched 23:40:03.370381 run osmo-stp_10.42.42.5: Starting osmo-stp 23:40:03.900468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29576): Launched 23:40:04.199110 run osmo-stp_10.42.42.5(pid=29577): Launched 23:40:04.313904 run osmo-msc_10.42.42.6: Starting osmo-msc 23:40:04.869039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29579): Launched 23:40:05.169212 run osmo-msc_10.42.42.6(pid=29580): Launched 23:40:05.337945 run osmo-stp_10.42.42.5(pid=29577): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29577)] 23:40:05.465971 run osmo-stp_10.42.42.5(pid=29577): stdout: | (launched: 2022-12-08_23:40:04.145210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:05.594368 run osmo-stp_10.42.42.5(pid=29577): stderr: | [0;m[38;5;43m20221208234004316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234004316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234004316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234004317 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234004317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234004317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234004317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:05.719815 run osmo-stp_10.42.42.5(pid=29577): stdout: | (launched: 2022-12-08_23:40:04.145210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:05.839354 run osmo-stp_10.42.42.5(pid=29577): stderr: | [0;m[38;5;43m20221208234004316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234004316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234004316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234004317 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234004317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234004317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234004317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:05.982598 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29577): Process ended prematurely: osmo-stp_10.42.42.5(pid=29577) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29577)] [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 23:40:05.991527 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:40:06.017882 run osmo-hlr_10.42.42.2(pid=29574): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29574)] 23:40:06.065282 run osmo-hlr_10.42.42.2(pid=29574): stdout: | (launched: 2022-12-08_23:40:03.202048) 23:40:06.114587 run osmo-hlr_10.42.42.2(pid=29574): stderr: | [0;m[1;31m20221208234003376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234003376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234003376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234003376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234003376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234003376 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234003389 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234003399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234003399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234003399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:40:06.182927 run osmo-msc_10.42.42.6(pid=29580): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29580)] 23:40:06.230170 run osmo-msc_10.42.42.6(pid=29580): stdout: | (launched: 2022-12-08_23:40:05.114556) 23:40:06.279144 run osmo-msc_10.42.42.6(pid=29580): stderr: | [0;m[38;5;43m20221208234005385 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234005386 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9ef98c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234005386 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234005386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234005386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234005386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234005388 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234005388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234005389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234005389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:40:06.328559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29573): Terminating (SIGTERM) 23:40:06.367896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29576): Terminating (SIGTERM) 23:40:06.407183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29579): Terminating (SIGTERM) 23:40:06.446774 --- ParallelTerminationStrategy: PID 29573 died... 23:40:06.465485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29573): Terminated: ok {rc=0} 23:40:06.509077 --- ParallelTerminationStrategy: PID 29576 died... 23:40:06.527248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29576): Terminated: ok {rc=0} 23:40:06.570649 --- ParallelTerminationStrategy: PID 29579 died... 23:40:06.588889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29579): Terminated: ok {rc=0} 23:40:06.674168 bus /sierra_3: Setting Powered False 23:40:07.772489 bus /sierra_3: Setting Powered False 23:40:08.887992 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 23:40:10.032366 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:40:10.044048 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:40:10.113393 tst mo_mt_call_osmux.py: using LAC 17555 23:40:10.232913 tst mo_mt_call_osmux.py: using RAC 215 23:40:10.351600 tst mo_mt_call_osmux.py: using CellId 17555 23:40:10.469397 tst mo_mt_call_osmux.py: using BVCI 17556 23:40:10.577758 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:40:10.588819 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:40:10.599717 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:40:10.610869 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:40:10.622070 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:40:10.633130 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:40:10.745644 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:40:10.864301 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:40:11.359873 run create_hlr_db(pid=29582): Launched 23:40:11.490088 bus /sierra_2: Setting Powered False 23:40:12.553582 run create_hlr_db(pid=29582): Terminated: ok {rc=0} 23:40:12.981247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29584): Launched 23:40:13.281665 run osmo-hlr_10.42.42.2(pid=29585): Launched 23:40:13.397098 run osmo-stp_10.42.42.5: Starting osmo-stp 23:40:13.915564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29587): Launched 23:40:14.216627 run osmo-stp_10.42.42.5(pid=29588): Launched 23:40:14.331025 run osmo-msc_10.42.42.6: Starting osmo-msc 23:40:14.873878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29590): Launched 23:40:15.173799 run osmo-msc_10.42.42.6(pid=29591): Launched 23:40:15.342701 run osmo-stp_10.42.42.5(pid=29588): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29588)] 23:40:15.470512 run osmo-stp_10.42.42.5(pid=29588): stdout: | (launched: 2022-12-08_23:40:14.161591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:15.598484 run osmo-stp_10.42.42.5(pid=29588): stderr: | [0;m[38;5;43m20221208234014334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234014334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234014334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234014335 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234014335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234014335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234014335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:15.724308 run osmo-stp_10.42.42.5(pid=29588): stdout: | (launched: 2022-12-08_23:40:14.161591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:15.857827 run osmo-stp_10.42.42.5(pid=29588): stderr: | [0;m[38;5;43m20221208234014334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234014334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234014334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234014335 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234014335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234014335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234014335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:16.022050 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29588): Process ended prematurely: osmo-stp_10.42.42.5(pid=29588) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29588)] [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 23:40:16.032330 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:40:16.062485 run osmo-hlr_10.42.42.2(pid=29585): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29585)] 23:40:16.115266 run osmo-hlr_10.42.42.2(pid=29585): stdout: | (launched: 2022-12-08_23:40:13.227185) 23:40:16.173351 run osmo-hlr_10.42.42.2(pid=29585): stderr: | [0;m[1;31m20221208234013405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234013405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234013405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234013405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234013405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234013405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234013417 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234013427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234013427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234013427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:40:16.248274 run osmo-msc_10.42.42.6(pid=29591): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29591)] 23:40:16.299200 run osmo-msc_10.42.42.6(pid=29591): stdout: | (launched: 2022-12-08_23:40:15.119195) 23:40:16.352343 run osmo-msc_10.42.42.6(pid=29591): stderr: | [0;m[38;5;43m20221208234015392 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234015392 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feb35bacc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234015392 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234015392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234015392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234015392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234015394 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234015395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234015395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234015395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:40:16.405755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29584): Terminating (SIGTERM) 23:40:16.450014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29587): Terminating (SIGTERM) 23:40:16.494602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29590): Terminating (SIGTERM) 23:40:16.540388 --- ParallelTerminationStrategy: PID 29584 died... 23:40:16.561335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29584): Terminated: ok {rc=0} 23:40:16.610476 --- ParallelTerminationStrategy: PID 29587 died... 23:40:16.631295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29587): Terminated: ok {rc=0} 23:40:16.679521 --- ParallelTerminationStrategy: PID 29590 died... 23:40:16.699448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29590): Terminated: ok {rc=0} 23:40:16.787189 bus /sierra_3: Setting Powered False 23:40:17.883744 bus /sierra_3: Setting Powered False 23:40:18.994350 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 23:40:20.244612 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:40:20.252315 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 23:40:20.287317 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 23:40:20.313347 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 23:40:20.363306 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 23:40:20.397800 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 23:40:20.425534 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 23:40:20.979025 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 23:40:21.031007 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:21.042260 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:40:21.109392 tst mo_mt_call.py: using LAC 17556 23:40:21.225655 tst mo_mt_call.py: using RAC 216 23:40:21.342190 tst mo_mt_call.py: using CellId 17556 23:40:21.458714 tst mo_mt_call.py: using BVCI 17557 23:40:21.567490 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:21.578633 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:21.589508 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:21.600895 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:21.612623 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:21.624164 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:40:21.742696 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:40:21.858205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:40:22.323086 run create_hlr_db(pid=29596): Launched 23:40:22.438166 bus /sierra_2: Setting Powered False 23:40:23.499167 run create_hlr_db(pid=29596): Terminated: ok {rc=0} 23:40:23.935991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29598): Launched 23:40:24.255947 run osmo-hlr_10.42.42.2(pid=29599): Launched 23:40:24.378586 run osmo-stp_10.42.42.5: Starting osmo-stp 23:40:24.908545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29601): Launched 23:40:25.209263 run osmo-stp_10.42.42.5(pid=29602): Launched 23:40:25.324225 run osmo-msc_10.42.42.6: Starting osmo-msc 23:40:25.871710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29604): Launched 23:40:26.172561 run osmo-msc_10.42.42.6(pid=29605): Launched 23:40:26.341818 run osmo-stp_10.42.42.5(pid=29602): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29602)] 23:40:26.469757 run osmo-stp_10.42.42.5(pid=29602): stdout: | (launched: 2022-12-08_23:40:25.154426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:26.597647 run osmo-stp_10.42.42.5(pid=29602): stderr: | [0;m[38;5;43m20221208234025325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234025325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234025325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234025326 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234025326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234025326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234025326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:26.723314 run osmo-stp_10.42.42.5(pid=29602): stdout: | (launched: 2022-12-08_23:40:25.154426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:26.843239 run osmo-stp_10.42.42.5(pid=29602): stderr: | [0;m[38;5;43m20221208234025325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234025325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234025325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234025326 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234025326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234025326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234025326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:26.986256 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29602): Process ended prematurely: osmo-stp_10.42.42.5(pid=29602) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29602)] [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 23:40:26.995159 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:40:27.021717 run osmo-hlr_10.42.42.2(pid=29599): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29599)] 23:40:27.068797 run osmo-hlr_10.42.42.2(pid=29599): stdout: | (launched: 2022-12-08_23:40:24.198075) 23:40:27.117746 run osmo-hlr_10.42.42.2(pid=29599): stderr: | [0;m[1;31m20221208234024396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234024396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234024396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234024396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234024396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234024396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234024407 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234024415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234024415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234024415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:40:27.185718 run osmo-msc_10.42.42.6(pid=29605): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29605)] 23:40:27.232672 run osmo-msc_10.42.42.6(pid=29605): stdout: | (launched: 2022-12-08_23:40:26.117797) 23:40:27.281507 run osmo-msc_10.42.42.6(pid=29605): stderr: | [0;m[38;5;43m20221208234026389 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234026390 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fca13f27c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234026390 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234026390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234026390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234026390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234026392 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234026393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234026393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234026393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:40:27.330681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29598): Terminating (SIGTERM) 23:40:27.369734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29601): Terminating (SIGTERM) 23:40:27.408686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29604): Terminating (SIGTERM) 23:40:27.448033 --- ParallelTerminationStrategy: PID 29598 died... 23:40:27.466671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29598): Terminated: ok {rc=0} 23:40:27.510131 --- ParallelTerminationStrategy: PID 29601 died... 23:40:27.528143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29601): Terminated: ok {rc=0} 23:40:27.571351 --- ParallelTerminationStrategy: PID 29604 died... 23:40:27.589534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29604): Terminated: ok {rc=0} 23:40:27.671763 bus /sierra_3: Setting Powered False 23:40:28.767066 bus /sierra_3: Setting Powered False 23:40:29.883344 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 23:40:31.033597 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:31.047387 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:40:31.119762 tst mo_mt_call_osmux.py: using LAC 17557 23:40:31.248264 tst mo_mt_call_osmux.py: using RAC 217 23:40:31.377431 tst mo_mt_call_osmux.py: using CellId 17557 23:40:31.499063 tst mo_mt_call_osmux.py: using BVCI 17558 23:40:31.622221 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:31.634471 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:31.647325 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:31.659255 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:31.671728 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:31.683848 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:40:31.802278 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:40:31.928569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:40:32.424603 run create_hlr_db(pid=29607): Launched 23:40:32.540118 bus /sierra_2: Setting Powered False 23:40:33.600452 run create_hlr_db(pid=29607): Terminated: ok {rc=0} 23:40:34.036729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29609): Launched 23:40:34.356226 run osmo-hlr_10.42.42.2(pid=29610): Launched 23:40:34.478392 run osmo-stp_10.42.42.5: Starting osmo-stp 23:40:35.032169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29612): Launched 23:40:35.352092 run osmo-stp_10.42.42.5(pid=29613): Launched 23:40:35.474600 run osmo-msc_10.42.42.6: Starting osmo-msc 23:40:36.053952 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29615): Launched 23:40:36.374837 run osmo-msc_10.42.42.6(pid=29616): Launched 23:40:36.553234 run osmo-stp_10.42.42.5(pid=29613): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29613)] 23:40:36.688179 run osmo-stp_10.42.42.5(pid=29613): stdout: | (launched: 2022-12-08_23:40:35.294237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:36.823600 run osmo-stp_10.42.42.5(pid=29613): stderr: | [0;m[38;5;43m20221208234035486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234035486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234035486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234035487 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234035487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234035487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234035487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:36.958617 run osmo-stp_10.42.42.5(pid=29613): stdout: | (launched: 2022-12-08_23:40:35.294237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:37.086002 run osmo-stp_10.42.42.5(pid=29613): stderr: | [0;m[38;5;43m20221208234035486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234035486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234035486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234035487 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234035487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234035487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234035487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:37.238448 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29613): Process ended prematurely: osmo-stp_10.42.42.5(pid=29613) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29613)] [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 23:40:37.248195 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 23:40:37.275928 run osmo-hlr_10.42.42.2(pid=29610): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29610)] 23:40:37.325412 run osmo-hlr_10.42.42.2(pid=29610): stdout: | (launched: 2022-12-08_23:40:34.298414) 23:40:37.377144 run osmo-hlr_10.42.42.2(pid=29610): stderr: | [0;m[1;31m20221208234034498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234034498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234034498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234034498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234034498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234034498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234034510 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234034518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234034518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234034518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:40:37.448525 run osmo-msc_10.42.42.6(pid=29616): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29616)] 23:40:37.497880 run osmo-msc_10.42.42.6(pid=29616): stdout: | (launched: 2022-12-08_23:40:36.316428) 23:40:37.548734 run osmo-msc_10.42.42.6(pid=29616): stderr: | [0;m[38;5;43m20221208234036639 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234036639 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd5afd54c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234036639 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234036639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234036639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234036640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234036642 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234036643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234036644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234036644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:40:37.599931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29609): Terminating (SIGTERM) 23:40:37.640992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29612): Terminating (SIGTERM) 23:40:37.682391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29615): Terminating (SIGTERM) 23:40:37.723945 --- ParallelTerminationStrategy: PID 29609 died... 23:40:37.743604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29609): Terminated: ok {rc=0} 23:40:37.789312 --- ParallelTerminationStrategy: PID 29612 died... 23:40:37.808568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29612): Terminated: ok {rc=0} 23:40:37.854651 --- ParallelTerminationStrategy: PID 29615 died... 23:40:37.874140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29615): Terminated: ok {rc=0} 23:40:37.960637 bus /sierra_3: Setting Powered False 23:40:39.058273 bus /sierra_3: Setting Powered False 23:40:40.172533 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 23:40:41.425956 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:40:41.433460 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 23:40:41.468412 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 23:40:41.495518 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 23:40:41.547851 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 23:40:41.582286 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 23:40:41.609509 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 23:40:42.161657 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 23:40:42.212855 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:42.224618 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:40:42.295868 tst mo_mt_call.py: using LAC 17558 23:40:42.423127 tst mo_mt_call.py: using RAC 218 23:40:42.548722 tst mo_mt_call.py: using CellId 17558 23:40:42.673742 tst mo_mt_call.py: using BVCI 17559 23:40:42.791180 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:42.802799 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:42.814115 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:42.825667 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:42.837287 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:42.848834 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:40:42.963598 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:40:43.082775 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:40:43.578891 run create_hlr_db(pid=29621): Launched 23:40:43.708081 bus /sierra_2: Setting Powered False 23:40:44.772466 run create_hlr_db(pid=29621): Terminated: ok {rc=0} 23:40:45.202070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29623): Launched 23:40:45.503510 run osmo-hlr_10.42.42.2(pid=29624): Launched 23:40:45.618763 run osmo-stp_10.42.42.5: Starting osmo-stp 23:40:46.185757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29626): Launched 23:40:46.512106 run osmo-stp_10.42.42.5(pid=29627): Launched 23:40:46.812689 run osmo-msc_10.42.42.6: Starting osmo-msc 23:40:47.416030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29629): Launched 23:40:47.717634 run osmo-msc_10.42.42.6(pid=29630): Launched 23:40:47.886484 run osmo-stp_10.42.42.5(pid=29627): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29627)] 23:40:48.014774 run osmo-stp_10.42.42.5(pid=29627): stdout: | (launched: 2022-12-08_23:40:46.442500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:48.142624 run osmo-stp_10.42.42.5(pid=29627): stderr: | [0;m[38;5;43m20221208234046708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234046708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234046708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234046709 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234046711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234046711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234046711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:48.268725 run osmo-stp_10.42.42.5(pid=29627): stdout: | (launched: 2022-12-08_23:40:46.442500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:48.388277 run osmo-stp_10.42.42.5(pid=29627): stderr: | [0;m[38;5;43m20221208234046708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234046708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234046708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234046709 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234046711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234046711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234046711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:48.531884 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29627): Process ended prematurely: osmo-stp_10.42.42.5(pid=29627) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29627)] [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 23:40:48.540860 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 23:40:48.567148 run osmo-hlr_10.42.42.2(pid=29624): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29624)] 23:40:48.614617 run osmo-hlr_10.42.42.2(pid=29624): stdout: | (launched: 2022-12-08_23:40:45.448804) 23:40:48.663706 run osmo-hlr_10.42.42.2(pid=29624): stderr: | [0;m[1;31m20221208234045625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234045625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234045625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234045625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234045625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234045626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234045636 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234045646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234045647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234045647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:40:48.731711 run osmo-msc_10.42.42.6(pid=29630): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29630)] 23:40:48.778821 run osmo-msc_10.42.42.6(pid=29630): stdout: | (launched: 2022-12-08_23:40:47.663056) 23:40:48.827486 run osmo-msc_10.42.42.6(pid=29630): stderr: | [0;m[38;5;43m20221208234047933 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234047933 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc348558c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234047933 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234047933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234047934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234047934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234047936 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234047937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234047937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234047937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:40:48.876666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29623): Terminating (SIGTERM) 23:40:48.916004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29626): Terminating (SIGTERM) 23:40:48.955409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29629): Terminating (SIGTERM) 23:40:48.995075 --- ParallelTerminationStrategy: PID 29623 died... 23:40:49.014088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29623): Terminated: ok {rc=0} 23:40:49.057984 --- ParallelTerminationStrategy: PID 29626 died... 23:40:49.076205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29626): Terminated: ok {rc=0} 23:40:49.119949 --- ParallelTerminationStrategy: PID 29629 died... 23:40:49.138269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29629): Terminated: ok {rc=0} 23:40:49.223004 bus /sierra_3: Setting Powered False 23:40:50.321568 bus /sierra_3: Setting Powered False 23:40:51.435900 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:40:52.585119 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:52.597421 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:40:52.669706 tst mo_mt_call_osmux.py: using LAC 17559 23:40:52.799651 tst mo_mt_call_osmux.py: using RAC 219 23:40:52.918066 tst mo_mt_call_osmux.py: using CellId 17559 23:40:53.037247 tst mo_mt_call_osmux.py: using BVCI 17560 23:40:53.146700 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:53.158007 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:53.169091 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:53.180429 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:53.191623 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:53.202775 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:40:53.320908 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:40:53.437580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:40:53.904507 run create_hlr_db(pid=29632): Launched 23:40:54.019539 bus /sierra_2: Setting Powered False 23:40:55.080199 run create_hlr_db(pid=29632): Terminated: ok {rc=0} 23:40:55.519170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29634): Launched 23:40:55.839981 run osmo-hlr_10.42.42.2(pid=29635): Launched 23:40:55.962058 run osmo-stp_10.42.42.5: Starting osmo-stp 23:40:56.517997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29637): Launched 23:40:56.837433 run osmo-stp_10.42.42.5(pid=29638): Launched 23:40:56.959014 run osmo-msc_10.42.42.6: Starting osmo-msc 23:40:57.537171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29640): Launched 23:40:57.857363 run osmo-msc_10.42.42.6(pid=29641): Launched 23:40:58.036002 run osmo-stp_10.42.42.5(pid=29638): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29638)] 23:40:58.171474 run osmo-stp_10.42.42.5(pid=29638): stdout: | (launched: 2022-12-08_23:40:56.779731) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:58.307610 run osmo-stp_10.42.42.5(pid=29638): stderr: | [0;m[38;5;43m20221208234056971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234056971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234056971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234056971 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234056972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234056972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234056972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:58.443406 run osmo-stp_10.42.42.5(pid=29638): stdout: | (launched: 2022-12-08_23:40:56.779731) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:58.571324 run osmo-stp_10.42.42.5(pid=29638): stderr: | [0;m[38;5;43m20221208234056971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234056971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234056971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234056971 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234056972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234056972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234056972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:58.724331 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29638): Process ended prematurely: osmo-stp_10.42.42.5(pid=29638) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29638)] [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:40:58.734032 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:40:58.761777 run osmo-hlr_10.42.42.2(pid=29635): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29635)] 23:40:58.812024 run osmo-hlr_10.42.42.2(pid=29635): stdout: | (launched: 2022-12-08_23:40:55.782094) 23:40:58.863822 run osmo-hlr_10.42.42.2(pid=29635): stderr: | [0;m[1;31m20221208234055979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234055979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234055979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234055979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234055980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234055980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234055990 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234055998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234055999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234055999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:40:58.935689 run osmo-msc_10.42.42.6(pid=29641): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29641)] 23:40:58.985148 run osmo-msc_10.42.42.6(pid=29641): stdout: | (launched: 2022-12-08_23:40:57.799285) 23:40:59.036206 run osmo-msc_10.42.42.6(pid=29641): stderr: | [0;m[38;5;43m20221208234058121 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234058121 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcd3d62ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234058121 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234058121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234058121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234058122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234058123 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234058124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234058124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234058124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:40:59.087939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29634): Terminating (SIGTERM) 23:40:59.129405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29637): Terminating (SIGTERM) 23:40:59.171138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29640): Terminating (SIGTERM) 23:40:59.213178 --- ParallelTerminationStrategy: PID 29634 died... 23:40:59.232828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29634): Terminated: ok {rc=0} 23:40:59.278961 --- ParallelTerminationStrategy: PID 29637 died... 23:40:59.298174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29637): Terminated: ok {rc=0} 23:40:59.344350 --- ParallelTerminationStrategy: PID 29640 died... 23:40:59.363592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29640): Terminated: ok {rc=0} 23:40:59.451027 bus /sierra_3: Setting Powered False 23:41:00.550201 bus /sierra_3: Setting Powered False 23:41:01.671588 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 23:41:02.926766 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:41:02.933963 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 23:41:02.967983 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 23:41:02.994385 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 23:41:03.046837 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 23:41:03.081106 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 23:41:03.107617 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 23:41:03.658994 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 23:41:03.707456 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:03.718480 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:41:03.787294 tst mo_mt_call.py: using LAC 17560 23:41:03.904701 tst mo_mt_call.py: using RAC 220 23:41:04.022003 tst mo_mt_call.py: using CellId 17560 23:41:04.141016 tst mo_mt_call.py: using BVCI 17561 23:41:04.251587 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:04.262708 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:04.273549 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:04.284712 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:04.295907 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:04.306973 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:41:04.425131 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:41:04.539011 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:41:05.005982 run create_hlr_db(pid=29647): Launched 23:41:05.120073 bus /sierra_2: Setting Powered False 23:41:06.180883 run create_hlr_db(pid=29647): Terminated: ok {rc=0} 23:41:06.619440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29649): Launched 23:41:06.940597 run osmo-hlr_10.42.42.2(pid=29650): Launched 23:41:07.063068 run osmo-stp_10.42.42.5: Starting osmo-stp 23:41:07.618334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29652): Launched 23:41:07.938389 run osmo-stp_10.42.42.5(pid=29653): Launched 23:41:08.060046 run osmo-msc_10.42.42.6: Starting osmo-msc 23:41:08.640917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29655): Launched 23:41:08.961634 run osmo-msc_10.42.42.6(pid=29656): Launched 23:41:09.139379 run osmo-stp_10.42.42.5(pid=29653): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29653)] 23:41:09.274231 run osmo-stp_10.42.42.5(pid=29653): stdout: | (launched: 2022-12-08_23:41:07.880471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:09.410198 run osmo-stp_10.42.42.5(pid=29653): stderr: | [0;m[38;5;43m20221208234108071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234108071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234108071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234108072 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234108074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234108075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234108075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:09.545223 run osmo-stp_10.42.42.5(pid=29653): stdout: | (launched: 2022-12-08_23:41:07.880471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:09.672776 run osmo-stp_10.42.42.5(pid=29653): stderr: | [0;m[38;5;43m20221208234108071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234108071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234108071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234108072 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234108074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234108075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234108075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:09.825859 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29653): Process ended prematurely: osmo-stp_10.42.42.5(pid=29653) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29653)] [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 23:41:09.835536 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 23:41:09.863222 run osmo-hlr_10.42.42.2(pid=29650): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29650)] 23:41:09.912907 run osmo-hlr_10.42.42.2(pid=29650): stdout: | (launched: 2022-12-08_23:41:06.882668) 23:41:09.964535 run osmo-hlr_10.42.42.2(pid=29650): stderr: | [0;m[1;31m20221208234107081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234107082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234107082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234107082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234107082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234107082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234107094 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234107102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234107102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234107102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:41:10.036245 run osmo-msc_10.42.42.6(pid=29656): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29656)] 23:41:10.085713 run osmo-msc_10.42.42.6(pid=29656): stdout: | (launched: 2022-12-08_23:41:08.903690) 23:41:10.137271 run osmo-msc_10.42.42.6(pid=29656): stderr: | [0;m[38;5;43m20221208234109223 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234109223 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1ec583dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234109223 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234109223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234109223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234109224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234109225 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234109226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234109226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234109226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:41:10.188547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29649): Terminating (SIGTERM) 23:41:10.230094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29652): Terminating (SIGTERM) 23:41:10.271615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29655): Terminating (SIGTERM) 23:41:10.313801 --- ParallelTerminationStrategy: PID 29649 died... 23:41:10.333739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29649): Terminated: ok {rc=0} 23:41:10.380100 --- ParallelTerminationStrategy: PID 29652 died... 23:41:10.399468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29652): Terminated: ok {rc=0} 23:41:10.445688 --- ParallelTerminationStrategy: PID 29655 died... 23:41:10.465175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29655): Terminated: ok {rc=0} 23:41:10.552844 bus /sierra_3: Setting Powered False 23:41:11.651480 bus /sierra_3: Setting Powered False 23:41:12.767326 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 23:41:13.914997 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:13.927337 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:41:14.002470 tst mo_mt_call_osmux.py: using LAC 17561 23:41:14.130899 tst mo_mt_call_osmux.py: using RAC 221 23:41:14.255326 tst mo_mt_call_osmux.py: using CellId 17561 23:41:14.379007 tst mo_mt_call_osmux.py: using BVCI 17562 23:41:14.490543 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:14.501660 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:14.512569 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:14.523755 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:14.534938 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:41:14.546470 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:41:14.665400 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:41:14.782844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:41:15.279458 run create_hlr_db(pid=29658): Launched 23:41:15.410689 bus /sierra_2: Setting Powered False 23:41:16.474227 run create_hlr_db(pid=29658): Terminated: ok {rc=0} 23:41:16.937503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29660): Launched 23:41:17.269123 run osmo-hlr_10.42.42.2(pid=29661): Launched 23:41:17.392616 run osmo-stp_10.42.42.5: Starting osmo-stp 23:41:17.945676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29663): Launched 23:41:18.265289 run osmo-stp_10.42.42.5(pid=29664): Launched 23:41:18.386777 run osmo-msc_10.42.42.6: Starting osmo-msc 23:41:18.965125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29666): Launched 23:41:19.284172 run osmo-msc_10.42.42.6(pid=29667): Launched 23:41:19.463478 run osmo-stp_10.42.42.5(pid=29664): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29664)] 23:41:19.599188 run osmo-stp_10.42.42.5(pid=29664): stdout: | (launched: 2022-12-08_23:41:18.207395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:19.735284 run osmo-stp_10.42.42.5(pid=29664): stderr: | [0;m[38;5;43m20221208234118397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234118397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234118397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234118398 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234118400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234118400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234118400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:19.870242 run osmo-stp_10.42.42.5(pid=29664): stdout: | (launched: 2022-12-08_23:41:18.207395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:19.997741 run osmo-stp_10.42.42.5(pid=29664): stderr: | [0;m[38;5;43m20221208234118397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234118397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234118397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234118398 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234118400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234118400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234118400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:20.149918 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29664): Process ended prematurely: osmo-stp_10.42.42.5(pid=29664) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29664)] [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 23:41:20.159613 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 23:41:20.187287 run osmo-hlr_10.42.42.2(pid=29661): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29661)] 23:41:20.236652 run osmo-hlr_10.42.42.2(pid=29661): stdout: | (launched: 2022-12-08_23:41:17.211191) 23:41:20.287615 run osmo-hlr_10.42.42.2(pid=29661): stderr: | [0;m[1;31m20221208234117409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234117409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234117409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234117409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234117409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234117409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234117421 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234117430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234117430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234117430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:41:20.358398 run osmo-msc_10.42.42.6(pid=29667): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29667)] 23:41:20.407577 run osmo-msc_10.42.42.6(pid=29667): stdout: | (launched: 2022-12-08_23:41:19.226412) 23:41:20.458376 run osmo-msc_10.42.42.6(pid=29667): stderr: | [0;m[38;5;43m20221208234119548 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234119548 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f11c2c05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234119548 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234119548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234119548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234119549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234119550 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234119551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234119551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234119551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:41:20.509402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29660): Terminating (SIGTERM) 23:41:20.550088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29663): Terminating (SIGTERM) 23:41:20.591168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29666): Terminating (SIGTERM) 23:41:20.632329 --- ParallelTerminationStrategy: PID 29660 died... 23:41:20.651382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29660): Terminated: ok {rc=0} 23:41:20.696445 --- ParallelTerminationStrategy: PID 29663 died... 23:41:20.715515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29663): Terminated: ok {rc=0} 23:41:20.760349 --- ParallelTerminationStrategy: PID 29666 died... 23:41:20.779319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29666): Terminated: ok {rc=0} 23:41:20.866223 bus /sierra_3: Setting Powered False 23:41:21.963526 bus /sierra_3: Setting Powered False 23:41:23.078846 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:41:24.331593 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:41:24.338439 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:41:24.372621 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:41:24.400050 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:41:24.452023 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:41:24.486425 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:41:24.512673 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:41:25.066500 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:41:25.118396 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:25.130041 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:41:25.201694 tst mo_mt_call.py: using LAC 17562 23:41:25.326620 tst mo_mt_call.py: using RAC 222 23:41:25.451539 tst mo_mt_call.py: using CellId 17562 23:41:25.577561 tst mo_mt_call.py: using BVCI 17563 23:41:25.695813 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:25.707372 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:25.718689 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:25.730126 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:25.741574 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:25.752842 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:41:25.868157 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:41:25.987200 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:41:26.484423 run create_hlr_db(pid=29672): Launched 23:41:26.614427 bus /sierra_2: Setting Powered False 23:41:27.678432 run create_hlr_db(pid=29672): Terminated: ok {rc=0} 23:41:28.107163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29674): Launched 23:41:28.409222 run osmo-hlr_10.42.42.2(pid=29675): Launched 23:41:28.524575 run osmo-stp_10.42.42.5: Starting osmo-stp 23:41:29.067219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29677): Launched 23:41:29.388336 run osmo-stp_10.42.42.5(pid=29678): Launched 23:41:29.511100 run osmo-msc_10.42.42.6: Starting osmo-msc 23:41:30.090612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29680): Launched 23:41:30.411810 run osmo-msc_10.42.42.6(pid=29681): Launched 23:41:30.589312 run osmo-stp_10.42.42.5(pid=29678): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29678)] 23:41:30.723672 run osmo-stp_10.42.42.5(pid=29678): stdout: | (launched: 2022-12-08_23:41:29.330170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:30.868592 run osmo-stp_10.42.42.5(pid=29678): stderr: | [0;m[38;5;43m20221208234129525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234129525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234129526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234129526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234129526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234129527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234129527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:31.075183 run osmo-stp_10.42.42.5(pid=29678): stdout: | (launched: 2022-12-08_23:41:29.330170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:31.199286 run osmo-stp_10.42.42.5(pid=29678): stderr: | [0;m[38;5;43m20221208234129525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234129525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234129526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234129526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234129526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234129527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234129527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:31.349118 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29678): Process ended prematurely: osmo-stp_10.42.42.5(pid=29678) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29678)] [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:41:31.358927 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 23:41:31.388433 run osmo-hlr_10.42.42.2(pid=29675): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29675)] 23:41:31.438109 run osmo-hlr_10.42.42.2(pid=29675): stdout: | (launched: 2022-12-08_23:41:28.354673) 23:41:31.490060 run osmo-hlr_10.42.42.2(pid=29675): stderr: | [0;m[1;31m20221208234128531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234128531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234128531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234128531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234128531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234128531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234128584 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234128595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234128595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234128595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:41:31.561815 run osmo-msc_10.42.42.6(pid=29681): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29681)] 23:41:31.611554 run osmo-msc_10.42.42.6(pid=29681): stdout: | (launched: 2022-12-08_23:41:30.353394) 23:41:31.664558 run osmo-msc_10.42.42.6(pid=29681): stderr: | [0;m[38;5;43m20221208234130679 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234130679 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa359a54c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234130679 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234130679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234130679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234130679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234130681 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234130683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234130683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234130683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:41:31.717202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29674): Terminating (SIGTERM) 23:41:31.759549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29677): Terminating (SIGTERM) 23:41:31.803887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29680): Terminating (SIGTERM) 23:41:31.847884 --- ParallelTerminationStrategy: PID 29674 died... 23:41:31.868264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29674): Terminated: ok {rc=0} 23:41:31.916826 --- ParallelTerminationStrategy: PID 29677 died... 23:41:31.936645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29677): Terminated: ok {rc=0} 23:41:31.983382 --- ParallelTerminationStrategy: PID 29680 died... 23:41:32.002792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29680): Terminated: ok {rc=0} 23:41:32.091021 bus /sierra_3: Setting Powered False 23:41:33.186255 bus /sierra_3: Setting Powered False 23:41:34.301515 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:41:35.446518 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:35.458489 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:41:35.530177 tst mo_mt_call_osmux.py: using LAC 17563 23:41:35.660421 tst mo_mt_call_osmux.py: using RAC 223 23:41:35.787968 tst mo_mt_call_osmux.py: using CellId 17563 23:41:35.913636 tst mo_mt_call_osmux.py: using BVCI 17564 23:41:36.031215 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:36.043055 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:36.054516 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:36.066174 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:36.077735 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:36.089205 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:41:36.205298 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:41:36.323408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:41:36.819714 run create_hlr_db(pid=29683): Launched 23:41:36.949656 bus /sierra_2: Setting Powered False 23:41:38.013203 run create_hlr_db(pid=29683): Terminated: ok {rc=0} 23:41:38.440767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29685): Launched 23:41:38.742068 run osmo-hlr_10.42.42.2(pid=29686): Launched 23:41:38.856117 run osmo-stp_10.42.42.5: Starting osmo-stp 23:41:39.388373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29688): Launched 23:41:39.688806 run osmo-stp_10.42.42.5(pid=29689): Launched 23:41:39.812630 run osmo-msc_10.42.42.6: Starting osmo-msc 23:41:40.371052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29691): Launched 23:41:40.673111 run osmo-msc_10.42.42.6(pid=29692): Launched 23:41:40.841734 run osmo-stp_10.42.42.5(pid=29689): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29689)] 23:41:40.970143 run osmo-stp_10.42.42.5(pid=29689): stdout: | (launched: 2022-12-08_23:41:39.634465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:41.098872 run osmo-stp_10.42.42.5(pid=29689): stderr: | [0;m[38;5;43m20221208234139820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234139820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234139821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234139821 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234139823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234139824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234139824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:41.225157 run osmo-stp_10.42.42.5(pid=29689): stdout: | (launched: 2022-12-08_23:41:39.634465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:41.345109 run osmo-stp_10.42.42.5(pid=29689): stderr: | [0;m[38;5;43m20221208234139820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234139820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234139821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234139821 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234139823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234139824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234139824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:41.488415 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29689): Process ended prematurely: osmo-stp_10.42.42.5(pid=29689) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29689)] [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:41:41.497556 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:41:41.524149 run osmo-hlr_10.42.42.2(pid=29686): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29686)] 23:41:41.571427 run osmo-hlr_10.42.42.2(pid=29686): stdout: | (launched: 2022-12-08_23:41:38.687496) 23:41:41.620462 run osmo-hlr_10.42.42.2(pid=29686): stderr: | [0;m[1;31m20221208234138864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234138864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234138864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234138864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234138864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234138864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234138877 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234138886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234138886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234138886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:41:41.688414 run osmo-msc_10.42.42.6(pid=29692): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29692)] 23:41:41.735365 run osmo-msc_10.42.42.6(pid=29692): stdout: | (launched: 2022-12-08_23:41:40.618254) 23:41:41.783936 run osmo-msc_10.42.42.6(pid=29692): stderr: | [0;m[38;5;43m20221208234140889 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234140889 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbd11e23c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234140889 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234140889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234140889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234140890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234140892 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234140893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234140893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234140893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:41:41.833154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29685): Terminating (SIGTERM) 23:41:41.872070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29688): Terminating (SIGTERM) 23:41:41.911118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29691): Terminating (SIGTERM) 23:41:41.950539 --- ParallelTerminationStrategy: PID 29685 died... 23:41:41.969455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29685): Terminated: ok {rc=0} 23:41:42.013249 --- ParallelTerminationStrategy: PID 29688 died... 23:41:42.031617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29688): Terminated: ok {rc=0} 23:41:42.075289 --- ParallelTerminationStrategy: PID 29691 died... 23:41:42.093754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29691): Terminated: ok {rc=0} 23:41:42.178654 bus /sierra_3: Setting Powered False 23:41:43.276201 bus /sierra_3: Setting Powered False 23:41:44.389222 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:41:45.647417 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:41:45.654412 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:41:45.688535 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:41:45.715400 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:41:45.767788 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:41:45.801715 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:41:45.828463 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:41:46.412265 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:41:46.465722 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:46.477776 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:41:46.547741 tst mo_mt_call.py: using LAC 17564 23:41:46.678328 tst mo_mt_call.py: using RAC 224 23:41:46.799946 tst mo_mt_call.py: using CellId 17564 23:41:46.959056 tst mo_mt_call.py: using BVCI 17565 23:41:47.106456 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:47.122603 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:47.135740 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:47.148016 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:47.160214 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:47.172504 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:41:47.292900 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:41:47.413866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:41:47.909485 run create_hlr_db(pid=29697): Launched 23:41:48.039523 bus /sierra_2: Setting Powered False 23:41:49.102251 run create_hlr_db(pid=29697): Terminated: ok {rc=0} 23:41:49.546415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29699): Launched 23:41:49.865981 run osmo-hlr_10.42.42.2(pid=29700): Launched 23:41:49.987853 run osmo-stp_10.42.42.5: Starting osmo-stp 23:41:50.537945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29702): Launched 23:41:50.858106 run osmo-stp_10.42.42.5(pid=29703): Launched 23:41:50.979332 run osmo-msc_10.42.42.6: Starting osmo-msc 23:41:51.557756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29705): Launched 23:41:51.876717 run osmo-msc_10.42.42.6(pid=29706): Launched 23:41:52.055375 run osmo-stp_10.42.42.5(pid=29703): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29703)] 23:41:52.190809 run osmo-stp_10.42.42.5(pid=29703): stdout: | (launched: 2022-12-08_23:41:50.798993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:52.326671 run osmo-stp_10.42.42.5(pid=29703): stderr: | [0;m[38;5;43m20221208234150993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234150993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234150993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234150994 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234150994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234150994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234150994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:52.463002 run osmo-stp_10.42.42.5(pid=29703): stdout: | (launched: 2022-12-08_23:41:50.798993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:52.590542 run osmo-stp_10.42.42.5(pid=29703): stderr: | [0;m[38;5;43m20221208234150993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234150993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234150993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234150994 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234150994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234150994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234150994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:52.743128 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29703): Process ended prematurely: osmo-stp_10.42.42.5(pid=29703) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29703)] [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:41:52.752590 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 23:41:52.779821 run osmo-hlr_10.42.42.2(pid=29700): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29700)] 23:41:52.829053 run osmo-hlr_10.42.42.2(pid=29700): stdout: | (launched: 2022-12-08_23:41:49.808359) 23:41:52.879790 run osmo-hlr_10.42.42.2(pid=29700): stderr: | [0;m[1;31m20221208234150006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234150006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234150006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234150006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234150006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234150006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234150039 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234150049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234150049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234150050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:41:52.950711 run osmo-msc_10.42.42.6(pid=29706): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29706)] 23:41:52.999509 run osmo-msc_10.42.42.6(pid=29706): stdout: | (launched: 2022-12-08_23:41:51.819063) 23:41:53.050281 run osmo-msc_10.42.42.6(pid=29706): stderr: | [0;m[38;5;43m20221208234152141 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234152142 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f56d092cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234152142 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234152142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234152142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234152142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234152144 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234152144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234152144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234152144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:41:53.101362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29699): Terminating (SIGTERM) 23:41:53.142295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29702): Terminating (SIGTERM) 23:41:53.183335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29705): Terminating (SIGTERM) 23:41:53.224448 --- ParallelTerminationStrategy: PID 29699 died... 23:41:53.243678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29699): Terminated: ok {rc=0} 23:41:53.288753 --- ParallelTerminationStrategy: PID 29702 died... 23:41:53.307813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29702): Terminated: ok {rc=0} 23:41:53.352858 --- ParallelTerminationStrategy: PID 29705 died... 23:41:53.371940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29705): Terminated: ok {rc=0} 23:41:53.458583 bus /sierra_3: Setting Powered False 23:41:54.554060 bus /sierra_3: Setting Powered False 23:41:55.665825 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:41:56.812172 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:56.824320 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:41:56.899449 tst mo_mt_call_osmux.py: using LAC 17565 23:41:57.019851 tst mo_mt_call_osmux.py: using RAC 225 23:41:57.137139 tst mo_mt_call_osmux.py: using CellId 17565 23:41:57.256664 tst mo_mt_call_osmux.py: using BVCI 17566 23:41:57.366354 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:57.377659 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:57.388787 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:57.400792 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:57.413092 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:57.424770 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:41:57.543167 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:41:57.659351 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:41:58.126062 run create_hlr_db(pid=29708): Launched 23:41:58.241490 bus /sierra_2: Setting Powered False 23:41:59.301748 run create_hlr_db(pid=29708): Terminated: ok {rc=0} 23:41:59.740149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29710): Launched 23:42:00.060611 run osmo-hlr_10.42.42.2(pid=29711): Launched 23:42:00.183699 run osmo-stp_10.42.42.5: Starting osmo-stp 23:42:00.736400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29713): Launched 23:42:01.130424 run osmo-stp_10.42.42.5(pid=29716): Launched 23:42:01.433566 run osmo-msc_10.42.42.6: Starting osmo-msc 23:42:02.137807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29718): Launched 23:42:02.463173 run osmo-msc_10.42.42.6(pid=29719): Launched 23:42:02.642191 run osmo-stp_10.42.42.5(pid=29716): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29716)] 23:42:02.777688 run osmo-stp_10.42.42.5(pid=29716): stdout: | (launched: 2022-12-08_23:42:01.063352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:02.913107 run osmo-stp_10.42.42.5(pid=29716): stderr: | [0;m[38;5;43m20221208234201314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234201315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234201315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234201315 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234201316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234201316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234201316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:03.047807 run osmo-stp_10.42.42.5(pid=29716): stdout: | (launched: 2022-12-08_23:42:01.063352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:03.175329 run osmo-stp_10.42.42.5(pid=29716): stderr: | [0;m[38;5;43m20221208234201314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234201315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234201315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234201315 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234201316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234201316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234201316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:03.328182 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29716): Process ended prematurely: osmo-stp_10.42.42.5(pid=29716) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29716)] [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:42:03.337881 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 23:42:03.365407 run osmo-hlr_10.42.42.2(pid=29711): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29711)] 23:42:03.415092 run osmo-hlr_10.42.42.2(pid=29711): stdout: | (launched: 2022-12-08_23:42:00.002754) 23:42:03.466215 run osmo-hlr_10.42.42.2(pid=29711): stderr: | [0;m[1;31m20221208234200199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234200199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234200199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234200199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234200199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234200199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234200257 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234200265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234200265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234200265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:42:03.537257 run osmo-msc_10.42.42.6(pid=29719): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29719)] 23:42:03.586450 run osmo-msc_10.42.42.6(pid=29719): stdout: | (launched: 2022-12-08_23:42:02.404708) 23:42:03.637344 run osmo-msc_10.42.42.6(pid=29719): stderr: | [0;m[38;5;43m20221208234202728 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234202728 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff29d4e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234202728 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234202728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234202728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234202729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234202730 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234202731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234202731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234202731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:42:03.688604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29710): Terminating (SIGTERM) 23:42:03.729593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29713): Terminating (SIGTERM) 23:42:03.770670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29718): Terminating (SIGTERM) 23:42:03.812138 --- ParallelTerminationStrategy: PID 29710 died... 23:42:03.831762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29710): Terminated: ok {rc=0} 23:42:03.877330 --- ParallelTerminationStrategy: PID 29713 died... 23:42:03.896527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29713): Terminated: ok {rc=0} 23:42:03.941960 --- ParallelTerminationStrategy: PID 29718 died... 23:42:03.961550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29718): Terminated: ok {rc=0} 23:42:04.048608 bus /sierra_3: Setting Powered False 23:42:05.146404 bus /sierra_3: Setting Powered False 23:42:06.261204 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:42:07.521159 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:42:07.527064 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:42:07.563573 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 23:42:07.589880 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 23:42:07.640304 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:42:07.675566 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 23:42:07.703046 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 23:42:08.249531 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 23:42:08.299266 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:08.310190 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:42:08.377933 tst mo_mt_call.py: using LAC 17566 23:42:08.496055 tst mo_mt_call.py: using RAC 226 23:42:08.614281 tst mo_mt_call.py: using CellId 17566 23:42:08.738913 tst mo_mt_call.py: using BVCI 17567 23:42:08.855102 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:08.866615 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:08.877938 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:08.889172 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:08.900574 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:08.911795 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:42:09.027755 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:42:09.145804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:42:09.642644 run create_hlr_db(pid=29725): Launched 23:42:09.772242 bus /sierra_2: Setting Powered False 23:42:10.836257 run create_hlr_db(pid=29725): Terminated: ok {rc=0} 23:42:11.264667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29727): Launched 23:42:11.567050 run osmo-hlr_10.42.42.2(pid=29728): Launched 23:42:11.683276 run osmo-stp_10.42.42.5: Starting osmo-stp 23:42:12.216626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29730): Launched 23:42:12.518808 run osmo-stp_10.42.42.5(pid=29731): Launched 23:42:12.634747 run osmo-msc_10.42.42.6: Starting osmo-msc 23:42:13.181593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29733): Launched 23:42:13.482520 run osmo-msc_10.42.42.6(pid=29734): Launched 23:42:13.652748 run osmo-stp_10.42.42.5(pid=29731): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29731)] 23:42:13.783023 run osmo-stp_10.42.42.5(pid=29731): stdout: | (launched: 2022-12-08_23:42:12.463943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:13.911404 run osmo-stp_10.42.42.5(pid=29731): stderr: | [0;m[38;5;43m20221208234212635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234212635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234212635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234212636 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234212636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234212636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234212636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:14.037567 run osmo-stp_10.42.42.5(pid=29731): stdout: | (launched: 2022-12-08_23:42:12.463943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:14.157382 run osmo-stp_10.42.42.5(pid=29731): stderr: | [0;m[38;5;43m20221208234212635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234212635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234212635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234212636 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234212636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234212636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234212636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:14.301298 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29731): Process ended prematurely: osmo-stp_10.42.42.5(pid=29731) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29731)] [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 23:42:14.310205 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:42:14.336472 run osmo-hlr_10.42.42.2(pid=29728): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29728)] 23:42:14.383819 run osmo-hlr_10.42.42.2(pid=29728): stdout: | (launched: 2022-12-08_23:42:11.511795) 23:42:14.432506 run osmo-hlr_10.42.42.2(pid=29728): stderr: | [0;m[1;31m20221208234211689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234211689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234211689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234211690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234211690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234211690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234211702 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234211711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234211711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234211711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:42:14.500078 run osmo-msc_10.42.42.6(pid=29734): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29734)] 23:42:14.547154 run osmo-msc_10.42.42.6(pid=29734): stdout: | (launched: 2022-12-08_23:42:13.427651) 23:42:14.595943 run osmo-msc_10.42.42.6(pid=29734): stderr: | [0;m[38;5;43m20221208234213698 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234213698 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f613261ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234213698 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234213698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234213698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234213698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234213700 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234213701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234213701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234213701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:42:14.645427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29727): Terminating (SIGTERM) 23:42:14.684355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29730): Terminating (SIGTERM) 23:42:14.723550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29733): Terminating (SIGTERM) 23:42:14.762910 --- ParallelTerminationStrategy: PID 29727 died... 23:42:14.781431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29727): Terminated: ok {rc=0} 23:42:14.825589 --- ParallelTerminationStrategy: PID 29730 died... 23:42:14.843791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29730): Terminated: ok {rc=0} 23:42:14.887568 --- ParallelTerminationStrategy: PID 29733 died... 23:42:14.905799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29733): Terminated: ok {rc=0} 23:42:14.990774 bus /sierra_3: Setting Powered False 23:42:16.093101 bus /sierra_3: Setting Powered False 23:42:17.228069 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 23:42:18.375878 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:18.387803 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:42:18.460802 tst mo_mt_call_osmux.py: using LAC 17567 23:42:18.579785 tst mo_mt_call_osmux.py: using RAC 227 23:42:18.701360 tst mo_mt_call_osmux.py: using CellId 17567 23:42:18.822326 tst mo_mt_call_osmux.py: using BVCI 17568 23:42:18.933953 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:18.944744 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:18.955647 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:18.966844 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:18.978086 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:18.989227 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:42:19.107704 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:42:19.227551 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:42:19.693617 run create_hlr_db(pid=29736): Launched 23:42:19.807916 bus /sierra_2: Setting Powered False 23:42:20.867510 run create_hlr_db(pid=29736): Terminated: ok {rc=0} 23:42:21.285973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29738): Launched 23:42:21.586617 run osmo-hlr_10.42.42.2(pid=29739): Launched 23:42:21.701508 run osmo-stp_10.42.42.5: Starting osmo-stp 23:42:22.233898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29741): Launched 23:42:22.534865 run osmo-stp_10.42.42.5(pid=29742): Launched 23:42:22.650619 run osmo-msc_10.42.42.6: Starting osmo-msc 23:42:23.195621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29744): Launched 23:42:23.496921 run osmo-msc_10.42.42.6(pid=29745): Launched 23:42:23.665595 run osmo-stp_10.42.42.5(pid=29742): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29742)] 23:42:23.794026 run osmo-stp_10.42.42.5(pid=29742): stdout: | (launched: 2022-12-08_23:42:22.480174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:23.922608 run osmo-stp_10.42.42.5(pid=29742): stderr: | [0;m[38;5;43m20221208234222650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234222650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234222650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234222650 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234222651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234222651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234222651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:24.049188 run osmo-stp_10.42.42.5(pid=29742): stdout: | (launched: 2022-12-08_23:42:22.480174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:24.168710 run osmo-stp_10.42.42.5(pid=29742): stderr: | [0;m[38;5;43m20221208234222650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234222650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234222650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234222650 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234222651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234222651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234222651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:24.311789 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29742): Process ended prematurely: osmo-stp_10.42.42.5(pid=29742) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29742)] [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 23:42:24.320661 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:42:24.347082 run osmo-hlr_10.42.42.2(pid=29739): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29739)] 23:42:24.394897 run osmo-hlr_10.42.42.2(pid=29739): stdout: | (launched: 2022-12-08_23:42:21.532037) 23:42:24.443954 run osmo-hlr_10.42.42.2(pid=29739): stderr: | [0;m[1;31m20221208234221709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234221709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234221709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234221710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234221710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234221710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234221722 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234221730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234221731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234221731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:42:24.512204 run osmo-msc_10.42.42.6(pid=29745): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29745)] 23:42:24.559664 run osmo-msc_10.42.42.6(pid=29745): stdout: | (launched: 2022-12-08_23:42:23.442420) 23:42:24.608652 run osmo-msc_10.42.42.6(pid=29745): stderr: | [0;m[38;5;43m20221208234223716 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234223716 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd77ce96c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234223717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234223717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234223717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234223717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234223720 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234223720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234223721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234223721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:42:24.657830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29738): Terminating (SIGTERM) 23:42:24.697313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29741): Terminating (SIGTERM) 23:42:24.736634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29744): Terminating (SIGTERM) 23:42:24.776021 --- ParallelTerminationStrategy: PID 29738 died... 23:42:24.794660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29738): Terminated: ok {rc=0} 23:42:24.838546 --- ParallelTerminationStrategy: PID 29741 died... 23:42:24.856772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29741): Terminated: ok {rc=0} 23:42:24.900113 --- ParallelTerminationStrategy: PID 29744 died... 23:42:24.918282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29744): Terminated: ok {rc=0} 23:42:25.003388 bus /sierra_3: Setting Powered False 23:42:26.100652 bus /sierra_3: Setting Powered False 23:42:27.214048 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 23:42:28.458242 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:42:28.462454 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 23:42:28.496751 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:42:28.522948 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 23:42:28.606390 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 23:42:28.639430 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:42:28.665649 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 23:42:29.248097 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2351 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 23:42:29.254940 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:29.266566 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:42:29.320497 tst emergency_mo_mt_call.py: using LAC 17568 23:42:29.438157 tst emergency_mo_mt_call.py: using RAC 228 23:42:29.553739 tst emergency_mo_mt_call.py: using CellId 17568 23:42:29.678307 tst emergency_mo_mt_call.py: using BVCI 17569 23:42:29.786216 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:29.797144 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:29.807762 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:29.818531 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:29.829472 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:29.840247 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:29.953585 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:30.065711 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:42:30.522842 run create_hlr_db(pid=29750): Launched 23:42:30.635662 bus /sierra_2: Setting Powered False 23:42:31.711707 run create_hlr_db(pid=29750): Terminated: ok {rc=0} 23:42:32.198441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29752): Launched 23:42:32.521997 run osmo-hlr_10.42.42.2(pid=29753): Launched 23:42:32.642015 run osmo-stp_10.42.42.5: Starting osmo-stp 23:42:33.186125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29755): Launched 23:42:33.500323 run osmo-stp_10.42.42.5(pid=29756): Launched 23:42:33.630344 tst emergency_mo_mt_call.py: using MSISDN 6913 23:42:33.793831 run osmo-msc_10.42.42.6: Starting osmo-msc 23:42:34.359851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29758): Launched 23:42:34.675694 run osmo-msc_10.42.42.6(pid=29759): Launched 23:42:34.851674 run osmo-stp_10.42.42.5(pid=29756): ERR: Terminated: ERROR {rc=1} [trial-2351↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29756)] 23:42:34.988321 run osmo-stp_10.42.42.5(pid=29756): stdout: | (launched: 2022-12-08_23:42:33.443341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:35.121764 run osmo-stp_10.42.42.5(pid=29756): stderr: | [0;m[38;5;43m20221208234233633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234233633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234233633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234233634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234233634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234233634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234233634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:35.254823 run osmo-stp_10.42.42.5(pid=29756): stdout: | (launched: 2022-12-08_23:42:33.443341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:35.380450 run osmo-stp_10.42.42.5(pid=29756): stderr: | [0;m[38;5;43m20221208234233633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234233633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234233633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234233634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234233634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234233634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234233634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:35.531157 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=29756): Process ended prematurely: osmo-stp_10.42.42.5(pid=29756) [trial-2351↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29756)] [trial-2351↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 23:42:35.539981 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 23:42:35.566976 run osmo-hlr_10.42.42.2(pid=29753): ERR: Terminated: ERROR {rc=237} [trial-2351↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29753)] 23:42:35.616466 run osmo-hlr_10.42.42.2(pid=29753): stdout: | (launched: 2022-12-08_23:42:32.465254) 23:42:35.667391 run osmo-hlr_10.42.42.2(pid=29753): stderr: | [0;m[1;31m20221208234232662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234232662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234232662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234232662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234232662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234232662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234232675 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234232683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234232683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234232683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:42:35.739124 run osmo-msc_10.42.42.6(pid=29759): ERR: Terminated: ERROR {rc=2} [trial-2351↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29759)] 23:42:35.790306 run osmo-msc_10.42.42.6(pid=29759): stdout: | (launched: 2022-12-08_23:42:34.618812) 23:42:35.839357 run osmo-msc_10.42.42.6(pid=29759): stderr: | [0;m[38;5;43m20221208234234942 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234234942 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f055a5bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234234942 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234234942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234234943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234234943 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234234945 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234234945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234234945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234234945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:42:35.888417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29752): Terminating (SIGTERM) 23:42:35.927761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29755): Terminating (SIGTERM) 23:42:35.966994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29758): Terminating (SIGTERM) 23:42:36.006339 --- ParallelTerminationStrategy: PID 29752 died... 23:42:36.024807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29752): Terminated: ok {rc=0} 23:42:36.068421 --- ParallelTerminationStrategy: PID 29755 died... 23:42:36.086662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29755): Terminated: ok {rc=0} 23:42:36.130169 --- ParallelTerminationStrategy: PID 29758 died... 23:42:36.148332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29758): Terminated: ok {rc=0} 23:42:36.234113 bus /sierra_3: Setting Powered False 23:42:37.332663 bus /sierra_3: Setting Powered False 23:42:38.447429 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 23:42:39.534152 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:39.545352 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:42:39.595731 tst emergency_preemptive_call.py: using LAC 17569 23:42:39.713247 tst emergency_preemptive_call.py: using RAC 229 23:42:39.829633 tst emergency_preemptive_call.py: using CellId 17569 23:42:39.944688 tst emergency_preemptive_call.py: using BVCI 17570 23:42:40.051134 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:40.061888 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:40.072355 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:40.083247 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:40.094088 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:40.104690 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:40.219491 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:40.337182 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:40.452037 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:40.563555 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:42:41.022406 run create_hlr_db(pid=29763): Launched 23:42:41.134032 bus /sierra_2: Setting Powered False 23:42:42.193163 run create_hlr_db(pid=29763): Terminated: ok {rc=0} 23:42:42.626229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29765): Launched 23:42:42.941610 run osmo-hlr_10.42.42.2(pid=29766): Launched 23:42:43.062201 run osmo-stp_10.42.42.5: Starting osmo-stp 23:42:43.604931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29768): Launched 23:42:43.919999 run osmo-stp_10.42.42.5(pid=29769): Launched 23:42:44.050470 tst emergency_preemptive_call.py: using MSISDN 6914 23:42:44.213088 run osmo-msc_10.42.42.6: Starting osmo-msc 23:42:44.778507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29771): Launched 23:42:45.093385 run osmo-msc_10.42.42.6(pid=29772): Launched 23:42:45.268938 run osmo-stp_10.42.42.5(pid=29769): ERR: Terminated: ERROR {rc=1} [trial-2351↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29769)] 23:42:45.401945 run osmo-stp_10.42.42.5(pid=29769): stdout: | (launched: 2022-12-08_23:42:43.863110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:45.536030 run osmo-stp_10.42.42.5(pid=29769): stderr: | [0;m[38;5;43m20221208234244056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234244056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234244056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234244057 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234244057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234244057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234244057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:45.669330 run osmo-stp_10.42.42.5(pid=29769): stdout: | (launched: 2022-12-08_23:42:43.863110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:45.794661 run osmo-stp_10.42.42.5(pid=29769): stderr: | [0;m[38;5;43m20221208234244056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234244056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234244056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234244057 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234244057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234244057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234244057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:45.963362 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=29769): Process ended prematurely: osmo-stp_10.42.42.5(pid=29769) [trial-2351↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29769)] [trial-2351↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 23:42:45.983694 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 23:42:46.020902 run osmo-hlr_10.42.42.2(pid=29766): ERR: Terminated: ERROR {rc=237} [trial-2351↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29766)] 23:42:46.071539 run osmo-hlr_10.42.42.2(pid=29766): stdout: | (launched: 2022-12-08_23:42:42.884730) 23:42:46.123734 run osmo-hlr_10.42.42.2(pid=29766): stderr: | [0;m[1;31m20221208234243082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234243082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234243083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234243083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234243083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234243083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234243095 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234243105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234243105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234243105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:42:46.197249 run osmo-msc_10.42.42.6(pid=29772): ERR: Terminated: ERROR {rc=2} [trial-2351↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29772)] 23:42:46.247931 run osmo-msc_10.42.42.6(pid=29772): stdout: | (launched: 2022-12-08_23:42:45.036341) 23:42:46.300612 run osmo-msc_10.42.42.6(pid=29772): stderr: | [0;m[38;5;43m20221208234245356 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234245356 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3fcd5fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234245356 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234245356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234245357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234245357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234245359 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234245359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234245359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234245359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:42:46.353766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29765): Terminating (SIGTERM) 23:42:46.396443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29768): Terminating (SIGTERM) 23:42:46.440401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29771): Terminating (SIGTERM) 23:42:46.483454 --- ParallelTerminationStrategy: PID 29765 died... 23:42:46.503401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29765): Terminated: ok {rc=0} 23:42:46.550721 --- ParallelTerminationStrategy: PID 29768 died... 23:42:46.570904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29768): Terminated: ok {rc=0} 23:42:46.618467 --- ParallelTerminationStrategy: PID 29771 died... 23:42:46.638727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29771): Terminated: ok {rc=0} 23:42:46.727665 bus /sierra_9: Setting Powered False 23:42:47.825613 bus /sierra_9: Setting Powered False 23:42:48.940345 bus /sierra_8: Setting Powered False 23:42:50.038590 bus /sierra_8: Setting Powered False 23:42:51.152632 bus /sierra_3: Setting Powered False 23:42:52.250476 bus /sierra_3: Setting Powered False 23:42:53.364103 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 23:42:54.651574 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:42:54.656724 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 23:42:54.691193 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 23:42:54.729230 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 23:42:54.813548 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 23:42:54.846365 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 23:42:54.883806 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 23:42:55.472714 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 23:42:55.522317 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:55.532876 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:42:55.584564 tst cs_paging_gprs_active.py: using LAC 17570 23:42:55.702527 tst cs_paging_gprs_active.py: using RAC 230 23:42:55.825011 tst cs_paging_gprs_active.py: using CellId 17570 23:42:55.950223 tst cs_paging_gprs_active.py: using BVCI 17571 23:42:56.067038 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:56.078615 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:56.089677 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:56.100687 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:56.111474 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:56.122236 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:56.133233 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:56.143941 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:56.154989 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:56.269377 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:56.387158 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:42:56.605071 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:42:56.926740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29777): Launched 23:42:57.206015 run iperf3-srv_10.42.42.10(pid=29778): Launched 23:42:57.326625 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:42:57.545139 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:42:57.868367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29779): Launched 23:42:58.147267 run iperf3-srv_10.42.42.10(pid=29780): Launched 23:42:58.267584 tst cs_paging_gprs_active.py:38: start network... 23:42:58.485329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:42:58.983609 run create_hlr_db(pid=29781): Launched 23:42:59.114694 bus /sierra_2: Setting Powered False 23:43:00.177944 run create_hlr_db(pid=29781): Terminated: ok {rc=0} 23:43:00.608476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29783): Launched 23:43:00.953763 run osmo-hlr_10.42.42.2(pid=29784): Launched 23:43:01.244445 run osmo-stp_10.42.42.5: Starting osmo-stp 23:43:01.885954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29786): Launched 23:43:02.224229 run osmo-stp_10.42.42.5(pid=29787): Launched 23:43:02.354930 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:43:02.878068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29789): Launched 23:43:02.994494 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:43:03.250370 run patchelf(pid=29790): Launched 23:43:03.418873 run osmo-stp_10.42.42.5(pid=29787): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29787)] 23:43:03.547326 run osmo-stp_10.42.42.5(pid=29787): stdout: | (launched: 2022-12-08_23:43:02.163538) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:03.676803 run osmo-stp_10.42.42.5(pid=29787): stderr: | [0;m[38;5;43m20221208234302335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234302335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234302336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234302336 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234302336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234302337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234302337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:03.806466 run osmo-stp_10.42.42.5(pid=29787): stdout: | (launched: 2022-12-08_23:43:02.163538) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:03.930442 run osmo-stp_10.42.42.5(pid=29787): stderr: | [0;m[38;5;43m20221208234302335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234302335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234302336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234302336 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234302336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234302337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234302337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:04.077722 run patchelf(pid=29790): Terminating (SIGINT) 23:43:04.247882 run patchelf(pid=29790): Terminated: ok {rc=0} 23:43:04.370254 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29787): Process ended prematurely: osmo-stp_10.42.42.5(pid=29787) [trial-2351↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29787)] [trial-2351↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 23:43:04.379707 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 23:43:04.406685 run osmo-hlr_10.42.42.2(pid=29784): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29784)] 23:43:04.453827 run osmo-hlr_10.42.42.2(pid=29784): stdout: | (launched: 2022-12-08_23:43:00.882693) 23:43:04.502362 run osmo-hlr_10.42.42.2(pid=29784): stderr: | [0;m[1;31m20221208234301233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234301233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234301233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234301233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234301233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234301233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234301251 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234301259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234301259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234301259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:43:04.551354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29777): Terminating (SIGTERM) 23:43:04.590588 run iperf3-srv_10.42.42.10(pid=29778): Terminating (SIGTERM) 23:43:04.629586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29779): Terminating (SIGTERM) 23:43:04.668831 run iperf3-srv_10.42.42.10(pid=29780): Terminating (SIGTERM) 23:43:04.708205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29783): Terminating (SIGTERM) 23:43:04.747453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29786): Terminating (SIGTERM) 23:43:04.786570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29789): Terminating (SIGTERM) 23:43:04.825819 --- ParallelTerminationStrategy: PID 29777 died... 23:43:04.844467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29777): Terminated: ok {rc=0} 23:43:04.888252 --- ParallelTerminationStrategy: PID 29778 died... 23:43:04.906350 run iperf3-srv_10.42.42.10(pid=29778): Terminated {rc=256} 23:43:04.949485 --- ParallelTerminationStrategy: PID 29779 died... 23:43:04.967673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29779): Terminated: ok {rc=0} 23:43:05.011177 --- ParallelTerminationStrategy: PID 29780 died... 23:43:05.029424 run iperf3-srv_10.42.42.10(pid=29780): Terminated {rc=256} 23:43:05.072644 --- ParallelTerminationStrategy: PID 29783 died... 23:43:05.090889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29783): Terminated: ok {rc=0} 23:43:05.134380 --- ParallelTerminationStrategy: PID 29786 died... 23:43:05.152621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29786): Terminated: ok {rc=0} 23:43:05.196350 --- ParallelTerminationStrategy: PID 29789 died... 23:43:05.214743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29789): Terminated: ok {rc=0} 23:43:05.299716 bus /gobi_0: Setting Powered False 23:43:06.398770 bus /gobi_0: Setting Powered False 23:43:07.510827 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 23:43:08.657576 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:08.669406 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:43:08.722259 tst iperf3.py: using LAC 17571 23:43:08.849692 tst iperf3.py: using RAC 231 23:43:08.975406 tst iperf3.py: using CellId 17571 23:43:09.101729 tst iperf3.py: using BVCI 17572 23:43:09.219862 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:09.230991 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:09.241964 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:09.252731 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:09.263635 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:09.274469 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:09.285485 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:09.296170 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:09.307143 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:43:09.420509 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:43:09.623699 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:09.926239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29791): Launched 23:43:10.189201 run iperf3-srv_10.42.42.10(pid=29792): Launched 23:43:10.303129 tst iperf3.py:8: start network... 23:43:10.507180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:43:10.976822 run create_hlr_db(pid=29793): Launched 23:43:11.093920 bus /gobi_6: Setting Powered False 23:43:12.154601 run create_hlr_db(pid=29793): Terminated: ok {rc=0} 23:43:12.595718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29795): Launched 23:43:12.917636 run osmo-hlr_10.42.42.2(pid=29796): Launched 23:43:13.040582 run osmo-stp_10.42.42.5: Starting osmo-stp 23:43:13.600893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29798): Launched 23:43:13.923227 run osmo-stp_10.42.42.5(pid=29799): Launched 23:43:14.046951 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:43:14.604637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29801): Launched 23:43:14.728354 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:43:15.000362 run patchelf(pid=29802): Launched 23:43:15.180142 run osmo-stp_10.42.42.5(pid=29799): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29799)] 23:43:15.317152 run osmo-stp_10.42.42.5(pid=29799): stdout: | (launched: 2022-12-08_23:43:13.864885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:15.456021 run osmo-stp_10.42.42.5(pid=29799): stderr: | [0;m[38;5;43m20221208234314055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234314056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234314056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234314056 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234314058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234314059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234314059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:15.594839 run osmo-stp_10.42.42.5(pid=29799): stdout: | (launched: 2022-12-08_23:43:13.864885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:15.727267 run osmo-stp_10.42.42.5(pid=29799): stderr: | [0;m[38;5;43m20221208234314055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234314056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234314056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234314056 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234314058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234314059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234314059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:15.884634 run patchelf(pid=29802): Terminating (SIGINT) 23:43:16.068833 run patchelf(pid=29802): Terminated: ok {rc=0} 23:43:16.202093 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29799): Process ended prematurely: osmo-stp_10.42.42.5(pid=29799) [trial-2351↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29799)] [trial-2351↪gprs:trx-sysmocell5000↪iperf3.py:8] 23:43:16.212676 tst iperf3.py:8: Test FAILED (7.6 sec) 23:43:16.241866 run osmo-hlr_10.42.42.2(pid=29796): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29796)] 23:43:16.292728 run osmo-hlr_10.42.42.2(pid=29796): stdout: | (launched: 2022-12-08_23:43:12.859598) 23:43:16.345421 run osmo-hlr_10.42.42.2(pid=29796): stderr: | [0;m[1;31m20221208234313057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234313057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234313057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234313057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234313057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234313057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234313068 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234313077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234313077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234313077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:43:16.398356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29791): Terminating (SIGTERM) 23:43:16.441371 run iperf3-srv_10.42.42.10(pid=29792): Terminating (SIGTERM) 23:43:16.485475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29795): Terminating (SIGTERM) 23:43:16.528539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29798): Terminating (SIGTERM) 23:43:16.571412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29801): Terminating (SIGTERM) 23:43:16.615627 --- ParallelTerminationStrategy: PID 29791 died... 23:43:16.635690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29791): Terminated: ok {rc=0} 23:43:16.682540 --- ParallelTerminationStrategy: PID 29792 died... 23:43:16.702443 run iperf3-srv_10.42.42.10(pid=29792): Terminated {rc=256} 23:43:16.749111 --- ParallelTerminationStrategy: PID 29795 died... 23:43:16.768936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29795): Terminated: ok {rc=0} 23:43:16.815663 --- ParallelTerminationStrategy: PID 29798 died... 23:43:16.835722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29798): Terminated: ok {rc=0} 23:43:16.882572 --- ParallelTerminationStrategy: PID 29801 died... 23:43:16.902533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29801): Terminated: ok {rc=0} 23:43:16.992261 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 23:43:18.142006 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:18.153605 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:43:18.205595 tst iperf3m4.py: using LAC 17572 23:43:18.336134 tst iperf3m4.py: using RAC 232 23:43:18.460338 tst iperf3m4.py: using CellId 17572 23:43:18.586269 tst iperf3m4.py: using BVCI 17573 23:43:18.704418 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:18.715596 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:18.726508 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:18.737366 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:18.748147 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:18.758972 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:18.769997 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:18.780742 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:18.791693 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:43:18.907960 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:43:19.024098 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:43:19.140062 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:43:19.259133 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:43:19.477326 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:19.799509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29804): Launched 23:43:20.078780 run iperf3-srv_10.42.42.10(pid=29805): Launched 23:43:20.199719 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:43:20.417232 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:20.740523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29806): Launched 23:43:21.020494 run iperf3-srv_10.42.42.10(pid=29807): Launched 23:43:21.141713 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:43:21.359266 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:21.682784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29808): Launched 23:43:21.962273 run iperf3-srv_10.42.42.10(pid=29809): Launched 23:43:22.082756 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:43:22.299498 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:22.622658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29810): Launched 23:43:22.901686 run iperf3-srv_10.42.42.10(pid=29811): Launched 23:43:23.021896 tst iperf3m4.py:8: start network... 23:43:23.238948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:43:23.737358 run create_hlr_db(pid=29812): Launched 23:43:23.868332 bus /gobi_6: Setting Powered False 23:43:24.932259 run create_hlr_db(pid=29812): Terminated: ok {rc=0} 23:43:25.380106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29814): Launched 23:43:25.702119 run osmo-hlr_10.42.42.2(pid=29815): Launched 23:43:25.824701 run osmo-stp_10.42.42.5: Starting osmo-stp 23:43:26.378886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29817): Launched 23:43:26.701784 run osmo-stp_10.42.42.5(pid=29818): Launched 23:43:26.824105 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:43:27.378936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29820): Launched 23:43:27.502895 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:43:27.774856 run patchelf(pid=29821): Launched 23:43:27.954079 run osmo-stp_10.42.42.5(pid=29818): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29818)] 23:43:28.090257 run osmo-stp_10.42.42.5(pid=29818): stdout: | (launched: 2022-12-08_23:43:26.643086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:28.228175 run osmo-stp_10.42.42.5(pid=29818): stderr: | [0;m[38;5;43m20221208234326838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234326838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234326838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234326838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234326839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234326839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234326839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:28.366605 run osmo-stp_10.42.42.5(pid=29818): stdout: | (launched: 2022-12-08_23:43:26.643086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:28.498745 run osmo-stp_10.42.42.5(pid=29818): stderr: | [0;m[38;5;43m20221208234326838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234326838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234326838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234326838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234326839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234326839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234326839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:28.655428 run patchelf(pid=29821): Terminating (SIGINT) 23:43:28.835555 run patchelf(pid=29821): Terminated: ok {rc=0} 23:43:28.965359 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29818): Process ended prematurely: osmo-stp_10.42.42.5(pid=29818) [trial-2351↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29818)] [trial-2351↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 23:43:28.975532 tst iperf3m4.py:8: Test FAILED (10.9 sec) 23:43:29.003958 run osmo-hlr_10.42.42.2(pid=29815): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29815)] 23:43:29.053356 run osmo-hlr_10.42.42.2(pid=29815): stdout: | (launched: 2022-12-08_23:43:25.643709) 23:43:29.104191 run osmo-hlr_10.42.42.2(pid=29815): stderr: | [0;m[1;31m20221208234325841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234325841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234325841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234325841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234325841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234325841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234325852 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234325862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234325862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234325862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:43:29.155457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29804): Terminating (SIGTERM) 23:43:29.196636 run iperf3-srv_10.42.42.10(pid=29805): Terminating (SIGTERM) 23:43:29.238027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29806): Terminating (SIGTERM) 23:43:29.279094 run iperf3-srv_10.42.42.10(pid=29807): Terminating (SIGTERM) 23:43:29.319936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29808): Terminating (SIGTERM) 23:43:29.361000 run iperf3-srv_10.42.42.10(pid=29809): Terminating (SIGTERM) 23:43:29.401834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29810): Terminating (SIGTERM) 23:43:29.442739 run iperf3-srv_10.42.42.10(pid=29811): Terminating (SIGTERM) 23:43:29.483807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29814): Terminating (SIGTERM) 23:43:29.524749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29817): Terminating (SIGTERM) 23:43:29.565802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29820): Terminating (SIGTERM) 23:43:29.607056 --- ParallelTerminationStrategy: PID 29804 died... 23:43:29.626674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29804): Terminated: ok {rc=0} 23:43:29.672035 --- ParallelTerminationStrategy: PID 29805 died... 23:43:29.691165 run iperf3-srv_10.42.42.10(pid=29805): Terminated {rc=256} 23:43:29.736186 --- ParallelTerminationStrategy: PID 29806 died... 23:43:29.755335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29806): Terminated: ok {rc=0} 23:43:29.800896 --- ParallelTerminationStrategy: PID 29807 died... 23:43:29.820497 run iperf3-srv_10.42.42.10(pid=29807): Terminated {rc=256} 23:43:29.865765 --- ParallelTerminationStrategy: PID 29808 died... 23:43:29.884841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29808): Terminated: ok {rc=0} 23:43:29.930466 --- ParallelTerminationStrategy: PID 29809 died... 23:43:29.949767 run iperf3-srv_10.42.42.10(pid=29809): Terminated {rc=256} 23:43:29.995127 --- ParallelTerminationStrategy: PID 29810 died... 23:43:30.014386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29810): Terminated: ok {rc=0} 23:43:30.059526 --- ParallelTerminationStrategy: PID 29811 died... 23:43:30.078674 run iperf3-srv_10.42.42.10(pid=29811): Terminated {rc=256} 23:43:30.123728 --- ParallelTerminationStrategy: PID 29814 died... 23:43:30.142913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29814): Terminated: ok {rc=0} 23:43:30.188268 --- ParallelTerminationStrategy: PID 29817 died... 23:43:30.207560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29817): Terminated: ok {rc=0} 23:43:30.252889 --- ParallelTerminationStrategy: PID 29820 died... 23:43:30.272136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29820): Terminated: ok {rc=0} 23:43:30.359026 bus /gobi_4: Setting Powered False 23:43:31.456678 bus /gobi_4: Setting Powered False 23:43:32.573635 bus /gobi_1: Setting Powered False 23:43:33.673728 bus /gobi_1: Setting Powered False 23:43:34.789571 bus /gobi_0: Setting Powered False 23:43:35.886718 bus /gobi_0: Setting Powered False 23:43:37.001579 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 23:43:38.105171 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:38.116909 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:43:38.167481 tst ping.py: using LAC 17573 23:43:38.291632 tst ping.py: using RAC 233 23:43:38.418895 tst ping.py: using CellId 17573 23:43:38.542447 tst ping.py: using BVCI 17574 23:43:38.658888 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:38.670035 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:38.681069 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:38.692051 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:38.702933 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:38.713782 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:38.724721 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:38.735726 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:43:38.852286 tst ping.py:19: start network... 23:43:39.064819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:43:39.553211 run create_hlr_db(pid=29822): Launched 23:43:39.681856 bus /gobi_6: Setting Powered False 23:43:40.744176 run create_hlr_db(pid=29822): Terminated: ok {rc=0} 23:43:41.167086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29824): Launched 23:43:41.463800 run osmo-hlr_10.42.42.2(pid=29825): Launched 23:43:41.577508 run osmo-stp_10.42.42.5: Starting osmo-stp 23:43:42.103965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29827): Launched 23:43:42.399658 run osmo-stp_10.42.42.5(pid=29828): Launched 23:43:42.512565 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:43:43.025624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29830): Launched 23:43:43.140141 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:43:43.391510 run patchelf(pid=29831): Launched 23:43:43.557688 run osmo-stp_10.42.42.5(pid=29828): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29828)] 23:43:43.684595 run osmo-stp_10.42.42.5(pid=29828): stdout: | (launched: 2022-12-08_23:43:42.345921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:43.812906 run osmo-stp_10.42.42.5(pid=29828): stderr: | [0;m[38;5;43m20221208234342515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234342515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234342516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234342516 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234342516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234342517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234342517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:43.941294 run osmo-stp_10.42.42.5(pid=29828): stdout: | (launched: 2022-12-08_23:43:42.345921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:44.063246 run osmo-stp_10.42.42.5(pid=29828): stderr: | [0;m[38;5;43m20221208234342515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234342515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234342516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234342516 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234342516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234342517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234342517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:44.207891 run patchelf(pid=29831): Terminating (SIGINT) 23:43:44.374510 run patchelf(pid=29831): Terminated: ok {rc=0} 23:43:44.495498 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29828): Process ended prematurely: osmo-stp_10.42.42.5(pid=29828) [trial-2351↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29828)] [trial-2351↪gprs:trx-sysmocell5000↪ping.py:22] 23:43:44.504600 tst ping.py:22: Test FAILED (6.4 sec) 23:43:44.531532 run osmo-hlr_10.42.42.2(pid=29825): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29825)] 23:43:44.579667 run osmo-hlr_10.42.42.2(pid=29825): stdout: | (launched: 2022-12-08_23:43:41.409851) 23:43:44.629424 run osmo-hlr_10.42.42.2(pid=29825): stderr: | [0;m[1;31m20221208234341583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234341583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234341583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234341583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234341583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234341583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234341595 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234341604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234341604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234341604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:43:44.679136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29824): Terminating (SIGTERM) 23:43:44.719112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29827): Terminating (SIGTERM) 23:43:44.759246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29830): Terminating (SIGTERM) 23:43:44.799430 --- ParallelTerminationStrategy: PID 29824 died... 23:43:44.818498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29824): Terminated: ok {rc=0} 23:43:44.862899 --- ParallelTerminationStrategy: PID 29827 died... 23:43:44.881583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29827): Terminated: ok {rc=0} 23:43:44.925765 --- ParallelTerminationStrategy: PID 29830 died... 23:43:44.944301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29830): Terminated: ok {rc=0} 23:43:45.030333 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 23:43:46.117250 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:46.129365 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:43:46.180930 tst ping_idle_ping.py: using LAC 17574 23:43:46.331198 tst ping_idle_ping.py: using RAC 234 23:43:46.496126 tst ping_idle_ping.py: using CellId 17574 23:43:46.653119 tst ping_idle_ping.py: using BVCI 17575 23:43:46.763856 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:46.775717 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:46.787267 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:46.799388 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:46.811305 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:46.823471 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:46.835735 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:46.848856 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:43:46.960631 tst ping_idle_ping.py:24: start network... 23:43:47.239435 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:43:47.708166 run create_hlr_db(pid=29832): Launched 23:43:47.822969 bus /gobi_6: Setting Powered False 23:43:48.883082 run create_hlr_db(pid=29832): Terminated: ok {rc=0} 23:43:49.321121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29834): Launched 23:43:49.640085 run osmo-hlr_10.42.42.2(pid=29835): Launched 23:43:49.761693 run osmo-stp_10.42.42.5: Starting osmo-stp 23:43:50.308327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29837): Launched 23:43:50.625497 run osmo-stp_10.42.42.5(pid=29838): Launched 23:43:50.746303 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:43:51.293682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29840): Launched 23:43:51.415076 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:43:51.682193 run patchelf(pid=29841): Launched 23:43:51.858223 run osmo-stp_10.42.42.5(pid=29838): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29838)] 23:43:51.992644 run osmo-stp_10.42.42.5(pid=29838): stdout: | (launched: 2022-12-08_23:43:50.568229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:52.128801 run osmo-stp_10.42.42.5(pid=29838): stderr: | [0;m[38;5;43m20221208234350759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234350759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234350760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234350760 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234350762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234350762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234350762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:52.265127 run osmo-stp_10.42.42.5(pid=29838): stdout: | (launched: 2022-12-08_23:43:50.568229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:52.394979 run osmo-stp_10.42.42.5(pid=29838): stderr: | [0;m[38;5;43m20221208234350759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234350759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234350760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234350760 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234350762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234350762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234350762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:52.549393 run patchelf(pid=29841): Terminating (SIGINT) 23:43:52.727153 run patchelf(pid=29841): Terminated: ok {rc=0} 23:43:52.855241 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29838): Process ended prematurely: osmo-stp_10.42.42.5(pid=29838) [trial-2351↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29838)] [trial-2351↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 23:43:52.864779 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 23:43:52.892813 run osmo-hlr_10.42.42.2(pid=29835): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29835)] 23:43:52.942193 run osmo-hlr_10.42.42.2(pid=29835): stdout: | (launched: 2022-12-08_23:43:49.582828) 23:43:52.994233 run osmo-hlr_10.42.42.2(pid=29835): stderr: | [0;m[1;31m20221208234349782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234349782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234349782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234349782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234349782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234349782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234349795 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234349803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234349804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234349804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:43:53.046317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29834): Terminating (SIGTERM) 23:43:53.088054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29837): Terminating (SIGTERM) 23:43:53.130097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29840): Terminating (SIGTERM) 23:43:53.172357 --- ParallelTerminationStrategy: PID 29834 died... 23:43:53.192259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29834): Terminated: ok {rc=0} 23:43:53.239034 --- ParallelTerminationStrategy: PID 29837 died... 23:43:53.258540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29837): Terminated: ok {rc=0} 23:43:53.304472 --- ParallelTerminationStrategy: PID 29840 died... 23:43:53.324083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29840): Terminated: ok {rc=0} 23:43:53.411284 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 23:43:54.716481 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:43:54.721659 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 23:43:54.756297 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 23:43:54.794527 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 23:43:54.879297 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 23:43:54.912666 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 23:43:54.950857 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 23:43:55.543234 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 23:43:55.593249 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:55.603969 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:43:55.654291 tst cs_paging_gprs_active.py: using LAC 17575 23:43:55.774859 tst cs_paging_gprs_active.py: using RAC 235 23:43:55.896356 tst cs_paging_gprs_active.py: using CellId 17575 23:43:56.017148 tst cs_paging_gprs_active.py: using BVCI 17576 23:43:56.127215 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:56.138154 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:56.148789 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:56.160170 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:56.171447 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:56.182729 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:56.194315 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:56.205724 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:56.217110 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:43:56.336406 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:43:56.453830 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:43:56.657749 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:56.959846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29848): Launched 23:43:57.223209 run iperf3-srv_10.42.42.10(pid=29849): Launched 23:43:57.336770 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:43:57.541175 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:57.844111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29850): Launched 23:43:58.107429 run iperf3-srv_10.42.42.10(pid=29851): Launched 23:43:58.220798 tst cs_paging_gprs_active.py:38: start network... 23:43:58.424097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:43:58.893660 run create_hlr_db(pid=29852): Launched 23:43:59.008211 bus /gobi_6: Setting Powered False 23:44:00.068463 run create_hlr_db(pid=29852): Terminated: ok {rc=0} 23:44:00.489599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29854): Launched 23:44:00.792760 run osmo-hlr_10.42.42.2(pid=29855): Launched 23:44:00.911622 run osmo-stp_10.42.42.5: Starting osmo-stp 23:44:01.604858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29857): Launched 23:44:01.951174 run osmo-stp_10.42.42.5(pid=29858): Launched 23:44:02.244453 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:44:02.805440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29860): Launched 23:44:02.929249 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:44:03.201647 run patchelf(pid=29861): Launched 23:44:03.381561 run osmo-stp_10.42.42.5(pid=29858): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29858)] 23:44:03.519671 run osmo-stp_10.42.42.5(pid=29858): stdout: | (launched: 2022-12-08_23:44:01.888782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:03.657519 run osmo-stp_10.42.42.5(pid=29858): stderr: | [0;m[38;5;43m20221208234402128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234402129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234402129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234402129 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234402130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234402130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234402130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:03.795214 run osmo-stp_10.42.42.5(pid=29858): stdout: | (launched: 2022-12-08_23:44:01.888782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:03.927959 run osmo-stp_10.42.42.5(pid=29858): stderr: | [0;m[38;5;43m20221208234402128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234402129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234402129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234402129 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234402130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234402130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234402130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:04.084798 run patchelf(pid=29861): Terminating (SIGINT) 23:44:04.265877 run patchelf(pid=29861): Terminated: ok {rc=0} 23:44:04.396320 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29858): Process ended prematurely: osmo-stp_10.42.42.5(pid=29858) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29858)] [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 23:44:04.406517 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 23:44:04.434617 run osmo-hlr_10.42.42.2(pid=29855): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29855)] 23:44:04.484096 run osmo-hlr_10.42.42.2(pid=29855): stdout: | (launched: 2022-12-08_23:44:00.736632) 23:44:04.535099 run osmo-hlr_10.42.42.2(pid=29855): stderr: | [0;m[1;31m20221208234400976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234400976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234400976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234400976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234400976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234400976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234400995 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234401008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234401008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234401008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:44:04.586370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29848): Terminating (SIGTERM) 23:44:04.627573 run iperf3-srv_10.42.42.10(pid=29849): Terminating (SIGTERM) 23:44:04.668547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29850): Terminating (SIGTERM) 23:44:04.709963 run iperf3-srv_10.42.42.10(pid=29851): Terminating (SIGTERM) 23:44:04.751054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29854): Terminating (SIGTERM) 23:44:04.792374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29857): Terminating (SIGTERM) 23:44:04.833634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29860): Terminating (SIGTERM) 23:44:04.875023 --- ParallelTerminationStrategy: PID 29848 died... 23:44:04.894653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29848): Terminated: ok {rc=0} 23:44:04.940744 --- ParallelTerminationStrategy: PID 29849 died... 23:44:04.959953 run iperf3-srv_10.42.42.10(pid=29849): Terminated {rc=256} 23:44:05.005396 --- ParallelTerminationStrategy: PID 29850 died... 23:44:05.024518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29850): Terminated: ok {rc=0} 23:44:05.070078 --- ParallelTerminationStrategy: PID 29851 died... 23:44:05.089300 run iperf3-srv_10.42.42.10(pid=29851): Terminated {rc=256} 23:44:05.134677 --- ParallelTerminationStrategy: PID 29854 died... 23:44:05.153971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29854): Terminated: ok {rc=0} 23:44:05.199350 --- ParallelTerminationStrategy: PID 29857 died... 23:44:05.218608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29857): Terminated: ok {rc=0} 23:44:05.264454 --- ParallelTerminationStrategy: PID 29860 died... 23:44:05.283742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29860): Terminated: ok {rc=0} 23:44:05.369724 bus /gobi_0: Setting Powered False 23:44:06.468941 bus /gobi_0: Setting Powered False 23:44:07.584362 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 23:44:08.732540 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:08.744308 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:44:08.803117 tst iperf3.py: using LAC 17576 23:44:08.928845 tst iperf3.py: using RAC 236 23:44:09.053348 tst iperf3.py: using CellId 17576 23:44:09.178026 tst iperf3.py: using BVCI 17577 23:44:09.295034 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:09.306413 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:09.317484 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:09.329051 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:09.340573 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:09.352122 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:09.363843 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:09.375327 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:09.387045 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:44:09.506188 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:44:09.724138 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:10.045630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29862): Launched 23:44:10.324748 run iperf3-srv_10.42.42.10(pid=29863): Launched 23:44:10.445917 tst iperf3.py:8: start network... 23:44:10.663437 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:44:11.162465 run create_hlr_db(pid=29864): Launched 23:44:11.293593 bus /gobi_6: Setting Powered False 23:44:12.357045 run create_hlr_db(pid=29864): Terminated: ok {rc=0} 23:44:12.787685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29866): Launched 23:44:13.090763 run osmo-hlr_10.42.42.2(pid=29867): Launched 23:44:13.206001 run osmo-stp_10.42.42.5: Starting osmo-stp 23:44:13.742871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29869): Launched 23:44:14.045040 run osmo-stp_10.42.42.5(pid=29870): Launched 23:44:14.160596 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:44:14.682624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29872): Launched 23:44:14.798844 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:44:15.054396 run patchelf(pid=29873): Launched 23:44:15.222098 run osmo-stp_10.42.42.5(pid=29870): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29870)] 23:44:15.349894 run osmo-stp_10.42.42.5(pid=29870): stdout: | (launched: 2022-12-08_23:44:13.990329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:15.479562 run osmo-stp_10.42.42.5(pid=29870): stderr: | [0;m[38;5;43m20221208234414161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234414162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234414162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234414162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234414163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234414163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234414163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:15.609932 run osmo-stp_10.42.42.5(pid=29870): stdout: | (launched: 2022-12-08_23:44:13.990329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:15.733453 run osmo-stp_10.42.42.5(pid=29870): stderr: | [0;m[38;5;43m20221208234414161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234414162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234414162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234414162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234414163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234414163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234414163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:15.907134 run patchelf(pid=29873): Terminating (SIGINT) 23:44:16.080003 run patchelf(pid=29873): Terminated: ok {rc=0} 23:44:16.205716 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29870): Process ended prematurely: osmo-stp_10.42.42.5(pid=29870) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29870)] [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 23:44:16.216140 tst iperf3.py:8: Test FAILED (7.5 sec) 23:44:16.246434 run osmo-hlr_10.42.42.2(pid=29867): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29867)] 23:44:16.296042 run osmo-hlr_10.42.42.2(pid=29867): stdout: | (launched: 2022-12-08_23:44:13.036020) 23:44:16.347900 run osmo-hlr_10.42.42.2(pid=29867): stderr: | [0;m[1;31m20221208234413211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234413211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234413211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234413211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234413211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234413211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234413223 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234413231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234413231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234413232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:44:16.399973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29862): Terminating (SIGTERM) 23:44:16.442486 run iperf3-srv_10.42.42.10(pid=29863): Terminating (SIGTERM) 23:44:16.487069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29866): Terminating (SIGTERM) 23:44:16.529199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29869): Terminating (SIGTERM) 23:44:16.570927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29872): Terminating (SIGTERM) 23:44:16.613213 --- ParallelTerminationStrategy: PID 29862 died... 23:44:16.632551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29862): Terminated: ok {rc=0} 23:44:16.679364 --- ParallelTerminationStrategy: PID 29863 died... 23:44:16.698712 run iperf3-srv_10.42.42.10(pid=29863): Terminated {rc=256} 23:44:16.745323 --- ParallelTerminationStrategy: PID 29866 died... 23:44:16.764459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29866): Terminated: ok {rc=0} 23:44:16.811309 --- ParallelTerminationStrategy: PID 29869 died... 23:44:16.830685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29869): Terminated: ok {rc=0} 23:44:16.877179 --- ParallelTerminationStrategy: PID 29872 died... 23:44:16.896387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29872): Terminated: ok {rc=0} 23:44:16.982757 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 23:44:18.125782 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:18.137312 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:44:18.188190 tst iperf3m4.py: using LAC 17577 23:44:18.308046 tst iperf3m4.py: using RAC 237 23:44:18.426568 tst iperf3m4.py: using CellId 17577 23:44:18.547536 tst iperf3m4.py: using BVCI 17578 23:44:18.658272 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:18.669326 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:18.680046 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:18.691064 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:18.702021 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:18.712732 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:18.723717 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:18.734583 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:18.745704 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:44:18.865441 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:44:18.984398 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:44:19.104054 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:44:19.221901 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:44:19.425119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:19.727658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29874): Launched 23:44:19.989924 run iperf3-srv_10.42.42.10(pid=29875): Launched 23:44:20.103447 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:44:20.306272 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:20.609367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29876): Launched 23:44:20.871152 run iperf3-srv_10.42.42.10(pid=29877): Launched 23:44:20.984504 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:44:21.186446 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:21.488446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29878): Launched 23:44:21.751357 run iperf3-srv_10.42.42.10(pid=29879): Launched 23:44:21.864367 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:44:22.068385 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:22.391603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29880): Launched 23:44:22.671366 run iperf3-srv_10.42.42.10(pid=29881): Launched 23:44:22.791855 tst iperf3m4.py:8: start network... 23:44:23.008357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:44:23.506535 run create_hlr_db(pid=29882): Launched 23:44:23.638486 bus /gobi_6: Setting Powered False 23:44:24.702116 run create_hlr_db(pid=29882): Terminated: ok {rc=0} 23:44:25.131820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29884): Launched 23:44:25.434938 run osmo-hlr_10.42.42.2(pid=29885): Launched 23:44:25.550479 run osmo-stp_10.42.42.5: Starting osmo-stp 23:44:26.074094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29887): Launched 23:44:26.377180 run osmo-stp_10.42.42.5(pid=29888): Launched 23:44:26.492183 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:44:27.013658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29890): Launched 23:44:27.128943 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:44:27.382714 run patchelf(pid=29891): Launched 23:44:27.550705 run osmo-stp_10.42.42.5(pid=29888): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29888)] 23:44:27.678812 run osmo-stp_10.42.42.5(pid=29888): stdout: | (launched: 2022-12-08_23:44:26.321563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:27.808653 run osmo-stp_10.42.42.5(pid=29888): stderr: | [0;m[38;5;43m20221208234426493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234426493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234426493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234426493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234426494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234426494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234426494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:27.938640 run osmo-stp_10.42.42.5(pid=29888): stdout: | (launched: 2022-12-08_23:44:26.321563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:28.062014 run osmo-stp_10.42.42.5(pid=29888): stderr: | [0;m[38;5;43m20221208234426493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234426493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234426493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234426493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234426494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234426494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234426494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:28.207953 run patchelf(pid=29891): Terminating (SIGINT) 23:44:28.376293 run patchelf(pid=29891): Terminated: ok {rc=0} 23:44:28.498344 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29888): Process ended prematurely: osmo-stp_10.42.42.5(pid=29888) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29888)] [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 23:44:28.507780 tst iperf3m4.py:8: Test FAILED (10.4 sec) 23:44:28.535446 run osmo-hlr_10.42.42.2(pid=29885): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29885)] 23:44:28.582628 run osmo-hlr_10.42.42.2(pid=29885): stdout: | (launched: 2022-12-08_23:44:25.380044) 23:44:28.631711 run osmo-hlr_10.42.42.2(pid=29885): stderr: | [0;m[1;31m20221208234425558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234425558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234425558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234425558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234425558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234425558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234425570 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234425579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234425579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234425579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:44:28.681322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29874): Terminating (SIGTERM) 23:44:28.720723 run iperf3-srv_10.42.42.10(pid=29875): Terminating (SIGTERM) 23:44:28.760213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29876): Terminating (SIGTERM) 23:44:28.799583 run iperf3-srv_10.42.42.10(pid=29877): Terminating (SIGTERM) 23:44:28.839204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29878): Terminating (SIGTERM) 23:44:28.878522 run iperf3-srv_10.42.42.10(pid=29879): Terminating (SIGTERM) 23:44:28.917549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29880): Terminating (SIGTERM) 23:44:28.956883 run iperf3-srv_10.42.42.10(pid=29881): Terminating (SIGTERM) 23:44:28.995930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29884): Terminating (SIGTERM) 23:44:29.035083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29887): Terminating (SIGTERM) 23:44:29.074257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29890): Terminating (SIGTERM) 23:44:29.113854 --- ParallelTerminationStrategy: PID 29874 died... 23:44:29.132516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29874): Terminated: ok {rc=0} 23:44:29.176109 --- ParallelTerminationStrategy: PID 29875 died... 23:44:29.194217 run iperf3-srv_10.42.42.10(pid=29875): Terminated {rc=256} 23:44:29.237498 --- ParallelTerminationStrategy: PID 29876 died... 23:44:29.255610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29876): Terminated: ok {rc=0} 23:44:29.299102 --- ParallelTerminationStrategy: PID 29877 died... 23:44:29.317198 run iperf3-srv_10.42.42.10(pid=29877): Terminated {rc=256} 23:44:29.360356 --- ParallelTerminationStrategy: PID 29878 died... 23:44:29.378536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29878): Terminated: ok {rc=0} 23:44:29.421898 --- ParallelTerminationStrategy: PID 29879 died... 23:44:29.440041 run iperf3-srv_10.42.42.10(pid=29879): Terminated {rc=256} 23:44:29.483746 --- ParallelTerminationStrategy: PID 29880 died... 23:44:29.501971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29880): Terminated: ok {rc=0} 23:44:29.545620 --- ParallelTerminationStrategy: PID 29881 died... 23:44:29.563909 run iperf3-srv_10.42.42.10(pid=29881): Terminated {rc=256} 23:44:29.607779 --- ParallelTerminationStrategy: PID 29884 died... 23:44:29.626068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29884): Terminated: ok {rc=0} 23:44:29.669565 --- ParallelTerminationStrategy: PID 29887 died... 23:44:29.688008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29887): Terminated: ok {rc=0} 23:44:29.731661 --- ParallelTerminationStrategy: PID 29890 died... 23:44:29.749977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29890): Terminated: ok {rc=0} 23:44:29.834316 bus /gobi_4: Setting Powered False 23:44:30.945419 bus /gobi_4: Setting Powered False 23:44:32.083127 bus /gobi_1: Setting Powered False 23:44:33.182524 bus /gobi_1: Setting Powered False 23:44:34.293640 bus /gobi_0: Setting Powered False 23:44:35.390475 bus /gobi_0: Setting Powered False 23:44:36.505306 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 23:44:37.605217 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:37.616649 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:44:37.667573 tst ping.py: using LAC 17578 23:44:37.785328 tst ping.py: using RAC 238 23:44:37.902785 tst ping.py: using CellId 17578 23:44:38.019776 tst ping.py: using BVCI 17579 23:44:38.126986 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:38.137896 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:38.148485 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:38.159572 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:38.170293 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:38.181193 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:38.192258 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:38.203613 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:44:38.320899 tst ping.py:19: start network... 23:44:38.535600 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:44:39.023200 run create_hlr_db(pid=29892): Launched 23:44:39.151455 bus /gobi_6: Setting Powered False 23:44:40.213868 run create_hlr_db(pid=29892): Terminated: ok {rc=0} 23:44:40.655276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29894): Launched 23:44:40.970246 run osmo-hlr_10.42.42.2(pid=29895): Launched 23:44:41.090004 run osmo-stp_10.42.42.5: Starting osmo-stp 23:44:41.635030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29897): Launched 23:44:41.951283 run osmo-stp_10.42.42.5(pid=29898): Launched 23:44:42.071382 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:44:42.617707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29900): Launched 23:44:42.738579 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:44:43.004605 run patchelf(pid=29901): Launched 23:44:43.180746 run osmo-stp_10.42.42.5(pid=29898): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29898)] 23:44:43.314825 run osmo-stp_10.42.42.5(pid=29898): stdout: | (launched: 2022-12-08_23:44:41.894088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:43.450574 run osmo-stp_10.42.42.5(pid=29898): stderr: | [0;m[38;5;43m20221208234442084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234442084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234442085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234442085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234442086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234442086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234442086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:43.587044 run osmo-stp_10.42.42.5(pid=29898): stdout: | (launched: 2022-12-08_23:44:41.894088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:43.716310 run osmo-stp_10.42.42.5(pid=29898): stderr: | [0;m[38;5;43m20221208234442084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234442084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234442085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234442085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234442086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234442086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234442086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:43.870621 run patchelf(pid=29901): Terminating (SIGINT) 23:44:44.047123 run patchelf(pid=29901): Terminated: ok {rc=0} 23:44:44.174439 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29898): Process ended prematurely: osmo-stp_10.42.42.5(pid=29898) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29898)] [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 23:44:44.183954 tst ping.py:22: Test FAILED (6.6 sec) 23:44:44.211875 run osmo-hlr_10.42.42.2(pid=29895): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29895)] 23:44:44.261113 run osmo-hlr_10.42.42.2(pid=29895): stdout: | (launched: 2022-12-08_23:44:40.913195) 23:44:44.311828 run osmo-hlr_10.42.42.2(pid=29895): stderr: | [0;m[1;31m20221208234441110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234441110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234441110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234441110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234441110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234441111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234441123 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234441131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234441132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234441132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:44:44.363160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29894): Terminating (SIGTERM) 23:44:44.404397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29897): Terminating (SIGTERM) 23:44:44.445694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29900): Terminating (SIGTERM) 23:44:44.487426 --- ParallelTerminationStrategy: PID 29894 died... 23:44:44.507144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29894): Terminated: ok {rc=0} 23:44:44.552746 --- ParallelTerminationStrategy: PID 29897 died... 23:44:44.572015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29897): Terminated: ok {rc=0} 23:44:44.617345 --- ParallelTerminationStrategy: PID 29900 died... 23:44:44.636551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29900): Terminated: ok {rc=0} 23:44:44.722963 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 23:44:45.809966 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:45.822753 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:44:45.882212 tst ping_idle_ping.py: using LAC 17579 23:44:46.031049 tst ping_idle_ping.py: using RAC 239 23:44:46.198766 tst ping_idle_ping.py: using CellId 17579 23:44:46.359457 tst ping_idle_ping.py: using BVCI 17580 23:44:46.474500 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:46.486831 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:46.498863 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:46.513202 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:46.526285 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:46.538339 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:46.551490 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:46.564895 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:44:46.696893 tst ping_idle_ping.py:24: start network... 23:44:46.946296 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:44:47.421856 run create_hlr_db(pid=29902): Launched 23:44:47.538240 bus /gobi_6: Setting Powered False 23:44:48.598047 run create_hlr_db(pid=29902): Terminated: ok {rc=0} 23:44:49.014777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29904): Launched 23:44:49.313334 run osmo-hlr_10.42.42.2(pid=29905): Launched 23:44:49.427491 run osmo-stp_10.42.42.5: Starting osmo-stp 23:44:49.938093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29907): Launched 23:44:50.235648 run osmo-stp_10.42.42.5(pid=29908): Launched 23:44:50.349500 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:44:50.865389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29910): Launched 23:44:50.980229 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:44:51.232194 run patchelf(pid=29911): Launched 23:44:51.398408 run osmo-stp_10.42.42.5(pid=29908): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29908)] 23:44:51.525271 run osmo-stp_10.42.42.5(pid=29908): stdout: | (launched: 2022-12-08_23:44:50.181520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:51.653777 run osmo-stp_10.42.42.5(pid=29908): stderr: | [0;m[38;5;43m20221208234450351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234450351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234450351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234450351 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234450352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234450352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234450352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:51.782481 run osmo-stp_10.42.42.5(pid=29908): stdout: | (launched: 2022-12-08_23:44:50.181520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:51.905842 run osmo-stp_10.42.42.5(pid=29908): stderr: | [0;m[38;5;43m20221208234450351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234450351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234450351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234450351 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234450352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234450352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234450352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:52.050719 run patchelf(pid=29911): Terminating (SIGINT) 23:44:52.217751 run patchelf(pid=29911): Terminated: ok {rc=0} 23:44:52.337988 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29908): Process ended prematurely: osmo-stp_10.42.42.5(pid=29908) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29908)] [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 23:44:52.346876 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:44:52.373878 run osmo-hlr_10.42.42.2(pid=29905): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29905)] 23:44:52.420735 run osmo-hlr_10.42.42.2(pid=29905): stdout: | (launched: 2022-12-08_23:44:49.258881) 23:44:52.469509 run osmo-hlr_10.42.42.2(pid=29905): stderr: | [0;m[1;31m20221208234449434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234449434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234449434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234449434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234449434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234449434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234449445 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234449454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234449454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234449455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:44:52.518579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29904): Terminating (SIGTERM) 23:44:52.557833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29907): Terminating (SIGTERM) 23:44:52.597281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29910): Terminating (SIGTERM) 23:44:52.636853 --- ParallelTerminationStrategy: PID 29904 died... 23:44:52.655711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29904): Terminated: ok {rc=0} 23:44:52.699358 --- ParallelTerminationStrategy: PID 29907 died... 23:44:52.717639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29907): Terminated: ok {rc=0} 23:44:52.761587 --- ParallelTerminationStrategy: PID 29910 died... 23:44:52.779848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29910): Terminated: ok {rc=0} 23:44:52.865408 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 23:44:54.180742 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:44:54.187384 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 23:44:54.221678 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 23:44:54.260491 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 23:44:54.349855 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 23:44:54.382826 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 23:44:54.420226 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 23:44:55.016142 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 23:44:55.068144 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:55.079432 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:44:55.153401 tst cs_paging_gprs_active.py: using LAC 17580 23:44:55.279287 tst cs_paging_gprs_active.py: using RAC 240 23:44:55.405448 tst cs_paging_gprs_active.py: using CellId 17580 23:44:55.522697 tst cs_paging_gprs_active.py: using BVCI 17581 23:44:55.634644 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:55.645601 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:55.656379 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:55.667517 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:55.678706 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:55.689663 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:55.700455 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:55.711284 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:55.722270 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:44:55.840369 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:44:55.957937 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:44:56.161593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:56.465326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29915): Launched 23:44:56.728443 run iperf3-srv_10.42.42.10(pid=29916): Launched 23:44:56.842061 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:44:57.045265 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:57.348755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29917): Launched 23:44:57.612425 run iperf3-srv_10.42.42.10(pid=29918): Launched 23:44:57.725875 tst cs_paging_gprs_active.py:38: start network... 23:44:57.929364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:44:58.398193 run create_hlr_db(pid=29919): Launched 23:44:58.513129 bus /gobi_6: Setting Powered False 23:44:59.573564 run create_hlr_db(pid=29919): Terminated: ok {rc=0} 23:45:00.013556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29921): Launched 23:45:00.336162 run osmo-hlr_10.42.42.2(pid=29922): Launched 23:45:00.460008 run osmo-stp_10.42.42.5: Starting osmo-stp 23:45:01.062605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29924): Launched 23:45:01.398186 run osmo-stp_10.42.42.5(pid=29925): Launched 23:45:01.545826 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:45:02.232687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29930): Launched 23:45:02.367190 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:45:02.641222 run patchelf(pid=29931): Launched 23:45:02.820514 run osmo-stp_10.42.42.5(pid=29925): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29925)] 23:45:02.956864 run osmo-stp_10.42.42.5(pid=29925): stdout: | (launched: 2022-12-08_23:45:01.326427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:03.094721 run osmo-stp_10.42.42.5(pid=29925): stderr: | [0;m[38;5;43m20221208234501676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234501676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234501676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234501677 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234501677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234501677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234501678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:03.232108 run osmo-stp_10.42.42.5(pid=29925): stdout: | (launched: 2022-12-08_23:45:01.326427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:03.363943 run osmo-stp_10.42.42.5(pid=29925): stderr: | [0;m[38;5;43m20221208234501676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234501676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234501676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234501677 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234501677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234501677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234501678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:03.520535 run patchelf(pid=29931): Terminating (SIGINT) 23:45:03.700270 run patchelf(pid=29931): Terminated: ok {rc=0} 23:45:03.829951 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29925): Process ended prematurely: osmo-stp_10.42.42.5(pid=29925) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29925)] [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 23:45:03.840072 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 23:45:03.868285 run osmo-hlr_10.42.42.2(pid=29922): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29922)] 23:45:03.917822 run osmo-hlr_10.42.42.2(pid=29922): stdout: | (launched: 2022-12-08_23:45:00.278159) 23:45:03.969451 run osmo-hlr_10.42.42.2(pid=29922): stderr: | [0;m[1;31m20221208234500476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234500476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234500476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234500476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234500476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234500476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234500487 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234500496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234500496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234500496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:45:04.021073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29915): Terminating (SIGTERM) 23:45:04.062306 run iperf3-srv_10.42.42.10(pid=29916): Terminating (SIGTERM) 23:45:04.103531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29917): Terminating (SIGTERM) 23:45:04.144783 run iperf3-srv_10.42.42.10(pid=29918): Terminating (SIGTERM) 23:45:04.185907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29921): Terminating (SIGTERM) 23:45:04.227201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29924): Terminating (SIGTERM) 23:45:04.268457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29930): Terminating (SIGTERM) 23:45:04.310036 --- ParallelTerminationStrategy: PID 29915 died... 23:45:04.329793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29915): Terminated: ok {rc=0} 23:45:04.375212 --- ParallelTerminationStrategy: PID 29916 died... 23:45:04.394345 run iperf3-srv_10.42.42.10(pid=29916): Terminated {rc=256} 23:45:04.439389 --- ParallelTerminationStrategy: PID 29917 died... 23:45:04.458400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29917): Terminated: ok {rc=0} 23:45:04.503531 --- ParallelTerminationStrategy: PID 29918 died... 23:45:04.522496 run iperf3-srv_10.42.42.10(pid=29918): Terminated {rc=256} 23:45:04.567913 --- ParallelTerminationStrategy: PID 29921 died... 23:45:04.587090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29921): Terminated: ok {rc=0} 23:45:04.632145 --- ParallelTerminationStrategy: PID 29924 died... 23:45:04.651265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29924): Terminated: ok {rc=0} 23:45:04.696280 --- ParallelTerminationStrategy: PID 29930 died... 23:45:04.715367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29930): Terminated: ok {rc=0} 23:45:04.800863 bus /gobi_0: Setting Powered False 23:45:05.896272 bus /gobi_0: Setting Powered False 23:45:07.010609 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 23:45:08.155358 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:08.166962 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:45:08.238351 tst iperf3.py: using LAC 17581 23:45:08.369689 tst iperf3.py: using RAC 241 23:45:08.495259 tst iperf3.py: using CellId 17581 23:45:08.613646 tst iperf3.py: using BVCI 17582 23:45:08.723907 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:08.734946 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:08.745795 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:08.757028 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:08.768131 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:08.779227 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:08.790259 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:08.801103 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:08.812175 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:45:08.928933 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:45:09.147251 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:09.469301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29932): Launched 23:45:09.747961 run iperf3-srv_10.42.42.10(pid=29933): Launched 23:45:09.868737 tst iperf3.py:8: start network... 23:45:10.086219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:45:10.583665 run create_hlr_db(pid=29934): Launched 23:45:10.713950 bus /gobi_6: Setting Powered False 23:45:11.778306 run create_hlr_db(pid=29934): Terminated: ok {rc=0} 23:45:12.208043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29936): Launched 23:45:12.511149 run osmo-hlr_10.42.42.2(pid=29937): Launched 23:45:12.628636 run osmo-stp_10.42.42.5: Starting osmo-stp 23:45:13.158925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29939): Launched 23:45:13.460192 run osmo-stp_10.42.42.5(pid=29940): Launched 23:45:13.576589 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:45:14.099083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29942): Launched 23:45:14.215346 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:45:14.471342 run patchelf(pid=29943): Launched 23:45:14.640750 run osmo-stp_10.42.42.5(pid=29940): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29940)] 23:45:14.769566 run osmo-stp_10.42.42.5(pid=29940): stdout: | (launched: 2022-12-08_23:45:13.405741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:14.900174 run osmo-stp_10.42.42.5(pid=29940): stderr: | [0;m[38;5;43m20221208234513575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234513575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234513576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234513576 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234513576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234513577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234513577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:15.031159 run osmo-stp_10.42.42.5(pid=29940): stdout: | (launched: 2022-12-08_23:45:13.405741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:15.155490 run osmo-stp_10.42.42.5(pid=29940): stderr: | [0;m[38;5;43m20221208234513575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234513575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234513576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234513576 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234513576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234513577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234513577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:15.302809 run patchelf(pid=29943): Terminating (SIGINT) 23:45:15.473079 run patchelf(pid=29943): Terminated: ok {rc=0} 23:45:15.596129 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29940): Process ended prematurely: osmo-stp_10.42.42.5(pid=29940) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29940)] [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 23:45:15.605706 tst iperf3.py:8: Test FAILED (7.5 sec) 23:45:15.633277 run osmo-hlr_10.42.42.2(pid=29937): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29937)] 23:45:15.680696 run osmo-hlr_10.42.42.2(pid=29937): stdout: | (launched: 2022-12-08_23:45:12.456273) 23:45:15.729884 run osmo-hlr_10.42.42.2(pid=29937): stderr: | [0;m[1;31m20221208234512629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234512629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234512629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234512629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234512629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234512629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234512641 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234512649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234512649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234512649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:45:15.779563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29932): Terminating (SIGTERM) 23:45:15.819374 run iperf3-srv_10.42.42.10(pid=29933): Terminating (SIGTERM) 23:45:15.901695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29936): Terminating (SIGTERM) 23:45:15.943457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29939): Terminating (SIGTERM) 23:45:15.986485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29942): Terminating (SIGTERM) 23:45:16.039026 --- ParallelTerminationStrategy: PID 29932 died... 23:45:16.062811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29932): Terminated: ok {rc=0} 23:45:16.121325 --- ParallelTerminationStrategy: PID 29933 died... 23:45:16.145200 run iperf3-srv_10.42.42.10(pid=29933): Terminated {rc=256} 23:45:16.199837 --- ParallelTerminationStrategy: PID 29936 died... 23:45:16.222875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29936): Terminated: ok {rc=0} 23:45:16.278538 --- ParallelTerminationStrategy: PID 29939 died... 23:45:16.302464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29939): Terminated: ok {rc=0} 23:45:16.357769 --- ParallelTerminationStrategy: PID 29942 died... 23:45:16.381645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29942): Terminated: ok {rc=0} 23:45:16.486260 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 23:45:17.642137 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:17.656774 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:45:17.729121 tst iperf3m4.py: using LAC 17582 23:45:17.855129 tst iperf3m4.py: using RAC 242 23:45:17.983343 tst iperf3m4.py: using CellId 17582 23:45:18.110255 tst iperf3m4.py: using BVCI 17583 23:45:18.227109 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:18.238705 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:18.250085 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:18.261791 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:18.273384 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:18.284887 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:18.296695 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:18.308223 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:18.320138 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:45:18.439831 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:45:18.557375 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:45:18.672586 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:45:18.791987 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:45:19.010532 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:19.333511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29944): Launched 23:45:19.615051 run iperf3-srv_10.42.42.10(pid=29945): Launched 23:45:19.736275 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:45:19.954130 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:20.277925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29946): Launched 23:45:20.558357 run iperf3-srv_10.42.42.10(pid=29947): Launched 23:45:20.679312 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:45:20.897427 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:21.221766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29948): Launched 23:45:21.501895 run iperf3-srv_10.42.42.10(pid=29949): Launched 23:45:21.623071 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:45:21.840820 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:22.165508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29950): Launched 23:45:22.445658 run iperf3-srv_10.42.42.10(pid=29951): Launched 23:45:22.567059 tst iperf3m4.py:8: start network... 23:45:22.783998 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:45:23.284367 run create_hlr_db(pid=29952): Launched 23:45:23.415576 bus /gobi_6: Setting Powered False 23:45:24.479260 run create_hlr_db(pid=29952): Terminated: ok {rc=0} 23:45:24.927632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29954): Launched 23:45:25.249945 run osmo-hlr_10.42.42.2(pid=29955): Launched 23:45:25.372786 run osmo-stp_10.42.42.5: Starting osmo-stp 23:45:25.926300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29957): Launched 23:45:26.247881 run osmo-stp_10.42.42.5(pid=29958): Launched 23:45:26.371045 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:45:26.926439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29960): Launched 23:45:27.049391 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:45:27.321071 run patchelf(pid=29961): Launched 23:45:27.499371 run osmo-stp_10.42.42.5(pid=29958): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29958)] 23:45:27.635682 run osmo-stp_10.42.42.5(pid=29958): stdout: | (launched: 2022-12-08_23:45:26.189611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:27.773695 run osmo-stp_10.42.42.5(pid=29958): stderr: | [0;m[38;5;43m20221208234526385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234526385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234526385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234526386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234526386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234526386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234526386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:27.911313 run osmo-stp_10.42.42.5(pid=29958): stdout: | (launched: 2022-12-08_23:45:26.189611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:28.042976 run osmo-stp_10.42.42.5(pid=29958): stderr: | [0;m[38;5;43m20221208234526385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234526385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234526385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234526386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234526386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234526386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234526386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:28.199184 run patchelf(pid=29961): Terminating (SIGINT) 23:45:28.378869 run patchelf(pid=29961): Terminated: ok {rc=0} 23:45:28.509074 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29958): Process ended prematurely: osmo-stp_10.42.42.5(pid=29958) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29958)] [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 23:45:28.519287 tst iperf3m4.py:8: Test FAILED (10.9 sec) 23:45:28.547601 run osmo-hlr_10.42.42.2(pid=29955): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29955)] 23:45:28.596691 run osmo-hlr_10.42.42.2(pid=29955): stdout: | (launched: 2022-12-08_23:45:25.191671) 23:45:28.647605 run osmo-hlr_10.42.42.2(pid=29955): stderr: | [0;m[1;31m20221208234525389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234525389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234525389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234525389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234525389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234525389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234525401 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234525409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234525410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234525410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:45:28.698832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29944): Terminating (SIGTERM) 23:45:28.739864 run iperf3-srv_10.42.42.10(pid=29945): Terminating (SIGTERM) 23:45:28.780769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29946): Terminating (SIGTERM) 23:45:28.821971 run iperf3-srv_10.42.42.10(pid=29947): Terminating (SIGTERM) 23:45:28.862789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29948): Terminating (SIGTERM) 23:45:28.903831 run iperf3-srv_10.42.42.10(pid=29949): Terminating (SIGTERM) 23:45:28.944609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29950): Terminating (SIGTERM) 23:45:28.985600 run iperf3-srv_10.42.42.10(pid=29951): Terminating (SIGTERM) 23:45:29.026490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29954): Terminating (SIGTERM) 23:45:29.067443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29957): Terminating (SIGTERM) 23:45:29.108350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29960): Terminating (SIGTERM) 23:45:29.149582 --- ParallelTerminationStrategy: PID 29944 died... 23:45:29.169109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29944): Terminated: ok {rc=0} 23:45:29.214381 --- ParallelTerminationStrategy: PID 29945 died... 23:45:29.233410 run iperf3-srv_10.42.42.10(pid=29945): Terminated {rc=256} 23:45:29.278274 --- ParallelTerminationStrategy: PID 29946 died... 23:45:29.297355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29946): Terminated: ok {rc=0} 23:45:29.342957 --- ParallelTerminationStrategy: PID 29947 died... 23:45:29.362144 run iperf3-srv_10.42.42.10(pid=29947): Terminated {rc=256} 23:45:29.407039 --- ParallelTerminationStrategy: PID 29948 died... 23:45:29.426216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29948): Terminated: ok {rc=0} 23:45:29.471417 --- ParallelTerminationStrategy: PID 29949 died... 23:45:29.490518 run iperf3-srv_10.42.42.10(pid=29949): Terminated {rc=256} 23:45:29.535573 --- ParallelTerminationStrategy: PID 29950 died... 23:45:29.554729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29950): Terminated: ok {rc=0} 23:45:29.600129 --- ParallelTerminationStrategy: PID 29951 died... 23:45:29.619276 run iperf3-srv_10.42.42.10(pid=29951): Terminated {rc=256} 23:45:29.664137 --- ParallelTerminationStrategy: PID 29954 died... 23:45:29.683221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29954): Terminated: ok {rc=0} 23:45:29.728401 --- ParallelTerminationStrategy: PID 29957 died... 23:45:29.747640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29957): Terminated: ok {rc=0} 23:45:29.793247 --- ParallelTerminationStrategy: PID 29960 died... 23:45:29.812199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29960): Terminated: ok {rc=0} 23:45:29.897817 bus /gobi_4: Setting Powered False 23:45:30.998854 bus /gobi_4: Setting Powered False 23:45:32.121608 bus /gobi_1: Setting Powered False 23:45:33.218949 bus /gobi_1: Setting Powered False 23:45:34.333050 bus /gobi_0: Setting Powered False 23:45:35.430871 bus /gobi_0: Setting Powered False 23:45:36.546190 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 23:45:37.647796 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:37.659799 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:45:37.733207 tst ping.py: using LAC 17583 23:45:37.857949 tst ping.py: using RAC 243 23:45:37.982541 tst ping.py: using CellId 17583 23:45:38.106680 tst ping.py: using BVCI 17584 23:45:38.221201 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:38.232571 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:38.243959 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:38.255180 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:38.266315 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:38.277490 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:38.288668 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:38.299789 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:45:38.416011 tst ping.py:19: start network... 23:45:38.628760 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:45:39.114916 run create_hlr_db(pid=29963): Launched 23:45:39.242206 bus /gobi_6: Setting Powered False 23:45:40.305238 run create_hlr_db(pid=29963): Terminated: ok {rc=0} 23:45:40.745416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29965): Launched 23:45:41.059522 run osmo-hlr_10.42.42.2(pid=29966): Launched 23:45:41.179694 run osmo-stp_10.42.42.5: Starting osmo-stp 23:45:41.723560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29968): Launched 23:45:42.038750 run osmo-stp_10.42.42.5(pid=29969): Launched 23:45:42.159215 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:45:42.705319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29971): Launched 23:45:42.825879 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:45:43.091900 run patchelf(pid=29972): Launched 23:45:43.267594 run osmo-stp_10.42.42.5(pid=29969): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29969)] 23:45:43.401374 run osmo-stp_10.42.42.5(pid=29969): stdout: | (launched: 2022-12-08_23:45:41.981712) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:43.537349 run osmo-stp_10.42.42.5(pid=29969): stderr: | [0;m[38;5;43m20221208234542171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234542172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234542172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234542172 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234542173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234542173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234542173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:43.672844 run osmo-stp_10.42.42.5(pid=29969): stdout: | (launched: 2022-12-08_23:45:41.981712) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:43.802593 run osmo-stp_10.42.42.5(pid=29969): stderr: | [0;m[38;5;43m20221208234542171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234542172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234542172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234542172 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234542173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234542173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234542173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:43.955827 run patchelf(pid=29972): Terminating (SIGINT) 23:45:44.132542 run patchelf(pid=29972): Terminated: ok {rc=0} 23:45:44.260025 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29969): Process ended prematurely: osmo-stp_10.42.42.5(pid=29969) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29969)] [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 23:45:44.270340 tst ping.py:22: Test FAILED (6.6 sec) 23:45:44.298475 run osmo-hlr_10.42.42.2(pid=29966): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29966)] 23:45:44.347848 run osmo-hlr_10.42.42.2(pid=29966): stdout: | (launched: 2022-12-08_23:45:41.002859) 23:45:44.398990 run osmo-hlr_10.42.42.2(pid=29966): stderr: | [0;m[1;31m20221208234541197 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234541198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234541198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234541198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234541198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234541198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234541211 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234541220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234541220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234541220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:45:44.450502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29965): Terminating (SIGTERM) 23:45:44.491739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29968): Terminating (SIGTERM) 23:45:44.533537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29971): Terminating (SIGTERM) 23:45:44.575014 --- ParallelTerminationStrategy: PID 29965 died... 23:45:44.594325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29965): Terminated: ok {rc=0} 23:45:44.639657 --- ParallelTerminationStrategy: PID 29968 died... 23:45:44.659113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29968): Terminated: ok {rc=0} 23:45:44.704309 --- ParallelTerminationStrategy: PID 29971 died... 23:45:44.723505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29971): Terminated: ok {rc=0} 23:45:44.809574 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 23:45:45.906170 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:45.925299 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:45:45.998816 tst ping_idle_ping.py: using LAC 17584 23:45:46.130806 tst ping_idle_ping.py: using RAC 244 23:45:46.251615 tst ping_idle_ping.py: using CellId 17584 23:45:46.400516 tst ping_idle_ping.py: using BVCI 17585 23:45:46.513289 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:46.525198 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:46.536664 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:46.548784 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:46.561264 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:46.572717 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:46.585823 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:46.597186 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:45:46.732500 tst ping_idle_ping.py:24: start network... 23:45:47.003328 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:45:47.513700 run create_hlr_db(pid=29973): Launched 23:45:47.643249 bus /gobi_6: Setting Powered False 23:45:48.706433 run create_hlr_db(pid=29973): Terminated: ok {rc=0} 23:45:49.132226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29975): Launched 23:45:49.432522 run osmo-hlr_10.42.42.2(pid=29976): Launched 23:45:49.546714 run osmo-stp_10.42.42.5: Starting osmo-stp 23:45:50.076212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29978): Launched 23:45:50.373666 run osmo-stp_10.42.42.5(pid=29979): Launched 23:45:50.487212 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:45:51.001207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29981): Launched 23:45:51.115666 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:45:51.366147 run patchelf(pid=29982): Launched 23:45:51.531721 run osmo-stp_10.42.42.5(pid=29979): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29979)] 23:45:51.657941 run osmo-stp_10.42.42.5(pid=29979): stdout: | (launched: 2022-12-08_23:45:50.319814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:51.785752 run osmo-stp_10.42.42.5(pid=29979): stderr: | [0;m[38;5;43m20221208234550489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234550489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234550489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234550490 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234550490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234550490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234550490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:51.913592 run osmo-stp_10.42.42.5(pid=29979): stdout: | (launched: 2022-12-08_23:45:50.319814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:52.035307 run osmo-stp_10.42.42.5(pid=29979): stderr: | [0;m[38;5;43m20221208234550489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234550489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234550489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234550490 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234550490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234550490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234550490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:52.179547 run patchelf(pid=29982): Terminating (SIGINT) 23:45:52.346436 run patchelf(pid=29982): Terminated: ok {rc=0} 23:45:52.467724 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29979): Process ended prematurely: osmo-stp_10.42.42.5(pid=29979) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29979)] [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 23:45:52.476700 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 23:45:52.503235 run osmo-hlr_10.42.42.2(pid=29976): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29976)] 23:45:52.550701 run osmo-hlr_10.42.42.2(pid=29976): stdout: | (launched: 2022-12-08_23:45:49.378287) 23:45:52.599450 run osmo-hlr_10.42.42.2(pid=29976): stderr: | [0;m[1;31m20221208234549554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234549554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234549554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234549554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234549554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234549554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234549566 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234549575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234549575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234549575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:45:52.649044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29975): Terminating (SIGTERM) 23:45:52.687969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29978): Terminating (SIGTERM) 23:45:52.727321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29981): Terminating (SIGTERM) 23:45:52.766655 --- ParallelTerminationStrategy: PID 29975 died... 23:45:52.785181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29975): Terminated: ok {rc=0} 23:45:52.828621 --- ParallelTerminationStrategy: PID 29978 died... 23:45:52.846702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29978): Terminated: ok {rc=0} 23:45:52.889964 --- ParallelTerminationStrategy: PID 29981 died... 23:45:52.908164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29981): Terminated: ok {rc=0} 23:45:52.992189 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:45:54.292708 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:45:54.299055 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:45:54.332824 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 23:45:54.371027 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 23:45:54.455351 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:45:54.488592 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 23:45:54.526137 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 23:45:55.126848 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 23:45:55.179510 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:55.190980 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:45:55.263657 tst cs_paging_gprs_active.py: using LAC 17585 23:45:55.393120 tst cs_paging_gprs_active.py: using RAC 245 23:45:55.519965 tst cs_paging_gprs_active.py: using CellId 17585 23:45:55.653086 tst cs_paging_gprs_active.py: using BVCI 17586 23:45:55.772218 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:55.783737 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:55.795161 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:55.807039 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:55.818860 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:55.830771 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:55.842468 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:55.853605 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:55.865924 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:45:55.987506 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:45:56.106564 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:45:56.324796 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:56.648684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29991): Launched 23:45:56.928588 run iperf3-srv_10.42.42.10(pid=29992): Launched 23:45:57.049714 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:45:57.267601 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:57.591537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29993): Launched 23:45:57.871271 run iperf3-srv_10.42.42.10(pid=29994): Launched 23:45:57.992173 tst cs_paging_gprs_active.py:38: start network... 23:45:58.210435 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:45:58.712143 run create_hlr_db(pid=29995): Launched 23:45:58.842859 bus /gobi_6: Setting Powered False 23:45:59.906119 run create_hlr_db(pid=29995): Terminated: ok {rc=0} 23:46:00.335504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29997): Launched 23:46:00.639316 run osmo-hlr_10.42.42.2(pid=29998): Launched 23:46:00.755141 run osmo-stp_10.42.42.5: Starting osmo-stp 23:46:01.386678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30000): Launched 23:46:01.737648 run osmo-stp_10.42.42.5(pid=30001): Launched 23:46:01.982443 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:46:02.597921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30003): Launched 23:46:02.721514 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:46:02.993255 run patchelf(pid=30004): Launched 23:46:03.172284 run osmo-stp_10.42.42.5(pid=30001): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30001)] 23:46:03.308164 run osmo-stp_10.42.42.5(pid=30001): stdout: | (launched: 2022-12-08_23:46:01.664884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:03.445414 run osmo-stp_10.42.42.5(pid=30001): stderr: | [0;m[38;5;43m20221208234601964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234601964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234601964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234601965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234601965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234601965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234601965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:03.583138 run osmo-stp_10.42.42.5(pid=30001): stdout: | (launched: 2022-12-08_23:46:01.664884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:03.714855 run osmo-stp_10.42.42.5(pid=30001): stderr: | [0;m[38;5;43m20221208234601964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234601964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234601964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234601965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234601965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234601965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234601965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:03.870618 run patchelf(pid=30004): Terminating (SIGINT) 23:46:04.050190 run patchelf(pid=30004): Terminated: ok {rc=0} 23:46:04.179666 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30001): Process ended prematurely: osmo-stp_10.42.42.5(pid=30001) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30001)] [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 23:46:04.189830 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 23:46:04.218426 run osmo-hlr_10.42.42.2(pid=29998): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29998)] 23:46:04.267915 run osmo-hlr_10.42.42.2(pid=29998): stdout: | (launched: 2022-12-08_23:46:00.584428) 23:46:04.319105 run osmo-hlr_10.42.42.2(pid=29998): stderr: | [0;m[1;31m20221208234600762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234600762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234600762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234600762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234600762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234600762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234600775 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234600783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234600783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234600783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:46:04.370740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29991): Terminating (SIGTERM) 23:46:04.412059 run iperf3-srv_10.42.42.10(pid=29992): Terminating (SIGTERM) 23:46:04.453608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29993): Terminating (SIGTERM) 23:46:04.494944 run iperf3-srv_10.42.42.10(pid=29994): Terminating (SIGTERM) 23:46:04.536239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29997): Terminating (SIGTERM) 23:46:04.577641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30000): Terminating (SIGTERM) 23:46:04.618813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30003): Terminating (SIGTERM) 23:46:04.660136 --- ParallelTerminationStrategy: PID 29991 died... 23:46:04.679668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29991): Terminated: ok {rc=0} 23:46:04.724896 --- ParallelTerminationStrategy: PID 29992 died... 23:46:04.744481 run iperf3-srv_10.42.42.10(pid=29992): Terminated {rc=256} 23:46:04.789585 --- ParallelTerminationStrategy: PID 29993 died... 23:46:04.808775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29993): Terminated: ok {rc=0} 23:46:04.853693 --- ParallelTerminationStrategy: PID 29994 died... 23:46:04.872702 run iperf3-srv_10.42.42.10(pid=29994): Terminated {rc=256} 23:46:04.918051 --- ParallelTerminationStrategy: PID 29997 died... 23:46:04.937112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29997): Terminated: ok {rc=0} 23:46:04.982268 --- ParallelTerminationStrategy: PID 30000 died... 23:46:05.001421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30000): Terminated: ok {rc=0} 23:46:05.046453 --- ParallelTerminationStrategy: PID 30003 died... 23:46:05.065657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30003): Terminated: ok {rc=0} 23:46:05.152335 bus /gobi_0: Setting Powered False 23:46:06.251047 bus /gobi_0: Setting Powered False 23:46:07.366147 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 23:46:08.511398 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:08.522911 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:46:08.598698 tst iperf3.py: using LAC 17586 23:46:08.717908 tst iperf3.py: using RAC 246 23:46:08.843012 tst iperf3.py: using CellId 17586 23:46:08.967933 tst iperf3.py: using BVCI 17587 23:46:09.085104 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:09.096540 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:09.107946 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:09.119139 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:09.130280 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:09.141433 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:09.152575 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:09.163729 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:09.175056 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:46:09.292652 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:46:09.510590 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:46:09.834685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30005): Launched 23:46:10.115409 run iperf3-srv_10.42.42.10(pid=30006): Launched 23:46:10.236254 tst iperf3.py:8: start network... 23:46:10.454259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:46:10.953816 run create_hlr_db(pid=30007): Launched 23:46:11.083863 bus /gobi_6: Setting Powered False 23:46:12.146969 run create_hlr_db(pid=30007): Terminated: ok {rc=0} 23:46:12.577810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30009): Launched 23:46:12.880520 run osmo-hlr_10.42.42.2(pid=30010): Launched 23:46:12.996297 run osmo-stp_10.42.42.5: Starting osmo-stp 23:46:13.534979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30012): Launched 23:46:13.836903 run osmo-stp_10.42.42.5(pid=30013): Launched 23:46:13.951568 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:46:14.472405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30015): Launched 23:46:14.588723 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:46:14.843567 run patchelf(pid=30016): Launched 23:46:15.012214 run osmo-stp_10.42.42.5(pid=30013): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30013)] 23:46:15.140764 run osmo-stp_10.42.42.5(pid=30013): stdout: | (launched: 2022-12-08_23:46:13.782106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:15.271082 run osmo-stp_10.42.42.5(pid=30013): stderr: | [0;m[38;5;43m20221208234613953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234613953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234613954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234613954 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234613956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234613956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234613957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:15.401294 run osmo-stp_10.42.42.5(pid=30013): stdout: | (launched: 2022-12-08_23:46:13.782106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:15.525306 run osmo-stp_10.42.42.5(pid=30013): stderr: | [0;m[38;5;43m20221208234613953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234613953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234613954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234613954 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234613956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234613956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234613957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:15.671967 run patchelf(pid=30016): Terminating (SIGINT) 23:46:15.847700 run patchelf(pid=30016): Terminated: ok {rc=0} 23:46:15.990071 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30013): Process ended prematurely: osmo-stp_10.42.42.5(pid=30013) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30013)] [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 23:46:16.000889 tst iperf3.py:8: Test FAILED (7.5 sec) 23:46:16.030585 run osmo-hlr_10.42.42.2(pid=30010): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30010)] 23:46:16.083332 run osmo-hlr_10.42.42.2(pid=30010): stdout: | (launched: 2022-12-08_23:46:12.825723) 23:46:16.136447 run osmo-hlr_10.42.42.2(pid=30010): stderr: | [0;m[1;31m20221208234612999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234612999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234612999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234612999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234612999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234612999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234613014 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234613025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234613025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234613025 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:46:16.189947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30005): Terminating (SIGTERM) 23:46:16.233608 run iperf3-srv_10.42.42.10(pid=30006): Terminating (SIGTERM) 23:46:16.279154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30009): Terminating (SIGTERM) 23:46:16.323231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30012): Terminating (SIGTERM) 23:46:16.368501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30015): Terminating (SIGTERM) 23:46:16.414443 --- ParallelTerminationStrategy: PID 30005 died... 23:46:16.434904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30005): Terminated: ok {rc=0} 23:46:16.485269 --- ParallelTerminationStrategy: PID 30006 died... 23:46:16.505332 run iperf3-srv_10.42.42.10(pid=30006): Terminated {rc=256} 23:46:16.554116 --- ParallelTerminationStrategy: PID 30009 died... 23:46:16.574642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30009): Terminated: ok {rc=0} 23:46:16.621860 --- ParallelTerminationStrategy: PID 30012 died... 23:46:16.642726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30012): Terminated: ok {rc=0} 23:46:16.691349 --- ParallelTerminationStrategy: PID 30015 died... 23:46:16.711989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30015): Terminated: ok {rc=0} 23:46:16.801086 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 23:46:17.942271 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:17.953843 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:46:18.025186 tst iperf3m4.py: using LAC 17587 23:46:18.143869 tst iperf3m4.py: using RAC 247 23:46:18.261514 tst iperf3m4.py: using CellId 17587 23:46:18.388607 tst iperf3m4.py: using BVCI 17588 23:46:18.505585 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:18.517151 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:18.528546 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:18.540422 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:18.551874 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:18.563144 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:18.574490 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:18.585823 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:18.597224 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:46:18.714213 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:46:18.834067 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:46:18.951393 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:46:19.071067 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:46:19.288654 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:46:19.611525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30017): Launched 23:46:19.890679 run iperf3-srv_10.42.42.10(pid=30018): Launched 23:46:20.011472 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:46:20.228602 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:46:20.551169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30019): Launched 23:46:20.830751 run iperf3-srv_10.42.42.10(pid=30020): Launched 23:46:20.951433 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:46:21.168365 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:46:21.490264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30021): Launched 23:46:21.770583 run iperf3-srv_10.42.42.10(pid=30022): Launched 23:46:21.891247 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:46:22.107845 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:46:22.430065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30023): Launched 23:46:22.710363 run iperf3-srv_10.42.42.10(pid=30024): Launched 23:46:22.830867 tst iperf3m4.py:8: start network... 23:46:23.047604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:46:23.548099 run create_hlr_db(pid=30025): Launched 23:46:23.678522 bus /gobi_6: Setting Powered False 23:46:24.742129 run create_hlr_db(pid=30025): Terminated: ok {rc=0} 23:46:25.170490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30027): Launched 23:46:25.474249 run osmo-hlr_10.42.42.2(pid=30028): Launched 23:46:25.590187 run osmo-stp_10.42.42.5: Starting osmo-stp 23:46:26.124891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30030): Launched 23:46:26.426415 run osmo-stp_10.42.42.5(pid=30031): Launched 23:46:26.541852 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:46:27.063196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30033): Launched 23:46:27.179299 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:46:27.434925 run patchelf(pid=30034): Launched 23:46:27.603208 run osmo-stp_10.42.42.5(pid=30031): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30031)] 23:46:27.731491 run osmo-stp_10.42.42.5(pid=30031): stdout: | (launched: 2022-12-08_23:46:26.371458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:27.861608 run osmo-stp_10.42.42.5(pid=30031): stderr: | [0;m[38;5;43m20221208234626542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234626542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234626542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234626543 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234626543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234626543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234626543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:27.991596 run osmo-stp_10.42.42.5(pid=30031): stdout: | (launched: 2022-12-08_23:46:26.371458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:28.115021 run osmo-stp_10.42.42.5(pid=30031): stderr: | [0;m[38;5;43m20221208234626542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234626542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234626542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234626543 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234626543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234626543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234626543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:28.261746 run patchelf(pid=30034): Terminating (SIGINT) 23:46:28.431420 run patchelf(pid=30034): Terminated: ok {rc=0} 23:46:28.553980 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30031): Process ended prematurely: osmo-stp_10.42.42.5(pid=30031) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30031)] [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 23:46:28.563540 tst iperf3m4.py:8: Test FAILED (10.7 sec) 23:46:28.591262 run osmo-hlr_10.42.42.2(pid=30028): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30028)] 23:46:28.638813 run osmo-hlr_10.42.42.2(pid=30028): stdout: | (launched: 2022-12-08_23:46:25.418174) 23:46:28.687645 run osmo-hlr_10.42.42.2(pid=30028): stderr: | [0;m[1;31m20221208234625595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234625595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234625595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234625595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234625596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234625596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234625607 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234625618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234625618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234625618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:46:28.736604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30017): Terminating (SIGTERM) 23:46:28.775755 run iperf3-srv_10.42.42.10(pid=30018): Terminating (SIGTERM) 23:46:28.814689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30019): Terminating (SIGTERM) 23:46:28.853635 run iperf3-srv_10.42.42.10(pid=30020): Terminating (SIGTERM) 23:46:28.892677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30021): Terminating (SIGTERM) 23:46:28.932351 run iperf3-srv_10.42.42.10(pid=30022): Terminating (SIGTERM) 23:46:28.971558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30023): Terminating (SIGTERM) 23:46:29.010830 run iperf3-srv_10.42.42.10(pid=30024): Terminating (SIGTERM) 23:46:29.050011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30027): Terminating (SIGTERM) 23:46:29.089153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30030): Terminating (SIGTERM) 23:46:29.128386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30033): Terminating (SIGTERM) 23:46:29.167773 --- ParallelTerminationStrategy: PID 30017 died... 23:46:29.186592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30017): Terminated: ok {rc=0} 23:46:29.230698 --- ParallelTerminationStrategy: PID 30018 died... 23:46:29.249092 run iperf3-srv_10.42.42.10(pid=30018): Terminated {rc=256} 23:46:29.292397 --- ParallelTerminationStrategy: PID 30019 died... 23:46:29.310912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30019): Terminated: ok {rc=0} 23:46:29.354641 --- ParallelTerminationStrategy: PID 30020 died... 23:46:29.372994 run iperf3-srv_10.42.42.10(pid=30020): Terminated {rc=256} 23:46:29.416605 --- ParallelTerminationStrategy: PID 30021 died... 23:46:29.434966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30021): Terminated: ok {rc=0} 23:46:29.478656 --- ParallelTerminationStrategy: PID 30022 died... 23:46:29.496826 run iperf3-srv_10.42.42.10(pid=30022): Terminated {rc=256} 23:46:29.540593 --- ParallelTerminationStrategy: PID 30023 died... 23:46:29.559072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30023): Terminated: ok {rc=0} 23:46:29.602970 --- ParallelTerminationStrategy: PID 30024 died... 23:46:29.621380 run iperf3-srv_10.42.42.10(pid=30024): Terminated {rc=256} 23:46:29.665115 --- ParallelTerminationStrategy: PID 30027 died... 23:46:29.683519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30027): Terminated: ok {rc=0} 23:46:29.727245 --- ParallelTerminationStrategy: PID 30030 died... 23:46:29.745657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30030): Terminated: ok {rc=0} 23:46:29.789225 --- ParallelTerminationStrategy: PID 30033 died... 23:46:29.807572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30033): Terminated: ok {rc=0} 23:46:29.893440 bus /gobi_4: Setting Powered False 23:46:31.003376 bus /gobi_4: Setting Powered False 23:46:32.135477 bus /gobi_1: Setting Powered False 23:46:33.234484 bus /gobi_1: Setting Powered False 23:46:34.348494 bus /gobi_0: Setting Powered False 23:46:35.445079 bus /gobi_0: Setting Powered False 23:46:36.559936 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 23:46:37.661332 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:37.673623 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:46:37.745624 tst ping.py: using LAC 17588 23:46:37.871309 tst ping.py: using RAC 248 23:46:37.994967 tst ping.py: using CellId 17588 23:46:38.118284 tst ping.py: using BVCI 17589 23:46:38.232273 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:38.243759 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:38.254989 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:38.266242 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:38.277399 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:38.288646 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:38.299965 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:38.311341 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:46:38.428657 tst ping.py:19: start network... 23:46:38.642464 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:46:39.130301 run create_hlr_db(pid=30035): Launched 23:46:39.257512 bus /gobi_6: Setting Powered False 23:46:40.320363 run create_hlr_db(pid=30035): Terminated: ok {rc=0} 23:46:40.744270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30037): Launched 23:46:41.039669 run osmo-hlr_10.42.42.2(pid=30038): Launched 23:46:41.152667 run osmo-stp_10.42.42.5: Starting osmo-stp 23:46:41.669557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30040): Launched 23:46:41.964338 run osmo-stp_10.42.42.5(pid=30041): Launched 23:46:42.076877 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:46:42.587363 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30043): Launched 23:46:42.701207 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:46:42.951225 run patchelf(pid=30044): Launched 23:46:43.115991 run osmo-stp_10.42.42.5(pid=30041): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30041)] 23:46:43.242091 run osmo-stp_10.42.42.5(pid=30041): stdout: | (launched: 2022-12-08_23:46:41.910869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:43.370194 run osmo-stp_10.42.42.5(pid=30041): stderr: | [0;m[38;5;43m20221208234642081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234642081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234642081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234642082 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234642082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234642082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234642082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:43.497994 run osmo-stp_10.42.42.5(pid=30041): stdout: | (launched: 2022-12-08_23:46:41.910869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:43.619928 run osmo-stp_10.42.42.5(pid=30041): stderr: | [0;m[38;5;43m20221208234642081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234642081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234642081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234642082 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234642082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234642082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234642082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:43.764058 run patchelf(pid=30044): Terminating (SIGINT) 23:46:43.930409 run patchelf(pid=30044): Terminated: ok {rc=0} 23:46:44.050653 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30041): Process ended prematurely: osmo-stp_10.42.42.5(pid=30041) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30041)] [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 23:46:44.059576 tst ping.py:22: Test FAILED (6.4 sec) 23:46:44.086263 run osmo-hlr_10.42.42.2(pid=30038): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30038)] 23:46:44.134044 run osmo-hlr_10.42.42.2(pid=30038): stdout: | (launched: 2022-12-08_23:46:40.986014) 23:46:44.183338 run osmo-hlr_10.42.42.2(pid=30038): stderr: | [0;m[1;31m20221208234641162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234641162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234641162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234641162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234641162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234641163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234641176 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234641186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234641186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234641186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:46:44.232792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30037): Terminating (SIGTERM) 23:46:44.272307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30040): Terminating (SIGTERM) 23:46:44.311901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30043): Terminating (SIGTERM) 23:46:44.351909 --- ParallelTerminationStrategy: PID 30037 died... 23:46:44.370888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30037): Terminated: ok {rc=0} 23:46:44.415420 --- ParallelTerminationStrategy: PID 30040 died... 23:46:44.433933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30040): Terminated: ok {rc=0} 23:46:44.477651 --- ParallelTerminationStrategy: PID 30043 died... 23:46:44.496133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30043): Terminated: ok {rc=0} 23:46:44.579347 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 23:46:45.666130 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:45.678756 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:46:45.753034 tst ping_idle_ping.py: using LAC 17589 23:46:45.887543 tst ping_idle_ping.py: using RAC 249 23:46:46.022629 tst ping_idle_ping.py: using CellId 17589 23:46:46.146329 tst ping_idle_ping.py: using BVCI 17590 23:46:46.297751 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:46.312860 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:46.329487 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:46.344239 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:46.359571 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:46.375832 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:46.391120 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:46.406780 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:46:46.534549 tst ping_idle_ping.py:24: start network... 23:46:46.785394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:46:47.271001 run create_hlr_db(pid=30045): Launched 23:46:47.400269 bus /gobi_6: Setting Powered False 23:46:48.463548 run create_hlr_db(pid=30045): Terminated: ok {rc=0} 23:46:48.906076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30047): Launched 23:46:49.222557 run osmo-hlr_10.42.42.2(pid=30048): Launched 23:46:49.342385 run osmo-stp_10.42.42.5: Starting osmo-stp 23:46:49.890727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30050): Launched 23:46:50.207342 run osmo-stp_10.42.42.5(pid=30051): Launched 23:46:50.328225 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:46:50.878239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30053): Launched 23:46:51.000440 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:46:51.268935 run patchelf(pid=30054): Launched 23:46:51.445333 run osmo-stp_10.42.42.5(pid=30051): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30051)] 23:46:51.580395 run osmo-stp_10.42.42.5(pid=30051): stdout: | (launched: 2022-12-08_23:46:50.150009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:51.716821 run osmo-stp_10.42.42.5(pid=30051): stderr: | [0;m[38;5;43m20221208234650340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234650340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234650340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234650341 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234650341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234650341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234650341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:51.853307 run osmo-stp_10.42.42.5(pid=30051): stdout: | (launched: 2022-12-08_23:46:50.150009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:51.983458 run osmo-stp_10.42.42.5(pid=30051): stderr: | [0;m[38;5;43m20221208234650340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234650340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234650340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234650341 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234650341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234650341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234650341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:52.137498 run patchelf(pid=30054): Terminating (SIGINT) 23:46:52.315034 run patchelf(pid=30054): Terminated: ok {rc=0} 23:46:52.443147 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30051): Process ended prematurely: osmo-stp_10.42.42.5(pid=30051) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30051)] [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 23:46:52.452778 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 23:46:52.480371 run osmo-hlr_10.42.42.2(pid=30048): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30048)] 23:46:52.530219 run osmo-hlr_10.42.42.2(pid=30048): stdout: | (launched: 2022-12-08_23:46:49.165469) 23:46:52.581353 run osmo-hlr_10.42.42.2(pid=30048): stderr: | [0;m[1;31m20221208234649362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234649362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234649362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234649362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234649362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234649362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234649375 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234649384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234649384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234649384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:46:52.632649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30047): Terminating (SIGTERM) 23:46:52.674170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30050): Terminating (SIGTERM) 23:46:52.715577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30053): Terminating (SIGTERM) 23:46:52.757251 --- ParallelTerminationStrategy: PID 30047 died... 23:46:52.776854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30047): Terminated: ok {rc=0} 23:46:52.822363 --- ParallelTerminationStrategy: PID 30050 died... 23:46:52.841528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30050): Terminated: ok {rc=0} 23:46:52.886910 --- ParallelTerminationStrategy: PID 30053 died... 23:46:52.906127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30053): Terminated: ok {rc=0} 23:46:52.993827 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:46:54.304677 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:46:54.312262 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:46:54.347161 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 23:46:54.381798 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:46:54.436159 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:46:54.470224 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 23:46:54.505072 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:46:55.063678 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2351 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 23:46:55.069697 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:55.081810 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:46:55.153136 tst switch_tch_pdch.py: using LAC 17590 23:46:55.276386 tst switch_tch_pdch.py: using RAC 250 23:46:55.393953 tst switch_tch_pdch.py: using CellId 17590 23:46:55.510528 tst switch_tch_pdch.py: using BVCI 17591 23:46:55.619935 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:55.631281 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:55.642452 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:55.653563 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:55.666326 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:55.678097 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:55.689852 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:55.700707 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:46:55.821852 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:46:55.941531 tst switch_tch_pdch.py:51: start network... 23:46:56.153815 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:46:56.642047 run create_hlr_db(pid=30058): Launched 23:46:56.770529 bus /gobi_6: Setting Powered False 23:46:57.833630 run create_hlr_db(pid=30058): Terminated: ok {rc=0} 23:46:58.257336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30060): Launched 23:46:58.554342 run osmo-hlr_10.42.42.2(pid=30061): Launched 23:46:58.668887 run osmo-stp_10.42.42.5: Starting osmo-stp 23:46:59.182565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30063): Launched 23:46:59.478165 run osmo-stp_10.42.42.5(pid=30064): Launched 23:46:59.591717 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:47:00.102774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30066): Launched 23:47:00.216536 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:47:00.465974 run patchelf(pid=30067): Launched 23:47:00.630543 run osmo-stp_10.42.42.5(pid=30064): ERR: Terminated: ERROR {rc=1} [trial-2351↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30064)] 23:47:00.755757 run osmo-stp_10.42.42.5(pid=30064): stdout: | (launched: 2022-12-08_23:46:59.423951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:00.893158 run osmo-stp_10.42.42.5(pid=30064): stderr: | [0;m[38;5;43m20221208234659593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234659593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234659594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234659594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234659595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234659595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234659595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:01.034389 run osmo-stp_10.42.42.5(pid=30064): stdout: | (launched: 2022-12-08_23:46:59.423951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:01.167976 run osmo-stp_10.42.42.5(pid=30064): stderr: | [0;m[38;5;43m20221208234659593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234659593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234659594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234659594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234659595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234659595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234659595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:01.325380 run patchelf(pid=30067): Terminating (SIGINT) 23:47:01.506678 run patchelf(pid=30067): Terminated: ok {rc=0} 23:47:01.637866 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30064): Process ended prematurely: osmo-stp_10.42.42.5(pid=30064) [trial-2351↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30064)] [trial-2351↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 23:47:01.647962 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 23:47:01.678508 run osmo-hlr_10.42.42.2(pid=30061): ERR: Terminated: ERROR {rc=237} [trial-2351↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30061)] 23:47:01.729445 run osmo-hlr_10.42.42.2(pid=30061): stdout: | (launched: 2022-12-08_23:46:58.499812) 23:47:01.782398 run osmo-hlr_10.42.42.2(pid=30061): stderr: | [0;m[1;31m20221208234658673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234658673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234658674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234658674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234658674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234658674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234658684 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234658692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234658693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234658693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:47:01.836726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30060): Terminating (SIGTERM) 23:47:01.882152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30063): Terminating (SIGTERM) 23:47:01.928596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30066): Terminating (SIGTERM) 23:47:01.977053 --- ParallelTerminationStrategy: PID 30060 died... 23:47:01.999863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30060): Terminated: ok {rc=0} 23:47:02.056384 --- ParallelTerminationStrategy: PID 30063 died... 23:47:02.078690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30063): Terminated: ok {rc=0} 23:47:02.123875 --- ParallelTerminationStrategy: PID 30066 died... 23:47:02.143338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30066): Terminated: ok {rc=0} 23:47:02.228709 bus /gobi_0: Setting Powered False 23:47:03.322613 bus /gobi_0: Setting Powered False 23:47:04.435699 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 23:47:05.685324 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:47:05.691452 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 23:47:05.724894 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 23:47:05.759161 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 23:47:05.811390 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 23:47:05.845685 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 23:47:05.879375 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 23:47:06.433423 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2351 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 23:47:06.438329 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:47:06.449296 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 23:47:06.517363 tst switch_tch_pdch.py: using LAC 17591 23:47:06.632818 tst switch_tch_pdch.py: using RAC 251 23:47:06.755434 tst switch_tch_pdch.py: using CellId 17591 23:47:06.871343 tst switch_tch_pdch.py: using BVCI 17592 23:47:06.978948 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:47:06.989864 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:47:07.000541 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:47:07.011541 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:47:07.022262 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:47:07.033527 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:47:07.044515 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:47:07.055458 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:47:07.174186 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:47:07.289098 tst switch_tch_pdch.py:51: start network... 23:47:07.488197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:47:07.921612 run create_hlr_db(pid=30071): Launched 23:47:08.034508 bus /gobi_6: Setting Powered False 23:47:09.093301 run create_hlr_db(pid=30071): Terminated: ok {rc=0} 23:47:09.482593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30073): Launched 23:47:09.778695 run osmo-hlr_10.42.42.2(pid=30074): Launched 23:47:09.892400 run osmo-stp_10.42.42.5: Starting osmo-stp 23:47:10.389189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30076): Launched 23:47:10.684313 run osmo-stp_10.42.42.5(pid=30077): Launched 23:47:10.797215 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:47:11.284777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30079): Launched 23:47:11.398926 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:47:11.648549 run patchelf(pid=30080): Launched 23:47:11.813583 run osmo-stp_10.42.42.5(pid=30077): ERR: Terminated: ERROR {rc=1} [trial-2351↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30077)] 23:47:11.939398 run osmo-stp_10.42.42.5(pid=30077): stdout: | (launched: 2022-12-08_23:47:10.630638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:12.067401 run osmo-stp_10.42.42.5(pid=30077): stderr: | [0;m[38;5;43m20221208234710799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234710799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234710800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234710800 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234710800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234710801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234710801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:12.194726 run osmo-stp_10.42.42.5(pid=30077): stdout: | (launched: 2022-12-08_23:47:10.630638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:12.316427 run osmo-stp_10.42.42.5(pid=30077): stderr: | [0;m[38;5;43m20221208234710799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234710799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234710800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234710800 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234710800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234710801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234710801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:12.460564 run patchelf(pid=30080): Terminating (SIGINT) 23:47:12.627174 run patchelf(pid=30080): Terminated: ok {rc=0} 23:47:12.747256 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30077): Process ended prematurely: osmo-stp_10.42.42.5(pid=30077) [trial-2351↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30077)] [trial-2351↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 23:47:12.756088 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 23:47:12.782296 run osmo-hlr_10.42.42.2(pid=30074): ERR: Terminated: ERROR {rc=237} [trial-2351↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30074)] 23:47:12.830011 run osmo-hlr_10.42.42.2(pid=30074): stdout: | (launched: 2022-12-08_23:47:09.724878) 23:47:12.878698 run osmo-hlr_10.42.42.2(pid=30074): stderr: | [0;m[1;31m20221208234709897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234709897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234709897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234709897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234709898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234709898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234709910 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234709918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234709918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234709919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:47:12.928209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30073): Terminating (SIGTERM) 23:47:12.967221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30076): Terminating (SIGTERM) 23:47:13.007173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30079): Terminating (SIGTERM) 23:47:13.046562 --- ParallelTerminationStrategy: PID 30073 died... 23:47:13.065640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30073): Terminated: ok {rc=0} 23:47:13.109050 --- ParallelTerminationStrategy: PID 30076 died... 23:47:13.127447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30076): Terminated: ok {rc=0} 23:47:13.170594 --- ParallelTerminationStrategy: PID 30079 died... 23:47:13.189072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30079): Terminated: ok {rc=0} 23:47:13.271575 bus /gobi_0: Setting Powered False 23:47:14.367548 bus /gobi_0: Setting Powered False 23:47:15.483131 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 nitb_sms:trx-umtrx --------------------------------------------------------------------- 23:47:16.767176 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:47:16.772823 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 23:47:16.815137 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 23:47:16.824790 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 23:47:16.887379 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 23:47:16.924768 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 23:47:16.932373 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 23:47:17.461790 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 23:47:17.466902 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 23:47:17.477654 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 23:47:17.524885 tst mo_mt_sms.py: using LAC 17592 23:47:17.650407 tst mo_mt_sms.py: using RAC 252 23:47:17.775583 tst mo_mt_sms.py: using CellId 17592 23:47:17.900575 tst mo_mt_sms.py: using BVCI 17593 23:47:18.014383 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 23:47:18.128200 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 23:47:18.244658 tst mo_mt_sms.py:9: start nitb and bts... 23:47:18.459190 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:47:19.103612 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30084): Launched 23:47:19.420325 run osmo-nitb_10.42.42.2(pid=30085): Launched 23:47:19.595311 run osmo-nitb_10.42.42.2(pid=30085): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30085)] 23:47:19.737188 run osmo-nitb_10.42.42.2(pid=30085): stdout: | (launched: 2022-12-08_23:47:19.363305) 23:47:19.880594 run osmo-nitb_10.42.42.2(pid=30085): stderr: | (launched: 2022-12-08_23:47:19.410396) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:47:20.024045 run osmo-nitb_10.42.42.2(pid=30085): stdout: | (launched: 2022-12-08_23:47:19.363305) 23:47:20.161664 run osmo-nitb_10.42.42.2(pid=30085): stderr: | (launched: 2022-12-08_23:47:19.410396) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6f22fc268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30085): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30085) [trial-2351↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30085)] 23:47:20.539054 tst osmo-nitb_10.42.42.2(pid=30085): stdout: | (launched: 2022-12-08_23:47:19.363305) 23:47:20.667777 tst osmo-nitb_10.42.42.2(pid=30085): stderr: | (launched: 2022-12-08_23:47:19.410396) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:47:20.818511 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=30085): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30085) [trial-2351↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30085)] [trial-2351↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 23:47:20.827451 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 23:47:20.834360 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30084): Terminating (SIGTERM) 23:47:21.044112 --- ParallelTerminationStrategy: PID 30084 died... 23:47:21.065364 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30084): Terminated: ok {rc=0} 23:47:21.152335 bus /sierra_3: Setting Powered False 23:47:22.249308 bus /sierra_3: Setting Powered False 23:47:23.365971 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 sms:trx-umtrx --------------------------------------------------------------------- 23:47:24.564862 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:47:24.569180 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 23:47:24.602097 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:47:24.629546 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 23:47:24.682013 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 23:47:24.715071 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:47:24.741726 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 23:47:25.287988 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 23:47:25.293072 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:25.303840 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 23:47:25.351073 tst mo_mt_sms.py: using LAC 17593 23:47:25.479519 tst mo_mt_sms.py: using RAC 253 23:47:25.603186 tst mo_mt_sms.py: using CellId 17593 23:47:25.726748 tst mo_mt_sms.py: using BVCI 17594 23:47:25.840911 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:25.851872 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:25.862664 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:25.873397 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:25.884197 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:25.895016 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 23:47:26.008555 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 23:47:26.126332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:47:26.616250 run create_hlr_db(pid=30089): Launched 23:47:26.744605 bus /sierra_2: Setting Powered False 23:47:27.807740 run create_hlr_db(pid=30089): Terminated: ok {rc=0} 23:47:28.231710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30091): Launched 23:47:28.528121 run osmo-hlr_10.42.42.2(pid=30092): Launched 23:47:28.642176 run osmo-stp_10.42.42.5: Starting osmo-stp 23:47:29.164007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30094): Launched 23:47:29.461123 run osmo-stp_10.42.42.5(pid=30095): Launched 23:47:29.574991 run osmo-msc_10.42.42.6: Starting osmo-msc 23:47:30.110830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30097): Launched 23:47:30.407014 run osmo-msc_10.42.42.6(pid=30098): Launched 23:47:30.573526 run osmo-stp_10.42.42.5(pid=30095): ERR: Terminated: ERROR {rc=1} [trial-2351↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30095)] 23:47:30.700344 run osmo-stp_10.42.42.5(pid=30095): stdout: | (launched: 2022-12-08_23:47:29.407028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:30.828212 run osmo-stp_10.42.42.5(pid=30095): stderr: | [0;m[38;5;43m20221208234729578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234729578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234729579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234729579 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234729580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234729580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234729580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:30.973950 run osmo-stp_10.42.42.5(pid=30095): stdout: | (launched: 2022-12-08_23:47:29.407028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:31.096522 run osmo-stp_10.42.42.5(pid=30095): stderr: | [0;m[38;5;43m20221208234729578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234729578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234729579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234729579 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234729580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234729580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234729580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:31.243252 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=30095): Process ended prematurely: osmo-stp_10.42.42.5(pid=30095) [trial-2351↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30095)] [trial-2351↪sms:trx-umtrx↪mo_mt_sms.py:16] 23:47:31.252548 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 23:47:31.279321 run osmo-hlr_10.42.42.2(pid=30092): ERR: Terminated: ERROR {rc=237} [trial-2351↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30092)] 23:47:31.330223 run osmo-hlr_10.42.42.2(pid=30092): stdout: | (launched: 2022-12-08_23:47:28.474129) 23:47:31.381711 run osmo-hlr_10.42.42.2(pid=30092): stderr: | [0;m[1;31m20221208234728647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234728647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234728647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234728647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234728647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234728647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234728659 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234728668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234728669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234728669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:47:31.452836 run osmo-msc_10.42.42.6(pid=30098): ERR: Terminated: ERROR {rc=2} [trial-2351↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30098)] 23:47:31.501861 run osmo-msc_10.42.42.6(pid=30098): stdout: | (launched: 2022-12-08_23:47:30.353254) 23:47:31.552044 run osmo-msc_10.42.42.6(pid=30098): stderr: | [0;m[38;5;43m20221208234730623 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234730623 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe2bc41ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234730623 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234730624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234730624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234730624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234730626 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234730626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234730626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234730626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:47:31.605106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30091): Terminating (SIGTERM) 23:47:31.647015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30094): Terminating (SIGTERM) 23:47:31.689022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30097): Terminating (SIGTERM) 23:47:31.730020 --- ParallelTerminationStrategy: PID 30091 died... 23:47:31.750594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30091): Terminated: ok {rc=0} 23:47:31.798657 --- ParallelTerminationStrategy: PID 30094 died... 23:47:31.818152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30094): Terminated: ok {rc=0} 23:47:31.863831 --- ParallelTerminationStrategy: PID 30097 died... 23:47:31.884299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30097): Terminated: ok {rc=0} 23:47:31.972103 bus /sierra_3: Setting Powered False 23:47:33.068625 bus /sierra_3: Setting Powered False 23:47:34.180269 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 23:47:35.409066 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:47:35.413188 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 23:47:35.446262 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 23:47:35.453352 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 23:47:35.488505 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 23:47:35.521883 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 23:47:35.529282 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 23:47:36.054642 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2351 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 23:47:36.061116 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 23:47:36.073152 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 23:47:36.132330 tst assert_extension.py: using LAC 17594 23:47:36.256015 tst assert_extension.py: using RAC 254 23:47:36.378863 tst assert_extension.py: using CellId 17594 23:47:36.501200 tst assert_extension.py: using BVCI 17595 23:47:36.616140 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 23:47:36.730435 tst assert_extension.py:10: start nitb and bts... 23:47:36.930290 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:47:37.537138 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30103): Launched 23:47:37.833751 run osmo-nitb_10.42.42.2(pid=30104): Launched 23:47:37.997805 run osmo-nitb_10.42.42.2(pid=30104): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30104)] 23:47:38.131453 run osmo-nitb_10.42.42.2(pid=30104): stdout: | (launched: 2022-12-08_23:47:37.779907) 23:47:38.266482 run osmo-nitb_10.42.42.2(pid=30104): stderr: | (launched: 2022-12-08_23:47:37.824124) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:47:38.401368 run osmo-nitb_10.42.42.2(pid=30104): stdout: | (launched: 2022-12-08_23:47:37.779907) 23:47:38.530666 run osmo-nitb_10.42.42.2(pid=30104): stderr: | (launched: 2022-12-08_23:47:37.824124) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6f22fc268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30104): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30104) [trial-2351↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30104)] 23:47:38.945323 tst osmo-nitb_10.42.42.2(pid=30104): stdout: | (launched: 2022-12-08_23:47:37.779907) 23:47:39.065462 tst osmo-nitb_10.42.42.2(pid=30104): stderr: | (launched: 2022-12-08_23:47:37.824124) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:47:39.207435 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=30104): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30104) [trial-2351↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30104)] [trial-2351↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 23:47:39.215836 tst assert_extension.py:12: Test FAILED (3.1 sec) 23:47:39.222338 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30103): Terminating (SIGTERM) 23:47:39.430632 --- ParallelTerminationStrategy: PID 30103 died... 23:47:39.451423 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30103): Terminated: ok {rc=0} 23:47:39.536800 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 ussd:trx-umtrx --------------------------------------------------------------------- 23:47:40.715433 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:47:40.719430 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 23:47:40.752144 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:47:40.778574 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 23:47:40.813574 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 23:47:40.845859 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:47:40.871954 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 23:47:41.399037 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2351 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 23:47:41.404118 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:41.414726 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 23:47:41.460701 tst assert_extension.py: using LAC 17595 23:47:41.578413 tst assert_extension.py: using RAC 255 23:47:41.696281 tst assert_extension.py: using CellId 17595 23:47:41.813578 tst assert_extension.py: using BVCI 17596 23:47:41.920707 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:41.931379 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:41.941940 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:41.952298 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:41.963418 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:41.973954 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 23:47:42.088884 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:47:42.579362 run create_hlr_db(pid=30109): Launched 23:47:42.708566 bus /sierra_2: Setting Powered False 23:47:43.767602 run create_hlr_db(pid=30109): Terminated: ok {rc=0} 23:47:44.194353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30111): Launched 23:47:44.491930 run osmo-hlr_10.42.42.2(pid=30112): Launched 23:47:44.607257 run osmo-stp_10.42.42.5: Starting osmo-stp 23:47:45.141096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30114): Launched 23:47:45.438760 run osmo-stp_10.42.42.5(pid=30115): Launched 23:47:45.552186 run osmo-msc_10.42.42.6: Starting osmo-msc 23:47:46.132440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30117): Launched 23:47:46.469683 run osmo-msc_10.42.42.6(pid=30118): Launched 23:47:46.912655 run osmo-stp_10.42.42.5(pid=30115): ERR: Terminated: ERROR {rc=1} [trial-2351↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30115)] 23:47:47.184268 run osmo-stp_10.42.42.5(pid=30115): stdout: | (launched: 2022-12-08_23:47:45.384616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:47.314018 run osmo-stp_10.42.42.5(pid=30115): stderr: | [0;m[38;5;43m20221208234745553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234745553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234745553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234745554 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234745554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234745554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234745554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:47.438130 run osmo-stp_10.42.42.5(pid=30115): stdout: | (launched: 2022-12-08_23:47:45.384616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:47.556471 run osmo-stp_10.42.42.5(pid=30115): stderr: | [0;m[38;5;43m20221208234745553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234745553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234745553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234745554 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234745554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234745554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234745554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:47.698487 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=30115): Process ended prematurely: osmo-stp_10.42.42.5(pid=30115) [trial-2351↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30115)] [trial-2351↪ussd:trx-umtrx↪assert_extension.py:17] 23:47:47.706688 tst assert_extension.py:17: Test FAILED (6.3 sec) 23:47:47.733068 run osmo-hlr_10.42.42.2(pid=30112): ERR: Terminated: ERROR {rc=237} [trial-2351↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30112)] 23:47:47.781133 run osmo-hlr_10.42.42.2(pid=30112): stdout: | (launched: 2022-12-08_23:47:44.438118) 23:47:47.829795 run osmo-hlr_10.42.42.2(pid=30112): stderr: | [0;m[1;31m20221208234744613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234744613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234744613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234744613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234744613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234744613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234744629 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234744637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234744637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234744637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:47:47.898416 run osmo-msc_10.42.42.6(pid=30118): ERR: Terminated: ERROR {rc=2} [trial-2351↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30118)] 23:47:47.945665 run osmo-msc_10.42.42.6(pid=30118): stdout: | (launched: 2022-12-08_23:47:46.407054) 23:47:47.994397 run osmo-msc_10.42.42.6(pid=30118): stderr: | [0;m[38;5;43m20221208234746811 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234746811 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbdbfd27c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234746811 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234746811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234746811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234746812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234746813 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234746814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234746814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234746814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:47:48.043935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30111): Terminating (SIGTERM) 23:47:48.083726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30114): Terminating (SIGTERM) 23:47:48.123250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30117): Terminating (SIGTERM) 23:47:48.163428 --- ParallelTerminationStrategy: PID 30111 died... 23:47:48.182386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30111): Terminated: ok {rc=0} 23:47:48.226523 --- ParallelTerminationStrategy: PID 30114 died... 23:47:48.244904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30114): Terminated: ok {rc=0} 23:47:48.288516 --- ParallelTerminationStrategy: PID 30117 died... 23:47:48.306904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30117): Terminated: ok {rc=0} 23:47:48.389924 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 23:47:49.598316 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:47:49.605799 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 23:47:49.639507 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 23:47:49.666629 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 23:47:49.718722 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 23:47:49.751651 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 23:47:49.778779 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 23:47:50.334833 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 23:47:50.388601 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:50.400033 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:47:50.468194 tst mo_mt_call.py: using LAC 17596 23:47:50.588610 tst mo_mt_call.py: using RAC 1 23:47:50.706192 tst mo_mt_call.py: using CellId 17596 23:47:50.823407 tst mo_mt_call.py: using BVCI 17597 23:47:50.933232 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:50.944257 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:50.955348 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:50.966809 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:50.977865 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:50.989163 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:47:51.107446 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:47:51.223615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:47:51.724831 run create_hlr_db(pid=30123): Launched 23:47:51.856694 bus /sierra_2: Setting Powered False 23:47:52.920475 run create_hlr_db(pid=30123): Terminated: ok {rc=0} 23:47:53.352779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30125): Launched 23:47:53.655969 run osmo-hlr_10.42.42.2(pid=30126): Launched 23:47:53.772747 run osmo-stp_10.42.42.5: Starting osmo-stp 23:47:54.308485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30128): Launched 23:47:54.612185 run osmo-stp_10.42.42.5(pid=30129): Launched 23:47:54.727906 run osmo-msc_10.42.42.6: Starting osmo-msc 23:47:55.276129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30131): Launched 23:47:55.579352 run osmo-msc_10.42.42.6(pid=30132): Launched 23:47:55.748272 run osmo-stp_10.42.42.5(pid=30129): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30129)] 23:47:55.876490 run osmo-stp_10.42.42.5(pid=30129): stdout: | (launched: 2022-12-08_23:47:54.556839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:56.004772 run osmo-stp_10.42.42.5(pid=30129): stderr: | [0;m[38;5;43m20221208234754728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234754728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234754729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234754729 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234754729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234754729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234754730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:56.130948 run osmo-stp_10.42.42.5(pid=30129): stdout: | (launched: 2022-12-08_23:47:54.556839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:56.251398 run osmo-stp_10.42.42.5(pid=30129): stderr: | [0;m[38;5;43m20221208234754728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234754728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234754729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234754729 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234754729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234754729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234754730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:56.395159 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30129): Process ended prematurely: osmo-stp_10.42.42.5(pid=30129) [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30129)] [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 23:47:56.404313 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:47:56.430482 run osmo-hlr_10.42.42.2(pid=30126): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30126)] 23:47:56.478207 run osmo-hlr_10.42.42.2(pid=30126): stdout: | (launched: 2022-12-08_23:47:53.600872) 23:47:56.527095 run osmo-hlr_10.42.42.2(pid=30126): stderr: | [0;m[1;31m20221208234753779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234753779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234753779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234753779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234753779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234753779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234753791 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234753800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234753801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234753801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:47:56.594998 run osmo-msc_10.42.42.6(pid=30132): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30132)] 23:47:56.641441 run osmo-msc_10.42.42.6(pid=30132): stdout: | (launched: 2022-12-08_23:47:55.524138) 23:47:56.690344 run osmo-msc_10.42.42.6(pid=30132): stderr: | [0;m[38;5;43m20221208234755795 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234755795 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffb1c1b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234755795 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234755795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234755795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234755795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234755797 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234755798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234755798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234755798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:47:56.739306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30125): Terminating (SIGTERM) 23:47:56.778478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30128): Terminating (SIGTERM) 23:47:56.817557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30131): Terminating (SIGTERM) 23:47:56.857281 --- ParallelTerminationStrategy: PID 30125 died... 23:47:56.875915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30125): Terminated: ok {rc=0} 23:47:56.919685 --- ParallelTerminationStrategy: PID 30128 died... 23:47:56.937903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30128): Terminated: ok {rc=0} 23:47:56.981062 --- ParallelTerminationStrategy: PID 30131 died... 23:47:56.999518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30131): Terminated: ok {rc=0} 23:47:57.083870 bus /sierra_3: Setting Powered False 23:47:58.181332 bus /sierra_3: Setting Powered False 23:47:59.295671 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 23:48:00.439344 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:48:00.451169 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:48:00.523896 tst mo_mt_call_osmux.py: using LAC 17597 23:48:00.652162 tst mo_mt_call_osmux.py: using RAC 2 23:48:00.780371 tst mo_mt_call_osmux.py: using CellId 17597 23:48:00.935708 tst mo_mt_call_osmux.py: using BVCI 17598 23:48:01.057333 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:48:01.069926 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:48:01.082462 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:48:01.095030 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:48:01.108654 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:48:01.122539 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:48:01.247627 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:48:01.380407 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:48:01.913717 run create_hlr_db(pid=30135): Launched 23:48:02.063376 bus /sierra_2: Setting Powered False 23:48:03.123452 run create_hlr_db(pid=30135): Terminated: ok {rc=0} 23:48:03.563335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30137): Launched 23:48:03.884894 run osmo-hlr_10.42.42.2(pid=30138): Launched 23:48:04.007731 run osmo-stp_10.42.42.5: Starting osmo-stp 23:48:04.561715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30140): Launched 23:48:04.883459 run osmo-stp_10.42.42.5(pid=30141): Launched 23:48:05.005597 run osmo-msc_10.42.42.6: Starting osmo-msc 23:48:05.588567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30143): Launched 23:48:05.909609 run osmo-msc_10.42.42.6(pid=30144): Launched 23:48:06.088059 run osmo-stp_10.42.42.5(pid=30141): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30141)] 23:48:06.223836 run osmo-stp_10.42.42.5(pid=30141): stdout: | (launched: 2022-12-08_23:48:04.825420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:06.360880 run osmo-stp_10.42.42.5(pid=30141): stderr: | [0;m[38;5;43m20221208234805020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234805020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234805020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234805021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234805021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234805021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234805021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:06.496604 run osmo-stp_10.42.42.5(pid=30141): stdout: | (launched: 2022-12-08_23:48:04.825420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:06.625800 run osmo-stp_10.42.42.5(pid=30141): stderr: | [0;m[38;5;43m20221208234805020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234805020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234805020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234805021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234805021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234805021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234805021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:06.779140 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30141): Process ended prematurely: osmo-stp_10.42.42.5(pid=30141) [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30141)] [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 23:48:06.788790 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 23:48:06.816365 run osmo-hlr_10.42.42.2(pid=30138): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30138)] 23:48:06.866100 run osmo-hlr_10.42.42.2(pid=30138): stdout: | (launched: 2022-12-08_23:48:03.827004) 23:48:06.917874 run osmo-hlr_10.42.42.2(pid=30138): stderr: | [0;m[1;31m20221208234804027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234804027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234804027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234804027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234804027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234804027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234804040 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234804050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234804050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234804050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:48:06.989713 run osmo-msc_10.42.42.6(pid=30144): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30144)] 23:48:07.039208 run osmo-msc_10.42.42.6(pid=30144): stdout: | (launched: 2022-12-08_23:48:05.851419) 23:48:07.090314 run osmo-msc_10.42.42.6(pid=30144): stderr: | [0;m[38;5;43m20221208234806175 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234806175 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f68e6b18c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234806175 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234806175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234806176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234806176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234806178 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234806178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234806178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234806178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:48:07.141889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30137): Terminating (SIGTERM) 23:48:07.183163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30140): Terminating (SIGTERM) 23:48:07.224376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30143): Terminating (SIGTERM) 23:48:07.266025 --- ParallelTerminationStrategy: PID 30137 died... 23:48:07.285829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30137): Terminated: ok {rc=0} 23:48:07.331242 --- ParallelTerminationStrategy: PID 30140 died... 23:48:07.350298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30140): Terminated: ok {rc=0} 23:48:07.395498 --- ParallelTerminationStrategy: PID 30143 died... 23:48:07.415047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30143): Terminated: ok {rc=0} 23:48:07.500989 bus /sierra_3: Setting Powered False 23:48:08.598986 bus /sierra_3: Setting Powered False 23:48:09.714306 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 23:48:10.966129 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:48:10.973217 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 23:48:11.006373 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 23:48:11.033637 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 23:48:11.087048 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 23:48:11.120549 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 23:48:11.147955 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 23:48:11.697934 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 23:48:11.749553 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:11.761240 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:48:11.831761 tst mo_mt_call.py: using LAC 17598 23:48:11.957847 tst mo_mt_call.py: using RAC 3 23:48:12.084295 tst mo_mt_call.py: using CellId 17598 23:48:12.203337 tst mo_mt_call.py: using BVCI 17599 23:48:12.314362 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:12.325487 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:12.336270 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:12.347665 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:12.358989 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:12.370035 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:48:12.488760 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:48:12.607162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:48:13.106341 run create_hlr_db(pid=30149): Launched 23:48:13.237847 bus /sierra_2: Setting Powered False 23:48:14.302520 run create_hlr_db(pid=30149): Terminated: ok {rc=0} 23:48:14.732893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30151): Launched 23:48:15.035685 run osmo-hlr_10.42.42.2(pid=30152): Launched 23:48:15.151271 run osmo-stp_10.42.42.5: Starting osmo-stp 23:48:15.689527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30154): Launched 23:48:16.013844 run osmo-stp_10.42.42.5(pid=30155): Launched 23:48:16.249526 run osmo-msc_10.42.42.6: Starting osmo-msc 23:48:16.882368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30157): Launched 23:48:17.201686 run osmo-msc_10.42.42.6(pid=30158): Launched 23:48:17.423435 run osmo-stp_10.42.42.5(pid=30155): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30155)] 23:48:17.552509 run osmo-stp_10.42.42.5(pid=30155): stdout: | (launched: 2022-12-08_23:48:15.948752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:17.681102 run osmo-stp_10.42.42.5(pid=30155): stderr: | [0;m[38;5;43m20221208234816271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234816272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234816272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234816272 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234816277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234816277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234816277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:17.807388 run osmo-stp_10.42.42.5(pid=30155): stdout: | (launched: 2022-12-08_23:48:15.948752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:17.927544 run osmo-stp_10.42.42.5(pid=30155): stderr: | [0;m[38;5;43m20221208234816271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234816272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234816272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234816272 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234816277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234816277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234816277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:18.071247 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30155): Process ended prematurely: osmo-stp_10.42.42.5(pid=30155) [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30155)] [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 23:48:18.080088 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 23:48:18.106573 run osmo-hlr_10.42.42.2(pid=30152): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30152)] 23:48:18.154735 run osmo-hlr_10.42.42.2(pid=30152): stdout: | (launched: 2022-12-08_23:48:14.981033) 23:48:18.204022 run osmo-hlr_10.42.42.2(pid=30152): stderr: | [0;m[1;31m20221208234815157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234815157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234815157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234815157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234815157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234815157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234815169 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234815178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234815178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234815178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:48:18.272661 run osmo-msc_10.42.42.6(pid=30158): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30158)] 23:48:18.319597 run osmo-msc_10.42.42.6(pid=30158): stdout: | (launched: 2022-12-08_23:48:17.137515) 23:48:18.369050 run osmo-msc_10.42.42.6(pid=30158): stderr: | [0;m[38;5;43m20221208234817465 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234817465 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f373e1a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234817466 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234817466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234817466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234817466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234817468 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234817468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234817468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234817468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:48:18.418295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30151): Terminating (SIGTERM) 23:48:18.457926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30154): Terminating (SIGTERM) 23:48:18.497297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30157): Terminating (SIGTERM) 23:48:18.537918 --- ParallelTerminationStrategy: PID 30151 died... 23:48:18.556321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30151): Terminated: ok {rc=0} 23:48:18.600626 --- ParallelTerminationStrategy: PID 30154 died... 23:48:18.619701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30154): Terminated: ok {rc=0} 23:48:18.663526 --- ParallelTerminationStrategy: PID 30157 died... 23:48:18.682077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30157): Terminated: ok {rc=0} 23:48:18.765311 bus /sierra_3: Setting Powered False 23:48:19.861312 bus /sierra_3: Setting Powered False 23:48:20.976676 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 23:48:22.119765 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:22.131730 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:48:22.200130 tst mo_mt_call_osmux.py: using LAC 17599 23:48:22.319716 tst mo_mt_call_osmux.py: using RAC 4 23:48:22.447597 tst mo_mt_call_osmux.py: using CellId 17599 23:48:22.573634 tst mo_mt_call_osmux.py: using BVCI 17600 23:48:22.691110 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:22.702864 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:22.714363 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:22.725915 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:22.737277 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:22.748504 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:48:22.864162 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:48:22.983380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:48:23.452449 run create_hlr_db(pid=30160): Launched 23:48:23.569295 bus /sierra_2: Setting Powered False 23:48:24.629997 run create_hlr_db(pid=30160): Terminated: ok {rc=0} 23:48:25.070573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30162): Launched 23:48:25.393349 run osmo-hlr_10.42.42.2(pid=30163): Launched 23:48:25.518702 run osmo-stp_10.42.42.5: Starting osmo-stp 23:48:26.074409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30165): Launched 23:48:26.395984 run osmo-stp_10.42.42.5(pid=30166): Launched 23:48:26.519007 run osmo-msc_10.42.42.6: Starting osmo-msc 23:48:27.103874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30168): Launched 23:48:27.426069 run osmo-msc_10.42.42.6(pid=30169): Launched 23:48:27.607790 run osmo-stp_10.42.42.5(pid=30166): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30166)] 23:48:27.743073 run osmo-stp_10.42.42.5(pid=30166): stdout: | (launched: 2022-12-08_23:48:26.337772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:27.879048 run osmo-stp_10.42.42.5(pid=30166): stderr: | [0;m[38;5;43m20221208234826528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234826528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234826529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234826529 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234826532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234826532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234826532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:28.014298 run osmo-stp_10.42.42.5(pid=30166): stdout: | (launched: 2022-12-08_23:48:26.337772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:28.142404 run osmo-stp_10.42.42.5(pid=30166): stderr: | [0;m[38;5;43m20221208234826528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234826528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234826529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234826529 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234826532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234826532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234826532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:28.295394 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30166): Process ended prematurely: osmo-stp_10.42.42.5(pid=30166) [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30166)] [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 23:48:28.304792 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:48:28.332073 run osmo-hlr_10.42.42.2(pid=30163): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30163)] 23:48:28.380926 run osmo-hlr_10.42.42.2(pid=30163): stdout: | (launched: 2022-12-08_23:48:25.335248) 23:48:28.431794 run osmo-hlr_10.42.42.2(pid=30163): stderr: | [0;m[1;31m20221208234825534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234825534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234825534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234825535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234825535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234825535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234825546 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234825554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234825555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234825555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:48:28.502858 run osmo-msc_10.42.42.6(pid=30169): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30169)] 23:48:28.551721 run osmo-msc_10.42.42.6(pid=30169): stdout: | (launched: 2022-12-08_23:48:27.367840) 23:48:28.602838 run osmo-msc_10.42.42.6(pid=30169): stderr: | [0;m[38;5;43m20221208234827691 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234827691 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f196c45fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234827691 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234827692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234827692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234827692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234827694 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234827694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234827694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234827694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:48:28.653842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30162): Terminating (SIGTERM) 23:48:28.694737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30165): Terminating (SIGTERM) 23:48:28.735584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30168): Terminating (SIGTERM) 23:48:28.776784 --- ParallelTerminationStrategy: PID 30162 died... 23:48:28.796402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30162): Terminated: ok {rc=0} 23:48:28.841387 --- ParallelTerminationStrategy: PID 30165 died... 23:48:28.860316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30165): Terminated: ok {rc=0} 23:48:28.905237 --- ParallelTerminationStrategy: PID 30168 died... 23:48:28.924264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30168): Terminated: ok {rc=0} 23:48:29.011025 bus /sierra_3: Setting Powered False 23:48:30.107412 bus /sierra_3: Setting Powered False 23:48:31.231909 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 23:48:32.499849 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:48:32.507674 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 23:48:32.540896 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 23:48:32.568466 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 23:48:32.621734 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 23:48:32.655424 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 23:48:32.682467 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 23:48:33.232321 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 23:48:33.283938 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:33.295530 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:48:33.365182 tst mo_mt_call.py: using LAC 17600 23:48:33.491176 tst mo_mt_call.py: using RAC 5 23:48:33.617772 tst mo_mt_call.py: using CellId 17600 23:48:33.743927 tst mo_mt_call.py: using BVCI 17601 23:48:33.860693 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:33.872026 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:33.883159 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:33.894362 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:33.905609 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:33.916675 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:48:34.034749 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:48:34.149365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:48:34.619814 run create_hlr_db(pid=30175): Launched 23:48:34.753357 bus /sierra_2: Setting Powered False 23:48:35.813509 run create_hlr_db(pid=30175): Terminated: ok {rc=0} 23:48:36.244762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30177): Launched 23:48:36.547962 run osmo-hlr_10.42.42.2(pid=30178): Launched 23:48:36.663819 run osmo-stp_10.42.42.5: Starting osmo-stp 23:48:37.197649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30180): Launched 23:48:37.499433 run osmo-stp_10.42.42.5(pid=30181): Launched 23:48:37.614764 run osmo-msc_10.42.42.6: Starting osmo-msc 23:48:38.161948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30183): Launched 23:48:38.464542 run osmo-msc_10.42.42.6(pid=30184): Launched 23:48:38.634234 run osmo-stp_10.42.42.5(pid=30181): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30181)] 23:48:38.763003 run osmo-stp_10.42.42.5(pid=30181): stdout: | (launched: 2022-12-08_23:48:37.444513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:38.891981 run osmo-stp_10.42.42.5(pid=30181): stderr: | [0;m[38;5;43m20221208234837615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234837615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234837615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234837616 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234837616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234837616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234837616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:39.018922 run osmo-stp_10.42.42.5(pid=30181): stdout: | (launched: 2022-12-08_23:48:37.444513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:39.139743 run osmo-stp_10.42.42.5(pid=30181): stderr: | [0;m[38;5;43m20221208234837615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234837615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234837615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234837616 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234837616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234837616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234837616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:39.283907 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30181): Process ended prematurely: osmo-stp_10.42.42.5(pid=30181) [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30181)] [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 23:48:39.292925 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:48:39.319108 run osmo-hlr_10.42.42.2(pid=30178): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30178)] 23:48:39.367583 run osmo-hlr_10.42.42.2(pid=30178): stdout: | (launched: 2022-12-08_23:48:36.493054) 23:48:39.416160 run osmo-hlr_10.42.42.2(pid=30178): stderr: | [0;m[1;31m20221208234836669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234836669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234836669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234836669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234836669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234836669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234836685 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234836696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234836696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234836696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:48:39.485110 run osmo-msc_10.42.42.6(pid=30184): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30184)] 23:48:39.531767 run osmo-msc_10.42.42.6(pid=30184): stdout: | (launched: 2022-12-08_23:48:38.409677) 23:48:39.581080 run osmo-msc_10.42.42.6(pid=30184): stderr: | [0;m[38;5;43m20221208234838681 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234838681 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f851b404c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234838682 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234838682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234838682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234838682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234838684 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234838684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234838684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234838684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:48:39.629805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30177): Terminating (SIGTERM) 23:48:39.669224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30180): Terminating (SIGTERM) 23:48:39.708490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30183): Terminating (SIGTERM) 23:48:39.748215 --- ParallelTerminationStrategy: PID 30177 died... 23:48:39.767061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30177): Terminated: ok {rc=0} 23:48:39.810519 --- ParallelTerminationStrategy: PID 30180 died... 23:48:39.829360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30180): Terminated: ok {rc=0} 23:48:39.873079 --- ParallelTerminationStrategy: PID 30183 died... 23:48:39.891500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30183): Terminated: ok {rc=0} 23:48:39.975215 bus /sierra_3: Setting Powered False 23:48:41.074196 bus /sierra_3: Setting Powered False 23:48:42.186424 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:48:43.333068 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:43.345162 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:48:43.416371 tst mo_mt_call_osmux.py: using LAC 17601 23:48:43.542438 tst mo_mt_call_osmux.py: using RAC 6 23:48:43.670483 tst mo_mt_call_osmux.py: using CellId 17601 23:48:43.799983 tst mo_mt_call_osmux.py: using BVCI 17602 23:48:43.918331 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:43.929850 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:43.941136 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:43.952359 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:43.963901 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:43.975287 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:48:44.091048 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:48:44.211693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:48:44.682065 run create_hlr_db(pid=30186): Launched 23:48:44.798823 bus /sierra_2: Setting Powered False 23:48:45.866633 run create_hlr_db(pid=30186): Terminated: ok {rc=0} 23:48:46.372673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30188): Launched 23:48:46.715423 run osmo-hlr_10.42.42.2(pid=30189): Launched 23:48:46.978136 run osmo-stp_10.42.42.5: Starting osmo-stp 23:48:47.624491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30191): Launched 23:48:47.928327 run osmo-stp_10.42.42.5(pid=30192): Launched 23:48:48.043667 run osmo-msc_10.42.42.6: Starting osmo-msc 23:48:48.590526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30194): Launched 23:48:48.893229 run osmo-msc_10.42.42.6(pid=30195): Launched 23:48:49.062596 run osmo-stp_10.42.42.5(pid=30192): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30192)] 23:48:49.191777 run osmo-stp_10.42.42.5(pid=30192): stdout: | (launched: 2022-12-08_23:48:47.873236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:49.320841 run osmo-stp_10.42.42.5(pid=30192): stderr: | [0;m[38;5;43m20221208234848042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234848042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234848043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234848043 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234848045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234848046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234848046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:49.446923 run osmo-stp_10.42.42.5(pid=30192): stdout: | (launched: 2022-12-08_23:48:47.873236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:49.567471 run osmo-stp_10.42.42.5(pid=30192): stderr: | [0;m[38;5;43m20221208234848042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234848042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234848043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234848043 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234848045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234848046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234848046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:49.711452 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30192): Process ended prematurely: osmo-stp_10.42.42.5(pid=30192) [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30192)] [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:48:49.720400 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 23:48:49.747368 run osmo-hlr_10.42.42.2(pid=30189): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30189)] 23:48:49.794777 run osmo-hlr_10.42.42.2(pid=30189): stdout: | (launched: 2022-12-08_23:48:46.650224) 23:48:49.843325 run osmo-hlr_10.42.42.2(pid=30189): stderr: | [0;m[1;31m20221208234846921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234846921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234846921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234846921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234846921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234846921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234846938 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234846963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234846963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234846963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:48:49.911668 run osmo-msc_10.42.42.6(pid=30195): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30195)] 23:48:49.958756 run osmo-msc_10.42.42.6(pid=30195): stdout: | (launched: 2022-12-08_23:48:48.837664) 23:48:50.007588 run osmo-msc_10.42.42.6(pid=30195): stderr: | [0;m[38;5;43m20221208234849110 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234849110 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7a85c54c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234849110 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234849110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234849110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234849110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234849112 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234849113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234849113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234849113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:48:50.056623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30188): Terminating (SIGTERM) 23:48:50.095590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30191): Terminating (SIGTERM) 23:48:50.134858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30194): Terminating (SIGTERM) 23:48:50.174431 --- ParallelTerminationStrategy: PID 30188 died... 23:48:50.193687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30188): Terminated: ok {rc=0} 23:48:50.237484 --- ParallelTerminationStrategy: PID 30191 died... 23:48:50.256166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30191): Terminated: ok {rc=0} 23:48:50.299778 --- ParallelTerminationStrategy: PID 30194 died... 23:48:50.318212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30194): Terminated: ok {rc=0} 23:48:50.402979 bus /sierra_3: Setting Powered False 23:48:51.501208 bus /sierra_3: Setting Powered False 23:48:52.614436 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 23:48:53.858358 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:48:53.864996 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 23:48:53.897317 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 23:48:53.923250 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 23:48:53.975194 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 23:48:54.007125 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 23:48:54.033722 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 23:48:54.580355 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 23:48:54.629297 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:54.640154 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:48:54.706850 tst mo_mt_call.py: using LAC 17602 23:48:54.825032 tst mo_mt_call.py: using RAC 7 23:48:54.952452 tst mo_mt_call.py: using CellId 17602 23:48:55.078799 tst mo_mt_call.py: using BVCI 17603 23:48:55.196839 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:55.208485 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:55.219931 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:55.231288 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:55.242983 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:55.254148 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:48:55.370483 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:48:55.487656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:48:55.957844 run create_hlr_db(pid=30200): Launched 23:48:56.074279 bus /sierra_2: Setting Powered False 23:48:57.134700 run create_hlr_db(pid=30200): Terminated: ok {rc=0} 23:48:57.556036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30202): Launched 23:48:57.860882 run osmo-hlr_10.42.42.2(pid=30203): Launched 23:48:57.976271 run osmo-stp_10.42.42.5: Starting osmo-stp 23:48:58.499032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30205): Launched 23:48:58.802221 run osmo-stp_10.42.42.5(pid=30206): Launched 23:48:58.918586 run osmo-msc_10.42.42.6: Starting osmo-msc 23:48:59.465671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30208): Launched 23:48:59.768332 run osmo-msc_10.42.42.6(pid=30209): Launched 23:48:59.938421 run osmo-stp_10.42.42.5(pid=30206): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30206)] 23:49:00.067706 run osmo-stp_10.42.42.5(pid=30206): stdout: | (launched: 2022-12-08_23:48:58.746871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:00.197374 run osmo-stp_10.42.42.5(pid=30206): stderr: | [0;m[38;5;43m20221208234858916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234858916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234858917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234858917 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234858918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234858918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234858918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:00.323575 run osmo-stp_10.42.42.5(pid=30206): stdout: | (launched: 2022-12-08_23:48:58.746871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:00.443894 run osmo-stp_10.42.42.5(pid=30206): stderr: | [0;m[38;5;43m20221208234858916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234858916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234858917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234858917 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234858918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234858918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234858918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:00.587995 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30206): Process ended prematurely: osmo-stp_10.42.42.5(pid=30206) [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30206)] [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 23:49:00.596765 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:49:00.622823 run osmo-hlr_10.42.42.2(pid=30203): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30203)] 23:49:00.671047 run osmo-hlr_10.42.42.2(pid=30203): stdout: | (launched: 2022-12-08_23:48:57.805714) 23:49:00.720053 run osmo-hlr_10.42.42.2(pid=30203): stderr: | [0;m[1;31m20221208234857981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234857981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234857981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234857981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234857981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234857981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234857992 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234858001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234858001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234858001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:49:00.788360 run osmo-msc_10.42.42.6(pid=30209): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30209)] 23:49:00.841314 run osmo-msc_10.42.42.6(pid=30209): stdout: | (launched: 2022-12-08_23:48:59.713402) 23:49:00.903645 run osmo-msc_10.42.42.6(pid=30209): stderr: | [0;m[38;5;43m20221208234859987 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234859987 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f60e98c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234859987 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234859987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234859987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234859987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234859989 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234859989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234859990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234859990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:49:00.953893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30202): Terminating (SIGTERM) 23:49:00.993971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30205): Terminating (SIGTERM) 23:49:01.035825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30208): Terminating (SIGTERM) 23:49:01.076151 --- ParallelTerminationStrategy: PID 30202 died... 23:49:01.095003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30202): Terminated: ok {rc=0} 23:49:01.138953 --- ParallelTerminationStrategy: PID 30205 died... 23:49:01.157922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30205): Terminated: ok {rc=0} 23:49:01.201836 --- ParallelTerminationStrategy: PID 30208 died... 23:49:01.220508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30208): Terminated: ok {rc=0} 23:49:01.304603 bus /sierra_3: Setting Powered False 23:49:02.397976 bus /sierra_3: Setting Powered False 23:49:03.512180 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 23:49:04.653484 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:49:04.665055 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:49:04.732335 tst mo_mt_call_osmux.py: using LAC 17603 23:49:04.859694 tst mo_mt_call_osmux.py: using RAC 8 23:49:04.986884 tst mo_mt_call_osmux.py: using CellId 17603 23:49:05.115306 tst mo_mt_call_osmux.py: using BVCI 17604 23:49:05.233776 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:49:05.245472 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:49:05.256890 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:49:05.268358 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:49:05.280443 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:49:05.292141 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:49:05.411859 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:49:05.529202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:49:05.999081 run create_hlr_db(pid=30211): Launched 23:49:06.115534 bus /sierra_2: Setting Powered False 23:49:07.175119 run create_hlr_db(pid=30211): Terminated: ok {rc=0} 23:49:07.614143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30213): Launched 23:49:07.937683 run osmo-hlr_10.42.42.2(pid=30214): Launched 23:49:08.060217 run osmo-stp_10.42.42.5: Starting osmo-stp 23:49:08.617229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30216): Launched 23:49:08.939758 run osmo-stp_10.42.42.5(pid=30217): Launched 23:49:09.062694 run osmo-msc_10.42.42.6: Starting osmo-msc 23:49:09.644127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30219): Launched 23:49:09.965621 run osmo-msc_10.42.42.6(pid=30220): Launched 23:49:10.144702 run osmo-stp_10.42.42.5(pid=30217): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30217)] 23:49:10.280760 run osmo-stp_10.42.42.5(pid=30217): stdout: | (launched: 2022-12-08_23:49:08.881513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:10.417113 run osmo-stp_10.42.42.5(pid=30217): stderr: | [0;m[38;5;43m20221208234909074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234909074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234909074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234909075 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234909075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234909075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234909075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:10.552535 run osmo-stp_10.42.42.5(pid=30217): stdout: | (launched: 2022-12-08_23:49:08.881513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:10.681145 run osmo-stp_10.42.42.5(pid=30217): stderr: | [0;m[38;5;43m20221208234909074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234909074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234909074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234909075 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234909075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234909075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234909075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:10.834093 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30217): Process ended prematurely: osmo-stp_10.42.42.5(pid=30217) [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30217)] [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 23:49:10.843701 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:49:10.871283 run osmo-hlr_10.42.42.2(pid=30214): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30214)] 23:49:10.920800 run osmo-hlr_10.42.42.2(pid=30214): stdout: | (launched: 2022-12-08_23:49:07.878893) 23:49:10.972248 run osmo-hlr_10.42.42.2(pid=30214): stderr: | [0;m[1;31m20221208234908079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234908079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234908079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234908079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234908079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234908079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234908092 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234908100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234908100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234908100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:49:11.043447 run osmo-msc_10.42.42.6(pid=30220): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30220)] 23:49:11.092376 run osmo-msc_10.42.42.6(pid=30220): stdout: | (launched: 2022-12-08_23:49:09.906960) 23:49:11.143153 run osmo-msc_10.42.42.6(pid=30220): stderr: | [0;m[38;5;43m20221208234910228 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234910228 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f501eec7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234910228 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234910229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234910229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234910229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234910230 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234910231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234910231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234910231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:49:11.194217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30213): Terminating (SIGTERM) 23:49:11.235325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30216): Terminating (SIGTERM) 23:49:11.276396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30219): Terminating (SIGTERM) 23:49:11.317706 --- ParallelTerminationStrategy: PID 30213 died... 23:49:11.337293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30213): Terminated: ok {rc=0} 23:49:11.382386 --- ParallelTerminationStrategy: PID 30216 died... 23:49:11.401416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30216): Terminated: ok {rc=0} 23:49:11.446470 --- ParallelTerminationStrategy: PID 30219 died... 23:49:11.465644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30219): Terminated: ok {rc=0} 23:49:11.552102 bus /sierra_3: Setting Powered False 23:49:12.650028 bus /sierra_3: Setting Powered False 23:49:13.764068 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:49:15.016221 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:49:15.023313 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:49:15.056374 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:49:15.083602 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:49:15.134049 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:49:15.167136 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:49:15.194187 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:49:15.747165 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:49:15.798695 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:15.810249 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:49:15.914060 tst mo_mt_call.py: using LAC 17604 23:49:16.042518 tst mo_mt_call.py: using RAC 9 23:49:16.163874 tst mo_mt_call.py: using CellId 17604 23:49:16.285761 tst mo_mt_call.py: using BVCI 17605 23:49:16.431762 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:16.443976 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:16.456095 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:16.468133 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:16.480355 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:16.492611 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:49:16.613935 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:49:16.738908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:49:17.227968 run create_hlr_db(pid=30225): Launched 23:49:17.379539 bus /sierra_2: Setting Powered False 23:49:18.442770 run create_hlr_db(pid=30225): Terminated: ok {rc=0} 23:49:18.889663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30227): Launched 23:49:19.210859 run osmo-hlr_10.42.42.2(pid=30228): Launched 23:49:19.333503 run osmo-stp_10.42.42.5: Starting osmo-stp 23:49:19.887269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30230): Launched 23:49:20.209909 run osmo-stp_10.42.42.5(pid=30231): Launched 23:49:20.332177 run osmo-msc_10.42.42.6: Starting osmo-msc 23:49:20.912868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30233): Launched 23:49:21.233326 run osmo-msc_10.42.42.6(pid=30234): Launched 23:49:21.413707 run osmo-stp_10.42.42.5(pid=30231): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30231)] 23:49:21.549791 run osmo-stp_10.42.42.5(pid=30231): stdout: | (launched: 2022-12-08_23:49:20.151171) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:21.686803 run osmo-stp_10.42.42.5(pid=30231): stderr: | [0;m[38;5;43m20221208234920345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234920346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234920346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234920346 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234920347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234920347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234920347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:21.822100 run osmo-stp_10.42.42.5(pid=30231): stdout: | (launched: 2022-12-08_23:49:20.151171) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:21.950782 run osmo-stp_10.42.42.5(pid=30231): stderr: | [0;m[38;5;43m20221208234920345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234920346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234920346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234920346 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234920347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234920347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234920347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:22.104700 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30231): Process ended prematurely: osmo-stp_10.42.42.5(pid=30231) [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30231)] [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:49:22.114433 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 23:49:22.141808 run osmo-hlr_10.42.42.2(pid=30228): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30228)] 23:49:22.191250 run osmo-hlr_10.42.42.2(pid=30228): stdout: | (launched: 2022-12-08_23:49:19.152452) 23:49:22.242282 run osmo-hlr_10.42.42.2(pid=30228): stderr: | [0;m[1;31m20221208234919353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234919353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234919353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234919353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234919353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234919353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234919366 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234919374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234919374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234919374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:49:22.313332 run osmo-msc_10.42.42.6(pid=30234): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30234)] 23:49:22.362531 run osmo-msc_10.42.42.6(pid=30234): stdout: | (launched: 2022-12-08_23:49:21.175256) 23:49:22.413506 run osmo-msc_10.42.42.6(pid=30234): stderr: | [0;m[38;5;43m20221208234921496 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234921496 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9b050e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234921496 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234921496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234921496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234921497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234921498 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234921499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234921499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234921499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:49:22.464523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30227): Terminating (SIGTERM) 23:49:22.505623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30230): Terminating (SIGTERM) 23:49:22.546529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30233): Terminating (SIGTERM) 23:49:22.587773 --- ParallelTerminationStrategy: PID 30227 died... 23:49:22.607126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30227): Terminated: ok {rc=0} 23:49:22.652860 --- ParallelTerminationStrategy: PID 30230 died... 23:49:22.672286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30230): Terminated: ok {rc=0} 23:49:22.717495 --- ParallelTerminationStrategy: PID 30233 died... 23:49:22.736810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30233): Terminated: ok {rc=0} 23:49:22.822927 bus /sierra_3: Setting Powered False 23:49:23.917944 bus /sierra_3: Setting Powered False 23:49:25.032825 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:49:26.175010 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:26.186722 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:49:26.254524 tst mo_mt_call_osmux.py: using LAC 17605 23:49:26.373329 tst mo_mt_call_osmux.py: using RAC 10 23:49:26.493118 tst mo_mt_call_osmux.py: using CellId 17605 23:49:26.617563 tst mo_mt_call_osmux.py: using BVCI 17606 23:49:26.737799 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:26.749423 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:26.760764 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:26.772185 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:26.784195 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:26.796426 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:49:26.914170 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:49:27.033960 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:49:27.534641 run create_hlr_db(pid=30236): Launched 23:49:27.665884 bus /sierra_2: Setting Powered False 23:49:28.729631 run create_hlr_db(pid=30236): Terminated: ok {rc=0} 23:49:29.160891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30238): Launched 23:49:29.464363 run osmo-hlr_10.42.42.2(pid=30239): Launched 23:49:29.581320 run osmo-stp_10.42.42.5: Starting osmo-stp 23:49:30.119394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30241): Launched 23:49:30.422149 run osmo-stp_10.42.42.5(pid=30242): Launched 23:49:30.537633 run osmo-msc_10.42.42.6: Starting osmo-msc 23:49:31.103401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30244): Launched 23:49:31.490380 run osmo-msc_10.42.42.6(pid=30245): Launched 23:49:32.018211 run osmo-stp_10.42.42.5(pid=30242): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30242)] 23:49:32.357692 run osmo-stp_10.42.42.5(pid=30242): stdout: | (launched: 2022-12-08_23:49:30.367164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:32.492502 run osmo-stp_10.42.42.5(pid=30242): stderr: | [0;m[38;5;43m20221208234930537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234930538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234930538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234930538 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234930539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234930539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234930539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:32.627359 run osmo-stp_10.42.42.5(pid=30242): stdout: | (launched: 2022-12-08_23:49:30.367164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:32.756273 run osmo-stp_10.42.42.5(pid=30242): stderr: | [0;m[38;5;43m20221208234930537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234930538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234930538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234930538 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234930539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234930539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234930539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:32.909884 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30242): Process ended prematurely: osmo-stp_10.42.42.5(pid=30242) [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30242)] [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:49:32.919583 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 23:49:32.947398 run osmo-hlr_10.42.42.2(pid=30239): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30239)] 23:49:32.997571 run osmo-hlr_10.42.42.2(pid=30239): stdout: | (launched: 2022-12-08_23:49:29.409326) 23:49:33.049536 run osmo-hlr_10.42.42.2(pid=30239): stderr: | [0;m[1;31m20221208234929585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234929585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234929585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234929585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234929585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234929585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234929598 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234929607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234929607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234929607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:49:33.122055 run osmo-msc_10.42.42.6(pid=30245): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30245)] 23:49:33.171804 run osmo-msc_10.42.42.6(pid=30245): stdout: | (launched: 2022-12-08_23:49:31.432775) 23:49:33.223606 run osmo-msc_10.42.42.6(pid=30245): stderr: | [0;m[38;5;43m20221208234931964 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234931964 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5dc04bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234931965 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234931965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234931965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234931966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234931970 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234931971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234931971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234931972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:49:33.275388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30238): Terminating (SIGTERM) 23:49:33.316927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30241): Terminating (SIGTERM) 23:49:33.358869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30244): Terminating (SIGTERM) 23:49:33.401224 --- ParallelTerminationStrategy: PID 30238 died... 23:49:33.421243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30238): Terminated: ok {rc=0} 23:49:33.467363 --- ParallelTerminationStrategy: PID 30241 died... 23:49:33.487039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30241): Terminated: ok {rc=0} 23:49:33.533245 --- ParallelTerminationStrategy: PID 30244 died... 23:49:33.552549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30244): Terminated: ok {rc=0} 23:49:33.640659 bus /sierra_3: Setting Powered False 23:49:34.738707 bus /sierra_3: Setting Powered False 23:49:35.854800 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:49:37.109432 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:49:37.116373 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:49:37.149298 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:49:37.176642 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:49:37.228859 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:49:37.262000 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:49:37.288934 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:49:37.838068 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:49:37.887970 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:37.899137 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:49:37.966247 tst mo_mt_call.py: using LAC 17606 23:49:38.086285 tst mo_mt_call.py: using RAC 11 23:49:38.207337 tst mo_mt_call.py: using CellId 17606 23:49:38.326328 tst mo_mt_call.py: using BVCI 17607 23:49:38.437975 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:38.448789 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:38.459670 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:38.470463 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:38.481807 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:38.493357 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:49:38.611961 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:49:38.731230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:49:39.229941 run create_hlr_db(pid=30250): Launched 23:49:39.360797 bus /sierra_2: Setting Powered False 23:49:40.424061 run create_hlr_db(pid=30250): Terminated: ok {rc=0} 23:49:40.854419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30252): Launched 23:49:41.157166 run osmo-hlr_10.42.42.2(pid=30253): Launched 23:49:41.272322 run osmo-stp_10.42.42.5: Starting osmo-stp 23:49:41.810344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30255): Launched 23:49:42.112410 run osmo-stp_10.42.42.5(pid=30256): Launched 23:49:42.227780 run osmo-msc_10.42.42.6: Starting osmo-msc 23:49:42.773422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30258): Launched 23:49:43.075827 run osmo-msc_10.42.42.6(pid=30259): Launched 23:49:43.245736 run osmo-stp_10.42.42.5(pid=30256): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30256)] 23:49:43.374709 run osmo-stp_10.42.42.5(pid=30256): stdout: | (launched: 2022-12-08_23:49:42.057197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:43.502825 run osmo-stp_10.42.42.5(pid=30256): stderr: | [0;m[38;5;43m20221208234942227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234942227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234942227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234942228 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234942228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234942228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234942228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:43.629245 run osmo-stp_10.42.42.5(pid=30256): stdout: | (launched: 2022-12-08_23:49:42.057197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:43.749569 run osmo-stp_10.42.42.5(pid=30256): stderr: | [0;m[38;5;43m20221208234942227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234942227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234942227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234942228 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234942228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234942228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234942228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:43.893920 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30256): Process ended prematurely: osmo-stp_10.42.42.5(pid=30256) [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30256)] [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:49:43.902876 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:49:43.929446 run osmo-hlr_10.42.42.2(pid=30253): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30253)] 23:49:43.976555 run osmo-hlr_10.42.42.2(pid=30253): stdout: | (launched: 2022-12-08_23:49:41.102243) 23:49:44.025511 run osmo-hlr_10.42.42.2(pid=30253): stderr: | [0;m[1;31m20221208234941274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234941274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234941275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234941275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234941275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234941275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234941287 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234941297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234941297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234941297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:49:44.093912 run osmo-msc_10.42.42.6(pid=30259): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30259)] 23:49:44.140924 run osmo-msc_10.42.42.6(pid=30259): stdout: | (launched: 2022-12-08_23:49:43.020545) 23:49:44.190011 run osmo-msc_10.42.42.6(pid=30259): stderr: | [0;m[38;5;43m20221208234943289 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234943289 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8871976c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234943289 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234943289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234943289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234943289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234943291 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234943291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234943292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234943292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:49:44.239542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30252): Terminating (SIGTERM) 23:49:44.279147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30255): Terminating (SIGTERM) 23:49:44.318777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30258): Terminating (SIGTERM) 23:49:44.358831 --- ParallelTerminationStrategy: PID 30252 died... 23:49:44.377956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30252): Terminated: ok {rc=0} 23:49:44.421815 --- ParallelTerminationStrategy: PID 30255 died... 23:49:44.439981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30255): Terminated: ok {rc=0} 23:49:44.483446 --- ParallelTerminationStrategy: PID 30258 died... 23:49:44.502253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30258): Terminated: ok {rc=0} 23:49:44.584403 bus /sierra_3: Setting Powered False 23:49:45.681551 bus /sierra_3: Setting Powered False 23:49:46.809529 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:49:47.958677 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:47.970879 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:49:48.041718 tst mo_mt_call_osmux.py: using LAC 17607 23:49:48.170460 tst mo_mt_call_osmux.py: using RAC 12 23:49:48.298697 tst mo_mt_call_osmux.py: using CellId 17607 23:49:48.426618 tst mo_mt_call_osmux.py: using BVCI 17608 23:49:48.545228 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:48.556739 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:48.568295 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:48.579714 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:48.591197 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:48.602625 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:49:48.719160 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:49:48.833852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:49:49.301831 run create_hlr_db(pid=30261): Launched 23:49:49.418012 bus /sierra_2: Setting Powered False 23:49:50.478723 run create_hlr_db(pid=30261): Terminated: ok {rc=0} 23:49:50.919479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30263): Launched 23:49:51.241950 run osmo-hlr_10.42.42.2(pid=30264): Launched 23:49:51.364704 run osmo-stp_10.42.42.5: Starting osmo-stp 23:49:51.924032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30266): Launched 23:49:52.246093 run osmo-stp_10.42.42.5(pid=30267): Launched 23:49:52.369857 run osmo-msc_10.42.42.6: Starting osmo-msc 23:49:52.953253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30269): Launched 23:49:53.275760 run osmo-msc_10.42.42.6(pid=30270): Launched 23:49:53.455907 run osmo-stp_10.42.42.5(pid=30267): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30267)] 23:49:53.592163 run osmo-stp_10.42.42.5(pid=30267): stdout: | (launched: 2022-12-08_23:49:52.187612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:53.729246 run osmo-stp_10.42.42.5(pid=30267): stderr: | [0;m[38;5;43m20221208234952380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234952380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234952380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234952380 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234952381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234952381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234952381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:53.864396 run osmo-stp_10.42.42.5(pid=30267): stdout: | (launched: 2022-12-08_23:49:52.187612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:53.992418 run osmo-stp_10.42.42.5(pid=30267): stderr: | [0;m[38;5;43m20221208234952380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208234952380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208234952380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208234952380 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208234952381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208234952381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208234952381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:54.145873 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30267): Process ended prematurely: osmo-stp_10.42.42.5(pid=30267) [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30267)] [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:49:54.155401 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:49:54.182718 run osmo-hlr_10.42.42.2(pid=30264): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30264)] 23:49:54.231900 run osmo-hlr_10.42.42.2(pid=30264): stdout: | (launched: 2022-12-08_23:49:51.183809) 23:49:54.283394 run osmo-hlr_10.42.42.2(pid=30264): stderr: | [0;m[1;31m20221208234951382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208234951382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208234951382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208234951382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208234951382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208234951382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208234951395 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208234951403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208234951403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208234951404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:49:54.355076 run osmo-msc_10.42.42.6(pid=30270): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30270)] 23:49:54.404261 run osmo-msc_10.42.42.6(pid=30270): stdout: | (launched: 2022-12-08_23:49:53.217352) 23:49:54.455071 run osmo-msc_10.42.42.6(pid=30270): stderr: | [0;m[38;5;43m20221208234953540 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208234953540 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7a5a67dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208234953540 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208234953540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208234953541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208234953541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208234953543 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208234953543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208234953543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208234953543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:49:54.506252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30263): Terminating (SIGTERM) 23:49:54.547507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30266): Terminating (SIGTERM) 23:49:54.588692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30269): Terminating (SIGTERM) 23:49:54.630293 --- ParallelTerminationStrategy: PID 30263 died... 23:49:54.650136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30263): Terminated: ok {rc=0} 23:49:54.695519 --- ParallelTerminationStrategy: PID 30266 died... 23:49:54.714583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30266): Terminated: ok {rc=0} 23:49:54.760080 --- ParallelTerminationStrategy: PID 30269 died... 23:49:54.779149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30269): Terminated: ok {rc=0} 23:49:54.864887 bus /sierra_3: Setting Powered False 23:49:55.962269 bus /sierra_3: Setting Powered False 23:49:57.075103 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:49:58.328505 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:49:58.334676 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:49:58.367798 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 23:49:58.395437 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 23:49:58.447158 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:49:58.480317 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 23:49:58.507930 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 23:49:59.054754 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 23:49:59.103390 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:59.114403 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:49:59.182709 tst mo_mt_call.py: using LAC 17608 23:49:59.300011 tst mo_mt_call.py: using RAC 13 23:49:59.418523 tst mo_mt_call.py: using CellId 17608 23:49:59.538920 tst mo_mt_call.py: using BVCI 17609 23:49:59.648290 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:59.659151 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:59.669885 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:59.680725 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:59.691629 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:59.702269 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:49:59.816399 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:49:59.930633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:50:00.399008 run create_hlr_db(pid=30275): Launched 23:50:00.514822 bus /sierra_2: Setting Powered False 23:50:01.574523 run create_hlr_db(pid=30275): Terminated: ok {rc=0} 23:50:02.015887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30280): Launched 23:50:02.331918 run osmo-hlr_10.42.42.2(pid=30281): Launched 23:50:02.448390 run osmo-stp_10.42.42.5: Starting osmo-stp 23:50:02.967622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30283): Launched 23:50:03.268861 run osmo-stp_10.42.42.5(pid=30284): Launched 23:50:03.384163 run osmo-msc_10.42.42.6: Starting osmo-msc 23:50:03.929234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30286): Launched 23:50:04.230986 run osmo-msc_10.42.42.6(pid=30287): Launched 23:50:04.400709 run osmo-stp_10.42.42.5(pid=30284): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30284)] 23:50:04.529985 run osmo-stp_10.42.42.5(pid=30284): stdout: | (launched: 2022-12-08_23:50:03.214118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:04.658529 run osmo-stp_10.42.42.5(pid=30284): stderr: | [0;m[38;5;43m20221208235003386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235003386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235003386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235003386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235003387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235003387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235003387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:04.784301 run osmo-stp_10.42.42.5(pid=30284): stdout: | (launched: 2022-12-08_23:50:03.214118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:04.904234 run osmo-stp_10.42.42.5(pid=30284): stderr: | [0;m[38;5;43m20221208235003386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235003386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235003386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235003386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235003387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235003387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235003387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:05.047824 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30284): Process ended prematurely: osmo-stp_10.42.42.5(pid=30284) [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30284)] [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 23:50:05.056989 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:50:05.083374 run osmo-hlr_10.42.42.2(pid=30281): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30281)] 23:50:05.130851 run osmo-hlr_10.42.42.2(pid=30281): stdout: | (launched: 2022-12-08_23:50:02.276261) 23:50:05.180241 run osmo-hlr_10.42.42.2(pid=30281): stderr: | [0;m[1;31m20221208235002452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235002452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235002452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235002452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235002452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235002452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235002464 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235002473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235002473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235002473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:50:05.248401 run osmo-msc_10.42.42.6(pid=30287): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30287)] 23:50:05.295603 run osmo-msc_10.42.42.6(pid=30287): stdout: | (launched: 2022-12-08_23:50:04.176107) 23:50:05.344315 run osmo-msc_10.42.42.6(pid=30287): stderr: | [0;m[38;5;43m20221208235004449 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235004449 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1df8e9bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235004449 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235004449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235004449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235004450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235004451 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235004452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235004452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235004452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:50:05.393622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30280): Terminating (SIGTERM) 23:50:05.432444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30283): Terminating (SIGTERM) 23:50:05.470968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30286): Terminating (SIGTERM) 23:50:05.510225 --- ParallelTerminationStrategy: PID 30280 died... 23:50:05.529243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30280): Terminated: ok {rc=0} 23:50:05.573025 --- ParallelTerminationStrategy: PID 30283 died... 23:50:05.591741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30283): Terminated: ok {rc=0} 23:50:05.634767 --- ParallelTerminationStrategy: PID 30286 died... 23:50:05.653639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30286): Terminated: ok {rc=0} 23:50:05.738932 bus /sierra_3: Setting Powered False 23:50:06.837397 bus /sierra_3: Setting Powered False 23:50:07.953420 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 23:50:09.103649 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:50:09.116055 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:50:09.187644 tst mo_mt_call_osmux.py: using LAC 17609 23:50:09.316119 tst mo_mt_call_osmux.py: using RAC 14 23:50:09.446111 tst mo_mt_call_osmux.py: using CellId 17609 23:50:09.572326 tst mo_mt_call_osmux.py: using BVCI 17610 23:50:09.689920 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:50:09.701588 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:50:09.712639 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:50:09.723711 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:50:09.735110 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:50:09.746255 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:50:09.862061 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:50:09.980487 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:50:10.480538 run create_hlr_db(pid=30289): Launched 23:50:10.611935 bus /sierra_2: Setting Powered False 23:50:11.676299 run create_hlr_db(pid=30289): Terminated: ok {rc=0} 23:50:12.106291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30291): Launched 23:50:12.408485 run osmo-hlr_10.42.42.2(pid=30292): Launched 23:50:12.524455 run osmo-stp_10.42.42.5: Starting osmo-stp 23:50:13.060491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30294): Launched 23:50:13.364470 run osmo-stp_10.42.42.5(pid=30295): Launched 23:50:13.480752 run osmo-msc_10.42.42.6: Starting osmo-msc 23:50:14.034055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30297): Launched 23:50:14.337718 run osmo-msc_10.42.42.6(pid=30298): Launched 23:50:14.507409 run osmo-stp_10.42.42.5(pid=30295): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30295)] 23:50:14.637539 run osmo-stp_10.42.42.5(pid=30295): stdout: | (launched: 2022-12-08_23:50:13.308901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:14.765964 run osmo-stp_10.42.42.5(pid=30295): stderr: | [0;m[38;5;43m20221208235013479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235013479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235013480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235013480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235013481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235013481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235013481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:14.891693 run osmo-stp_10.42.42.5(pid=30295): stdout: | (launched: 2022-12-08_23:50:13.308901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:15.011915 run osmo-stp_10.42.42.5(pid=30295): stderr: | [0;m[38;5;43m20221208235013479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235013479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235013480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235013480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235013481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235013481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235013481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:15.155989 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30295): Process ended prematurely: osmo-stp_10.42.42.5(pid=30295) [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30295)] [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 23:50:15.164756 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:50:15.191052 run osmo-hlr_10.42.42.2(pid=30292): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30292)] 23:50:15.238725 run osmo-hlr_10.42.42.2(pid=30292): stdout: | (launched: 2022-12-08_23:50:12.353292) 23:50:15.288079 run osmo-hlr_10.42.42.2(pid=30292): stderr: | [0;m[1;31m20221208235012529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235012529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235012529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235012529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235012529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235012529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235012542 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235012553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235012553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235012553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:50:15.357125 run osmo-msc_10.42.42.6(pid=30298): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30298)] 23:50:15.404568 run osmo-msc_10.42.42.6(pid=30298): stdout: | (launched: 2022-12-08_23:50:14.282475) 23:50:15.453707 run osmo-msc_10.42.42.6(pid=30298): stderr: | [0;m[38;5;43m20221208235014554 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235014554 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fce19308c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235014554 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235014554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235014554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235014554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235014556 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235014557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235014557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235014557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:50:15.503359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30291): Terminating (SIGTERM) 23:50:15.542843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30294): Terminating (SIGTERM) 23:50:15.582068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30297): Terminating (SIGTERM) 23:50:15.621763 --- ParallelTerminationStrategy: PID 30291 died... 23:50:15.640667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30291): Terminated: ok {rc=0} 23:50:15.684832 --- ParallelTerminationStrategy: PID 30294 died... 23:50:15.703094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30294): Terminated: ok {rc=0} 23:50:15.746828 --- ParallelTerminationStrategy: PID 30297 died... 23:50:15.765395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30297): Terminated: ok {rc=0} 23:50:15.870029 bus /sierra_3: Setting Powered False 23:50:16.974859 bus /sierra_3: Setting Powered False 23:50:18.093440 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 23:50:19.335973 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:50:19.341897 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 23:50:19.374386 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 23:50:19.400783 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 23:50:19.453072 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 23:50:19.486491 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 23:50:19.513678 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 23:50:20.061829 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 23:50:20.110912 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:20.122766 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:50:20.173929 tst mo_mt_call.py: using LAC 17610 23:50:20.293242 tst mo_mt_call.py: using RAC 15 23:50:20.411664 tst mo_mt_call.py: using CellId 17610 23:50:20.531839 tst mo_mt_call.py: using BVCI 17611 23:50:20.649993 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:20.662236 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:20.674049 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:20.685718 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:20.697494 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:20.709315 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:50:20.826442 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:50:20.940017 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:50:21.408138 run create_hlr_db(pid=30305): Launched 23:50:21.523679 bus /sierra_2: Setting Powered False 23:50:22.583442 run create_hlr_db(pid=30305): Terminated: ok {rc=0} 23:50:23.003546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30307): Launched 23:50:23.306174 run osmo-hlr_10.42.42.2(pid=30308): Launched 23:50:23.422148 run osmo-stp_10.42.42.5: Starting osmo-stp 23:50:23.941376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30310): Launched 23:50:24.243176 run osmo-stp_10.42.42.5(pid=30311): Launched 23:50:24.358752 run osmo-msc_10.42.42.6: Starting osmo-msc 23:50:24.906881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30313): Launched 23:50:25.210937 run osmo-msc_10.42.42.6(pid=30314): Launched 23:50:25.379783 run osmo-stp_10.42.42.5(pid=30311): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30311)] 23:50:25.508422 run osmo-stp_10.42.42.5(pid=30311): stdout: | (launched: 2022-12-08_23:50:24.188421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:25.637115 run osmo-stp_10.42.42.5(pid=30311): stderr: | [0;m[38;5;43m20221208235024359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235024359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235024360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235024360 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235024360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235024361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235024361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:25.764042 run osmo-stp_10.42.42.5(pid=30311): stdout: | (launched: 2022-12-08_23:50:24.188421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:25.884346 run osmo-stp_10.42.42.5(pid=30311): stderr: | [0;m[38;5;43m20221208235024359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235024359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235024360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235024360 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235024360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235024361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235024361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:26.028554 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30311): Process ended prematurely: osmo-stp_10.42.42.5(pid=30311) [trial-2351↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30311)] [trial-2351↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 23:50:26.037562 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:50:26.064056 run osmo-hlr_10.42.42.2(pid=30308): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30308)] 23:50:26.111626 run osmo-hlr_10.42.42.2(pid=30308): stdout: | (launched: 2022-12-08_23:50:23.250776) 23:50:26.160500 run osmo-hlr_10.42.42.2(pid=30308): stderr: | [0;m[1;31m20221208235023425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235023425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235023425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235023425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235023425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235023425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235023438 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235023447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235023447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235023447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:50:26.228855 run osmo-msc_10.42.42.6(pid=30314): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30314)] 23:50:26.275972 run osmo-msc_10.42.42.6(pid=30314): stdout: | (launched: 2022-12-08_23:50:25.155287) 23:50:26.324645 run osmo-msc_10.42.42.6(pid=30314): stderr: | [0;m[38;5;43m20221208235025426 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235025426 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3c11327c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235025426 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235025426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235025426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235025426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235025428 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235025428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235025429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235025429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:50:26.373758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30307): Terminating (SIGTERM) 23:50:26.412941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30310): Terminating (SIGTERM) 23:50:26.452118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30313): Terminating (SIGTERM) 23:50:26.491540 --- ParallelTerminationStrategy: PID 30307 died... 23:50:26.510578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30307): Terminated: ok {rc=0} 23:50:26.554307 --- ParallelTerminationStrategy: PID 30310 died... 23:50:26.572859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30310): Terminated: ok {rc=0} 23:50:26.616602 --- ParallelTerminationStrategy: PID 30313 died... 23:50:26.635038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30313): Terminated: ok {rc=0} 23:50:26.720069 bus /sierra_3: Setting Powered False 23:50:27.819223 bus /sierra_3: Setting Powered False 23:50:28.933002 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 23:50:30.079640 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:30.092044 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:50:30.145819 tst mo_mt_call_osmux.py: using LAC 17611 23:50:30.277759 tst mo_mt_call_osmux.py: using RAC 16 23:50:30.396872 tst mo_mt_call_osmux.py: using CellId 17611 23:50:30.514293 tst mo_mt_call_osmux.py: using BVCI 17612 23:50:30.625944 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:30.636915 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:30.647884 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:30.658816 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:30.670332 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:30.681566 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:50:30.795935 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:50:30.921780 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:50:31.423744 run create_hlr_db(pid=30316): Launched 23:50:31.573383 bus /sierra_2: Setting Powered False 23:50:32.633412 run create_hlr_db(pid=30316): Terminated: ok {rc=0} 23:50:33.073418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30318): Launched 23:50:33.395338 run osmo-hlr_10.42.42.2(pid=30319): Launched 23:50:33.520885 run osmo-stp_10.42.42.5: Starting osmo-stp 23:50:34.077913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30321): Launched 23:50:34.400781 run osmo-stp_10.42.42.5(pid=30322): Launched 23:50:34.523431 run osmo-msc_10.42.42.6: Starting osmo-msc 23:50:35.108862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30324): Launched 23:50:35.432099 run osmo-msc_10.42.42.6(pid=30325): Launched 23:50:35.611944 run osmo-stp_10.42.42.5(pid=30322): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30322)] 23:50:35.749160 run osmo-stp_10.42.42.5(pid=30322): stdout: | (launched: 2022-12-08_23:50:34.342409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:35.885642 run osmo-stp_10.42.42.5(pid=30322): stderr: | [0;m[38;5;43m20221208235034536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235034536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235034536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235034537 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235034537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235034537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235034537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:36.021414 run osmo-stp_10.42.42.5(pid=30322): stdout: | (launched: 2022-12-08_23:50:34.342409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:36.150042 run osmo-stp_10.42.42.5(pid=30322): stderr: | [0;m[38;5;43m20221208235034536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235034536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235034536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235034537 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235034537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235034537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235034537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:36.303724 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30322): Process ended prematurely: osmo-stp_10.42.42.5(pid=30322) [trial-2351↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30322)] [trial-2351↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 23:50:36.313259 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 23:50:36.340774 run osmo-hlr_10.42.42.2(pid=30319): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30319)] 23:50:36.390112 run osmo-hlr_10.42.42.2(pid=30319): stdout: | (launched: 2022-12-08_23:50:33.337351) 23:50:36.441191 run osmo-hlr_10.42.42.2(pid=30319): stderr: | [0;m[1;31m20221208235033534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235033534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235033534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235033534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235033534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235033534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235033545 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235033554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235033554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235033554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:50:36.512261 run osmo-msc_10.42.42.6(pid=30325): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30325)] 23:50:36.561515 run osmo-msc_10.42.42.6(pid=30325): stdout: | (launched: 2022-12-08_23:50:35.373630) 23:50:36.612827 run osmo-msc_10.42.42.6(pid=30325): stderr: | [0;m[38;5;43m20221208235035697 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235035698 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0a322c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235035698 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235035698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235035698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235035698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235035700 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235035700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235035700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235035700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:50:36.664658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30318): Terminating (SIGTERM) 23:50:36.705804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30321): Terminating (SIGTERM) 23:50:36.747055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30324): Terminating (SIGTERM) 23:50:36.788563 --- ParallelTerminationStrategy: PID 30318 died... 23:50:36.808305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30318): Terminated: ok {rc=0} 23:50:36.853708 --- ParallelTerminationStrategy: PID 30321 died... 23:50:36.873098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30321): Terminated: ok {rc=0} 23:50:36.918155 --- ParallelTerminationStrategy: PID 30324 died... 23:50:36.937539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30324): Terminated: ok {rc=0} 23:50:37.023544 bus /sierra_3: Setting Powered False 23:50:38.121451 bus /sierra_3: Setting Powered False 23:50:39.237999 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 emergency:trx-umtrx --------------------------------------------------------------------- 23:50:40.488387 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:50:40.493067 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 23:50:40.526159 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:50:40.553171 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 23:50:40.644477 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 23:50:40.678231 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:50:40.705164 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 23:50:41.283381 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2351 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 23:50:41.288737 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:41.299986 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 23:50:41.348368 tst emergency_mo_mt_call.py: using LAC 17612 23:50:41.471730 tst emergency_mo_mt_call.py: using RAC 17 23:50:41.588522 tst emergency_mo_mt_call.py: using CellId 17612 23:50:41.703657 tst emergency_mo_mt_call.py: using BVCI 17613 23:50:41.810746 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:41.821392 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:41.831906 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:41.842694 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:41.853819 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:41.864428 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:41.981684 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:42.101712 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:50:42.592073 run create_hlr_db(pid=30330): Launched 23:50:42.720718 bus /sierra_2: Setting Powered False 23:50:43.784616 run create_hlr_db(pid=30330): Terminated: ok {rc=0} 23:50:44.226351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30332): Launched 23:50:44.542262 run osmo-hlr_10.42.42.2(pid=30333): Launched 23:50:44.663439 run osmo-stp_10.42.42.5: Starting osmo-stp 23:50:45.209122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30335): Launched 23:50:45.526296 run osmo-stp_10.42.42.5(pid=30336): Launched 23:50:45.655763 tst emergency_mo_mt_call.py: using MSISDN 6915 23:50:45.818744 run osmo-msc_10.42.42.6: Starting osmo-msc 23:50:46.415025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30338): Launched 23:50:46.757730 run osmo-msc_10.42.42.6(pid=30339): Launched 23:50:47.162115 run osmo-stp_10.42.42.5(pid=30336): ERR: Terminated: ERROR {rc=1} [trial-2351↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30336)] 23:50:47.295813 run osmo-stp_10.42.42.5(pid=30336): stdout: | (launched: 2022-12-08_23:50:45.468655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:47.430096 run osmo-stp_10.42.42.5(pid=30336): stderr: | [0;m[38;5;43m20221208235045661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235045661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235045661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235045662 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235045662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235045662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235045662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:47.562562 run osmo-stp_10.42.42.5(pid=30336): stdout: | (launched: 2022-12-08_23:50:45.468655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:47.689722 run osmo-stp_10.42.42.5(pid=30336): stderr: | [0;m[38;5;43m20221208235045661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235045661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235045661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235045662 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235045662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235045662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235045662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:47.841152 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=30336): Process ended prematurely: osmo-stp_10.42.42.5(pid=30336) [trial-2351↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30336)] [trial-2351↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 23:50:47.850355 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 23:50:47.877657 run osmo-hlr_10.42.42.2(pid=30333): ERR: Terminated: ERROR {rc=237} [trial-2351↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30333)] 23:50:47.927374 run osmo-hlr_10.42.42.2(pid=30333): stdout: | (launched: 2022-12-08_23:50:44.485035) 23:50:47.978594 run osmo-hlr_10.42.42.2(pid=30333): stderr: | [0;m[1;31m20221208235044683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235044683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235044684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235044684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235044684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235044684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235044699 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235044709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235044709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235044710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:50:48.049877 run osmo-msc_10.42.42.6(pid=30339): ERR: Terminated: ERROR {rc=2} [trial-2351↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30339)] 23:50:48.099326 run osmo-msc_10.42.42.6(pid=30339): stdout: | (launched: 2022-12-08_23:50:46.689899) 23:50:48.150302 run osmo-msc_10.42.42.6(pid=30339): stderr: | [0;m[38;5;43m20221208235047044 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235047044 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7e073e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235047044 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235047044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235047044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235047044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235047046 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235047047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235047047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235047047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:50:48.201658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30332): Terminating (SIGTERM) 23:50:48.242819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30335): Terminating (SIGTERM) 23:50:48.284168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30338): Terminating (SIGTERM) 23:50:48.326009 --- ParallelTerminationStrategy: PID 30332 died... 23:50:48.345998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30332): Terminated: ok {rc=0} 23:50:48.391483 --- ParallelTerminationStrategy: PID 30335 died... 23:50:48.410950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30335): Terminated: ok {rc=0} 23:50:48.456389 --- ParallelTerminationStrategy: PID 30338 died... 23:50:48.475832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30338): Terminated: ok {rc=0} 23:50:48.562659 bus /sierra_3: Setting Powered False 23:50:49.661091 bus /sierra_3: Setting Powered False 23:50:50.775713 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 23:50:51.861089 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:51.873031 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 23:50:51.924342 tst emergency_preemptive_call.py: using LAC 17613 23:50:52.049404 tst emergency_preemptive_call.py: using RAC 18 23:50:52.173526 tst emergency_preemptive_call.py: using CellId 17613 23:50:52.294601 tst emergency_preemptive_call.py: using BVCI 17614 23:50:52.411055 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:52.422394 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:52.433347 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:52.444327 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:52.455701 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:52.466747 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:52.583213 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:52.698985 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:52.816334 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:52.933781 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:50:53.427355 run create_hlr_db(pid=30341): Launched 23:50:53.556804 bus /sierra_2: Setting Powered False 23:50:54.619659 run create_hlr_db(pid=30341): Terminated: ok {rc=0} 23:50:55.046836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30343): Launched 23:50:55.344821 run osmo-hlr_10.42.42.2(pid=30344): Launched 23:50:55.458728 run osmo-stp_10.42.42.5: Starting osmo-stp 23:50:55.973611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30346): Launched 23:50:56.271515 run osmo-stp_10.42.42.5(pid=30347): Launched 23:50:56.395672 tst emergency_preemptive_call.py: using MSISDN 6916 23:50:56.548237 run osmo-msc_10.42.42.6: Starting osmo-msc 23:50:57.082265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30349): Launched 23:50:57.379967 run osmo-msc_10.42.42.6(pid=30350): Launched 23:50:57.547838 run osmo-stp_10.42.42.5(pid=30347): ERR: Terminated: ERROR {rc=1} [trial-2351↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30347)] 23:50:57.674462 run osmo-stp_10.42.42.5(pid=30347): stdout: | (launched: 2022-12-08_23:50:56.217554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:57.801719 run osmo-stp_10.42.42.5(pid=30347): stderr: | [0;m[38;5;43m20221208235056387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235056387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235056388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235056389 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235056389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235056389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235056389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:57.926648 run osmo-stp_10.42.42.5(pid=30347): stdout: | (launched: 2022-12-08_23:50:56.217554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:58.045562 run osmo-stp_10.42.42.5(pid=30347): stderr: | [0;m[38;5;43m20221208235056387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235056387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235056388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235056389 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235056389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235056389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235056389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:58.187660 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=30347): Process ended prematurely: osmo-stp_10.42.42.5(pid=30347) [trial-2351↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30347)] [trial-2351↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 23:50:58.196245 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 23:50:58.222078 run osmo-hlr_10.42.42.2(pid=30344): ERR: Terminated: ERROR {rc=237} [trial-2351↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30344)] 23:50:58.269759 run osmo-hlr_10.42.42.2(pid=30344): stdout: | (launched: 2022-12-08_23:50:55.290754) 23:50:58.318797 run osmo-hlr_10.42.42.2(pid=30344): stderr: | [0;m[1;31m20221208235055466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235055466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235055466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235055466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235055466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235055466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235055478 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235055487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235055487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235055487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:50:58.387084 run osmo-msc_10.42.42.6(pid=30350): ERR: Terminated: ERROR {rc=2} [trial-2351↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30350)] 23:50:58.434223 run osmo-msc_10.42.42.6(pid=30350): stdout: | (launched: 2022-12-08_23:50:57.325529) 23:50:58.482877 run osmo-msc_10.42.42.6(pid=30350): stderr: | [0;m[38;5;43m20221208235057597 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235057597 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f50ae856c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235057597 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235057598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235057598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235057598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235057600 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235057600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235057600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235057600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:50:58.531980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30343): Terminating (SIGTERM) 23:50:58.571025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30346): Terminating (SIGTERM) 23:50:58.610484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30349): Terminating (SIGTERM) 23:50:58.650011 --- ParallelTerminationStrategy: PID 30343 died... 23:50:58.669346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30343): Terminated: ok {rc=0} 23:50:58.713351 --- ParallelTerminationStrategy: PID 30346 died... 23:50:58.731836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30346): Terminated: ok {rc=0} 23:50:58.775872 --- ParallelTerminationStrategy: PID 30349 died... 23:50:58.794366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30349): Terminated: ok {rc=0} 23:50:58.879265 bus /sierra_9: Setting Powered False 23:50:59.977453 bus /sierra_9: Setting Powered False 23:51:01.097070 bus /sierra_8: Setting Powered False 23:51:02.220527 bus /sierra_8: Setting Powered False 23:51:03.334699 bus /sierra_3: Setting Powered False 23:51:04.431844 bus /sierra_3: Setting Powered False 23:51:05.546097 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-umtrx --------------------------------------------------------------------- 23:51:06.822120 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:51:06.826858 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 23:51:06.859901 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 23:51:06.898917 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 23:51:06.985994 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 23:51:07.018914 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 23:51:07.058058 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 23:51:07.647947 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 23:51:07.700734 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:07.711654 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 23:51:07.760358 tst cs_paging_gprs_active.py: using LAC 17614 23:51:07.888238 tst cs_paging_gprs_active.py: using RAC 19 23:51:08.014241 tst cs_paging_gprs_active.py: using CellId 17614 23:51:08.140352 tst cs_paging_gprs_active.py: using BVCI 17615 23:51:08.257597 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:08.268524 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:08.279339 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:08.290205 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:08.301251 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:08.311857 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:08.322770 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:08.333448 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:08.344288 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:08.459687 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:08.579110 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:51:08.799027 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:09.123402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30355): Launched 23:51:09.404452 run iperf3-srv_10.42.42.10(pid=30356): Launched 23:51:09.526138 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:51:09.745283 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:10.069041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30357): Launched 23:51:10.349750 run iperf3-srv_10.42.42.10(pid=30358): Launched 23:51:10.470600 tst cs_paging_gprs_active.py:38: start network... 23:51:10.689807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:51:11.192317 run create_hlr_db(pid=30359): Launched 23:51:11.323422 bus /sierra_2: Setting Powered False 23:51:12.386839 run create_hlr_db(pid=30359): Terminated: ok {rc=0} 23:51:12.819795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30361): Launched 23:51:13.125526 run osmo-hlr_10.42.42.2(pid=30362): Launched 23:51:13.242338 run osmo-stp_10.42.42.5: Starting osmo-stp 23:51:13.769507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30364): Launched 23:51:14.073654 run osmo-stp_10.42.42.5(pid=30365): Launched 23:51:14.190219 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:51:14.714130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30367): Launched 23:51:14.830656 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:51:15.088239 run patchelf(pid=30368): Launched 23:51:15.258292 run osmo-stp_10.42.42.5(pid=30365): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30365)] 23:51:15.387707 run osmo-stp_10.42.42.5(pid=30365): stdout: | (launched: 2022-12-08_23:51:14.018127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:15.518382 run osmo-stp_10.42.42.5(pid=30365): stderr: | [0;m[38;5;43m20221208235114188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235114188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235114189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235114189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235114191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235114192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235114192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:15.648786 run osmo-stp_10.42.42.5(pid=30365): stdout: | (launched: 2022-12-08_23:51:14.018127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:15.773993 run osmo-stp_10.42.42.5(pid=30365): stderr: | [0;m[38;5;43m20221208235114188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235114188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235114189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235114189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235114191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235114192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235114192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:15.957739 run patchelf(pid=30368): Terminating (SIGINT) 23:51:16.144149 run patchelf(pid=30368): Terminated: ok {rc=0} 23:51:16.279360 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30365): Process ended prematurely: osmo-stp_10.42.42.5(pid=30365) [trial-2351↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30365)] [trial-2351↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 23:51:16.290097 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 23:51:16.320504 run osmo-hlr_10.42.42.2(pid=30362): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30362)] 23:51:16.371638 run osmo-hlr_10.42.42.2(pid=30362): stdout: | (launched: 2022-12-08_23:51:13.069770) 23:51:16.424423 run osmo-hlr_10.42.42.2(pid=30362): stderr: | [0;m[1;31m20221208235113248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235113248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235113248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235113248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235113248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235113248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235113261 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235113269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235113269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235113269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:51:16.477428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30355): Terminating (SIGTERM) 23:51:16.521453 run iperf3-srv_10.42.42.10(pid=30356): Terminating (SIGTERM) 23:51:16.564693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30357): Terminating (SIGTERM) 23:51:16.608297 run iperf3-srv_10.42.42.10(pid=30358): Terminating (SIGTERM) 23:51:16.655456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30361): Terminating (SIGTERM) 23:51:16.701258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30364): Terminating (SIGTERM) 23:51:16.746038 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30367): Terminating (SIGTERM) 23:51:16.791351 --- ParallelTerminationStrategy: PID 30355 died... 23:51:16.811827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30355): Terminated: ok {rc=0} 23:51:16.860219 --- ParallelTerminationStrategy: PID 30356 died... 23:51:16.880088 run iperf3-srv_10.42.42.10(pid=30356): Terminated {rc=256} 23:51:16.927792 --- ParallelTerminationStrategy: PID 30357 died... 23:51:16.948045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30357): Terminated: ok {rc=0} 23:51:16.994900 --- ParallelTerminationStrategy: PID 30358 died... 23:51:17.015346 run iperf3-srv_10.42.42.10(pid=30358): Terminated {rc=256} 23:51:17.062317 --- ParallelTerminationStrategy: PID 30361 died... 23:51:17.082747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30361): Terminated: ok {rc=0} 23:51:17.130488 --- ParallelTerminationStrategy: PID 30364 died... 23:51:17.151654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30364): Terminated: ok {rc=0} 23:51:17.198206 --- ParallelTerminationStrategy: PID 30367 died... 23:51:17.217606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30367): Terminated: ok {rc=0} 23:51:17.305066 bus /gobi_0: Setting Powered False 23:51:18.402611 bus /gobi_0: Setting Powered False 23:51:19.515245 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-umtrx iperf3.py ---------------------------------------------- 23:51:20.663305 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:20.674872 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 23:51:20.726473 tst iperf3.py: using LAC 17615 23:51:20.855448 tst iperf3.py: using RAC 20 23:51:20.982404 tst iperf3.py: using CellId 17615 23:51:21.110298 tst iperf3.py: using BVCI 17616 23:51:21.229187 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:21.240146 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:21.250919 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:21.261688 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:21.272299 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:21.283034 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:21.294387 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:21.305159 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:21.316003 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:21.430423 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:51:21.636218 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:21.947227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30369): Launched 23:51:22.229134 run iperf3-srv_10.42.42.10(pid=30370): Launched 23:51:22.350974 tst iperf3.py:8: start network... 23:51:22.570283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:51:23.073224 run create_hlr_db(pid=30371): Launched 23:51:23.204865 bus /gobi_6: Setting Powered False 23:51:24.269467 run create_hlr_db(pid=30371): Terminated: ok {rc=0} 23:51:24.702344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30373): Launched 23:51:25.007753 run osmo-hlr_10.42.42.2(pid=30374): Launched 23:51:25.124139 run osmo-stp_10.42.42.5: Starting osmo-stp 23:51:25.685387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30376): Launched 23:51:26.009046 run osmo-stp_10.42.42.5(pid=30377): Launched 23:51:26.132144 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:51:26.690934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30379): Launched 23:51:26.815623 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:51:27.089617 run patchelf(pid=30380): Launched 23:51:27.269971 run osmo-stp_10.42.42.5(pid=30377): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30377)] 23:51:27.407317 run osmo-stp_10.42.42.5(pid=30377): stdout: | (launched: 2022-12-08_23:51:25.950184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:27.546658 run osmo-stp_10.42.42.5(pid=30377): stderr: | [0;m[38;5;43m20221208235126143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235126143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235126144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235126144 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235126145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235126145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235126145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:27.685868 run osmo-stp_10.42.42.5(pid=30377): stdout: | (launched: 2022-12-08_23:51:25.950184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:27.819343 run osmo-stp_10.42.42.5(pid=30377): stderr: | [0;m[38;5;43m20221208235126143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235126143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235126144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235126144 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235126145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235126145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235126145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:27.976132 run patchelf(pid=30380): Terminating (SIGINT) 23:51:28.156924 run patchelf(pid=30380): Terminated: ok {rc=0} 23:51:28.287348 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30377): Process ended prematurely: osmo-stp_10.42.42.5(pid=30377) [trial-2351↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30377)] [trial-2351↪gprs:trx-umtrx↪iperf3.py:8] 23:51:28.297443 tst iperf3.py:8: Test FAILED (7.7 sec) 23:51:28.325461 run osmo-hlr_10.42.42.2(pid=30374): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30374)] 23:51:28.375230 run osmo-hlr_10.42.42.2(pid=30374): stdout: | (launched: 2022-12-08_23:51:24.951710) 23:51:28.426467 run osmo-hlr_10.42.42.2(pid=30374): stderr: | [0;m[1;31m20221208235125130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235125131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235125131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235125131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235125131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235125131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235125144 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235125152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235125153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235125153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:51:28.478137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30369): Terminating (SIGTERM) 23:51:28.519775 run iperf3-srv_10.42.42.10(pid=30370): Terminating (SIGTERM) 23:51:28.561368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30373): Terminating (SIGTERM) 23:51:28.602938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30376): Terminating (SIGTERM) 23:51:28.644475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30379): Terminating (SIGTERM) 23:51:28.686620 --- ParallelTerminationStrategy: PID 30369 died... 23:51:28.706952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30369): Terminated: ok {rc=0} 23:51:28.753112 --- ParallelTerminationStrategy: PID 30370 died... 23:51:28.772411 run iperf3-srv_10.42.42.10(pid=30370): Terminated {rc=256} 23:51:28.818064 --- ParallelTerminationStrategy: PID 30373 died... 23:51:28.837422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30373): Terminated: ok {rc=0} 23:51:28.883134 --- ParallelTerminationStrategy: PID 30376 died... 23:51:28.902546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30376): Terminated: ok {rc=0} 23:51:28.948144 --- ParallelTerminationStrategy: PID 30379 died... 23:51:28.967487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30379): Terminated: ok {rc=0} 23:51:29.054838 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 23:51:30.202432 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:30.214137 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 23:51:30.263709 tst iperf3m4.py: using LAC 17616 23:51:30.396027 tst iperf3m4.py: using RAC 21 23:51:30.522410 tst iperf3m4.py: using CellId 17616 23:51:30.642717 tst iperf3m4.py: using BVCI 17617 23:51:30.755088 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:30.765863 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:30.776433 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:30.787079 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:30.797846 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:30.807915 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:30.818981 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:30.832404 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:30.849737 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:30.996219 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:31.146250 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:31.286708 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:31.406922 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:51:31.618643 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:31.958241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30381): Launched 23:51:32.246600 run iperf3-srv_10.42.42.10(pid=30382): Launched 23:51:32.374693 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:51:32.579783 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:32.885285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30383): Launched 23:51:33.151107 run iperf3-srv_10.42.42.10(pid=30384): Launched 23:51:33.265735 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:51:33.469908 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:33.775242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30385): Launched 23:51:34.039597 run iperf3-srv_10.42.42.10(pid=30386): Launched 23:51:34.154358 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:51:34.358816 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:34.664723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30387): Launched 23:51:34.930547 run iperf3-srv_10.42.42.10(pid=30388): Launched 23:51:35.045303 tst iperf3m4.py:8: start network... 23:51:35.249867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:51:35.721502 run create_hlr_db(pid=30389): Launched 23:51:35.837948 bus /gobi_6: Setting Powered False 23:51:36.898238 run create_hlr_db(pid=30389): Terminated: ok {rc=0} 23:51:37.341299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30391): Launched 23:51:37.665806 run osmo-hlr_10.42.42.2(pid=30392): Launched 23:51:37.790535 run osmo-stp_10.42.42.5: Starting osmo-stp 23:51:38.349719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30394): Launched 23:51:38.674137 run osmo-stp_10.42.42.5(pid=30395): Launched 23:51:38.798993 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:51:39.359966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30397): Launched 23:51:39.484248 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:51:39.758311 run patchelf(pid=30398): Launched 23:51:39.938455 run osmo-stp_10.42.42.5(pid=30395): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30395)] 23:51:40.076117 run osmo-stp_10.42.42.5(pid=30395): stdout: | (launched: 2022-12-08_23:51:38.615096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:40.215210 run osmo-stp_10.42.42.5(pid=30395): stderr: | [0;m[38;5;43m20221208235138809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235138809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235138809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235138810 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235138810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235138810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235138810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:40.354740 run osmo-stp_10.42.42.5(pid=30395): stdout: | (launched: 2022-12-08_23:51:38.615096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:40.487685 run osmo-stp_10.42.42.5(pid=30395): stderr: | [0;m[38;5;43m20221208235138809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235138809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235138809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235138810 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235138810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235138810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235138810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:40.645128 run patchelf(pid=30398): Terminating (SIGINT) 23:51:40.826948 run patchelf(pid=30398): Terminated: ok {rc=0} 23:51:40.957685 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30395): Process ended prematurely: osmo-stp_10.42.42.5(pid=30395) [trial-2351↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30395)] [trial-2351↪gprs:trx-umtrx↪iperf3m4.py:8] 23:51:40.967865 tst iperf3m4.py:8: Test FAILED (10.8 sec) 23:51:40.996284 run osmo-hlr_10.42.42.2(pid=30392): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30392)] 23:51:41.045366 run osmo-hlr_10.42.42.2(pid=30392): stdout: | (launched: 2022-12-08_23:51:37.607104) 23:51:41.096222 run osmo-hlr_10.42.42.2(pid=30392): stderr: | [0;m[1;31m20221208235137805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235137805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235137805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235137805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235137805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235137805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235137818 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235137826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235137826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235137826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:51:41.147929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30381): Terminating (SIGTERM) 23:51:41.188985 run iperf3-srv_10.42.42.10(pid=30382): Terminating (SIGTERM) 23:51:41.229926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30383): Terminating (SIGTERM) 23:51:41.271180 run iperf3-srv_10.42.42.10(pid=30384): Terminating (SIGTERM) 23:51:41.312477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30385): Terminating (SIGTERM) 23:51:41.353890 run iperf3-srv_10.42.42.10(pid=30386): Terminating (SIGTERM) 23:51:41.394944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30387): Terminating (SIGTERM) 23:51:41.436243 run iperf3-srv_10.42.42.10(pid=30388): Terminating (SIGTERM) 23:51:41.477396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30391): Terminating (SIGTERM) 23:51:41.518578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30394): Terminating (SIGTERM) 23:51:41.559623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30397): Terminating (SIGTERM) 23:51:41.601173 --- ParallelTerminationStrategy: PID 30381 died... 23:51:41.620869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30381): Terminated: ok {rc=0} 23:51:41.666408 --- ParallelTerminationStrategy: PID 30382 died... 23:51:41.685624 run iperf3-srv_10.42.42.10(pid=30382): Terminated {rc=256} 23:51:41.731144 --- ParallelTerminationStrategy: PID 30383 died... 23:51:41.750488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30383): Terminated: ok {rc=0} 23:51:41.796411 --- ParallelTerminationStrategy: PID 30384 died... 23:51:41.815867 run iperf3-srv_10.42.42.10(pid=30384): Terminated {rc=256} 23:51:41.861159 --- ParallelTerminationStrategy: PID 30385 died... 23:51:41.880234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30385): Terminated: ok {rc=0} 23:51:41.925626 --- ParallelTerminationStrategy: PID 30386 died... 23:51:41.944724 run iperf3-srv_10.42.42.10(pid=30386): Terminated {rc=256} 23:51:41.989888 --- ParallelTerminationStrategy: PID 30387 died... 23:51:42.009112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30387): Terminated: ok {rc=0} 23:51:42.054401 --- ParallelTerminationStrategy: PID 30388 died... 23:51:42.073641 run iperf3-srv_10.42.42.10(pid=30388): Terminated {rc=256} 23:51:42.118985 --- ParallelTerminationStrategy: PID 30391 died... 23:51:42.138260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30391): Terminated: ok {rc=0} 23:51:42.183752 --- ParallelTerminationStrategy: PID 30394 died... 23:51:42.203221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30394): Terminated: ok {rc=0} 23:51:42.248465 --- ParallelTerminationStrategy: PID 30397 died... 23:51:42.267786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30397): Terminated: ok {rc=0} 23:51:42.354308 bus /gobi_4: Setting Powered False 23:51:43.453212 bus /gobi_4: Setting Powered False 23:51:44.567994 bus /gobi_1: Setting Powered False 23:51:45.665382 bus /gobi_1: Setting Powered False 23:51:46.779598 bus /gobi_0: Setting Powered False 23:51:47.881670 bus /gobi_0: Setting Powered False 23:51:48.996897 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-umtrx ping.py ---------------------------------------------- 23:51:50.097848 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:50.109639 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 23:51:50.159419 tst ping.py: using LAC 17617 23:51:50.284886 tst ping.py: using RAC 22 23:51:50.409093 tst ping.py: using CellId 17617 23:51:50.533332 tst ping.py: using BVCI 17618 23:51:50.649753 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:50.661049 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:50.672014 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:50.682816 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:50.693593 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:50.705144 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:50.716422 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:50.727348 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:50.844219 tst ping.py:19: start network... 23:51:51.058623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:51:51.549687 run create_hlr_db(pid=30399): Launched 23:51:51.677751 bus /gobi_6: Setting Powered False 23:51:52.740180 run create_hlr_db(pid=30399): Terminated: ok {rc=0} 23:51:53.182722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30401): Launched 23:51:53.501095 run osmo-hlr_10.42.42.2(pid=30402): Launched 23:51:53.621022 run osmo-stp_10.42.42.5: Starting osmo-stp 23:51:54.170145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30404): Launched 23:51:54.487888 run osmo-stp_10.42.42.5(pid=30405): Launched 23:51:54.609477 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:51:55.159774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30407): Launched 23:51:55.282519 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:51:55.552639 run patchelf(pid=30408): Launched 23:51:55.730010 run osmo-stp_10.42.42.5(pid=30405): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30405)] 23:51:55.864749 run osmo-stp_10.42.42.5(pid=30405): stdout: | (launched: 2022-12-08_23:51:54.429735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:56.001254 run osmo-stp_10.42.42.5(pid=30405): stderr: | [0;m[38;5;43m20221208235154621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235154621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235154621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235154622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235154622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235154622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235154622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:56.138039 run osmo-stp_10.42.42.5(pid=30405): stdout: | (launched: 2022-12-08_23:51:54.429735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:56.268471 run osmo-stp_10.42.42.5(pid=30405): stderr: | [0;m[38;5;43m20221208235154621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235154621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235154621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235154622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235154622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235154622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235154622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:56.423261 run patchelf(pid=30408): Terminating (SIGINT) 23:51:56.601121 run patchelf(pid=30408): Terminated: ok {rc=0} 23:51:56.729711 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30405): Process ended prematurely: osmo-stp_10.42.42.5(pid=30405) [trial-2351↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30405)] [trial-2351↪gprs:trx-umtrx↪ping.py:22] 23:51:56.739083 tst ping.py:22: Test FAILED (6.6 sec) 23:51:56.767024 run osmo-hlr_10.42.42.2(pid=30402): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30402)] 23:51:56.816277 run osmo-hlr_10.42.42.2(pid=30402): stdout: | (launched: 2022-12-08_23:51:53.442566) 23:51:56.867276 run osmo-hlr_10.42.42.2(pid=30402): stderr: | [0;m[1;31m20221208235153640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235153640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235153640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235153640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235153640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235153640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235153653 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235153661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235153662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235153662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:51:56.918627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30401): Terminating (SIGTERM) 23:51:56.959795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30404): Terminating (SIGTERM) 23:51:57.001071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30407): Terminating (SIGTERM) 23:51:57.042509 --- ParallelTerminationStrategy: PID 30401 died... 23:51:57.061755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30401): Terminated: ok {rc=0} 23:51:57.106988 --- ParallelTerminationStrategy: PID 30404 died... 23:51:57.126305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30404): Terminated: ok {rc=0} 23:51:57.171637 --- ParallelTerminationStrategy: PID 30407 died... 23:51:57.190913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30407): Terminated: ok {rc=0} 23:51:57.278079 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 23:51:58.365487 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:58.377063 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 23:51:58.427482 tst ping_idle_ping.py: using LAC 17618 23:51:58.553471 tst ping_idle_ping.py: using RAC 23 23:51:58.678418 tst ping_idle_ping.py: using CellId 17618 23:51:58.803855 tst ping_idle_ping.py: using BVCI 17619 23:51:58.919352 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:58.930438 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:58.941463 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:58.952272 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:58.963575 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:58.974319 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:58.985273 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:58.996091 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:59.110877 tst ping_idle_ping.py:24: start network... 23:51:59.314126 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:51:59.780434 run create_hlr_db(pid=30409): Launched 23:51:59.895346 bus /gobi_6: Setting Powered False 23:52:00.954349 run create_hlr_db(pid=30409): Terminated: ok {rc=0} 23:52:01.423876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30411): Launched 23:52:01.773717 run osmo-hlr_10.42.42.2(pid=30412): Launched 23:52:01.913504 run osmo-stp_10.42.42.5: Starting osmo-stp 23:52:02.619317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30414): Launched 23:52:02.939436 run osmo-stp_10.42.42.5(pid=30415): Launched 23:52:03.060878 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:52:03.613284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30417): Launched 23:52:03.736070 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:52:04.005635 run patchelf(pid=30418): Launched 23:52:04.182740 run osmo-stp_10.42.42.5(pid=30415): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30415)] 23:52:04.317663 run osmo-stp_10.42.42.5(pid=30415): stdout: | (launched: 2022-12-08_23:52:02.881688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:04.454754 run osmo-stp_10.42.42.5(pid=30415): stderr: | [0;m[38;5;43m20221208235203071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235203071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235203071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235203072 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235203072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235203072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235203073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:04.591420 run osmo-stp_10.42.42.5(pid=30415): stdout: | (launched: 2022-12-08_23:52:02.881688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:04.722415 run osmo-stp_10.42.42.5(pid=30415): stderr: | [0;m[38;5;43m20221208235203071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235203071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235203071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235203072 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235203072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235203072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235203073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:04.876781 run patchelf(pid=30418): Terminating (SIGINT) 23:52:05.054860 run patchelf(pid=30418): Terminated: ok {rc=0} 23:52:05.183723 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30415): Process ended prematurely: osmo-stp_10.42.42.5(pid=30415) [trial-2351↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30415)] [trial-2351↪gprs:trx-umtrx↪ping_idle_ping.py:27] 23:52:05.193317 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 23:52:05.221144 run osmo-hlr_10.42.42.2(pid=30412): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30412)] 23:52:05.270553 run osmo-hlr_10.42.42.2(pid=30412): stdout: | (launched: 2022-12-08_23:52:01.707282) 23:52:05.322530 run osmo-hlr_10.42.42.2(pid=30412): stderr: | [0;m[1;31m20221208235202103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235202103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235202103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235202103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235202103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235202103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235202119 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235202136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235202136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235202136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:52:05.374367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30411): Terminating (SIGTERM) 23:52:05.416162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30414): Terminating (SIGTERM) 23:52:05.457989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30417): Terminating (SIGTERM) 23:52:05.500135 --- ParallelTerminationStrategy: PID 30411 died... 23:52:05.520345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30411): Terminated: ok {rc=0} 23:52:05.566542 --- ParallelTerminationStrategy: PID 30414 died... 23:52:05.586035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30414): Terminated: ok {rc=0} 23:52:05.631819 --- ParallelTerminationStrategy: PID 30417 died... 23:52:05.651551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30417): Terminated: ok {rc=0} 23:52:05.740247 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 23:52:07.039996 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:52:07.046152 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 23:52:07.079492 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 23:52:07.118943 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 23:52:07.206515 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 23:52:07.239544 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 23:52:07.278648 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 23:52:07.867378 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 23:52:07.917447 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:07.928282 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:52:07.976660 tst cs_paging_gprs_active.py: using LAC 17619 23:52:08.096823 tst cs_paging_gprs_active.py: using RAC 24 23:52:08.225366 tst cs_paging_gprs_active.py: using CellId 17619 23:52:08.354803 tst cs_paging_gprs_active.py: using BVCI 17620 23:52:08.473132 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:08.484373 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:08.495399 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:08.506514 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:08.517451 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:08.528297 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:08.539462 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:08.550352 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:08.561527 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:08.678852 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:08.793449 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:52:08.998881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:09.304070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30422): Launched 23:52:09.570134 run iperf3-srv_10.42.42.10(pid=30423): Launched 23:52:09.685292 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:52:09.890640 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:10.196134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30424): Launched 23:52:10.478621 run iperf3-srv_10.42.42.10(pid=30425): Launched 23:52:10.599890 tst cs_paging_gprs_active.py:38: start network... 23:52:10.820644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:52:11.322900 run create_hlr_db(pid=30426): Launched 23:52:11.454021 bus /gobi_6: Setting Powered False 23:52:12.517219 run create_hlr_db(pid=30426): Terminated: ok {rc=0} 23:52:12.948875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30428): Launched 23:52:13.254291 run osmo-hlr_10.42.42.2(pid=30429): Launched 23:52:13.371772 run osmo-stp_10.42.42.5: Starting osmo-stp 23:52:13.911233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30431): Launched 23:52:14.216858 run osmo-stp_10.42.42.5(pid=30432): Launched 23:52:14.333918 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:52:14.859496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30434): Launched 23:52:14.976198 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:52:15.233483 run patchelf(pid=30435): Launched 23:52:15.403688 run osmo-stp_10.42.42.5(pid=30432): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30432)] 23:52:15.532621 run osmo-stp_10.42.42.5(pid=30432): stdout: | (launched: 2022-12-08_23:52:14.160539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:15.663314 run osmo-stp_10.42.42.5(pid=30432): stderr: | [0;m[38;5;43m20221208235214332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235214332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235214332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235214333 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235214335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235214335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235214335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:15.793919 run osmo-stp_10.42.42.5(pid=30432): stdout: | (launched: 2022-12-08_23:52:14.160539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:15.938360 run osmo-stp_10.42.42.5(pid=30432): stderr: | [0;m[38;5;43m20221208235214332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235214332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235214332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235214333 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235214335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235214335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235214335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:16.089771 run patchelf(pid=30435): Terminating (SIGINT) 23:52:16.264570 run patchelf(pid=30435): Terminated: ok {rc=0} 23:52:16.391636 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30432): Process ended prematurely: osmo-stp_10.42.42.5(pid=30432) [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30432)] [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 23:52:16.402313 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 23:52:16.430412 run osmo-hlr_10.42.42.2(pid=30429): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30429)] 23:52:16.481314 run osmo-hlr_10.42.42.2(pid=30429): stdout: | (launched: 2022-12-08_23:52:13.198553) 23:52:16.532125 run osmo-hlr_10.42.42.2(pid=30429): stderr: | [0;m[1;31m20221208235213375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235213375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235213375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235213375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235213375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235213375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235213390 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235213400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235213400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235213400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:52:16.583848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30422): Terminating (SIGTERM) 23:52:16.625829 run iperf3-srv_10.42.42.10(pid=30423): Terminating (SIGTERM) 23:52:16.670202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30424): Terminating (SIGTERM) 23:52:16.712649 run iperf3-srv_10.42.42.10(pid=30425): Terminating (SIGTERM) 23:52:16.757286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30428): Terminating (SIGTERM) 23:52:16.799766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30431): Terminating (SIGTERM) 23:52:16.842371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30434): Terminating (SIGTERM) 23:52:16.886548 --- ParallelTerminationStrategy: PID 30422 died... 23:52:16.906258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30422): Terminated: ok {rc=0} 23:52:16.953228 --- ParallelTerminationStrategy: PID 30423 died... 23:52:16.972424 run iperf3-srv_10.42.42.10(pid=30423): Terminated {rc=256} 23:52:17.018560 --- ParallelTerminationStrategy: PID 30424 died... 23:52:17.037924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30424): Terminated: ok {rc=0} 23:52:17.084745 --- ParallelTerminationStrategy: PID 30425 died... 23:52:17.104039 run iperf3-srv_10.42.42.10(pid=30425): Terminated {rc=256} 23:52:17.148927 --- ParallelTerminationStrategy: PID 30428 died... 23:52:17.169146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30428): Terminated: ok {rc=0} 23:52:17.215104 --- ParallelTerminationStrategy: PID 30431 died... 23:52:17.233516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30431): Terminated: ok {rc=0} 23:52:17.277309 --- ParallelTerminationStrategy: PID 30434 died... 23:52:17.295493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30434): Terminated: ok {rc=0} 23:52:17.380166 bus /gobi_0: Setting Powered False 23:52:18.476406 bus /gobi_0: Setting Powered False 23:52:19.589765 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 23:52:20.734535 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:20.746010 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:52:20.797942 tst iperf3.py: using LAC 17620 23:52:20.921859 tst iperf3.py: using RAC 25 23:52:21.041971 tst iperf3.py: using CellId 17620 23:52:21.169432 tst iperf3.py: using BVCI 17621 23:52:21.287512 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:21.298878 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:21.309915 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:21.320855 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:21.331826 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:21.342762 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:21.354295 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:21.365220 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:21.376271 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:21.491641 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:52:21.695447 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:21.999989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30436): Launched 23:52:22.264595 run iperf3-srv_10.42.42.10(pid=30437): Launched 23:52:22.379187 tst iperf3.py:8: start network... 23:52:22.582730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:52:23.053160 run create_hlr_db(pid=30438): Launched 23:52:23.171192 bus /gobi_6: Setting Powered False 23:52:24.231322 run create_hlr_db(pid=30438): Terminated: ok {rc=0} 23:52:24.672149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30440): Launched 23:52:24.996522 run osmo-hlr_10.42.42.2(pid=30441): Launched 23:52:25.120208 run osmo-stp_10.42.42.5: Starting osmo-stp 23:52:25.683441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30443): Launched 23:52:26.007075 run osmo-stp_10.42.42.5(pid=30444): Launched 23:52:26.130553 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:52:26.690244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30446): Launched 23:52:26.814348 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:52:27.087261 run patchelf(pid=30447): Launched 23:52:27.267107 run osmo-stp_10.42.42.5(pid=30444): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30444)] 23:52:27.403777 run osmo-stp_10.42.42.5(pid=30444): stdout: | (launched: 2022-12-08_23:52:25.948288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:27.542713 run osmo-stp_10.42.42.5(pid=30444): stderr: | [0;m[38;5;43m20221208235226142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235226142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235226142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235226142 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235226143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235226143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235226143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:27.681353 run osmo-stp_10.42.42.5(pid=30444): stdout: | (launched: 2022-12-08_23:52:25.948288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:27.814062 run osmo-stp_10.42.42.5(pid=30444): stderr: | [0;m[38;5;43m20221208235226142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235226142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235226142 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235226142 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235226143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235226143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235226143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:27.969930 run patchelf(pid=30447): Terminating (SIGINT) 23:52:28.150187 run patchelf(pid=30447): Terminated: ok {rc=0} 23:52:28.280485 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30444): Process ended prematurely: osmo-stp_10.42.42.5(pid=30444) [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30444)] [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 23:52:28.290751 tst iperf3.py:8: Test FAILED (7.6 sec) 23:52:28.318888 run osmo-hlr_10.42.42.2(pid=30441): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30441)] 23:52:28.368116 run osmo-hlr_10.42.42.2(pid=30441): stdout: | (launched: 2022-12-08_23:52:24.937795) 23:52:28.419025 run osmo-hlr_10.42.42.2(pid=30441): stderr: | [0;m[1;31m20221208235225136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235225136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235225136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235225136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235225136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235225136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235225153 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235225163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235225163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235225163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:52:28.470179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30436): Terminating (SIGTERM) 23:52:28.511118 run iperf3-srv_10.42.42.10(pid=30437): Terminating (SIGTERM) 23:52:28.552032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30440): Terminating (SIGTERM) 23:52:28.592759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30443): Terminating (SIGTERM) 23:52:28.633707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30446): Terminating (SIGTERM) 23:52:28.674819 --- ParallelTerminationStrategy: PID 30436 died... 23:52:28.694061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30436): Terminated: ok {rc=0} 23:52:28.739430 --- ParallelTerminationStrategy: PID 30437 died... 23:52:28.758604 run iperf3-srv_10.42.42.10(pid=30437): Terminated {rc=256} 23:52:28.803770 --- ParallelTerminationStrategy: PID 30440 died... 23:52:28.823047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30440): Terminated: ok {rc=0} 23:52:28.868162 --- ParallelTerminationStrategy: PID 30443 died... 23:52:28.887433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30443): Terminated: ok {rc=0} 23:52:28.932484 --- ParallelTerminationStrategy: PID 30446 died... 23:52:28.951701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30446): Terminated: ok {rc=0} 23:52:29.037472 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 23:52:30.186986 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:30.198920 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:52:30.249785 tst iperf3m4.py: using LAC 17621 23:52:30.377676 tst iperf3m4.py: using RAC 26 23:52:30.504713 tst iperf3m4.py: using CellId 17621 23:52:30.631820 tst iperf3m4.py: using BVCI 17622 23:52:30.749927 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:30.761406 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:30.772620 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:30.783770 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:30.794926 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:30.806030 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:30.817335 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:30.828297 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:30.840076 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:30.979460 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:31.098846 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:31.217616 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:31.339822 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:52:31.560818 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:31.883879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30448): Launched 23:52:32.242092 run iperf3-srv_10.42.42.10(pid=30449): Launched 23:52:32.377060 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:52:32.596370 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:32.922668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30450): Launched 23:52:33.204105 run iperf3-srv_10.42.42.10(pid=30451): Launched 23:52:33.326013 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:52:33.545533 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:33.871781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30452): Launched 23:52:34.153744 run iperf3-srv_10.42.42.10(pid=30453): Launched 23:52:34.275300 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:52:34.494472 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:34.820621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30454): Launched 23:52:35.102659 run iperf3-srv_10.42.42.10(pid=30455): Launched 23:52:35.224833 tst iperf3m4.py:8: start network... 23:52:35.444634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:52:35.941609 run create_hlr_db(pid=30458): Launched 23:52:36.059739 bus /gobi_6: Setting Powered False 23:52:37.119982 run create_hlr_db(pid=30458): Terminated: ok {rc=0} 23:52:37.544261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30460): Launched 23:52:37.850380 run osmo-hlr_10.42.42.2(pid=30461): Launched 23:52:37.966414 run osmo-stp_10.42.42.5: Starting osmo-stp 23:52:38.510013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30463): Launched 23:52:38.816020 run osmo-stp_10.42.42.5(pid=30464): Launched 23:52:38.933749 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:52:39.462100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30466): Launched 23:52:39.579445 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:52:39.836484 run patchelf(pid=30467): Launched 23:52:40.006736 run osmo-stp_10.42.42.5(pid=30464): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30464)] 23:52:40.135803 run osmo-stp_10.42.42.5(pid=30464): stdout: | (launched: 2022-12-08_23:52:38.760195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:40.267180 run osmo-stp_10.42.42.5(pid=30464): stderr: | [0;m[38;5;43m20221208235238932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235238932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235238933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235238933 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235238933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235238934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235238934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:40.398460 run osmo-stp_10.42.42.5(pid=30464): stdout: | (launched: 2022-12-08_23:52:38.760195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:40.523530 run osmo-stp_10.42.42.5(pid=30464): stderr: | [0;m[38;5;43m20221208235238932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235238932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235238933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235238933 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235238933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235238934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235238934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:40.671738 run patchelf(pid=30467): Terminating (SIGINT) 23:52:40.842830 run patchelf(pid=30467): Terminated: ok {rc=0} 23:52:40.965976 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30464): Process ended prematurely: osmo-stp_10.42.42.5(pid=30464) [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30464)] [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 23:52:40.975413 tst iperf3m4.py:8: Test FAILED (10.8 sec) 23:52:41.002787 run osmo-hlr_10.42.42.2(pid=30461): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30461)] 23:52:41.051095 run osmo-hlr_10.42.42.2(pid=30461): stdout: | (launched: 2022-12-08_23:52:37.794293) 23:52:41.100178 run osmo-hlr_10.42.42.2(pid=30461): stderr: | [0;m[1;31m20221208235237969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235237969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235237969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235237969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235237969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235237969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235237982 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235237992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235237993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235237993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:52:41.149842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30448): Terminating (SIGTERM) 23:52:41.188655 run iperf3-srv_10.42.42.10(pid=30449): Terminating (SIGTERM) 23:52:41.228384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30450): Terminating (SIGTERM) 23:52:41.268562 run iperf3-srv_10.42.42.10(pid=30451): Terminating (SIGTERM) 23:52:41.308303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30452): Terminating (SIGTERM) 23:52:41.347631 run iperf3-srv_10.42.42.10(pid=30453): Terminating (SIGTERM) 23:52:41.386503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30454): Terminating (SIGTERM) 23:52:41.426442 run iperf3-srv_10.42.42.10(pid=30455): Terminating (SIGTERM) 23:52:41.466621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30460): Terminating (SIGTERM) 23:52:41.509959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30463): Terminating (SIGTERM) 23:52:41.552752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30466): Terminating (SIGTERM) 23:52:41.595391 --- ParallelTerminationStrategy: PID 30448 died... 23:52:41.615383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30448): Terminated: ok {rc=0} 23:52:41.661424 --- ParallelTerminationStrategy: PID 30449 died... 23:52:41.681195 run iperf3-srv_10.42.42.10(pid=30449): Terminated {rc=256} 23:52:41.727038 --- ParallelTerminationStrategy: PID 30450 died... 23:52:41.746516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30450): Terminated: ok {rc=0} 23:52:41.792456 --- ParallelTerminationStrategy: PID 30451 died... 23:52:41.811894 run iperf3-srv_10.42.42.10(pid=30451): Terminated {rc=256} 23:52:41.857317 --- ParallelTerminationStrategy: PID 30452 died... 23:52:41.876631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30452): Terminated: ok {rc=0} 23:52:41.922133 --- ParallelTerminationStrategy: PID 30453 died... 23:52:41.941390 run iperf3-srv_10.42.42.10(pid=30453): Terminated {rc=256} 23:52:41.986835 --- ParallelTerminationStrategy: PID 30454 died... 23:52:42.006390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30454): Terminated: ok {rc=0} 23:52:42.052017 --- ParallelTerminationStrategy: PID 30455 died... 23:52:42.071596 run iperf3-srv_10.42.42.10(pid=30455): Terminated {rc=256} 23:52:42.117060 --- ParallelTerminationStrategy: PID 30460 died... 23:52:42.136641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30460): Terminated: ok {rc=0} 23:52:42.182401 --- ParallelTerminationStrategy: PID 30463 died... 23:52:42.202028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30463): Terminated: ok {rc=0} 23:52:42.248157 --- ParallelTerminationStrategy: PID 30466 died... 23:52:42.267880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30466): Terminated: ok {rc=0} 23:52:42.354530 bus /gobi_4: Setting Powered False 23:52:43.452020 bus /gobi_4: Setting Powered False 23:52:44.566143 bus /gobi_1: Setting Powered False 23:52:45.662954 bus /gobi_1: Setting Powered False 23:52:46.782822 bus /gobi_0: Setting Powered False 23:52:47.894293 bus /gobi_0: Setting Powered False 23:52:49.009315 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 23:52:50.110412 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:50.122275 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:52:50.176341 tst ping.py: using LAC 17622 23:52:50.300538 tst ping.py: using RAC 27 23:52:50.423560 tst ping.py: using CellId 17622 23:52:50.547807 tst ping.py: using BVCI 17623 23:52:50.662712 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:50.674428 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:50.685737 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:50.696919 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:50.708060 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:50.719205 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:50.730622 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:50.742806 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:50.861816 tst ping.py:19: start network... 23:52:51.076442 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:52:51.568194 run create_hlr_db(pid=30468): Launched 23:52:51.697671 bus /gobi_6: Setting Powered False 23:52:52.761185 run create_hlr_db(pid=30468): Terminated: ok {rc=0} 23:52:53.188694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30470): Launched 23:52:53.488714 run osmo-hlr_10.42.42.2(pid=30471): Launched 23:52:53.604220 run osmo-stp_10.42.42.5: Starting osmo-stp 23:52:54.133627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30473): Launched 23:52:54.431250 run osmo-stp_10.42.42.5(pid=30474): Launched 23:52:54.545511 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:52:55.061689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30476): Launched 23:52:55.176400 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:52:55.428400 run patchelf(pid=30477): Launched 23:52:55.595159 run osmo-stp_10.42.42.5(pid=30474): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30474)] 23:52:55.721794 run osmo-stp_10.42.42.5(pid=30474): stdout: | (launched: 2022-12-08_23:52:54.377163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:55.850536 run osmo-stp_10.42.42.5(pid=30474): stderr: | [0;m[38;5;43m20221208235254546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235254546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235254546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235254547 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235254549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235254549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235254549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:55.979063 run osmo-stp_10.42.42.5(pid=30474): stdout: | (launched: 2022-12-08_23:52:54.377163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:56.101154 run osmo-stp_10.42.42.5(pid=30474): stderr: | [0;m[38;5;43m20221208235254546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235254546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235254546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235254547 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235254549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235254549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235254549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:56.246227 run patchelf(pid=30477): Terminating (SIGINT) 23:52:56.413826 run patchelf(pid=30477): Terminated: ok {rc=0} 23:52:56.534637 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30474): Process ended prematurely: osmo-stp_10.42.42.5(pid=30474) [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30474)] [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 23:52:56.543423 tst ping.py:22: Test FAILED (6.4 sec) 23:52:56.569866 run osmo-hlr_10.42.42.2(pid=30471): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30471)] 23:52:56.617466 run osmo-hlr_10.42.42.2(pid=30471): stdout: | (launched: 2022-12-08_23:52:53.433979) 23:52:56.666328 run osmo-hlr_10.42.42.2(pid=30471): stderr: | [0;m[1;31m20221208235253610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235253610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235253610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235253610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235253610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235253610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235253622 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235253630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235253631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235253631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:52:56.715174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30470): Terminating (SIGTERM) 23:52:56.755040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30473): Terminating (SIGTERM) 23:52:56.794472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30476): Terminating (SIGTERM) 23:52:56.834328 --- ParallelTerminationStrategy: PID 30470 died... 23:52:56.853330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30470): Terminated: ok {rc=0} 23:52:56.897353 --- ParallelTerminationStrategy: PID 30473 died... 23:52:56.915899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30473): Terminated: ok {rc=0} 23:52:56.960006 --- ParallelTerminationStrategy: PID 30476 died... 23:52:56.978431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30476): Terminated: ok {rc=0} 23:52:57.061248 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 23:52:58.144476 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:58.155899 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:52:58.206075 tst ping_idle_ping.py: using LAC 17623 23:52:58.323729 tst ping_idle_ping.py: using RAC 28 23:52:58.440608 tst ping_idle_ping.py: using CellId 17623 23:52:58.557929 tst ping_idle_ping.py: using BVCI 17624 23:52:58.666478 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:58.677352 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:58.687944 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:58.698817 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:58.709320 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:58.720295 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:58.731013 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:58.742142 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:58.858615 tst ping_idle_ping.py:24: start network... 23:52:59.075669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:52:59.573789 run create_hlr_db(pid=30478): Launched 23:52:59.704696 bus /gobi_6: Setting Powered False 23:53:00.768924 run create_hlr_db(pid=30478): Terminated: ok {rc=0} 23:53:01.269869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30484): Launched 23:53:01.703107 run osmo-hlr_10.42.42.2(pid=30517): Launched 23:53:01.939314 run osmo-stp_10.42.42.5: Starting osmo-stp 23:53:02.770488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30552): Launched 23:53:03.137068 run osmo-stp_10.42.42.5(pid=30566): Launched 23:53:03.409887 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:53:04.186597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30676): Launched 23:53:04.349886 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:53:04.672021 run patchelf(pid=30745): Launched 23:53:04.922763 run osmo-stp_10.42.42.5(pid=30566): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30566)] 23:53:05.061793 run osmo-stp_10.42.42.5(pid=30566): stdout: | (launched: 2022-12-08_23:53:03.068809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:05.201216 run osmo-stp_10.42.42.5(pid=30566): stderr: | [0;m[38;5;43m20221208235303398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235303399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235303399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235303399 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235303400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235303400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235303400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:05.340825 run osmo-stp_10.42.42.5(pid=30566): stdout: | (launched: 2022-12-08_23:53:03.068809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:05.475413 run osmo-stp_10.42.42.5(pid=30566): stderr: | [0;m[38;5;43m20221208235303398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235303399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235303399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235303399 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235303400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235303400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235303400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:05.636067 run patchelf(pid=30745): Terminating (SIGINT) 23:53:05.820643 run patchelf(pid=30745): Terminated: ok {rc=0} 23:53:05.952638 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30566): Process ended prematurely: osmo-stp_10.42.42.5(pid=30566) [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30566)] [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 23:53:05.963338 tst ping_idle_ping.py:27: Test FAILED (7.8 sec) 23:53:05.992660 run osmo-hlr_10.42.42.2(pid=30517): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30517)] 23:53:06.043812 run osmo-hlr_10.42.42.2(pid=30517): stdout: | (launched: 2022-12-08_23:53:01.628695) 23:53:06.096547 run osmo-hlr_10.42.42.2(pid=30517): stderr: | [0;m[1;31m20221208235302019 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235302019 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235302019 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235302019 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235302019 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235302019 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235302041 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235302055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235302055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235302055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:53:06.149970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30484): Terminating (SIGTERM) 23:53:06.192812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30552): Terminating (SIGTERM) 23:53:06.236732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30676): Terminating (SIGTERM) 23:53:06.282052 --- ParallelTerminationStrategy: PID 30484 died... 23:53:06.302989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30484): Terminated: ok {rc=0} 23:53:06.351645 --- ParallelTerminationStrategy: PID 30552 died... 23:53:06.372300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30552): Terminated: ok {rc=0} 23:53:06.419718 --- ParallelTerminationStrategy: PID 30676 died... 23:53:06.440340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30676): Terminated: ok {rc=0} 23:53:06.530304 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 23:53:07.832311 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:53:07.838976 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 23:53:07.874934 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 23:53:07.916384 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 23:53:08.005230 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 23:53:08.039044 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 23:53:08.078725 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 23:53:08.667615 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 23:53:08.722440 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:08.734120 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:53:08.802781 tst cs_paging_gprs_active.py: using LAC 17624 23:53:08.925296 tst cs_paging_gprs_active.py: using RAC 29 23:53:09.046504 tst cs_paging_gprs_active.py: using CellId 17624 23:53:09.168549 tst cs_paging_gprs_active.py: using BVCI 17625 23:53:09.283544 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:09.295391 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:09.307991 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:09.320733 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:09.333416 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:09.346574 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:09.359393 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:09.373277 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:09.385006 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:09.509656 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:09.629253 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:53:09.846924 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:53:10.173716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30762): Launched 23:53:10.472366 run iperf3-srv_10.42.42.10(pid=30763): Launched 23:53:10.609716 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:53:10.834656 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:53:11.171929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30764): Launched 23:53:11.475932 run iperf3-srv_10.42.42.10(pid=30765): Launched 23:53:11.613396 tst cs_paging_gprs_active.py:38: start network... 23:53:11.838772 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:53:12.357798 run create_hlr_db(pid=30766): Launched 23:53:12.522098 bus /gobi_6: Setting Powered False 23:53:13.588424 run create_hlr_db(pid=30766): Terminated: ok {rc=0} 23:53:14.062192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30768): Launched 23:53:14.416432 run osmo-hlr_10.42.42.2(pid=30769): Launched 23:53:14.668703 run osmo-stp_10.42.42.5: Starting osmo-stp 23:53:15.354075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30771): Launched 23:53:15.709801 run osmo-stp_10.42.42.5(pid=30772): Launched 23:53:15.977839 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:53:16.677747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30774): Launched 23:53:16.868666 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:53:17.153819 run patchelf(pid=30775): Launched 23:53:17.337480 run osmo-stp_10.42.42.5(pid=30772): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30772)] 23:53:17.470522 run osmo-stp_10.42.42.5(pid=30772): stdout: | (launched: 2022-12-08_23:53:15.639887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:17.605424 run osmo-stp_10.42.42.5(pid=30772): stderr: | [0;m[38;5;43m20221208235315958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235315958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235315959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235315959 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235315960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235315960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235315960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:17.741342 run osmo-stp_10.42.42.5(pid=30772): stdout: | (launched: 2022-12-08_23:53:15.639887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:17.870823 run osmo-stp_10.42.42.5(pid=30772): stderr: | [0;m[38;5;43m20221208235315958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235315958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235315959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235315959 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235315960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235315960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235315960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:18.024610 run patchelf(pid=30775): Terminating (SIGINT) 23:53:18.200313 run patchelf(pid=30775): Terminated: ok {rc=0} 23:53:18.328845 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30772): Process ended prematurely: osmo-stp_10.42.42.5(pid=30772) [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30772)] [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 23:53:18.339543 tst cs_paging_gprs_active.py:38: Test FAILED (9.7 sec) 23:53:18.369204 run osmo-hlr_10.42.42.2(pid=30769): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30769)] 23:53:18.420163 run osmo-hlr_10.42.42.2(pid=30769): stdout: | (launched: 2022-12-08_23:53:14.351334) 23:53:18.471744 run osmo-hlr_10.42.42.2(pid=30769): stderr: | [0;m[1;31m20221208235314661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235314661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235314661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235314661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235314661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235314661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235314685 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235314694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235314694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235314694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:53:18.523984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30762): Terminating (SIGTERM) 23:53:18.566714 run iperf3-srv_10.42.42.10(pid=30763): Terminating (SIGTERM) 23:53:18.611567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30764): Terminating (SIGTERM) 23:53:18.653212 run iperf3-srv_10.42.42.10(pid=30765): Terminating (SIGTERM) 23:53:18.700079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30768): Terminating (SIGTERM) 23:53:18.742341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30771): Terminating (SIGTERM) 23:53:18.784842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30774): Terminating (SIGTERM) 23:53:18.829555 --- ParallelTerminationStrategy: PID 30762 died... 23:53:18.849400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30762): Terminated: ok {rc=0} 23:53:18.896304 --- ParallelTerminationStrategy: PID 30763 died... 23:53:18.917128 run iperf3-srv_10.42.42.10(pid=30763): Terminated {rc=256} 23:53:18.965242 --- ParallelTerminationStrategy: PID 30764 died... 23:53:18.984745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30764): Terminated: ok {rc=0} 23:53:19.031870 --- ParallelTerminationStrategy: PID 30765 died... 23:53:19.051414 run iperf3-srv_10.42.42.10(pid=30765): Terminated {rc=256} 23:53:19.098438 --- ParallelTerminationStrategy: PID 30768 died... 23:53:19.118150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30768): Terminated: ok {rc=0} 23:53:19.165631 --- ParallelTerminationStrategy: PID 30771 died... 23:53:19.185275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30771): Terminated: ok {rc=0} 23:53:19.232552 --- ParallelTerminationStrategy: PID 30774 died... 23:53:19.252385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30774): Terminated: ok {rc=0} 23:53:19.341103 bus /gobi_0: Setting Powered False 23:53:20.436831 bus /gobi_0: Setting Powered False 23:53:21.551771 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 23:53:22.706851 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:22.719726 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:53:22.791856 tst iperf3.py: using LAC 17625 23:53:22.922627 tst iperf3.py: using RAC 30 23:53:23.055414 tst iperf3.py: using CellId 17625 23:53:23.185489 tst iperf3.py: using BVCI 17626 23:53:23.309885 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:23.322277 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:23.334651 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:23.347194 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:23.359653 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:23.372256 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:23.384994 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:23.397889 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:23.410397 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:23.534769 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:53:23.764492 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:53:24.108895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30776): Launched 23:53:24.419463 run iperf3-srv_10.42.42.10(pid=30777): Launched 23:53:24.559502 tst iperf3.py:8: start network... 23:53:24.787902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:53:25.322253 run create_hlr_db(pid=30778): Launched 23:53:25.490628 bus /gobi_6: Setting Powered False 23:53:26.554473 run create_hlr_db(pid=30778): Terminated: ok {rc=0} 23:53:27.012883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30781): Launched 23:53:27.336402 run osmo-hlr_10.42.42.2(pid=30782): Launched 23:53:27.459753 run osmo-stp_10.42.42.5: Starting osmo-stp 23:53:28.111305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30784): Launched 23:53:28.427983 run osmo-stp_10.42.42.5(pid=30785): Launched 23:53:28.549338 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:53:29.098050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30787): Launched 23:53:29.219209 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:53:29.487003 run patchelf(pid=30788): Launched 23:53:29.663116 run osmo-stp_10.42.42.5(pid=30785): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30785)] 23:53:29.797738 run osmo-stp_10.42.42.5(pid=30785): stdout: | (launched: 2022-12-08_23:53:28.370596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:29.933920 run osmo-stp_10.42.42.5(pid=30785): stderr: | [0;m[38;5;43m20221208235328561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235328561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235328561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235328562 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235328562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235328562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235328562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:30.070597 run osmo-stp_10.42.42.5(pid=30785): stdout: | (launched: 2022-12-08_23:53:28.370596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:30.200935 run osmo-stp_10.42.42.5(pid=30785): stderr: | [0;m[38;5;43m20221208235328561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235328561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235328561 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235328562 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235328562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235328562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235328562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:30.355033 run patchelf(pid=30788): Terminating (SIGINT) 23:53:30.532426 run patchelf(pid=30788): Terminated: ok {rc=0} 23:53:30.661266 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30785): Process ended prematurely: osmo-stp_10.42.42.5(pid=30785) [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30785)] [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 23:53:30.671690 tst iperf3.py:8: Test FAILED (8.0 sec) 23:53:30.699848 run osmo-hlr_10.42.42.2(pid=30782): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30782)] 23:53:30.749218 run osmo-hlr_10.42.42.2(pid=30782): stdout: | (launched: 2022-12-08_23:53:27.277834) 23:53:30.799997 run osmo-hlr_10.42.42.2(pid=30782): stderr: | [0;m[1;31m20221208235327478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235327478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235327478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235327478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235327478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235327479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235327490 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235327499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235327499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235327499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:53:30.860754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30776): Terminating (SIGTERM) 23:53:30.907163 run iperf3-srv_10.42.42.10(pid=30777): Terminating (SIGTERM) 23:53:30.951616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30781): Terminating (SIGTERM) 23:53:30.993975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30784): Terminating (SIGTERM) 23:53:31.036289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30787): Terminating (SIGTERM) 23:53:31.080530 --- ParallelTerminationStrategy: PID 30776 died... 23:53:31.100608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30776): Terminated: ok {rc=0} 23:53:31.147037 --- ParallelTerminationStrategy: PID 30777 died... 23:53:31.167030 run iperf3-srv_10.42.42.10(pid=30777): Terminated {rc=256} 23:53:31.213307 --- ParallelTerminationStrategy: PID 30781 died... 23:53:31.233117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30781): Terminated: ok {rc=0} 23:53:31.279634 --- ParallelTerminationStrategy: PID 30784 died... 23:53:31.299383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30784): Terminated: ok {rc=0} 23:53:31.345938 --- ParallelTerminationStrategy: PID 30787 died... 23:53:31.365628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30787): Terminated: ok {rc=0} 23:53:31.458489 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 23:53:32.621736 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:32.633428 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:53:32.703206 tst iperf3m4.py: using LAC 17626 23:53:32.834197 tst iperf3m4.py: using RAC 31 23:53:32.958295 tst iperf3m4.py: using CellId 17626 23:53:33.080433 tst iperf3m4.py: using BVCI 17627 23:53:33.195429 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:33.206554 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:33.217530 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:33.228405 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:33.239405 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:33.250430 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:33.261456 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:33.272237 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:33.283392 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:33.397939 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:33.519427 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:33.636518 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:33.751589 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:53:33.952918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:53:34.253858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30789): Launched 23:53:34.514223 run iperf3-srv_10.42.42.10(pid=30790): Launched 23:53:34.627463 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:53:34.828897 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:53:35.129486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30791): Launched 23:53:35.390347 run iperf3-srv_10.42.42.10(pid=30792): Launched 23:53:35.503570 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:53:35.705038 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:53:36.006575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30793): Launched 23:53:36.268250 run iperf3-srv_10.42.42.10(pid=30794): Launched 23:53:36.381402 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:53:36.582753 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:53:36.884058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30795): Launched 23:53:37.145293 run iperf3-srv_10.42.42.10(pid=30796): Launched 23:53:37.258054 tst iperf3m4.py:8: start network... 23:53:37.460036 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:53:37.928900 run create_hlr_db(pid=30797): Launched 23:53:38.046056 bus /gobi_6: Setting Powered False 23:53:39.105384 run create_hlr_db(pid=30797): Terminated: ok {rc=0} 23:53:39.524021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30799): Launched 23:53:39.825580 run osmo-hlr_10.42.42.2(pid=30800): Launched 23:53:39.940491 run osmo-stp_10.42.42.5: Starting osmo-stp 23:53:40.462429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30802): Launched 23:53:40.762195 run osmo-stp_10.42.42.5(pid=30803): Launched 23:53:40.877425 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:53:41.394216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30805): Launched 23:53:41.509467 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:53:41.763362 run patchelf(pid=30806): Launched 23:53:41.931006 run osmo-stp_10.42.42.5(pid=30803): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30803)] 23:53:42.058752 run osmo-stp_10.42.42.5(pid=30803): stdout: | (launched: 2022-12-08_23:53:40.707648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:42.188640 run osmo-stp_10.42.42.5(pid=30803): stderr: | [0;m[38;5;43m20221208235340876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235340877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235340877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235340877 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235340878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235340878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235340878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:42.318454 run osmo-stp_10.42.42.5(pid=30803): stdout: | (launched: 2022-12-08_23:53:40.707648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:42.442441 run osmo-stp_10.42.42.5(pid=30803): stderr: | [0;m[38;5;43m20221208235340876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235340877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235340877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235340877 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235340878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235340878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235340878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:42.588822 run patchelf(pid=30806): Terminating (SIGINT) 23:53:42.757345 run patchelf(pid=30806): Terminated: ok {rc=0} 23:53:42.879126 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30803): Process ended prematurely: osmo-stp_10.42.42.5(pid=30803) [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30803)] [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 23:53:42.888660 tst iperf3m4.py:8: Test FAILED (10.3 sec) 23:53:42.916414 run osmo-hlr_10.42.42.2(pid=30800): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30800)] 23:53:42.964891 run osmo-hlr_10.42.42.2(pid=30800): stdout: | (launched: 2022-12-08_23:53:39.770461) 23:53:43.014585 run osmo-hlr_10.42.42.2(pid=30800): stderr: | [0;m[1;31m20221208235339946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235339946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235339946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235339946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235339946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235339946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235339958 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235339969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235339969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235339969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:53:43.064839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30789): Terminating (SIGTERM) 23:53:43.105066 run iperf3-srv_10.42.42.10(pid=30790): Terminating (SIGTERM) 23:53:43.145164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30791): Terminating (SIGTERM) 23:53:43.184702 run iperf3-srv_10.42.42.10(pid=30792): Terminating (SIGTERM) 23:53:43.225110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30793): Terminating (SIGTERM) 23:53:43.264799 run iperf3-srv_10.42.42.10(pid=30794): Terminating (SIGTERM) 23:53:43.304549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30795): Terminating (SIGTERM) 23:53:43.343642 run iperf3-srv_10.42.42.10(pid=30796): Terminating (SIGTERM) 23:53:43.383243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30799): Terminating (SIGTERM) 23:53:43.423467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30802): Terminating (SIGTERM) 23:53:43.462839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30805): Terminating (SIGTERM) 23:53:43.502510 --- ParallelTerminationStrategy: PID 30789 died... 23:53:43.521761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30789): Terminated: ok {rc=0} 23:53:43.565285 --- ParallelTerminationStrategy: PID 30790 died... 23:53:43.583902 run iperf3-srv_10.42.42.10(pid=30790): Terminated {rc=256} 23:53:43.627649 --- ParallelTerminationStrategy: PID 30791 died... 23:53:43.645856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30791): Terminated: ok {rc=0} 23:53:43.689503 --- ParallelTerminationStrategy: PID 30792 died... 23:53:43.707776 run iperf3-srv_10.42.42.10(pid=30792): Terminated {rc=256} 23:53:43.751483 --- ParallelTerminationStrategy: PID 30793 died... 23:53:43.769812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30793): Terminated: ok {rc=0} 23:53:43.813186 --- ParallelTerminationStrategy: PID 30794 died... 23:53:43.831838 run iperf3-srv_10.42.42.10(pid=30794): Terminated {rc=256} 23:53:43.875438 --- ParallelTerminationStrategy: PID 30795 died... 23:53:43.893810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30795): Terminated: ok {rc=0} 23:53:43.937864 --- ParallelTerminationStrategy: PID 30796 died... 23:53:43.956006 run iperf3-srv_10.42.42.10(pid=30796): Terminated {rc=256} 23:53:43.999746 --- ParallelTerminationStrategy: PID 30799 died... 23:53:44.018033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30799): Terminated: ok {rc=0} 23:53:44.061938 --- ParallelTerminationStrategy: PID 30802 died... 23:53:44.080745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30802): Terminated: ok {rc=0} 23:53:44.124695 --- ParallelTerminationStrategy: PID 30805 died... 23:53:44.143191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30805): Terminated: ok {rc=0} 23:53:44.225542 bus /gobi_4: Setting Powered False 23:53:45.322638 bus /gobi_4: Setting Powered False 23:53:46.446384 bus /gobi_1: Setting Powered False 23:53:47.558424 bus /gobi_1: Setting Powered False 23:53:48.673758 bus /gobi_0: Setting Powered False 23:53:49.771224 bus /gobi_0: Setting Powered False 23:53:50.886762 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 23:53:51.988365 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:52.000318 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:53:52.070715 tst ping.py: using LAC 17627 23:53:52.195734 tst ping.py: using RAC 32 23:53:52.318227 tst ping.py: using CellId 17627 23:53:52.441352 tst ping.py: using BVCI 17628 23:53:52.554622 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:52.565957 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:52.576929 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:52.588308 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:52.599347 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:52.610584 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:52.621752 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:52.632731 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:52.746243 tst ping.py:19: start network... 23:53:52.943362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:53:53.401354 run create_hlr_db(pid=30807): Launched 23:53:53.513422 bus /gobi_6: Setting Powered False 23:53:54.572062 run create_hlr_db(pid=30807): Terminated: ok {rc=0} 23:53:54.983808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30809): Launched 23:53:55.277800 run osmo-hlr_10.42.42.2(pid=30810): Launched 23:53:55.389648 run osmo-stp_10.42.42.5: Starting osmo-stp 23:53:55.909576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30812): Launched 23:53:56.204705 run osmo-stp_10.42.42.5(pid=30813): Launched 23:53:56.316860 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:53:56.826292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30815): Launched 23:53:56.939402 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:53:57.188034 run patchelf(pid=30816): Launched 23:53:57.351944 run osmo-stp_10.42.42.5(pid=30813): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30813)] 23:53:57.477220 run osmo-stp_10.42.42.5(pid=30813): stdout: | (launched: 2022-12-08_23:53:56.150383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:57.604298 run osmo-stp_10.42.42.5(pid=30813): stderr: | [0;m[38;5;43m20221208235356321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235356322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235356322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235356322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235356323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235356323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235356323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:57.731514 run osmo-stp_10.42.42.5(pid=30813): stdout: | (launched: 2022-12-08_23:53:56.150383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:57.852777 run osmo-stp_10.42.42.5(pid=30813): stderr: | [0;m[38;5;43m20221208235356321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235356322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235356322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235356322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235356323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235356323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235356323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:57.996245 run patchelf(pid=30816): Terminating (SIGINT) 23:53:58.161399 run patchelf(pid=30816): Terminated: ok {rc=0} 23:53:58.280881 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30813): Process ended prematurely: osmo-stp_10.42.42.5(pid=30813) [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30813)] [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 23:53:58.289904 tst ping.py:22: Test FAILED (6.3 sec) 23:53:58.316392 run osmo-hlr_10.42.42.2(pid=30810): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30810)] 23:53:58.363556 run osmo-hlr_10.42.42.2(pid=30810): stdout: | (launched: 2022-12-08_23:53:55.224238) 23:53:58.412159 run osmo-hlr_10.42.42.2(pid=30810): stderr: | [0;m[1;31m20221208235355402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235355402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235355402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235355402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235355402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235355402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235355414 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235355423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235355423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235355423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:53:58.461303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30809): Terminating (SIGTERM) 23:53:58.500394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30812): Terminating (SIGTERM) 23:53:58.539544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30815): Terminating (SIGTERM) 23:53:58.578666 --- ParallelTerminationStrategy: PID 30809 died... 23:53:58.597563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30809): Terminated: ok {rc=0} 23:53:58.640728 --- ParallelTerminationStrategy: PID 30812 died... 23:53:58.659079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30812): Terminated: ok {rc=0} 23:53:58.702178 --- ParallelTerminationStrategy: PID 30815 died... 23:53:58.720380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30815): Terminated: ok {rc=0} 23:53:58.804285 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 23:53:59.890694 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:59.902391 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:53:59.974141 tst ping_idle_ping.py: using LAC 17628 23:54:00.090773 tst ping_idle_ping.py: using RAC 33 23:54:00.207487 tst ping_idle_ping.py: using CellId 17628 23:54:00.323608 tst ping_idle_ping.py: using BVCI 17629 23:54:00.430130 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:54:00.441051 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:54:00.451514 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:54:00.462437 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:54:00.472904 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:54:00.483691 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:54:00.494606 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:54:00.505567 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:54:00.618296 tst ping_idle_ping.py:24: start network... 23:54:00.816228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:54:01.300665 run create_hlr_db(pid=30817): Launched 23:54:01.448460 bus /gobi_6: Setting Powered False 23:54:02.511176 run create_hlr_db(pid=30817): Terminated: ok {rc=0} 23:54:02.950867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30819): Launched 23:54:03.264080 run osmo-hlr_10.42.42.2(pid=30820): Launched 23:54:03.384298 run osmo-stp_10.42.42.5: Starting osmo-stp 23:54:03.928364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30822): Launched 23:54:04.244620 run osmo-stp_10.42.42.5(pid=30823): Launched 23:54:04.365201 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:54:04.912743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30825): Launched 23:54:05.033468 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:54:05.299544 run patchelf(pid=30826): Launched 23:54:05.475250 run osmo-stp_10.42.42.5(pid=30823): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30823)] 23:54:05.608931 run osmo-stp_10.42.42.5(pid=30823): stdout: | (launched: 2022-12-08_23:54:04.186890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:05.744257 run osmo-stp_10.42.42.5(pid=30823): stderr: | [0;m[38;5;43m20221208235404378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235404378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235404378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235404378 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235404381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235404381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235404381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:05.880082 run osmo-stp_10.42.42.5(pid=30823): stdout: | (launched: 2022-12-08_23:54:04.186890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:06.009617 run osmo-stp_10.42.42.5(pid=30823): stderr: | [0;m[38;5;43m20221208235404378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235404378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235404378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235404378 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235404381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235404381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235404381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:06.162805 run patchelf(pid=30826): Terminating (SIGINT) 23:54:06.340508 run patchelf(pid=30826): Terminated: ok {rc=0} 23:54:06.468222 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30823): Process ended prematurely: osmo-stp_10.42.42.5(pid=30823) [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30823)] [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 23:54:06.478046 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 23:54:06.506044 run osmo-hlr_10.42.42.2(pid=30820): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30820)] 23:54:06.555206 run osmo-hlr_10.42.42.2(pid=30820): stdout: | (launched: 2022-12-08_23:54:03.207297) 23:54:06.606037 run osmo-hlr_10.42.42.2(pid=30820): stderr: | [0;m[1;31m20221208235403405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235403405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235403405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235403405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235403405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235403405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235403418 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235403426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235403426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235403426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:54:06.657388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30819): Terminating (SIGTERM) 23:54:06.699096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30822): Terminating (SIGTERM) 23:54:06.740280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30825): Terminating (SIGTERM) 23:54:06.782404 --- ParallelTerminationStrategy: PID 30819 died... 23:54:06.802294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30819): Terminated: ok {rc=0} 23:54:06.848035 --- ParallelTerminationStrategy: PID 30822 died... 23:54:06.867542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30822): Terminated: ok {rc=0} 23:54:06.913407 --- ParallelTerminationStrategy: PID 30825 died... 23:54:06.932996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30825): Terminated: ok {rc=0} 23:54:07.019343 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:54:08.324655 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:54:08.331225 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:54:08.364635 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 23:54:08.404133 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 23:54:08.492082 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:54:08.525263 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 23:54:08.566126 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 23:54:09.160563 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 23:54:09.212058 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:09.223440 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:54:09.294012 tst cs_paging_gprs_active.py: using LAC 17629 23:54:09.421888 tst cs_paging_gprs_active.py: using RAC 34 23:54:09.551438 tst cs_paging_gprs_active.py: using CellId 17629 23:54:09.677685 tst cs_paging_gprs_active.py: using BVCI 17630 23:54:09.794628 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:09.805910 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:09.816791 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:09.828004 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:09.839570 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:09.850870 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:09.862451 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:09.873920 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:09.885901 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:10.003986 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:10.124933 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:54:10.343756 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:10.665192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30831): Launched 23:54:10.944873 run iperf3-srv_10.42.42.10(pid=30832): Launched 23:54:11.065613 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:54:11.282432 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:11.604705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30833): Launched 23:54:11.883453 run iperf3-srv_10.42.42.10(pid=30834): Launched 23:54:12.003042 tst cs_paging_gprs_active.py:38: start network... 23:54:12.218371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:54:12.715377 run create_hlr_db(pid=30835): Launched 23:54:12.845737 bus /gobi_6: Setting Powered False 23:54:13.908647 run create_hlr_db(pid=30835): Terminated: ok {rc=0} 23:54:14.338720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30837): Launched 23:54:14.640543 run osmo-hlr_10.42.42.2(pid=30838): Launched 23:54:14.756316 run osmo-stp_10.42.42.5: Starting osmo-stp 23:54:15.278825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30840): Launched 23:54:15.579677 run osmo-stp_10.42.42.5(pid=30841): Launched 23:54:15.706937 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:54:16.288413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30843): Launched 23:54:16.426033 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:54:16.715800 run patchelf(pid=30844): Launched 23:54:16.946761 run osmo-stp_10.42.42.5(pid=30841): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30841)] 23:54:17.093699 run osmo-stp_10.42.42.5(pid=30841): stdout: | (launched: 2022-12-08_23:54:15.525103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:17.235018 run osmo-stp_10.42.42.5(pid=30841): stderr: | [0;m[38;5;43m20221208235415712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235415712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235415712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235415713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235415715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235415715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235415715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:17.368730 run osmo-stp_10.42.42.5(pid=30841): stdout: | (launched: 2022-12-08_23:54:15.525103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:17.492887 run osmo-stp_10.42.42.5(pid=30841): stderr: | [0;m[38;5;43m20221208235415712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235415712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235415712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235415713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235415715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235415715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235415715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:17.640146 run patchelf(pid=30844): Terminating (SIGINT) 23:54:17.809981 run patchelf(pid=30844): Terminated: ok {rc=0} 23:54:17.932567 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30841): Process ended prematurely: osmo-stp_10.42.42.5(pid=30841) [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30841)] [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 23:54:17.942382 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 23:54:17.969468 run osmo-hlr_10.42.42.2(pid=30838): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30838)] 23:54:18.017360 run osmo-hlr_10.42.42.2(pid=30838): stdout: | (launched: 2022-12-08_23:54:14.585599) 23:54:18.066478 run osmo-hlr_10.42.42.2(pid=30838): stderr: | [0;m[1;31m20221208235414764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235414764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235414764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235414764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235414764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235414764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235414776 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235414784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235414785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235414785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:54:18.116032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30831): Terminating (SIGTERM) 23:54:18.155519 run iperf3-srv_10.42.42.10(pid=30832): Terminating (SIGTERM) 23:54:18.194442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30833): Terminating (SIGTERM) 23:54:18.233897 run iperf3-srv_10.42.42.10(pid=30834): Terminating (SIGTERM) 23:54:18.273564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30837): Terminating (SIGTERM) 23:54:18.313420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30840): Terminating (SIGTERM) 23:54:18.353600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30843): Terminating (SIGTERM) 23:54:18.393306 --- ParallelTerminationStrategy: PID 30831 died... 23:54:18.412122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30831): Terminated: ok {rc=0} 23:54:18.456270 --- ParallelTerminationStrategy: PID 30832 died... 23:54:18.474774 run iperf3-srv_10.42.42.10(pid=30832): Terminated {rc=256} 23:54:18.518559 --- ParallelTerminationStrategy: PID 30833 died... 23:54:18.537039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30833): Terminated: ok {rc=0} 23:54:18.580754 --- ParallelTerminationStrategy: PID 30834 died... 23:54:18.599447 run iperf3-srv_10.42.42.10(pid=30834): Terminated {rc=256} 23:54:18.643112 --- ParallelTerminationStrategy: PID 30837 died... 23:54:18.661618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30837): Terminated: ok {rc=0} 23:54:18.705428 --- ParallelTerminationStrategy: PID 30840 died... 23:54:18.724639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30840): Terminated: ok {rc=0} 23:54:18.768692 --- ParallelTerminationStrategy: PID 30843 died... 23:54:18.787273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30843): Terminated: ok {rc=0} 23:54:18.873401 bus /gobi_0: Setting Powered False 23:54:19.972155 bus /gobi_0: Setting Powered False 23:54:21.086519 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 23:54:22.231516 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:22.242910 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:54:22.312133 tst iperf3.py: using LAC 17630 23:54:22.430697 tst iperf3.py: using RAC 35 23:54:22.550263 tst iperf3.py: using CellId 17630 23:54:22.675143 tst iperf3.py: using BVCI 17631 23:54:22.785476 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:22.796149 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:22.806762 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:22.817343 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:22.828102 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:22.839272 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:22.849924 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:22.860746 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:22.871659 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:22.985905 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:54:23.187134 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:23.487630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30845): Launched 23:54:23.748868 run iperf3-srv_10.42.42.10(pid=30846): Launched 23:54:23.861978 tst iperf3.py:8: start network... 23:54:24.062826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:54:24.527353 run create_hlr_db(pid=30847): Launched 23:54:24.641600 bus /gobi_6: Setting Powered False 23:54:25.701125 run create_hlr_db(pid=30847): Terminated: ok {rc=0} 23:54:26.137425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30849): Launched 23:54:26.456514 run osmo-hlr_10.42.42.2(pid=30850): Launched 23:54:26.578924 run osmo-stp_10.42.42.5: Starting osmo-stp 23:54:27.129100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30852): Launched 23:54:27.448307 run osmo-stp_10.42.42.5(pid=30853): Launched 23:54:27.571160 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:54:28.123036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30855): Launched 23:54:28.245633 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:54:28.515979 run patchelf(pid=30856): Launched 23:54:28.693952 run osmo-stp_10.42.42.5(pid=30853): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30853)] 23:54:28.830332 run osmo-stp_10.42.42.5(pid=30853): stdout: | (launched: 2022-12-08_23:54:27.390165) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:28.967648 run osmo-stp_10.42.42.5(pid=30853): stderr: | [0;m[38;5;43m20221208235427581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235427581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235427581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235427582 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235427582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235427582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235427582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:29.106011 run osmo-stp_10.42.42.5(pid=30853): stdout: | (launched: 2022-12-08_23:54:27.390165) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:29.237408 run osmo-stp_10.42.42.5(pid=30853): stderr: | [0;m[38;5;43m20221208235427581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235427581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235427581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235427582 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235427582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235427582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235427582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:29.393116 run patchelf(pid=30856): Terminating (SIGINT) 23:54:29.572577 run patchelf(pid=30856): Terminated: ok {rc=0} 23:54:29.702411 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30853): Process ended prematurely: osmo-stp_10.42.42.5(pid=30853) [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30853)] [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 23:54:29.712713 tst iperf3.py:8: Test FAILED (7.5 sec) 23:54:29.741387 run osmo-hlr_10.42.42.2(pid=30850): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30850)] 23:54:29.791662 run osmo-hlr_10.42.42.2(pid=30850): stdout: | (launched: 2022-12-08_23:54:26.398420) 23:54:29.843645 run osmo-hlr_10.42.42.2(pid=30850): stderr: | [0;m[1;31m20221208235426598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235426598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235426598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235426598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235426598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235426599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235426611 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235426621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235426622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235426622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:54:29.895381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30845): Terminating (SIGTERM) 23:54:29.937097 run iperf3-srv_10.42.42.10(pid=30846): Terminating (SIGTERM) 23:54:29.979233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30849): Terminating (SIGTERM) 23:54:30.021593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30852): Terminating (SIGTERM) 23:54:30.063988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30855): Terminating (SIGTERM) 23:54:30.106370 --- ParallelTerminationStrategy: PID 30845 died... 23:54:30.126115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30845): Terminated: ok {rc=0} 23:54:30.171762 --- ParallelTerminationStrategy: PID 30846 died... 23:54:30.190976 run iperf3-srv_10.42.42.10(pid=30846): Terminated {rc=256} 23:54:30.236401 --- ParallelTerminationStrategy: PID 30849 died... 23:54:30.256072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30849): Terminated: ok {rc=0} 23:54:30.301650 --- ParallelTerminationStrategy: PID 30852 died... 23:54:30.321159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30852): Terminated: ok {rc=0} 23:54:30.366751 --- ParallelTerminationStrategy: PID 30855 died... 23:54:30.386078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30855): Terminated: ok {rc=0} 23:54:30.473572 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 23:54:31.643718 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:31.659272 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:54:31.739887 tst iperf3m4.py: using LAC 17631 23:54:31.897919 tst iperf3m4.py: using RAC 36 23:54:32.022169 tst iperf3m4.py: using CellId 17631 23:54:32.190549 tst iperf3m4.py: using BVCI 17632 23:54:32.308476 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:32.320764 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:32.331910 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:32.343900 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:32.354489 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:32.365156 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:32.375762 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:32.386268 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:32.397046 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:32.519595 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:32.640865 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:32.759764 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:32.878474 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:54:33.094609 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:33.416291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30857): Launched 23:54:33.694713 run iperf3-srv_10.42.42.10(pid=30858): Launched 23:54:33.815010 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:54:34.030898 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:34.351711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30859): Launched 23:54:34.630301 run iperf3-srv_10.42.42.10(pid=30860): Launched 23:54:34.750243 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:54:34.966292 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:35.286934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30861): Launched 23:54:35.565590 run iperf3-srv_10.42.42.10(pid=30862): Launched 23:54:35.684844 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:54:35.900475 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:36.220509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30863): Launched 23:54:36.497978 run iperf3-srv_10.42.42.10(pid=30864): Launched 23:54:36.618095 tst iperf3m4.py:8: start network... 23:54:36.833510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:54:37.329181 run create_hlr_db(pid=30865): Launched 23:54:37.458658 bus /gobi_6: Setting Powered False 23:54:38.521868 run create_hlr_db(pid=30865): Terminated: ok {rc=0} 23:54:38.951085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30867): Launched 23:54:39.253229 run osmo-hlr_10.42.42.2(pid=30868): Launched 23:54:39.371065 run osmo-stp_10.42.42.5: Starting osmo-stp 23:54:39.890360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30870): Launched 23:54:40.191613 run osmo-stp_10.42.42.5(pid=30871): Launched 23:54:40.306356 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:54:40.827124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30873): Launched 23:54:40.943205 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:54:41.198613 run patchelf(pid=30874): Launched 23:54:41.366443 run osmo-stp_10.42.42.5(pid=30871): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30871)] 23:54:41.494371 run osmo-stp_10.42.42.5(pid=30871): stdout: | (launched: 2022-12-08_23:54:40.136645) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:41.624328 run osmo-stp_10.42.42.5(pid=30871): stderr: | [0;m[38;5;43m20221208235440307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235440307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235440307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235440308 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235440310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235440310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235440310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:41.754094 run osmo-stp_10.42.42.5(pid=30871): stdout: | (launched: 2022-12-08_23:54:40.136645) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:41.877690 run osmo-stp_10.42.42.5(pid=30871): stderr: | [0;m[38;5;43m20221208235440307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235440307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235440307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235440308 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235440310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235440310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235440310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:42.023546 run patchelf(pid=30874): Terminating (SIGINT) 23:54:42.192495 run patchelf(pid=30874): Terminated: ok {rc=0} 23:54:42.314610 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30871): Process ended prematurely: osmo-stp_10.42.42.5(pid=30871) [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30871)] [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 23:54:42.324126 tst iperf3m4.py:8: Test FAILED (10.7 sec) 23:54:42.351331 run osmo-hlr_10.42.42.2(pid=30868): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30868)] 23:54:42.399505 run osmo-hlr_10.42.42.2(pid=30868): stdout: | (launched: 2022-12-08_23:54:39.197918) 23:54:42.449117 run osmo-hlr_10.42.42.2(pid=30868): stderr: | [0;m[1;31m20221208235439377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235439377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235439377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235439378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235439378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235439378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235439390 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235439399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235439399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235439400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:54:42.498758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30857): Terminating (SIGTERM) 23:54:42.538543 run iperf3-srv_10.42.42.10(pid=30858): Terminating (SIGTERM) 23:54:42.578052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30859): Terminating (SIGTERM) 23:54:42.617670 run iperf3-srv_10.42.42.10(pid=30860): Terminating (SIGTERM) 23:54:42.658507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30861): Terminating (SIGTERM) 23:54:42.698667 run iperf3-srv_10.42.42.10(pid=30862): Terminating (SIGTERM) 23:54:42.738108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30863): Terminating (SIGTERM) 23:54:42.777125 run iperf3-srv_10.42.42.10(pid=30864): Terminating (SIGTERM) 23:54:42.816034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30867): Terminating (SIGTERM) 23:54:42.855560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30870): Terminating (SIGTERM) 23:54:42.894739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30873): Terminating (SIGTERM) 23:54:42.934111 --- ParallelTerminationStrategy: PID 30857 died... 23:54:42.953078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30857): Terminated: ok {rc=0} 23:54:42.996650 --- ParallelTerminationStrategy: PID 30858 died... 23:54:43.014886 run iperf3-srv_10.42.42.10(pid=30858): Terminated {rc=256} 23:54:43.057975 --- ParallelTerminationStrategy: PID 30859 died... 23:54:43.076469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30859): Terminated: ok {rc=0} 23:54:43.120009 --- ParallelTerminationStrategy: PID 30860 died... 23:54:43.138134 run iperf3-srv_10.42.42.10(pid=30860): Terminated {rc=256} 23:54:43.181200 --- ParallelTerminationStrategy: PID 30861 died... 23:54:43.199651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30861): Terminated: ok {rc=0} 23:54:43.243171 --- ParallelTerminationStrategy: PID 30862 died... 23:54:43.261396 run iperf3-srv_10.42.42.10(pid=30862): Terminated {rc=256} 23:54:43.304538 --- ParallelTerminationStrategy: PID 30863 died... 23:54:43.323088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30863): Terminated: ok {rc=0} 23:54:43.366496 --- ParallelTerminationStrategy: PID 30864 died... 23:54:43.384595 run iperf3-srv_10.42.42.10(pid=30864): Terminated {rc=256} 23:54:43.427984 --- ParallelTerminationStrategy: PID 30867 died... 23:54:43.446297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30867): Terminated: ok {rc=0} 23:54:43.489615 --- ParallelTerminationStrategy: PID 30870 died... 23:54:43.507860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30870): Terminated: ok {rc=0} 23:54:43.551316 --- ParallelTerminationStrategy: PID 30873 died... 23:54:43.569563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30873): Terminated: ok {rc=0} 23:54:43.651654 bus /gobi_4: Setting Powered False 23:54:44.746323 bus /gobi_4: Setting Powered False 23:54:45.864392 bus /gobi_1: Setting Powered False 23:54:46.976786 bus /gobi_1: Setting Powered False 23:54:48.089839 bus /gobi_0: Setting Powered False 23:54:49.188747 bus /gobi_0: Setting Powered False 23:54:50.306420 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 23:54:51.407747 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:51.419057 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:54:51.487931 tst ping.py: using LAC 17632 23:54:51.603590 tst ping.py: using RAC 37 23:54:51.723870 tst ping.py: using CellId 17632 23:54:51.838428 tst ping.py: using BVCI 17633 23:54:51.946675 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:51.957501 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:51.968069 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:51.978883 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:51.989457 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:52.000499 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:52.011164 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:52.022292 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:52.134266 tst ping.py:19: start network... 23:54:52.330916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:54:52.789860 run create_hlr_db(pid=30875): Launched 23:54:52.902826 bus /gobi_6: Setting Powered False 23:54:53.961665 run create_hlr_db(pid=30875): Terminated: ok {rc=0} 23:54:54.394743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30877): Launched 23:54:54.710674 run osmo-hlr_10.42.42.2(pid=30878): Launched 23:54:54.830261 run osmo-stp_10.42.42.5: Starting osmo-stp 23:54:55.370777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30880): Launched 23:54:55.683802 run osmo-stp_10.42.42.5(pid=30881): Launched 23:54:55.803381 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:54:56.345425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30883): Launched 23:54:56.465447 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:54:56.729762 run patchelf(pid=30884): Launched 23:54:56.904377 run osmo-stp_10.42.42.5(pid=30881): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30881)] 23:54:57.037933 run osmo-stp_10.42.42.5(pid=30881): stdout: | (launched: 2022-12-08_23:54:55.627022) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:57.173167 run osmo-stp_10.42.42.5(pid=30881): stderr: | [0;m[38;5;43m20221208235455821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235455821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235455821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235455822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235455822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235455822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235455822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:57.308442 run osmo-stp_10.42.42.5(pid=30881): stdout: | (launched: 2022-12-08_23:54:55.627022) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:57.437468 run osmo-stp_10.42.42.5(pid=30881): stderr: | [0;m[38;5;43m20221208235455821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235455821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235455821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235455822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235455822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235455822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235455822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:57.590015 run patchelf(pid=30884): Terminating (SIGINT) 23:54:57.766262 run patchelf(pid=30884): Terminated: ok {rc=0} 23:54:57.893769 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30881): Process ended prematurely: osmo-stp_10.42.42.5(pid=30881) [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30881)] [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 23:54:57.903451 tst ping.py:22: Test FAILED (6.5 sec) 23:54:57.931320 run osmo-hlr_10.42.42.2(pid=30878): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30878)] 23:54:57.980612 run osmo-hlr_10.42.42.2(pid=30878): stdout: | (launched: 2022-12-08_23:54:54.652595) 23:54:58.031693 run osmo-hlr_10.42.42.2(pid=30878): stderr: | [0;m[1;31m20221208235454851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235454851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235454851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235454851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235454851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235454851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235454864 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235454872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235454872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235454872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:54:58.083153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30877): Terminating (SIGTERM) 23:54:58.124467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30880): Terminating (SIGTERM) 23:54:58.165957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30883): Terminating (SIGTERM) 23:54:58.207501 --- ParallelTerminationStrategy: PID 30877 died... 23:54:58.227007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30877): Terminated: ok {rc=0} 23:54:58.272594 --- ParallelTerminationStrategy: PID 30880 died... 23:54:58.292075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30880): Terminated: ok {rc=0} 23:54:58.337814 --- ParallelTerminationStrategy: PID 30883 died... 23:54:58.357179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30883): Terminated: ok {rc=0} 23:54:58.445597 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 23:54:59.532409 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:59.544300 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:54:59.617225 tst ping_idle_ping.py: using LAC 17633 23:54:59.742617 tst ping_idle_ping.py: using RAC 38 23:54:59.868942 tst ping_idle_ping.py: using CellId 17633 23:54:59.992042 tst ping_idle_ping.py: using BVCI 17634 23:55:00.106214 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:55:00.117757 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:55:00.129109 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:55:00.140194 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:55:00.151265 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:55:00.162461 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:55:00.173689 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:55:00.184778 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:55:00.298393 tst ping_idle_ping.py:24: start network... 23:55:00.495898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:55:00.982899 run create_hlr_db(pid=30885): Launched 23:55:01.114854 bus /gobi_6: Setting Powered False 23:55:02.174783 run create_hlr_db(pid=30885): Terminated: ok {rc=0} 23:55:02.593502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30890): Launched 23:55:02.891860 run osmo-hlr_10.42.42.2(pid=30891): Launched 23:55:03.005820 run osmo-stp_10.42.42.5: Starting osmo-stp 23:55:03.531525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30893): Launched 23:55:03.829844 run osmo-stp_10.42.42.5(pid=30894): Launched 23:55:03.942429 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:55:04.454698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30896): Launched 23:55:04.569118 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:55:04.819164 run patchelf(pid=30897): Launched 23:55:04.994109 run osmo-stp_10.42.42.5(pid=30894): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30894)] 23:55:05.128529 run osmo-stp_10.42.42.5(pid=30894): stdout: | (launched: 2022-12-08_23:55:03.775465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:05.265035 run osmo-stp_10.42.42.5(pid=30894): stderr: | [0;m[38;5;43m20221208235503945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235503945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235503946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235503946 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235503946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235503946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235503947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:05.401466 run osmo-stp_10.42.42.5(pid=30894): stdout: | (launched: 2022-12-08_23:55:03.775465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:05.531051 run osmo-stp_10.42.42.5(pid=30894): stderr: | [0;m[38;5;43m20221208235503945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235503945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235503946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235503946 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235503946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235503946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235503947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:05.684699 run patchelf(pid=30897): Terminating (SIGINT) 23:55:05.862334 run patchelf(pid=30897): Terminated: ok {rc=0} 23:55:05.989974 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30894): Process ended prematurely: osmo-stp_10.42.42.5(pid=30894) [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30894)] [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 23:55:05.999453 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:55:06.027509 run osmo-hlr_10.42.42.2(pid=30891): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30891)] 23:55:06.076772 run osmo-hlr_10.42.42.2(pid=30891): stdout: | (launched: 2022-12-08_23:55:02.837617) 23:55:06.127960 run osmo-hlr_10.42.42.2(pid=30891): stderr: | [0;m[1;31m20221208235503013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235503013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235503013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235503013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235503013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235503013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235503024 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235503033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235503033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235503033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:55:06.179609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30890): Terminating (SIGTERM) 23:55:06.220870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30893): Terminating (SIGTERM) 23:55:06.262252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30896): Terminating (SIGTERM) 23:55:06.303815 --- ParallelTerminationStrategy: PID 30890 died... 23:55:06.323702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30890): Terminated: ok {rc=0} 23:55:06.369673 --- ParallelTerminationStrategy: PID 30893 died... 23:55:06.389264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30893): Terminated: ok {rc=0} 23:55:06.435241 --- ParallelTerminationStrategy: PID 30896 died... 23:55:06.454717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30896): Terminated: ok {rc=0} 23:55:06.541967 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 23:55:07.840301 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:55:07.847093 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 23:55:07.880839 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 23:55:07.918491 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 23:55:08.004553 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 23:55:08.036316 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 23:55:08.075199 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 23:55:08.677328 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 23:55:08.726722 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:08.737915 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:55:08.790738 tst cs_paging_gprs_active.py: using LAC 17634 23:55:08.911907 tst cs_paging_gprs_active.py: using RAC 39 23:55:09.039510 tst cs_paging_gprs_active.py: using CellId 17634 23:55:09.165512 tst cs_paging_gprs_active.py: using BVCI 17635 23:55:09.276803 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:09.287997 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:09.298949 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:09.310614 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:09.322319 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:09.334188 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:09.345212 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:09.355887 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:09.368005 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:09.485500 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:09.599729 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:55:09.803363 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:55:10.105635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30903): Launched 23:55:10.368810 run iperf3-srv_10.42.42.10(pid=30904): Launched 23:55:10.482507 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:55:10.685612 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:55:10.989273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30905): Launched 23:55:11.252762 run iperf3-srv_10.42.42.10(pid=30906): Launched 23:55:11.365915 tst cs_paging_gprs_active.py:38: start network... 23:55:11.568093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:55:12.035091 run create_hlr_db(pid=30907): Launched 23:55:12.150257 bus /gobi_6: Setting Powered False 23:55:13.210032 run create_hlr_db(pid=30907): Terminated: ok {rc=0} 23:55:13.648872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30909): Launched 23:55:13.971891 run osmo-hlr_10.42.42.2(pid=30910): Launched 23:55:14.094717 run osmo-stp_10.42.42.5: Starting osmo-stp 23:55:14.647471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30912): Launched 23:55:14.969455 run osmo-stp_10.42.42.5(pid=30913): Launched 23:55:15.092778 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:55:15.649481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30915): Launched 23:55:15.771652 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:55:16.059835 run patchelf(pid=30916): Launched 23:55:16.266247 run osmo-stp_10.42.42.5(pid=30913): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30913)] 23:55:16.404365 run osmo-stp_10.42.42.5(pid=30913): stdout: | (launched: 2022-12-08_23:55:14.911189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:16.544061 run osmo-stp_10.42.42.5(pid=30913): stderr: | [0;m[38;5;43m20221208235515104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235515104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235515104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235515106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235515106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235515106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235515106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:16.683582 run osmo-stp_10.42.42.5(pid=30913): stdout: | (launched: 2022-12-08_23:55:14.911189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:16.818318 run osmo-stp_10.42.42.5(pid=30913): stderr: | [0;m[38;5;43m20221208235515104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235515104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235515104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235515106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235515106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235515106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235515106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:16.976448 run patchelf(pid=30916): Terminating (SIGINT) 23:55:17.158591 run patchelf(pid=30916): Terminated: ok {rc=0} 23:55:17.289729 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30913): Process ended prematurely: osmo-stp_10.42.42.5(pid=30913) [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30913)] [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 23:55:17.300337 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 23:55:17.329288 run osmo-hlr_10.42.42.2(pid=30910): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30910)] 23:55:17.379453 run osmo-hlr_10.42.42.2(pid=30910): stdout: | (launched: 2022-12-08_23:55:13.913666) 23:55:17.430740 run osmo-hlr_10.42.42.2(pid=30910): stderr: | [0;m[1;31m20221208235514112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235514112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235514112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235514112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235514112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235514112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235514124 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235514134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235514134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235514134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:55:17.482555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30903): Terminating (SIGTERM) 23:55:17.523729 run iperf3-srv_10.42.42.10(pid=30904): Terminating (SIGTERM) 23:55:17.564816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30905): Terminating (SIGTERM) 23:55:17.606176 run iperf3-srv_10.42.42.10(pid=30906): Terminating (SIGTERM) 23:55:17.647308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30909): Terminating (SIGTERM) 23:55:17.688523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30912): Terminating (SIGTERM) 23:55:17.730364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30915): Terminating (SIGTERM) 23:55:17.771773 --- ParallelTerminationStrategy: PID 30903 died... 23:55:17.791382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30903): Terminated: ok {rc=0} 23:55:17.837708 --- ParallelTerminationStrategy: PID 30904 died... 23:55:17.857109 run iperf3-srv_10.42.42.10(pid=30904): Terminated {rc=256} 23:55:17.902491 --- ParallelTerminationStrategy: PID 30905 died... 23:55:17.921890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30905): Terminated: ok {rc=0} 23:55:17.967274 --- ParallelTerminationStrategy: PID 30906 died... 23:55:17.986532 run iperf3-srv_10.42.42.10(pid=30906): Terminated {rc=256} 23:55:18.031802 --- ParallelTerminationStrategy: PID 30909 died... 23:55:18.051139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30909): Terminated: ok {rc=0} 23:55:18.096525 --- ParallelTerminationStrategy: PID 30912 died... 23:55:18.115944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30912): Terminated: ok {rc=0} 23:55:18.161670 --- ParallelTerminationStrategy: PID 30915 died... 23:55:18.181392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30915): Terminated: ok {rc=0} 23:55:18.268093 bus /gobi_0: Setting Powered False 23:55:19.366883 bus /gobi_0: Setting Powered False 23:55:20.481160 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 23:55:21.621225 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:21.632821 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:55:21.686597 tst iperf3.py: using LAC 17635 23:55:21.806659 tst iperf3.py: using RAC 40 23:55:21.926619 tst iperf3.py: using CellId 17635 23:55:22.049455 tst iperf3.py: using BVCI 17636 23:55:22.159869 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:22.171007 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:22.181989 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:22.192845 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:22.204134 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:22.214995 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:22.226289 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:22.237574 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:22.248704 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:22.367692 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:55:22.585384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:55:22.907469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30917): Launched 23:55:23.186660 run iperf3-srv_10.42.42.10(pid=30918): Launched 23:55:23.306765 tst iperf3.py:8: start network... 23:55:23.523183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:55:24.020219 run create_hlr_db(pid=30919): Launched 23:55:24.150830 bus /gobi_6: Setting Powered False 23:55:25.214084 run create_hlr_db(pid=30919): Terminated: ok {rc=0} 23:55:25.659773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30921): Launched 23:55:25.981046 run osmo-hlr_10.42.42.2(pid=30922): Launched 23:55:26.103681 run osmo-stp_10.42.42.5: Starting osmo-stp 23:55:26.656387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30924): Launched 23:55:26.978503 run osmo-stp_10.42.42.5(pid=30925): Launched 23:55:27.101090 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:55:27.654698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30927): Launched 23:55:27.777618 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:55:28.048526 run patchelf(pid=30928): Launched 23:55:28.226838 run osmo-stp_10.42.42.5(pid=30925): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30925)] 23:55:28.363011 run osmo-stp_10.42.42.5(pid=30925): stdout: | (launched: 2022-12-08_23:55:26.920193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:28.501174 run osmo-stp_10.42.42.5(pid=30925): stderr: | [0;m[38;5;43m20221208235527114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235527114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235527114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235527115 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235527115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235527115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235527115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:28.639000 run osmo-stp_10.42.42.5(pid=30925): stdout: | (launched: 2022-12-08_23:55:26.920193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:28.770486 run osmo-stp_10.42.42.5(pid=30925): stderr: | [0;m[38;5;43m20221208235527114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235527114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235527114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235527115 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235527115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235527115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235527115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:28.927303 run patchelf(pid=30928): Terminating (SIGINT) 23:55:29.107388 run patchelf(pid=30928): Terminated: ok {rc=0} 23:55:29.237208 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30925): Process ended prematurely: osmo-stp_10.42.42.5(pid=30925) [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30925)] [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 23:55:29.247479 tst iperf3.py:8: Test FAILED (7.7 sec) 23:55:29.275789 run osmo-hlr_10.42.42.2(pid=30922): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30922)] 23:55:29.325168 run osmo-hlr_10.42.42.2(pid=30922): stdout: | (launched: 2022-12-08_23:55:25.922982) 23:55:29.376536 run osmo-hlr_10.42.42.2(pid=30922): stderr: | [0;m[1;31m20221208235526121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235526121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235526121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235526121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235526121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235526121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235526134 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235526142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235526142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235526143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:55:29.428351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30917): Terminating (SIGTERM) 23:55:29.469947 run iperf3-srv_10.42.42.10(pid=30918): Terminating (SIGTERM) 23:55:29.511206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30921): Terminating (SIGTERM) 23:55:29.552785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30924): Terminating (SIGTERM) 23:55:29.594401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30927): Terminating (SIGTERM) 23:55:29.636002 --- ParallelTerminationStrategy: PID 30917 died... 23:55:29.655473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30917): Terminated: ok {rc=0} 23:55:29.701084 --- ParallelTerminationStrategy: PID 30918 died... 23:55:29.720253 run iperf3-srv_10.42.42.10(pid=30918): Terminated {rc=256} 23:55:29.765588 --- ParallelTerminationStrategy: PID 30921 died... 23:55:29.784820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30921): Terminated: ok {rc=0} 23:55:29.830310 --- ParallelTerminationStrategy: PID 30924 died... 23:55:29.849539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30924): Terminated: ok {rc=0} 23:55:29.894960 --- ParallelTerminationStrategy: PID 30927 died... 23:55:29.914324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30927): Terminated: ok {rc=0} 23:55:29.999670 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 23:55:31.184908 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:31.206500 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:55:31.270176 tst iperf3m4.py: using LAC 17636 23:55:31.397543 tst iperf3m4.py: using RAC 41 23:55:31.521177 tst iperf3m4.py: using CellId 17636 23:55:31.680902 tst iperf3m4.py: using BVCI 17637 23:55:31.836379 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:31.850360 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:31.863428 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:31.876643 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:31.891280 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:31.903202 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:31.917409 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:31.930496 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:31.942876 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:32.064428 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:32.185109 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:32.306009 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:32.430501 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:55:32.647223 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:55:32.969229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30929): Launched 23:55:33.247942 run iperf3-srv_10.42.42.10(pid=30930): Launched 23:55:33.368912 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:55:33.585389 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:55:33.908254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30931): Launched 23:55:34.186966 run iperf3-srv_10.42.42.10(pid=30932): Launched 23:55:34.307640 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:55:34.523341 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:55:34.845508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30933): Launched 23:55:35.124637 run iperf3-srv_10.42.42.10(pid=30934): Launched 23:55:35.244889 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:55:35.461126 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:55:35.782622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30935): Launched 23:55:36.061921 run iperf3-srv_10.42.42.10(pid=30936): Launched 23:55:36.182185 tst iperf3m4.py:8: start network... 23:55:36.398185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:55:36.895692 run create_hlr_db(pid=30937): Launched 23:55:37.026846 bus /gobi_6: Setting Powered False 23:55:38.089846 run create_hlr_db(pid=30937): Terminated: ok {rc=0} 23:55:38.519446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30939): Launched 23:55:38.821566 run osmo-hlr_10.42.42.2(pid=30940): Launched 23:55:38.937129 run osmo-stp_10.42.42.5: Starting osmo-stp 23:55:39.469580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30942): Launched 23:55:39.770642 run osmo-stp_10.42.42.5(pid=30943): Launched 23:55:39.885209 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:55:40.406692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30945): Launched 23:55:40.522628 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:55:40.777327 run patchelf(pid=30946): Launched 23:55:40.945333 run osmo-stp_10.42.42.5(pid=30943): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30943)] 23:55:41.073708 run osmo-stp_10.42.42.5(pid=30943): stdout: | (launched: 2022-12-08_23:55:39.715835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:41.203494 run osmo-stp_10.42.42.5(pid=30943): stderr: | [0;m[38;5;43m20221208235539885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235539885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235539885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235539886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235539886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235539886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235539886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:41.333554 run osmo-stp_10.42.42.5(pid=30943): stdout: | (launched: 2022-12-08_23:55:39.715835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:41.456888 run osmo-stp_10.42.42.5(pid=30943): stderr: | [0;m[38;5;43m20221208235539885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235539885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235539885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235539886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235539886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235539886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235539886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:41.603447 run patchelf(pid=30946): Terminating (SIGINT) 23:55:41.771674 run patchelf(pid=30946): Terminated: ok {rc=0} 23:55:41.893630 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30943): Process ended prematurely: osmo-stp_10.42.42.5(pid=30943) [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30943)] [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 23:55:41.903512 tst iperf3m4.py:8: Test FAILED (10.8 sec) 23:55:41.931388 run osmo-hlr_10.42.42.2(pid=30940): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30940)] 23:55:41.980538 run osmo-hlr_10.42.42.2(pid=30940): stdout: | (launched: 2022-12-08_23:55:38.766836) 23:55:42.029090 run osmo-hlr_10.42.42.2(pid=30940): stderr: | [0;m[1;31m20221208235538943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235538943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235538943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235538943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235538943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235538943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235538955 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235538966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235538966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235538966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:55:42.078250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30929): Terminating (SIGTERM) 23:55:42.117791 run iperf3-srv_10.42.42.10(pid=30930): Terminating (SIGTERM) 23:55:42.156758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30931): Terminating (SIGTERM) 23:55:42.195976 run iperf3-srv_10.42.42.10(pid=30932): Terminating (SIGTERM) 23:55:42.236717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30933): Terminating (SIGTERM) 23:55:42.276340 run iperf3-srv_10.42.42.10(pid=30934): Terminating (SIGTERM) 23:55:42.315949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30935): Terminating (SIGTERM) 23:55:42.359405 run iperf3-srv_10.42.42.10(pid=30936): Terminating (SIGTERM) 23:55:42.400477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30939): Terminating (SIGTERM) 23:55:42.442172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30942): Terminating (SIGTERM) 23:55:42.483548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30945): Terminating (SIGTERM) 23:55:42.525295 --- ParallelTerminationStrategy: PID 30929 died... 23:55:42.544906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30929): Terminated: ok {rc=0} 23:55:42.590968 --- ParallelTerminationStrategy: PID 30930 died... 23:55:42.610301 run iperf3-srv_10.42.42.10(pid=30930): Terminated {rc=256} 23:55:42.655412 --- ParallelTerminationStrategy: PID 30931 died... 23:55:42.674784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30931): Terminated: ok {rc=0} 23:55:42.719971 --- ParallelTerminationStrategy: PID 30932 died... 23:55:42.739455 run iperf3-srv_10.42.42.10(pid=30932): Terminated {rc=256} 23:55:42.784398 --- ParallelTerminationStrategy: PID 30933 died... 23:55:42.803705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30933): Terminated: ok {rc=0} 23:55:42.849672 --- ParallelTerminationStrategy: PID 30934 died... 23:55:42.868762 run iperf3-srv_10.42.42.10(pid=30934): Terminated {rc=256} 23:55:42.913778 --- ParallelTerminationStrategy: PID 30935 died... 23:55:42.932855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30935): Terminated: ok {rc=0} 23:55:42.977856 --- ParallelTerminationStrategy: PID 30936 died... 23:55:42.996803 run iperf3-srv_10.42.42.10(pid=30936): Terminated {rc=256} 23:55:43.042412 --- ParallelTerminationStrategy: PID 30939 died... 23:55:43.061662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30939): Terminated: ok {rc=0} 23:55:43.106775 --- ParallelTerminationStrategy: PID 30942 died... 23:55:43.126395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30942): Terminated: ok {rc=0} 23:55:43.171451 --- ParallelTerminationStrategy: PID 30945 died... 23:55:43.190627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30945): Terminated: ok {rc=0} 23:55:43.276615 bus /gobi_4: Setting Powered False 23:55:44.373953 bus /gobi_4: Setting Powered False 23:55:45.488450 bus /gobi_1: Setting Powered False 23:55:46.589809 bus /gobi_1: Setting Powered False 23:55:47.713302 bus /gobi_0: Setting Powered False 23:55:48.809799 bus /gobi_0: Setting Powered False 23:55:49.925161 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 23:55:51.025976 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:51.038361 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:55:51.090792 tst ping.py: using LAC 17637 23:55:51.220306 tst ping.py: using RAC 42 23:55:51.342707 tst ping.py: using CellId 17637 23:55:51.464241 tst ping.py: using BVCI 17638 23:55:51.578369 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:51.590107 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:51.601663 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:51.613143 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:51.624541 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:51.636135 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:51.647645 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:51.659072 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:51.774385 tst ping.py:19: start network... 23:55:51.972451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:55:52.429205 run create_hlr_db(pid=30947): Launched 23:55:52.542139 bus /gobi_6: Setting Powered False 23:55:53.600790 run create_hlr_db(pid=30947): Terminated: ok {rc=0} 23:55:54.032631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30949): Launched 23:55:54.346626 run osmo-hlr_10.42.42.2(pid=30950): Launched 23:55:54.466167 run osmo-stp_10.42.42.5: Starting osmo-stp 23:55:55.012093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30952): Launched 23:55:55.327526 run osmo-stp_10.42.42.5(pid=30953): Launched 23:55:55.447645 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:55:55.991932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30955): Launched 23:55:56.113082 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:55:56.378720 run patchelf(pid=30956): Launched 23:55:56.554130 run osmo-stp_10.42.42.5(pid=30953): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30953)] 23:55:56.687632 run osmo-stp_10.42.42.5(pid=30953): stdout: | (launched: 2022-12-08_23:55:55.270301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:56.823364 run osmo-stp_10.42.42.5(pid=30953): stderr: | [0;m[38;5;43m20221208235555462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235555462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235555463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235555463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235555463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235555464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235555464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:56.958763 run osmo-stp_10.42.42.5(pid=30953): stdout: | (launched: 2022-12-08_23:55:55.270301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:57.087894 run osmo-stp_10.42.42.5(pid=30953): stderr: | [0;m[38;5;43m20221208235555462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235555462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235555463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235555463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235555463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235555464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235555464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:57.241373 run patchelf(pid=30956): Terminating (SIGINT) 23:55:57.418066 run patchelf(pid=30956): Terminated: ok {rc=0} 23:55:57.545750 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30953): Process ended prematurely: osmo-stp_10.42.42.5(pid=30953) [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30953)] [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 23:55:57.555187 tst ping.py:22: Test FAILED (6.5 sec) 23:55:57.582793 run osmo-hlr_10.42.42.2(pid=30950): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30950)] 23:55:57.631666 run osmo-hlr_10.42.42.2(pid=30950): stdout: | (launched: 2022-12-08_23:55:54.289684) 23:55:57.682521 run osmo-hlr_10.42.42.2(pid=30950): stderr: | [0;m[1;31m20221208235554487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235554487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235554487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235554487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235554487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235554487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235554500 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235554509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235554509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235554509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:55:57.733690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30949): Terminating (SIGTERM) 23:55:57.774564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30952): Terminating (SIGTERM) 23:55:57.815797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30955): Terminating (SIGTERM) 23:55:57.857569 --- ParallelTerminationStrategy: PID 30949 died... 23:55:57.877422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30949): Terminated: ok {rc=0} 23:55:57.922735 --- ParallelTerminationStrategy: PID 30952 died... 23:55:57.941987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30952): Terminated: ok {rc=0} 23:55:57.987103 --- ParallelTerminationStrategy: PID 30955 died... 23:55:58.006443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30955): Terminated: ok {rc=0} 23:55:58.092536 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 23:55:59.179465 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:59.191319 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:55:59.244294 tst ping_idle_ping.py: using LAC 17638 23:55:59.361730 tst ping_idle_ping.py: using RAC 43 23:55:59.478710 tst ping_idle_ping.py: using CellId 17638 23:55:59.594754 tst ping_idle_ping.py: using BVCI 17639 23:55:59.703708 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:59.714973 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:59.726035 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:59.737256 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:59.747996 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:59.758986 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:59.770801 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:59.782537 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:59.895701 tst ping_idle_ping.py:24: start network... 23:56:00.094141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:56:00.555157 run create_hlr_db(pid=30957): Launched 23:56:00.667973 bus /gobi_6: Setting Powered False 23:56:01.733145 run create_hlr_db(pid=30957): Terminated: ok {rc=0} 23:56:02.225733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30959): Launched 23:56:02.531344 run osmo-hlr_10.42.42.2(pid=30960): Launched 23:56:02.644536 run osmo-stp_10.42.42.5: Starting osmo-stp 23:56:03.174279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30962): Launched 23:56:03.471798 run osmo-stp_10.42.42.5(pid=30963): Launched 23:56:03.585459 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:56:04.103589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30965): Launched 23:56:04.218358 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:56:04.469430 run patchelf(pid=30966): Launched 23:56:04.634374 run osmo-stp_10.42.42.5(pid=30963): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30963)] 23:56:04.760345 run osmo-stp_10.42.42.5(pid=30963): stdout: | (launched: 2022-12-08_23:56:03.417665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:04.888105 run osmo-stp_10.42.42.5(pid=30963): stderr: | [0;m[38;5;43m20221208235603587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235603588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235603588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235603588 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235603589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235603589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235603589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:05.015780 run osmo-stp_10.42.42.5(pid=30963): stdout: | (launched: 2022-12-08_23:56:03.417665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:05.137376 run osmo-stp_10.42.42.5(pid=30963): stderr: | [0;m[38;5;43m20221208235603587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235603588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235603588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235603588 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235603589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235603589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235603589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:05.282141 run patchelf(pid=30966): Terminating (SIGINT) 23:56:05.448152 run patchelf(pid=30966): Terminated: ok {rc=0} 23:56:05.567960 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30963): Process ended prematurely: osmo-stp_10.42.42.5(pid=30963) [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30963)] [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 23:56:05.576841 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 23:56:05.603035 run osmo-hlr_10.42.42.2(pid=30960): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30960)] 23:56:05.650275 run osmo-hlr_10.42.42.2(pid=30960): stdout: | (launched: 2022-12-08_23:56:02.477289) 23:56:05.698572 run osmo-hlr_10.42.42.2(pid=30960): stderr: | [0;m[1;31m20221208235602651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235602651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235602651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235602652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235602652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235602652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235602664 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235602672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235602673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235602673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:56:05.747998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30959): Terminating (SIGTERM) 23:56:05.787067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30962): Terminating (SIGTERM) 23:56:05.826776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30965): Terminating (SIGTERM) 23:56:05.866277 --- ParallelTerminationStrategy: PID 30959 died... 23:56:05.884991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30959): Terminated: ok {rc=0} 23:56:05.928739 --- ParallelTerminationStrategy: PID 30962 died... 23:56:05.947090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30962): Terminated: ok {rc=0} 23:56:05.990319 --- ParallelTerminationStrategy: PID 30965 died... 23:56:06.008627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30965): Terminated: ok {rc=0} 23:56:06.093929 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:56:07.401130 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:56:07.407944 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:56:07.441100 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 23:56:07.474599 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:56:07.526768 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:56:07.558951 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 23:56:07.592471 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:56:08.155803 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2351 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 23:56:08.160656 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:56:08.171736 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:56:08.238998 tst switch_tch_pdch.py: using LAC 17639 23:56:08.355049 tst switch_tch_pdch.py: using RAC 44 23:56:08.477400 tst switch_tch_pdch.py: using CellId 17639 23:56:08.593865 tst switch_tch_pdch.py: using BVCI 17640 23:56:08.703081 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:56:08.714066 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:56:08.724824 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:56:08.735689 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:56:08.747038 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:56:08.758221 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:56:08.769566 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:56:08.780661 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:56:08.897715 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:56:09.013638 tst switch_tch_pdch.py:51: start network... 23:56:09.211730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:56:09.670128 run create_hlr_db(pid=30971): Launched 23:56:09.782084 bus /gobi_6: Setting Powered False 23:56:10.841220 run create_hlr_db(pid=30971): Terminated: ok {rc=0} 23:56:11.274231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30973): Launched 23:56:11.589514 run osmo-hlr_10.42.42.2(pid=30974): Launched 23:56:11.710826 run osmo-stp_10.42.42.5: Starting osmo-stp 23:56:12.253773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30976): Launched 23:56:12.567828 run osmo-stp_10.42.42.5(pid=30977): Launched 23:56:12.688780 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:56:13.234260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30979): Launched 23:56:13.355959 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:56:13.621805 run patchelf(pid=30980): Launched 23:56:13.796712 run osmo-stp_10.42.42.5(pid=30977): ERR: Terminated: ERROR {rc=1} [trial-2351↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30977)] 23:56:13.931123 run osmo-stp_10.42.42.5(pid=30977): stdout: | (launched: 2022-12-08_23:56:12.510986) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:14.066585 run osmo-stp_10.42.42.5(pid=30977): stderr: | [0;m[38;5;43m20221208235612701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235612701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235612702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235612702 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235612702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235612703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235612703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:14.202055 run osmo-stp_10.42.42.5(pid=30977): stdout: | (launched: 2022-12-08_23:56:12.510986) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:14.331249 run osmo-stp_10.42.42.5(pid=30977): stderr: | [0;m[38;5;43m20221208235612701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235612701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235612702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235612702 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235612702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235612703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235612703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:14.484141 run patchelf(pid=30980): Terminating (SIGINT) 23:56:14.660157 run patchelf(pid=30980): Terminated: ok {rc=0} 23:56:14.787448 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30977): Process ended prematurely: osmo-stp_10.42.42.5(pid=30977) [trial-2351↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30977)] [trial-2351↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 23:56:14.797055 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 23:56:14.824422 run osmo-hlr_10.42.42.2(pid=30974): ERR: Terminated: ERROR {rc=237} [trial-2351↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30974)] 23:56:14.873794 run osmo-hlr_10.42.42.2(pid=30974): stdout: | (launched: 2022-12-08_23:56:11.532347) 23:56:14.924865 run osmo-hlr_10.42.42.2(pid=30974): stderr: | [0;m[1;31m20221208235611730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235611730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235611730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235611730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235611730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235611730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235611744 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235611754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235611754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235611754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:56:14.976473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30973): Terminating (SIGTERM) 23:56:15.018117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30976): Terminating (SIGTERM) 23:56:15.059832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30979): Terminating (SIGTERM) 23:56:15.101768 --- ParallelTerminationStrategy: PID 30973 died... 23:56:15.121487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30973): Terminated: ok {rc=0} 23:56:15.167495 --- ParallelTerminationStrategy: PID 30976 died... 23:56:15.186998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30976): Terminated: ok {rc=0} 23:56:15.232765 --- ParallelTerminationStrategy: PID 30979 died... 23:56:15.252037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30979): Terminated: ok {rc=0} 23:56:15.340231 bus /gobi_0: Setting Powered False 23:56:16.443205 bus /gobi_0: Setting Powered False 23:56:17.567150 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 23:56:18.817758 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:56:18.824043 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 23:56:18.857429 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 23:56:18.892856 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 23:56:18.947758 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 23:56:18.980622 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 23:56:19.015405 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 23:56:19.573326 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2351 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 23:56:19.579680 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:56:19.592074 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 23:56:19.660081 tst switch_tch_pdch.py: using LAC 17640 23:56:19.781034 tst switch_tch_pdch.py: using RAC 45 23:56:19.902772 tst switch_tch_pdch.py: using CellId 17640 23:56:20.023706 tst switch_tch_pdch.py: using BVCI 17641 23:56:20.137167 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:56:20.148404 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:56:20.159512 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:56:20.170605 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:56:20.181619 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:56:20.192762 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:56:20.204344 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:56:20.215453 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:56:20.328025 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:56:20.446468 tst switch_tch_pdch.py:51: start network... 23:56:20.644521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:56:21.075235 run create_hlr_db(pid=30984): Launched 23:56:21.188882 bus /gobi_6: Setting Powered False 23:56:22.247254 run create_hlr_db(pid=30984): Terminated: ok {rc=0} 23:56:22.651107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30986): Launched 23:56:22.965927 run osmo-hlr_10.42.42.2(pid=30987): Launched 23:56:23.085998 run osmo-stp_10.42.42.5: Starting osmo-stp 23:56:23.600203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30989): Launched 23:56:23.914174 run osmo-stp_10.42.42.5(pid=30990): Launched 23:56:24.033144 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:56:24.547662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30992): Launched 23:56:24.668151 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:56:24.933616 run patchelf(pid=30993): Launched 23:56:25.107648 run osmo-stp_10.42.42.5(pid=30990): ERR: Terminated: ERROR {rc=1} [trial-2351↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30990)] 23:56:25.240772 run osmo-stp_10.42.42.5(pid=30990): stdout: | (launched: 2022-12-08_23:56:23.857494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:25.376261 run osmo-stp_10.42.42.5(pid=30990): stderr: | [0;m[38;5;43m20221208235624048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235624048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235624048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235624049 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235624049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235624049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235624049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:25.511553 run osmo-stp_10.42.42.5(pid=30990): stdout: | (launched: 2022-12-08_23:56:23.857494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:25.640041 run osmo-stp_10.42.42.5(pid=30990): stderr: | [0;m[38;5;43m20221208235624048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235624048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235624048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235624049 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235624049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235624049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235624049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:25.792315 run patchelf(pid=30993): Terminating (SIGINT) 23:56:25.968052 run patchelf(pid=30993): Terminated: ok {rc=0} 23:56:26.094778 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30990): Process ended prematurely: osmo-stp_10.42.42.5(pid=30990) [trial-2351↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30990)] [trial-2351↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 23:56:26.104304 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 23:56:26.131722 run osmo-hlr_10.42.42.2(pid=30987): ERR: Terminated: ERROR {rc=237} [trial-2351↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30987)] 23:56:26.180692 run osmo-hlr_10.42.42.2(pid=30987): stdout: | (launched: 2022-12-08_23:56:22.909169) 23:56:26.231487 run osmo-hlr_10.42.42.2(pid=30987): stderr: | [0;m[1;31m20221208235623107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235623107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235623107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235623107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235623107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235623107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235623120 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235623130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235623130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235623130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:56:26.282747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30986): Terminating (SIGTERM) 23:56:26.324067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30989): Terminating (SIGTERM) 23:56:26.365194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30992): Terminating (SIGTERM) 23:56:26.406337 --- ParallelTerminationStrategy: PID 30986 died... 23:56:26.425805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30986): Terminated: ok {rc=0} 23:56:26.471135 --- ParallelTerminationStrategy: PID 30989 died... 23:56:26.490236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30989): Terminated: ok {rc=0} 23:56:26.535170 --- ParallelTerminationStrategy: PID 30992 died... 23:56:26.554302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30992): Terminated: ok {rc=0} 23:56:26.641155 bus /gobi_0: Setting Powered False 23:56:27.737768 bus /gobi_0: Setting Powered False 23:56:28.851910 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 nitb_sms:trx-lms --------------------------------------------------------------------- 23:56:30.102499 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:56:30.106531 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 23:56:30.140297 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 23:56:30.147606 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 23:56:30.199511 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 23:56:30.232829 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 23:56:30.239696 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 23:56:30.778719 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 23:56:30.783807 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 23:56:30.794806 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 23:56:30.850853 tst mo_mt_sms.py: using LAC 17641 23:56:30.991502 tst mo_mt_sms.py: using RAC 46 23:56:31.146244 tst mo_mt_sms.py: using CellId 17641 23:56:31.273474 tst mo_mt_sms.py: using BVCI 17642 23:56:31.391577 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 23:56:31.514561 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 23:56:31.630469 tst mo_mt_sms.py:9: start nitb and bts... 23:56:31.849208 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:56:32.498516 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30997): Launched 23:56:32.813678 run osmo-nitb_10.42.42.2(pid=30998): Launched 23:56:32.987983 run osmo-nitb_10.42.42.2(pid=30998): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30998)] 23:56:33.128496 run osmo-nitb_10.42.42.2(pid=30998): stdout: | (launched: 2022-12-08_23:56:32.756675) 23:56:33.271349 run osmo-nitb_10.42.42.2(pid=30998): stderr: | (launched: 2022-12-08_23:56:32.803525) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:56:33.413969 run osmo-nitb_10.42.42.2(pid=30998): stdout: | (launched: 2022-12-08_23:56:32.756675) 23:56:33.551263 run osmo-nitb_10.42.42.2(pid=30998): stderr: | (launched: 2022-12-08_23:56:32.803525) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6f22fc268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30998): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30998) [trial-2351↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30998)] 23:56:33.932659 tst osmo-nitb_10.42.42.2(pid=30998): stdout: | (launched: 2022-12-08_23:56:32.756675) 23:56:34.059752 tst osmo-nitb_10.42.42.2(pid=30998): stderr: | (launched: 2022-12-08_23:56:32.803525) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:56:34.209763 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=30998): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30998) [trial-2351↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30998)] [trial-2351↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 23:56:34.218863 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 23:56:34.226133 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30997): Terminating (SIGTERM) 23:56:34.436126 --- ParallelTerminationStrategy: PID 30997 died... 23:56:34.457495 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30997): Terminated: ok {rc=0} 23:56:34.545543 bus /sierra_3: Setting Powered False 23:56:35.644315 bus /sierra_3: Setting Powered False 23:56:36.762510 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 sms:trx-lms --------------------------------------------------------------------- 23:56:37.957721 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:56:37.961688 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 23:56:37.994759 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 23:56:38.020892 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 23:56:38.071122 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 23:56:38.104471 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 23:56:38.131650 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 23:56:38.678117 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 23:56:38.683399 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:38.694474 tst sms:trx-lms: Using 1 x bts (candidates: 1) 23:56:38.742700 tst mo_mt_sms.py: using LAC 17642 23:56:38.866494 tst mo_mt_sms.py: using RAC 47 23:56:38.989947 tst mo_mt_sms.py: using CellId 17642 23:56:39.111590 tst mo_mt_sms.py: using BVCI 17643 23:56:39.225507 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:39.236328 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:39.247125 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:39.257889 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:39.269073 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:39.279859 tst sms:trx-lms: Using 1 x modem (candidates: 2) 23:56:39.395196 tst sms:trx-lms: Using 1 x modem (candidates: 2) 23:56:39.515584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:56:40.002506 run create_hlr_db(pid=31002): Launched 23:56:40.130078 bus /sierra_2: Setting Powered False 23:56:41.192116 run create_hlr_db(pid=31002): Terminated: ok {rc=0} 23:56:41.614006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31004): Launched 23:56:41.910996 run osmo-hlr_10.42.42.2(pid=31005): Launched 23:56:42.023333 run osmo-stp_10.42.42.5: Starting osmo-stp 23:56:42.536296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31007): Launched 23:56:42.832390 run osmo-stp_10.42.42.5(pid=31008): Launched 23:56:42.945378 run osmo-msc_10.42.42.6: Starting osmo-msc 23:56:43.480714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31010): Launched 23:56:43.777600 run osmo-msc_10.42.42.6(pid=31011): Launched 23:56:43.943135 run osmo-stp_10.42.42.5(pid=31008): ERR: Terminated: ERROR {rc=1} [trial-2351↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31008)] 23:56:44.069134 run osmo-stp_10.42.42.5(pid=31008): stdout: | (launched: 2022-12-08_23:56:42.778459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:44.195383 run osmo-stp_10.42.42.5(pid=31008): stderr: | [0;m[38;5;43m20221208235642947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235642948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235642948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235642948 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235642949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235642949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235642949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:44.318841 run osmo-stp_10.42.42.5(pid=31008): stdout: | (launched: 2022-12-08_23:56:42.778459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:44.437224 run osmo-stp_10.42.42.5(pid=31008): stderr: | [0;m[38;5;43m20221208235642947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235642948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235642948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235642948 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235642949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235642949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235642949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:44.578439 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=31008): Process ended prematurely: osmo-stp_10.42.42.5(pid=31008) [trial-2351↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31008)] [trial-2351↪sms:trx-lms↪mo_mt_sms.py:16] 23:56:44.586559 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 23:56:44.612412 run osmo-hlr_10.42.42.2(pid=31005): ERR: Terminated: ERROR {rc=237} [trial-2351↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31005)] 23:56:44.659425 run osmo-hlr_10.42.42.2(pid=31005): stdout: | (launched: 2022-12-08_23:56:41.856041) 23:56:44.708319 run osmo-hlr_10.42.42.2(pid=31005): stderr: | [0;m[1;31m20221208235642032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235642032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235642032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235642032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235642032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235642032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235642044 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235642053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235642054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235642054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:56:44.776125 run osmo-msc_10.42.42.6(pid=31011): ERR: Terminated: ERROR {rc=2} [trial-2351↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31011)] 23:56:44.822994 run osmo-msc_10.42.42.6(pid=31011): stdout: | (launched: 2022-12-08_23:56:43.723864) 23:56:44.871684 run osmo-msc_10.42.42.6(pid=31011): stderr: | [0;m[38;5;43m20221208235643993 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235643993 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0462f05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235643993 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235643993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235643993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235643993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235643995 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235643996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235643996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235643996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:56:44.920774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31004): Terminating (SIGTERM) 23:56:44.959771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31007): Terminating (SIGTERM) 23:56:44.998677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31010): Terminating (SIGTERM) 23:56:45.037635 --- ParallelTerminationStrategy: PID 31004 died... 23:56:45.056635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31004): Terminated: ok {rc=0} 23:56:45.100094 --- ParallelTerminationStrategy: PID 31007 died... 23:56:45.118193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31007): Terminated: ok {rc=0} 23:56:45.161379 --- ParallelTerminationStrategy: PID 31010 died... 23:56:45.179483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31010): Terminated: ok {rc=0} 23:56:45.261519 bus /sierra_3: Setting Powered False 23:56:46.368393 bus /sierra_3: Setting Powered False 23:56:47.497497 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 nitb_ussd:trx-lms --------------------------------------------------------------------- 23:56:48.732494 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:56:48.736369 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 23:56:48.769500 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 23:56:48.776411 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 23:56:48.811449 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 23:56:48.845149 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 23:56:48.852068 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 23:56:49.372615 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2351 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 23:56:49.377696 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 23:56:49.388478 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 23:56:49.439692 tst assert_extension.py: using LAC 17643 23:56:49.561083 tst assert_extension.py: using RAC 48 23:56:49.682273 tst assert_extension.py: using CellId 17643 23:56:49.805142 tst assert_extension.py: using BVCI 17644 23:56:49.918795 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 23:56:50.032411 tst assert_extension.py:10: start nitb and bts... 23:56:50.231323 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:56:50.836183 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31017): Launched 23:56:51.133079 run osmo-nitb_10.42.42.2(pid=31018): Launched 23:56:51.296796 run osmo-nitb_10.42.42.2(pid=31018): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31018)] 23:56:51.430666 run osmo-nitb_10.42.42.2(pid=31018): stdout: | (launched: 2022-12-08_23:56:51.078602) 23:56:51.565848 run osmo-nitb_10.42.42.2(pid=31018): stderr: | (launched: 2022-12-08_23:56:51.122981) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:56:51.701396 run osmo-nitb_10.42.42.2(pid=31018): stdout: | (launched: 2022-12-08_23:56:51.078602) 23:56:51.830528 run osmo-nitb_10.42.42.2(pid=31018): stderr: | (launched: 2022-12-08_23:56:51.122981) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6f22fc268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31018): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31018) [trial-2351↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31018)] 23:56:52.244678 tst osmo-nitb_10.42.42.2(pid=31018): stdout: | (launched: 2022-12-08_23:56:51.078602) 23:56:52.364086 tst osmo-nitb_10.42.42.2(pid=31018): stderr: | (launched: 2022-12-08_23:56:51.122981) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:56:52.505498 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=31018): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31018) [trial-2351↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31018)] [trial-2351↪nitb_ussd:trx-lms↪assert_extension.py:12] 23:56:52.513797 tst assert_extension.py:12: Test FAILED (3.1 sec) 23:56:52.520286 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31017): Terminating (SIGTERM) 23:56:52.729160 --- ParallelTerminationStrategy: PID 31017 died... 23:56:52.749222 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31017): Terminated: ok {rc=0} 23:56:52.834634 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 ussd:trx-lms --------------------------------------------------------------------- 23:56:54.020842 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:56:54.024928 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 23:56:54.058252 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 23:56:54.085219 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 23:56:54.119694 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 23:56:54.152938 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 23:56:54.180050 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 23:56:54.710793 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2351 ussd:trx-lms assert_extension.py ---------------------------------------------- 23:56:54.716571 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:54.727853 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 23:56:54.774574 tst assert_extension.py: using LAC 17644 23:56:54.898019 tst assert_extension.py: using RAC 49 23:56:55.018825 tst assert_extension.py: using CellId 17644 23:56:55.140769 tst assert_extension.py: using BVCI 17645 23:56:55.254235 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:55.265197 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:55.276072 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:55.286715 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:55.297934 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:55.308792 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 23:56:55.422634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:56:55.881863 run create_hlr_db(pid=31022): Launched 23:56:55.995189 bus /sierra_2: Setting Powered False 23:56:57.053886 run create_hlr_db(pid=31022): Terminated: ok {rc=0} 23:56:57.487030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31024): Launched 23:56:57.805315 run osmo-hlr_10.42.42.2(pid=31025): Launched 23:56:57.926023 run osmo-stp_10.42.42.5: Starting osmo-stp 23:56:58.473743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31027): Launched 23:56:58.788053 run osmo-stp_10.42.42.5(pid=31028): Launched 23:56:58.909308 run osmo-msc_10.42.42.6: Starting osmo-msc 23:56:59.478999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31030): Launched 23:56:59.793506 run osmo-msc_10.42.42.6(pid=31031): Launched 23:56:59.969562 run osmo-stp_10.42.42.5(pid=31028): ERR: Terminated: ERROR {rc=1} [trial-2351↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31028)] 23:57:00.102462 run osmo-stp_10.42.42.5(pid=31028): stdout: | (launched: 2022-12-08_23:56:58.730912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:00.235949 run osmo-stp_10.42.42.5(pid=31028): stderr: | [0;m[38;5;43m20221208235658922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235658922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235658922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235658922 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235658923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235658923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235658923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:00.369236 run osmo-stp_10.42.42.5(pid=31028): stdout: | (launched: 2022-12-08_23:56:58.730912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:00.494898 run osmo-stp_10.42.42.5(pid=31028): stderr: | [0;m[38;5;43m20221208235658922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235658922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235658922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235658922 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235658923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235658923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235658923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:00.644592 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=31028): Process ended prematurely: osmo-stp_10.42.42.5(pid=31028) [trial-2351↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31028)] [trial-2351↪ussd:trx-lms↪assert_extension.py:17] 23:57:00.653471 tst assert_extension.py:17: Test FAILED (5.9 sec) 23:57:00.680449 run osmo-hlr_10.42.42.2(pid=31025): ERR: Terminated: ERROR {rc=237} [trial-2351↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31025)] 23:57:00.729635 run osmo-hlr_10.42.42.2(pid=31025): stdout: | (launched: 2022-12-08_23:56:57.748313) 23:57:00.780915 run osmo-hlr_10.42.42.2(pid=31025): stderr: | [0;m[1;31m20221208235657944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235657944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235657944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235657944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235657945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235657945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235657957 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235657965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235657966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235657966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:57:00.864927 run osmo-msc_10.42.42.6(pid=31031): ERR: Terminated: ERROR {rc=2} [trial-2351↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31031)] 23:57:00.920508 run osmo-msc_10.42.42.6(pid=31031): stdout: | (launched: 2022-12-08_23:56:59.736311) 23:57:00.973147 run osmo-msc_10.42.42.6(pid=31031): stderr: | [0;m[38;5;43m20221208235700054 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235700054 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff3c4019c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235700054 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235700054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235700054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235700055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235700056 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235700057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235700057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235700057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:57:01.025878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31024): Terminating (SIGTERM) 23:57:01.068827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31027): Terminating (SIGTERM) 23:57:01.111189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31030): Terminating (SIGTERM) 23:57:01.153514 --- ParallelTerminationStrategy: PID 31024 died... 23:57:01.173413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31024): Terminated: ok {rc=0} 23:57:01.220096 --- ParallelTerminationStrategy: PID 31027 died... 23:57:01.240035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31027): Terminated: ok {rc=0} 23:57:01.286748 --- ParallelTerminationStrategy: PID 31030 died... 23:57:01.306677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31030): Terminated: ok {rc=0} 23:57:01.400009 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 23:57:02.619340 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:57:02.627406 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 23:57:02.661190 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 23:57:02.688208 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 23:57:02.738858 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 23:57:02.772278 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 23:57:02.799312 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 23:57:03.353603 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 23:57:03.405161 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:57:03.416534 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:57:03.485445 tst mo_mt_call.py: using LAC 17645 23:57:03.609058 tst mo_mt_call.py: using RAC 50 23:57:03.732594 tst mo_mt_call.py: using CellId 17645 23:57:03.856900 tst mo_mt_call.py: using BVCI 17646 23:57:03.972803 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:57:03.984149 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:57:03.995291 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:57:04.006630 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:57:04.017873 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:57:04.029085 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:57:04.145520 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:57:04.263050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:57:04.758749 run create_hlr_db(pid=31037): Launched 23:57:04.888244 bus /sierra_2: Setting Powered False 23:57:05.951880 run create_hlr_db(pid=31037): Terminated: ok {rc=0} 23:57:06.381073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31039): Launched 23:57:06.683189 run osmo-hlr_10.42.42.2(pid=31040): Launched 23:57:06.798243 run osmo-stp_10.42.42.5: Starting osmo-stp 23:57:07.316194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31042): Launched 23:57:07.618775 run osmo-stp_10.42.42.5(pid=31043): Launched 23:57:07.734422 run osmo-msc_10.42.42.6: Starting osmo-msc 23:57:08.278180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31045): Launched 23:57:08.578953 run osmo-msc_10.42.42.6(pid=31046): Launched 23:57:08.747154 run osmo-stp_10.42.42.5(pid=31043): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31043)] 23:57:08.875560 run osmo-stp_10.42.42.5(pid=31043): stdout: | (launched: 2022-12-08_23:57:07.563825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:09.004072 run osmo-stp_10.42.42.5(pid=31043): stderr: | [0;m[38;5;43m20221208235707735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235707736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235707736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235707736 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235707737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235707737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235707737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:09.130139 run osmo-stp_10.42.42.5(pid=31043): stdout: | (launched: 2022-12-08_23:57:07.563825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:09.249782 run osmo-stp_10.42.42.5(pid=31043): stderr: | [0;m[38;5;43m20221208235707735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235707736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235707736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235707736 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235707737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235707737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235707737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:09.392835 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31043): Process ended prematurely: osmo-stp_10.42.42.5(pid=31043) [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31043)] [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 23:57:09.401975 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:57:09.427968 run osmo-hlr_10.42.42.2(pid=31040): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31040)] 23:57:09.475768 run osmo-hlr_10.42.42.2(pid=31040): stdout: | (launched: 2022-12-08_23:57:06.628492) 23:57:09.524743 run osmo-hlr_10.42.42.2(pid=31040): stderr: | [0;m[1;31m20221208235706807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235706807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235706807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235706807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235706807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235706807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235706843 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235706853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235706854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235706854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:57:09.592668 run osmo-msc_10.42.42.6(pid=31046): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31046)] 23:57:09.639510 run osmo-msc_10.42.42.6(pid=31046): stdout: | (launched: 2022-12-08_23:57:08.524014) 23:57:09.688401 run osmo-msc_10.42.42.6(pid=31046): stderr: | [0;m[38;5;43m20221208235708796 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235708796 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa51fd0cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235708797 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235708797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235708797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235708797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235708799 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235708799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235708799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235708799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:57:09.737923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31039): Terminating (SIGTERM) 23:57:09.776529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31042): Terminating (SIGTERM) 23:57:09.816098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31045): Terminating (SIGTERM) 23:57:09.855311 --- ParallelTerminationStrategy: PID 31039 died... 23:57:09.874469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31039): Terminated: ok {rc=0} 23:57:09.918151 --- ParallelTerminationStrategy: PID 31042 died... 23:57:09.936449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31042): Terminated: ok {rc=0} 23:57:09.979876 --- ParallelTerminationStrategy: PID 31045 died... 23:57:09.998331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31045): Terminated: ok {rc=0} 23:57:10.083452 bus /sierra_3: Setting Powered False 23:57:11.183271 bus /sierra_3: Setting Powered False 23:57:12.295798 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 23:57:13.442349 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:57:13.454315 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:57:13.525602 tst mo_mt_call_osmux.py: using LAC 17646 23:57:13.650395 tst mo_mt_call_osmux.py: using RAC 51 23:57:13.775564 tst mo_mt_call_osmux.py: using CellId 17646 23:57:13.900812 tst mo_mt_call_osmux.py: using BVCI 17647 23:57:14.016503 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:57:14.027950 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:57:14.039176 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:57:14.050499 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:57:14.061811 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:57:14.073031 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:57:14.188701 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:57:14.311474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:57:14.780182 run create_hlr_db(pid=31048): Launched 23:57:14.896633 bus /sierra_2: Setting Powered False 23:57:15.977967 run create_hlr_db(pid=31048): Terminated: ok {rc=0} 23:57:16.449873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31050): Launched 23:57:16.775224 run osmo-hlr_10.42.42.2(pid=31051): Launched 23:57:16.988781 run osmo-stp_10.42.42.5: Starting osmo-stp 23:57:17.667829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31053): Launched 23:57:17.990046 run osmo-stp_10.42.42.5(pid=31054): Launched 23:57:18.113302 run osmo-msc_10.42.42.6: Starting osmo-msc 23:57:18.693688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31056): Launched 23:57:19.014656 run osmo-msc_10.42.42.6(pid=31057): Launched 23:57:19.191774 run osmo-stp_10.42.42.5(pid=31054): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31054)] 23:57:19.326177 run osmo-stp_10.42.42.5(pid=31054): stdout: | (launched: 2022-12-08_23:57:17.932037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:19.462341 run osmo-stp_10.42.42.5(pid=31054): stderr: | [0;m[38;5;43m20221208235718124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235718124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235718125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235718125 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235718126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235718126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235718126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:19.597114 run osmo-stp_10.42.42.5(pid=31054): stdout: | (launched: 2022-12-08_23:57:17.932037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:19.724296 run osmo-stp_10.42.42.5(pid=31054): stderr: | [0;m[38;5;43m20221208235718124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235718124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235718125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235718125 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235718126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235718126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235718126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:19.877506 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31054): Process ended prematurely: osmo-stp_10.42.42.5(pid=31054) [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31054)] [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 23:57:19.887065 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 23:57:19.914615 run osmo-hlr_10.42.42.2(pid=31051): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31051)] 23:57:19.964022 run osmo-hlr_10.42.42.2(pid=31051): stdout: | (launched: 2022-12-08_23:57:16.711374) 23:57:20.015110 run osmo-hlr_10.42.42.2(pid=31051): stderr: | [0;m[1;31m20221208235717124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235717124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235717124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235717124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235717124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235717124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235717150 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235717169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235717169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235717169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:57:20.086460 run osmo-msc_10.42.42.6(pid=31057): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31057)] 23:57:20.135714 run osmo-msc_10.42.42.6(pid=31057): stdout: | (launched: 2022-12-08_23:57:18.956439) 23:57:20.186697 run osmo-msc_10.42.42.6(pid=31057): stderr: | [0;m[38;5;43m20221208235719279 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235719279 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efc6bf23c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235719279 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235719279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235719279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235719280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235719281 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235719282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235719282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235719282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:57:20.238142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31050): Terminating (SIGTERM) 23:57:20.279258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31053): Terminating (SIGTERM) 23:57:20.320663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31056): Terminating (SIGTERM) 23:57:20.362059 --- ParallelTerminationStrategy: PID 31050 died... 23:57:20.381619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31050): Terminated: ok {rc=0} 23:57:20.426937 --- ParallelTerminationStrategy: PID 31053 died... 23:57:20.446141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31053): Terminated: ok {rc=0} 23:57:20.491290 --- ParallelTerminationStrategy: PID 31056 died... 23:57:20.510429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31056): Terminated: ok {rc=0} 23:57:20.596316 bus /sierra_3: Setting Powered False 23:57:21.693590 bus /sierra_3: Setting Powered False 23:57:22.808444 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 23:57:24.059816 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:57:24.067077 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 23:57:24.100478 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 23:57:24.127948 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 23:57:24.179747 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 23:57:24.213216 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 23:57:24.240017 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 23:57:24.792713 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 23:57:24.843761 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:24.855099 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:57:24.925543 tst mo_mt_call.py: using LAC 17647 23:57:25.050245 tst mo_mt_call.py: using RAC 52 23:57:25.176899 tst mo_mt_call.py: using CellId 17647 23:57:25.302302 tst mo_mt_call.py: using BVCI 17648 23:57:25.419733 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:25.431093 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:25.442361 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:25.453548 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:25.465226 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:25.476325 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:57:25.593365 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:57:25.711884 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:57:26.182072 run create_hlr_db(pid=31062): Launched 23:57:26.298650 bus /sierra_2: Setting Powered False 23:57:27.358571 run create_hlr_db(pid=31062): Terminated: ok {rc=0} 23:57:27.779727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31064): Launched 23:57:28.083692 run osmo-hlr_10.42.42.2(pid=31065): Launched 23:57:28.199482 run osmo-stp_10.42.42.5: Starting osmo-stp 23:57:28.733938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31067): Launched 23:57:29.035032 run osmo-stp_10.42.42.5(pid=31068): Launched 23:57:29.150357 run osmo-msc_10.42.42.6: Starting osmo-msc 23:57:29.694688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31070): Launched 23:57:29.997149 run osmo-msc_10.42.42.6(pid=31071): Launched 23:57:30.165754 run osmo-stp_10.42.42.5(pid=31068): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31068)] 23:57:30.293523 run osmo-stp_10.42.42.5(pid=31068): stdout: | (launched: 2022-12-08_23:57:28.979873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:30.421469 run osmo-stp_10.42.42.5(pid=31068): stderr: | [0;m[38;5;43m20221208235729149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235729149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235729150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235729150 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235729152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235729153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235729153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:30.547389 run osmo-stp_10.42.42.5(pid=31068): stdout: | (launched: 2022-12-08_23:57:28.979873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:30.667520 run osmo-stp_10.42.42.5(pid=31068): stderr: | [0;m[38;5;43m20221208235729149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235729149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235729150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235729150 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235729152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235729153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235729153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:30.811082 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31068): Process ended prematurely: osmo-stp_10.42.42.5(pid=31068) [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31068)] [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 23:57:30.819963 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:57:30.851709 run osmo-hlr_10.42.42.2(pid=31065): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31065)] 23:57:30.913068 run osmo-hlr_10.42.42.2(pid=31065): stdout: | (launched: 2022-12-08_23:57:28.028499) 23:57:30.966979 run osmo-hlr_10.42.42.2(pid=31065): stderr: | [0;m[1;31m20221208235728207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235728207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235728207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235728207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235728207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235728207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235728219 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235728230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235728230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235728230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:57:31.041924 run osmo-msc_10.42.42.6(pid=31071): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31071)] 23:57:31.108302 run osmo-msc_10.42.42.6(pid=31071): stdout: | (launched: 2022-12-08_23:57:29.942296) 23:57:31.169478 run osmo-msc_10.42.42.6(pid=31071): stderr: | [0;m[38;5;43m20221208235730212 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235730212 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8813349c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235730212 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235730212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235730212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235730212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235730214 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235730215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235730215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235730215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:57:31.220312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31064): Terminating (SIGTERM) 23:57:31.263043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31067): Terminating (SIGTERM) 23:57:31.305349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31070): Terminating (SIGTERM) 23:57:31.348303 --- ParallelTerminationStrategy: PID 31064 died... 23:57:31.368065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31064): Terminated: ok {rc=0} 23:57:31.414320 --- ParallelTerminationStrategy: PID 31067 died... 23:57:31.433696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31067): Terminated: ok {rc=0} 23:57:31.479553 --- ParallelTerminationStrategy: PID 31070 died... 23:57:31.498733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31070): Terminated: ok {rc=0} 23:57:31.585554 bus /sierra_3: Setting Powered False 23:57:32.680646 bus /sierra_3: Setting Powered False 23:57:33.795300 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 23:57:34.940274 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:34.951982 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:57:35.021310 tst mo_mt_call_osmux.py: using LAC 17648 23:57:35.139579 tst mo_mt_call_osmux.py: using RAC 53 23:57:35.258892 tst mo_mt_call_osmux.py: using CellId 17648 23:57:35.377355 tst mo_mt_call_osmux.py: using BVCI 17649 23:57:35.488488 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:35.499419 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:35.510242 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:35.520873 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:35.531966 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:35.542890 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:57:35.656722 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:57:35.778714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:57:36.277429 run create_hlr_db(pid=31074): Launched 23:57:36.407303 bus /sierra_2: Setting Powered False 23:57:37.470142 run create_hlr_db(pid=31074): Terminated: ok {rc=0} 23:57:37.899835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31076): Launched 23:57:38.202943 run osmo-hlr_10.42.42.2(pid=31077): Launched 23:57:38.317883 run osmo-stp_10.42.42.5: Starting osmo-stp 23:57:38.847575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31079): Launched 23:57:39.150538 run osmo-stp_10.42.42.5(pid=31080): Launched 23:57:39.265415 run osmo-msc_10.42.42.6: Starting osmo-msc 23:57:39.810881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31082): Launched 23:57:40.115052 run osmo-msc_10.42.42.6(pid=31083): Launched 23:57:40.284159 run osmo-stp_10.42.42.5(pid=31080): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31080)] 23:57:40.413409 run osmo-stp_10.42.42.5(pid=31080): stdout: | (launched: 2022-12-08_23:57:39.095129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:40.542136 run osmo-stp_10.42.42.5(pid=31080): stderr: | [0;m[38;5;43m20221208235739265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235739265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235739265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235739266 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235739266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235739266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235739266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:40.668178 run osmo-stp_10.42.42.5(pid=31080): stdout: | (launched: 2022-12-08_23:57:39.095129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:40.788120 run osmo-stp_10.42.42.5(pid=31080): stderr: | [0;m[38;5;43m20221208235739265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235739265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235739265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235739266 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235739266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235739266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235739266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:40.932241 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31080): Process ended prematurely: osmo-stp_10.42.42.5(pid=31080) [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31080)] [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 23:57:40.941393 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:57:40.968202 run osmo-hlr_10.42.42.2(pid=31077): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31077)] 23:57:41.016370 run osmo-hlr_10.42.42.2(pid=31077): stdout: | (launched: 2022-12-08_23:57:38.147761) 23:57:41.066070 run osmo-hlr_10.42.42.2(pid=31077): stderr: | [0;m[1;31m20221208235738322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235738323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235738323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235738323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235738323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235738323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235738335 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235738346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235738346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235738346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:57:41.135341 run osmo-msc_10.42.42.6(pid=31083): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31083)] 23:57:41.182641 run osmo-msc_10.42.42.6(pid=31083): stdout: | (launched: 2022-12-08_23:57:40.058999) 23:57:41.232545 run osmo-msc_10.42.42.6(pid=31083): stderr: | [0;m[38;5;43m20221208235740332 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235740332 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f668d16fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235740332 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235740332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235740332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235740332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235740334 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235740335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235740335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235740335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:57:41.281817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31076): Terminating (SIGTERM) 23:57:41.321638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31079): Terminating (SIGTERM) 23:57:41.361808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31082): Terminating (SIGTERM) 23:57:41.401858 --- ParallelTerminationStrategy: PID 31076 died... 23:57:41.420655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31076): Terminated: ok {rc=0} 23:57:41.465501 --- ParallelTerminationStrategy: PID 31079 died... 23:57:41.484364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31079): Terminated: ok {rc=0} 23:57:41.528260 --- ParallelTerminationStrategy: PID 31082 died... 23:57:41.547016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31082): Terminated: ok {rc=0} 23:57:41.633947 bus /sierra_3: Setting Powered False 23:57:42.732658 bus /sierra_3: Setting Powered False 23:57:43.847931 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 23:57:45.102196 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:57:45.109327 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 23:57:45.145283 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 23:57:45.171103 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 23:57:45.224815 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 23:57:45.259687 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 23:57:45.287010 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 23:57:45.841469 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 23:57:45.912227 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:45.924324 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:57:46.003753 tst mo_mt_call.py: using LAC 17649 23:57:46.138269 tst mo_mt_call.py: using RAC 54 23:57:46.258906 tst mo_mt_call.py: using CellId 17649 23:57:46.425359 tst mo_mt_call.py: using BVCI 17650 23:57:46.539201 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:46.551216 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:46.562792 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:46.575682 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:46.588661 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:46.600512 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:57:46.720440 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:57:46.858815 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:57:47.397203 run create_hlr_db(pid=31088): Launched 23:57:47.528647 bus /sierra_2: Setting Powered False 23:57:48.592912 run create_hlr_db(pid=31088): Terminated: ok {rc=0} 23:57:49.024548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31090): Launched 23:57:49.348227 run osmo-hlr_10.42.42.2(pid=31091): Launched 23:57:49.470223 run osmo-stp_10.42.42.5: Starting osmo-stp 23:57:50.023726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31093): Launched 23:57:50.344507 run osmo-stp_10.42.42.5(pid=31094): Launched 23:57:50.466125 run osmo-msc_10.42.42.6: Starting osmo-msc 23:57:51.045993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31096): Launched 23:57:51.367783 run osmo-msc_10.42.42.6(pid=31097): Launched 23:57:51.546149 run osmo-stp_10.42.42.5(pid=31094): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31094)] 23:57:51.681147 run osmo-stp_10.42.42.5(pid=31094): stdout: | (launched: 2022-12-08_23:57:50.286582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:51.816579 run osmo-stp_10.42.42.5(pid=31094): stderr: | [0;m[38;5;43m20221208235750479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235750479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235750479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235750480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235750480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235750480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235750480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:51.951777 run osmo-stp_10.42.42.5(pid=31094): stdout: | (launched: 2022-12-08_23:57:50.286582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:52.079450 run osmo-stp_10.42.42.5(pid=31094): stderr: | [0;m[38;5;43m20221208235750479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235750479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235750479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235750480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235750480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235750480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235750480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:52.231431 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31094): Process ended prematurely: osmo-stp_10.42.42.5(pid=31094) [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31094)] [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 23:57:52.241052 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 23:57:52.268236 run osmo-hlr_10.42.42.2(pid=31091): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31091)] 23:57:52.317552 run osmo-hlr_10.42.42.2(pid=31091): stdout: | (launched: 2022-12-08_23:57:49.289805) 23:57:52.368678 run osmo-hlr_10.42.42.2(pid=31091): stderr: | [0;m[1;31m20221208235749486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235749486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235749486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235749486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235749486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235749486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235749499 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235749510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235749510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235749510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:57:52.439422 run osmo-msc_10.42.42.6(pid=31097): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31097)] 23:57:52.488450 run osmo-msc_10.42.42.6(pid=31097): stdout: | (launched: 2022-12-08_23:57:51.309238) 23:57:52.539435 run osmo-msc_10.42.42.6(pid=31097): stderr: | [0;m[38;5;43m20221208235751633 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235751633 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbeca7a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235751633 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235751633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235751634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235751634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235751635 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235751636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235751636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235751636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:57:52.590819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31090): Terminating (SIGTERM) 23:57:52.631731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31093): Terminating (SIGTERM) 23:57:52.673357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31096): Terminating (SIGTERM) 23:57:52.714682 --- ParallelTerminationStrategy: PID 31090 died... 23:57:52.734362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31090): Terminated: ok {rc=0} 23:57:52.779656 --- ParallelTerminationStrategy: PID 31093 died... 23:57:52.799391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31093): Terminated: ok {rc=0} 23:57:52.844936 --- ParallelTerminationStrategy: PID 31096 died... 23:57:52.864226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31096): Terminated: ok {rc=0} 23:57:52.951228 bus /sierra_3: Setting Powered False 23:57:54.049757 bus /sierra_3: Setting Powered False 23:57:55.165124 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:57:56.312851 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:56.325079 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:57:56.396718 tst mo_mt_call_osmux.py: using LAC 17650 23:57:56.522919 tst mo_mt_call_osmux.py: using RAC 55 23:57:56.650517 tst mo_mt_call_osmux.py: using CellId 17650 23:57:56.778003 tst mo_mt_call_osmux.py: using BVCI 17651 23:57:56.895654 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:56.907122 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:56.918401 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:56.929787 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:56.941042 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:56.952311 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:57:57.070298 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:57:57.186226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:57:57.654316 run create_hlr_db(pid=31099): Launched 23:57:57.770804 bus /sierra_2: Setting Powered False 23:57:58.831999 run create_hlr_db(pid=31099): Terminated: ok {rc=0} 23:57:59.271266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31101): Launched 23:57:59.578505 run osmo-hlr_10.42.42.2(pid=31102): Launched 23:57:59.693569 run osmo-stp_10.42.42.5: Starting osmo-stp 23:58:00.228319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31104): Launched 23:58:00.530920 run osmo-stp_10.42.42.5(pid=31105): Launched 23:58:00.646485 run osmo-msc_10.42.42.6: Starting osmo-msc 23:58:01.265639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31107): Launched 23:58:01.608063 run osmo-msc_10.42.42.6(pid=31108): Launched 23:58:01.936865 run osmo-stp_10.42.42.5(pid=31105): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31105)] 23:58:02.179985 run osmo-stp_10.42.42.5(pid=31105): stdout: | (launched: 2022-12-08_23:58:00.475951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:02.340779 run osmo-stp_10.42.42.5(pid=31105): stderr: | [0;m[38;5;43m20221208235800646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235800646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235800647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235800647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235800647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235800647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235800648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:02.466928 run osmo-stp_10.42.42.5(pid=31105): stdout: | (launched: 2022-12-08_23:58:00.475951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:02.587019 run osmo-stp_10.42.42.5(pid=31105): stderr: | [0;m[38;5;43m20221208235800646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235800646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235800647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235800647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235800647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235800647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235800648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:02.731002 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31105): Process ended prematurely: osmo-stp_10.42.42.5(pid=31105) [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31105)] [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:58:02.739733 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 23:58:02.766199 run osmo-hlr_10.42.42.2(pid=31102): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31102)] 23:58:02.813653 run osmo-hlr_10.42.42.2(pid=31102): stdout: | (launched: 2022-12-08_23:57:59.523358) 23:58:02.862763 run osmo-hlr_10.42.42.2(pid=31102): stderr: | [0;m[1;31m20221208235759698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235759699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235759699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235759699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235759699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235759699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235759711 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235759720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235759720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235759720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:58:02.931169 run osmo-msc_10.42.42.6(pid=31108): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31108)] 23:58:02.978362 run osmo-msc_10.42.42.6(pid=31108): stdout: | (launched: 2022-12-08_23:58:01.541059) 23:58:03.027262 run osmo-msc_10.42.42.6(pid=31108): stderr: | [0;m[38;5;43m20221208235802012 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235802012 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feadc41dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235802012 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235802012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235802012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235802012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235802014 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235802014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235802015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235802015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:58:03.076015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31101): Terminating (SIGTERM) 23:58:03.115443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31104): Terminating (SIGTERM) 23:58:03.154301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31107): Terminating (SIGTERM) 23:58:03.193663 --- ParallelTerminationStrategy: PID 31101 died... 23:58:03.212183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31101): Terminated: ok {rc=0} 23:58:03.255795 --- ParallelTerminationStrategy: PID 31104 died... 23:58:03.273969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31104): Terminated: ok {rc=0} 23:58:03.317305 --- ParallelTerminationStrategy: PID 31107 died... 23:58:03.335360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31107): Terminated: ok {rc=0} 23:58:03.419789 bus /sierra_3: Setting Powered False 23:58:04.518109 bus /sierra_3: Setting Powered False 23:58:05.628699 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 23:58:06.879740 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:58:06.887064 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 23:58:06.920314 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 23:58:06.948000 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 23:58:07.000501 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 23:58:07.034462 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 23:58:07.061568 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 23:58:07.613988 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 23:58:07.664092 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:58:07.675193 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:58:07.743071 tst mo_mt_call.py: using LAC 17651 23:58:07.861727 tst mo_mt_call.py: using RAC 56 23:58:07.989082 tst mo_mt_call.py: using CellId 17651 23:58:08.117453 tst mo_mt_call.py: using BVCI 17652 23:58:08.235133 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:58:08.246622 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:58:08.257837 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:58:08.269030 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:58:08.280301 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:58:08.291571 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:58:08.408411 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:58:08.526772 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:58:09.023361 run create_hlr_db(pid=31113): Launched 23:58:09.153316 bus /sierra_2: Setting Powered False 23:58:10.217925 run create_hlr_db(pid=31113): Terminated: ok {rc=0} 23:58:10.646629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31115): Launched 23:58:10.948654 run osmo-hlr_10.42.42.2(pid=31116): Launched 23:58:11.064028 run osmo-stp_10.42.42.5: Starting osmo-stp 23:58:11.596736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31118): Launched 23:58:11.899311 run osmo-stp_10.42.42.5(pid=31119): Launched 23:58:12.014150 run osmo-msc_10.42.42.6: Starting osmo-msc 23:58:12.558979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31121): Launched 23:58:12.861096 run osmo-msc_10.42.42.6(pid=31122): Launched 23:58:13.030874 run osmo-stp_10.42.42.5(pid=31119): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31119)] 23:58:13.159610 run osmo-stp_10.42.42.5(pid=31119): stdout: | (launched: 2022-12-08_23:58:11.844323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:13.288498 run osmo-stp_10.42.42.5(pid=31119): stderr: | [0;m[38;5;43m20221208235812014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235812014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235812015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235812015 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235812016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235812016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235812016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:13.414718 run osmo-stp_10.42.42.5(pid=31119): stdout: | (launched: 2022-12-08_23:58:11.844323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:13.535217 run osmo-stp_10.42.42.5(pid=31119): stderr: | [0;m[38;5;43m20221208235812014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235812014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235812015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235812015 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235812016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235812016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235812016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:13.679256 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31119): Process ended prematurely: osmo-stp_10.42.42.5(pid=31119) [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31119)] [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 23:58:13.688330 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:58:13.714641 run osmo-hlr_10.42.42.2(pid=31116): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31116)] 23:58:13.762701 run osmo-hlr_10.42.42.2(pid=31116): stdout: | (launched: 2022-12-08_23:58:10.893331) 23:58:13.812708 run osmo-hlr_10.42.42.2(pid=31116): stderr: | [0;m[1;31m20221208235811068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235811068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235811068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235811068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235811068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235811068 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235811080 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235811089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235811089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235811089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:58:13.881322 run osmo-msc_10.42.42.6(pid=31122): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31122)] 23:58:13.928606 run osmo-msc_10.42.42.6(pid=31122): stdout: | (launched: 2022-12-08_23:58:12.805747) 23:58:13.977769 run osmo-msc_10.42.42.6(pid=31122): stderr: | [0;m[38;5;43m20221208235813076 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235813077 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5305433c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235813077 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235813077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235813077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235813077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235813079 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235813079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235813079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235813080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:58:14.026926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31115): Terminating (SIGTERM) 23:58:14.066478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31118): Terminating (SIGTERM) 23:58:14.106561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31121): Terminating (SIGTERM) 23:58:14.146287 --- ParallelTerminationStrategy: PID 31115 died... 23:58:14.165138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31115): Terminated: ok {rc=0} 23:58:14.208640 --- ParallelTerminationStrategy: PID 31118 died... 23:58:14.227699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31118): Terminated: ok {rc=0} 23:58:14.271909 --- ParallelTerminationStrategy: PID 31121 died... 23:58:14.290431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31121): Terminated: ok {rc=0} 23:58:14.375586 bus /sierra_3: Setting Powered False 23:58:15.473879 bus /sierra_3: Setting Powered False 23:58:16.589353 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 23:58:17.732794 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:58:17.744546 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:58:17.817034 tst mo_mt_call_osmux.py: using LAC 17652 23:58:17.935930 tst mo_mt_call_osmux.py: using RAC 57 23:58:18.053617 tst mo_mt_call_osmux.py: using CellId 17652 23:58:18.170499 tst mo_mt_call_osmux.py: using BVCI 17653 23:58:18.281708 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:58:18.293113 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:58:18.303783 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:58:18.315044 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:58:18.326239 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:58:18.336920 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:58:18.454543 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:58:18.569447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:58:19.038110 run create_hlr_db(pid=31124): Launched 23:58:19.153860 bus /sierra_2: Setting Powered False 23:58:20.214322 run create_hlr_db(pid=31124): Terminated: ok {rc=0} 23:58:20.654148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31126): Launched 23:58:20.977361 run osmo-hlr_10.42.42.2(pid=31127): Launched 23:58:21.099987 run osmo-stp_10.42.42.5: Starting osmo-stp 23:58:21.651732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31129): Launched 23:58:21.973511 run osmo-stp_10.42.42.5(pid=31130): Launched 23:58:22.096527 run osmo-msc_10.42.42.6: Starting osmo-msc 23:58:22.676569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31132): Launched 23:58:22.998525 run osmo-msc_10.42.42.6(pid=31133): Launched 23:58:23.178268 run osmo-stp_10.42.42.5(pid=31130): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31130)] 23:58:23.319597 run osmo-stp_10.42.42.5(pid=31130): stdout: | (launched: 2022-12-08_23:58:21.915199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:23.456352 run osmo-stp_10.42.42.5(pid=31130): stderr: | [0;m[38;5;43m20221208235822106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235822107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235822107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235822107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235822108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235822108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235822108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:23.590436 run osmo-stp_10.42.42.5(pid=31130): stdout: | (launched: 2022-12-08_23:58:21.915199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:23.718220 run osmo-stp_10.42.42.5(pid=31130): stderr: | [0;m[38;5;43m20221208235822106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235822107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235822107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235822107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235822108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235822108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235822108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:23.871332 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31130): Process ended prematurely: osmo-stp_10.42.42.5(pid=31130) [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31130)] [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 23:58:23.880752 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:58:23.908709 run osmo-hlr_10.42.42.2(pid=31127): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31127)] 23:58:23.958219 run osmo-hlr_10.42.42.2(pid=31127): stdout: | (launched: 2022-12-08_23:58:20.919209) 23:58:24.009406 run osmo-hlr_10.42.42.2(pid=31127): stderr: | [0;m[1;31m20221208235821116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235821116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235821116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235821116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235821116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235821116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235821128 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235821136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235821137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235821137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:58:24.080546 run osmo-msc_10.42.42.6(pid=31133): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31133)] 23:58:24.129975 run osmo-msc_10.42.42.6(pid=31133): stdout: | (launched: 2022-12-08_23:58:22.940169) 23:58:24.181241 run osmo-msc_10.42.42.6(pid=31133): stderr: | [0;m[38;5;43m20221208235823263 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235823264 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1be10f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235823264 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235823264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235823264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235823264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235823266 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235823266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235823266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235823267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:58:24.232705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31126): Terminating (SIGTERM) 23:58:24.274154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31129): Terminating (SIGTERM) 23:58:24.315833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31132): Terminating (SIGTERM) 23:58:24.357775 --- ParallelTerminationStrategy: PID 31126 died... 23:58:24.377789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31126): Terminated: ok {rc=0} 23:58:24.423461 --- ParallelTerminationStrategy: PID 31129 died... 23:58:24.442743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31129): Terminated: ok {rc=0} 23:58:24.488474 --- ParallelTerminationStrategy: PID 31132 died... 23:58:24.507779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31132): Terminated: ok {rc=0} 23:58:24.593697 bus /sierra_3: Setting Powered False 23:58:25.689878 bus /sierra_3: Setting Powered False 23:58:26.804555 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:58:28.065069 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:58:28.073584 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:58:28.107135 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:58:28.134190 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:58:28.184377 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:58:28.217686 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:58:28.244592 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:58:28.797484 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:58:28.849469 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:28.860630 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:58:28.930667 tst mo_mt_call.py: using LAC 17653 23:58:29.058328 tst mo_mt_call.py: using RAC 58 23:58:29.184412 tst mo_mt_call.py: using CellId 17653 23:58:29.308827 tst mo_mt_call.py: using BVCI 17654 23:58:29.425245 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:29.436543 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:29.447668 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:29.458818 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:29.470101 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:29.481290 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:58:29.600056 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:58:29.716016 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:58:30.213290 run create_hlr_db(pid=31138): Launched 23:58:30.344169 bus /sierra_2: Setting Powered False 23:58:31.410806 run create_hlr_db(pid=31138): Terminated: ok {rc=0} 23:58:31.866857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31140): Launched 23:58:32.204184 run osmo-hlr_10.42.42.2(pid=31141): Launched 23:58:32.328654 run osmo-stp_10.42.42.5: Starting osmo-stp 23:58:32.887638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31143): Launched 23:58:33.209667 run osmo-stp_10.42.42.5(pid=31144): Launched 23:58:33.331388 run osmo-msc_10.42.42.6: Starting osmo-msc 23:58:33.910781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31146): Launched 23:58:34.231069 run osmo-msc_10.42.42.6(pid=31147): Launched 23:58:34.409833 run osmo-stp_10.42.42.5(pid=31144): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31144)] 23:58:34.545127 run osmo-stp_10.42.42.5(pid=31144): stdout: | (launched: 2022-12-08_23:58:33.151302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:34.680453 run osmo-stp_10.42.42.5(pid=31144): stderr: | [0;m[38;5;43m20221208235833343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235833343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235833344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235833344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235833344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235833345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235833345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:34.815247 run osmo-stp_10.42.42.5(pid=31144): stdout: | (launched: 2022-12-08_23:58:33.151302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:34.943136 run osmo-stp_10.42.42.5(pid=31144): stderr: | [0;m[38;5;43m20221208235833343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235833343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235833344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235833344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235833344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235833345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235833345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:35.095447 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31144): Process ended prematurely: osmo-stp_10.42.42.5(pid=31144) [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31144)] [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:58:35.104860 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 23:58:35.132205 run osmo-hlr_10.42.42.2(pid=31141): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31141)] 23:58:35.181668 run osmo-hlr_10.42.42.2(pid=31141): stdout: | (launched: 2022-12-08_23:58:32.145785) 23:58:35.232816 run osmo-hlr_10.42.42.2(pid=31141): stderr: | [0;m[1;31m20221208235832345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235832345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235832345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235832345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235832345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235832345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235832357 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235832366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235832366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235832366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:58:35.303693 run osmo-msc_10.42.42.6(pid=31147): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31147)] 23:58:35.352775 run osmo-msc_10.42.42.6(pid=31147): stdout: | (launched: 2022-12-08_23:58:34.172771) 23:58:35.403779 run osmo-msc_10.42.42.6(pid=31147): stderr: | [0;m[38;5;43m20221208235834494 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235834495 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa3a8209c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235834495 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235834495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235834495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235834495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235834497 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235834497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235834497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235834498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:58:35.455197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31140): Terminating (SIGTERM) 23:58:35.495991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31143): Terminating (SIGTERM) 23:58:35.537087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31146): Terminating (SIGTERM) 23:58:35.578320 --- ParallelTerminationStrategy: PID 31140 died... 23:58:35.597857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31140): Terminated: ok {rc=0} 23:58:35.643103 --- ParallelTerminationStrategy: PID 31143 died... 23:58:35.662315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31143): Terminated: ok {rc=0} 23:58:35.707562 --- ParallelTerminationStrategy: PID 31146 died... 23:58:35.726802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31146): Terminated: ok {rc=0} 23:58:35.814146 bus /sierra_3: Setting Powered False 23:58:36.913854 bus /sierra_3: Setting Powered False 23:58:38.028673 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:58:39.176205 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:39.188182 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:58:39.264405 tst mo_mt_call_osmux.py: using LAC 17654 23:58:39.390539 tst mo_mt_call_osmux.py: using RAC 59 23:58:39.514816 tst mo_mt_call_osmux.py: using CellId 17654 23:58:39.633105 tst mo_mt_call_osmux.py: using BVCI 17655 23:58:39.743032 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:39.754110 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:39.765153 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:39.775964 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:39.787309 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:39.799101 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:58:39.919709 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:58:40.040656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:58:40.538538 run create_hlr_db(pid=31150): Launched 23:58:40.669426 bus /sierra_2: Setting Powered False 23:58:41.732560 run create_hlr_db(pid=31150): Terminated: ok {rc=0} 23:58:42.162843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31152): Launched 23:58:42.465312 run osmo-hlr_10.42.42.2(pid=31153): Launched 23:58:42.581952 run osmo-stp_10.42.42.5: Starting osmo-stp 23:58:43.108800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31155): Launched 23:58:43.430836 run osmo-stp_10.42.42.5(pid=31156): Launched 23:58:43.552476 run osmo-msc_10.42.42.6: Starting osmo-msc 23:58:44.133174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31158): Launched 23:58:44.453066 run osmo-msc_10.42.42.6(pid=31159): Launched 23:58:44.632016 run osmo-stp_10.42.42.5(pid=31156): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31156)] 23:58:44.766918 run osmo-stp_10.42.42.5(pid=31156): stdout: | (launched: 2022-12-08_23:58:43.372794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:44.903449 run osmo-stp_10.42.42.5(pid=31156): stderr: | [0;m[38;5;43m20221208235843564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235843564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235843564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235843565 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235843565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235843565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235843565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:45.038470 run osmo-stp_10.42.42.5(pid=31156): stdout: | (launched: 2022-12-08_23:58:43.372794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:45.165813 run osmo-stp_10.42.42.5(pid=31156): stderr: | [0;m[38;5;43m20221208235843564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235843564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235843564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235843565 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235843565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235843565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235843565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:45.318060 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31156): Process ended prematurely: osmo-stp_10.42.42.5(pid=31156) [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31156)] [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:58:45.327640 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:58:45.355080 run osmo-hlr_10.42.42.2(pid=31153): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31153)] 23:58:45.404420 run osmo-hlr_10.42.42.2(pid=31153): stdout: | (launched: 2022-12-08_23:58:42.410264) 23:58:45.455800 run osmo-hlr_10.42.42.2(pid=31153): stderr: | [0;m[1;31m20221208235842586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235842586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235842587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235842587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235842587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235842587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235842599 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235842608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235842608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235842608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:58:45.527346 run osmo-msc_10.42.42.6(pid=31159): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31159)] 23:58:45.576938 run osmo-msc_10.42.42.6(pid=31159): stdout: | (launched: 2022-12-08_23:58:44.395038) 23:58:45.628326 run osmo-msc_10.42.42.6(pid=31159): stderr: | [0;m[38;5;43m20221208235844719 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235844719 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5df8e56c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235844719 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235844719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235844719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235844720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235844721 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235844722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235844722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235844722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:58:45.679926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31152): Terminating (SIGTERM) 23:58:45.721006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31155): Terminating (SIGTERM) 23:58:45.762202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31158): Terminating (SIGTERM) 23:58:45.803964 --- ParallelTerminationStrategy: PID 31152 died... 23:58:45.823617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31152): Terminated: ok {rc=0} 23:58:45.869518 --- ParallelTerminationStrategy: PID 31155 died... 23:58:45.889198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31155): Terminated: ok {rc=0} 23:58:45.935736 --- ParallelTerminationStrategy: PID 31158 died... 23:58:45.955576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31158): Terminated: ok {rc=0} 23:58:46.043519 bus /sierra_3: Setting Powered False 23:58:47.149050 bus /sierra_3: Setting Powered False 23:58:48.280775 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:58:49.534649 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:58:49.542476 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:58:49.575383 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:58:49.601836 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:58:49.652594 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:58:49.684915 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:58:49.711447 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:58:50.263193 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:58:50.311530 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:50.322839 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:58:50.391666 tst mo_mt_call.py: using LAC 17655 23:58:50.509750 tst mo_mt_call.py: using RAC 60 23:58:50.636870 tst mo_mt_call.py: using CellId 17655 23:58:50.762537 tst mo_mt_call.py: using BVCI 17656 23:58:50.878583 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:50.890014 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:50.901244 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:50.912789 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:50.924156 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:50.935388 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:58:51.049835 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:58:51.167688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:58:51.665915 run create_hlr_db(pid=31165): Launched 23:58:51.797381 bus /sierra_2: Setting Powered False 23:58:52.861136 run create_hlr_db(pid=31165): Terminated: ok {rc=0} 23:58:53.292214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31167): Launched 23:58:53.596348 run osmo-hlr_10.42.42.2(pid=31168): Launched 23:58:53.712375 run osmo-stp_10.42.42.5: Starting osmo-stp 23:58:54.245139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31170): Launched 23:58:54.548170 run osmo-stp_10.42.42.5(pid=31171): Launched 23:58:54.663739 run osmo-msc_10.42.42.6: Starting osmo-msc 23:58:55.210603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31173): Launched 23:58:55.512672 run osmo-msc_10.42.42.6(pid=31174): Launched 23:58:55.681980 run osmo-stp_10.42.42.5(pid=31171): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31171)] 23:58:55.811552 run osmo-stp_10.42.42.5(pid=31171): stdout: | (launched: 2022-12-08_23:58:54.493132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:55.940478 run osmo-stp_10.42.42.5(pid=31171): stderr: | [0;m[38;5;43m20221208235854664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235854664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235854664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235854665 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235854665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235854665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235854665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:56.066178 run osmo-stp_10.42.42.5(pid=31171): stdout: | (launched: 2022-12-08_23:58:54.493132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:56.186107 run osmo-stp_10.42.42.5(pid=31171): stderr: | [0;m[38;5;43m20221208235854664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235854664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235854664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235854665 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235854665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235854665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235854665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:56.329939 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31171): Process ended prematurely: osmo-stp_10.42.42.5(pid=31171) [trial-2351↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31171)] [trial-2351↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:58:56.338834 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:58:56.365270 run osmo-hlr_10.42.42.2(pid=31168): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31168)] 23:58:56.412645 run osmo-hlr_10.42.42.2(pid=31168): stdout: | (launched: 2022-12-08_23:58:53.540773) 23:58:56.461503 run osmo-hlr_10.42.42.2(pid=31168): stderr: | [0;m[1;31m20221208235853719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235853719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235853719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235853719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235853719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235853719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235853731 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235853741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235853742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235853742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:58:56.529786 run osmo-msc_10.42.42.6(pid=31174): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31174)] 23:58:56.577321 run osmo-msc_10.42.42.6(pid=31174): stdout: | (launched: 2022-12-08_23:58:55.457674) 23:58:56.625991 run osmo-msc_10.42.42.6(pid=31174): stderr: | [0;m[38;5;43m20221208235855730 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235855730 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd6f4229c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235855730 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235855730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235855730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235855731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235855732 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235855733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235855733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235855733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:58:56.674688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31167): Terminating (SIGTERM) 23:58:56.713630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31170): Terminating (SIGTERM) 23:58:56.752687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31173): Terminating (SIGTERM) 23:58:56.792179 --- ParallelTerminationStrategy: PID 31167 died... 23:58:56.810850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31167): Terminated: ok {rc=0} 23:58:56.854603 --- ParallelTerminationStrategy: PID 31170 died... 23:58:56.872665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31170): Terminated: ok {rc=0} 23:58:56.916136 --- ParallelTerminationStrategy: PID 31173 died... 23:58:56.934401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31173): Terminated: ok {rc=0} 23:58:57.019804 bus /sierra_3: Setting Powered False 23:58:58.118975 bus /sierra_3: Setting Powered False 23:58:59.233055 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:59:00.377530 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:59:00.389169 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:59:00.456776 tst mo_mt_call_osmux.py: using LAC 17656 23:59:00.574476 tst mo_mt_call_osmux.py: using RAC 61 23:59:00.694279 tst mo_mt_call_osmux.py: using CellId 17656 23:59:00.817066 tst mo_mt_call_osmux.py: using BVCI 17657 23:59:00.967135 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:59:00.979505 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:59:00.991888 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:59:01.004500 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:59:01.017105 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:59:01.032526 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:59:01.155362 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:59:01.305059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:59:01.833915 run create_hlr_db(pid=31176): Launched 23:59:01.975550 bus /sierra_2: Setting Powered False 23:59:03.036706 run create_hlr_db(pid=31176): Terminated: ok {rc=0} 23:59:03.476282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31178): Launched 23:59:03.797250 run osmo-hlr_10.42.42.2(pid=31179): Launched 23:59:03.919857 run osmo-stp_10.42.42.5: Starting osmo-stp 23:59:04.472330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31181): Launched 23:59:04.792883 run osmo-stp_10.42.42.5(pid=31182): Launched 23:59:04.915233 run osmo-msc_10.42.42.6: Starting osmo-msc 23:59:05.501591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31184): Launched 23:59:05.823610 run osmo-msc_10.42.42.6(pid=31185): Launched 23:59:06.003699 run osmo-stp_10.42.42.5(pid=31182): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31182)] 23:59:06.139678 run osmo-stp_10.42.42.5(pid=31182): stdout: | (launched: 2022-12-08_23:59:04.734736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:06.276393 run osmo-stp_10.42.42.5(pid=31182): stderr: | [0;m[38;5;43m20221208235904926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235904926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235904926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235904927 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235904929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235904929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235904929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:06.411693 run osmo-stp_10.42.42.5(pid=31182): stdout: | (launched: 2022-12-08_23:59:04.734736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:06.539722 run osmo-stp_10.42.42.5(pid=31182): stderr: | [0;m[38;5;43m20221208235904926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235904926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235904926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235904927 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235904929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235904929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235904929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:06.693628 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31182): Process ended prematurely: osmo-stp_10.42.42.5(pid=31182) [trial-2351↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31182)] [trial-2351↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:59:06.703184 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 23:59:06.730942 run osmo-hlr_10.42.42.2(pid=31179): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31179)] 23:59:06.780481 run osmo-hlr_10.42.42.2(pid=31179): stdout: | (launched: 2022-12-08_23:59:03.739046) 23:59:06.831783 run osmo-hlr_10.42.42.2(pid=31179): stderr: | [0;m[1;31m20221208235903937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235903937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235903937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235903937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235903937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235903937 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235903949 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235903958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235903958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235903958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:59:06.903501 run osmo-msc_10.42.42.6(pid=31185): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31185)] 23:59:06.953315 run osmo-msc_10.42.42.6(pid=31185): stdout: | (launched: 2022-12-08_23:59:05.765306) 23:59:07.004728 run osmo-msc_10.42.42.6(pid=31185): stderr: | [0;m[38;5;43m20221208235906088 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235906088 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fea60f79c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235906088 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235906088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235906088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235906088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235906090 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235906090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235906091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235906091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:59:07.056196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31178): Terminating (SIGTERM) 23:59:07.097634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31181): Terminating (SIGTERM) 23:59:07.139290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31184): Terminating (SIGTERM) 23:59:07.181048 --- ParallelTerminationStrategy: PID 31178 died... 23:59:07.200764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31178): Terminated: ok {rc=0} 23:59:07.246351 --- ParallelTerminationStrategy: PID 31181 died... 23:59:07.265603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31181): Terminated: ok {rc=0} 23:59:07.310934 --- ParallelTerminationStrategy: PID 31184 died... 23:59:07.330349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31184): Terminated: ok {rc=0} 23:59:07.417485 bus /sierra_3: Setting Powered False 23:59:08.516133 bus /sierra_3: Setting Powered False 23:59:09.633937 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:59:10.880623 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:59:10.886506 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:59:10.919885 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 23:59:10.946015 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 23:59:10.996165 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:59:11.029061 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 23:59:11.054950 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 23:59:11.603145 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 23:59:11.653336 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:11.664162 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:59:11.733831 tst mo_mt_call.py: using LAC 17657 23:59:11.855151 tst mo_mt_call.py: using RAC 62 23:59:11.972714 tst mo_mt_call.py: using CellId 17657 23:59:12.091356 tst mo_mt_call.py: using BVCI 17658 23:59:12.202216 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:12.213212 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:12.223795 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:12.234815 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:12.245539 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:12.257373 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:59:12.375251 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:59:12.491683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:59:12.962912 run create_hlr_db(pid=31190): Launched 23:59:13.077947 bus /sierra_2: Setting Powered False 23:59:14.137879 run create_hlr_db(pid=31190): Terminated: ok {rc=0} 23:59:14.577165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31192): Launched 23:59:14.899942 run osmo-hlr_10.42.42.2(pid=31193): Launched 23:59:15.023754 run osmo-stp_10.42.42.5: Starting osmo-stp 23:59:15.579470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31195): Launched 23:59:15.939056 run osmo-stp_10.42.42.5(pid=31196): Launched 23:59:16.076093 run osmo-msc_10.42.42.6: Starting osmo-msc 23:59:16.816070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31198): Launched 23:59:17.147417 run osmo-msc_10.42.42.6(pid=31199): Launched 23:59:17.368197 run osmo-stp_10.42.42.5(pid=31196): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31196)] 23:59:17.498352 run osmo-stp_10.42.42.5(pid=31196): stdout: | (launched: 2022-12-08_23:59:15.854674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:17.628753 run osmo-stp_10.42.42.5(pid=31196): stderr: | [0;m[38;5;43m20221208235916207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235916207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235916208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235916208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235916208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235916213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235916213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:17.755418 run osmo-stp_10.42.42.5(pid=31196): stdout: | (launched: 2022-12-08_23:59:15.854674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:17.875936 run osmo-stp_10.42.42.5(pid=31196): stderr: | [0;m[38;5;43m20221208235916207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235916207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235916208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235916208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235916208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235916213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235916213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:18.020132 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31196): Process ended prematurely: osmo-stp_10.42.42.5(pid=31196) [trial-2351↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31196)] [trial-2351↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 23:59:18.029306 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 23:59:18.055511 run osmo-hlr_10.42.42.2(pid=31193): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31193)] 23:59:18.103520 run osmo-hlr_10.42.42.2(pid=31193): stdout: | (launched: 2022-12-08_23:59:14.841741) 23:59:18.153062 run osmo-hlr_10.42.42.2(pid=31193): stderr: | [0;m[1;31m20221208235915042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235915042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235915042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235915042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235915042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235915042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235915054 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235915062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235915062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235915062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:59:18.221806 run osmo-msc_10.42.42.6(pid=31199): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31199)] 23:59:18.269081 run osmo-msc_10.42.42.6(pid=31199): stdout: | (launched: 2022-12-08_23:59:17.082521) 23:59:18.318255 run osmo-msc_10.42.42.6(pid=31199): stderr: | [0;m[38;5;43m20221208235917425 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235917425 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5ee9311c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235917426 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235917426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235917426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235917426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235917428 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235917428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235917428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235917428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:59:18.367464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31192): Terminating (SIGTERM) 23:59:18.406614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31195): Terminating (SIGTERM) 23:59:18.446317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31198): Terminating (SIGTERM) 23:59:18.485961 --- ParallelTerminationStrategy: PID 31192 died... 23:59:18.505489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31192): Terminated: ok {rc=0} 23:59:18.549814 --- ParallelTerminationStrategy: PID 31195 died... 23:59:18.568227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31195): Terminated: ok {rc=0} 23:59:18.612578 --- ParallelTerminationStrategy: PID 31198 died... 23:59:18.631127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31198): Terminated: ok {rc=0} 23:59:18.716107 bus /sierra_3: Setting Powered False 23:59:19.814094 bus /sierra_3: Setting Powered False 23:59:20.928297 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 23:59:22.078205 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:22.090277 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:59:22.161896 tst mo_mt_call_osmux.py: using LAC 17658 23:59:22.292704 tst mo_mt_call_osmux.py: using RAC 63 23:59:22.421807 tst mo_mt_call_osmux.py: using CellId 17658 23:59:22.548347 tst mo_mt_call_osmux.py: using BVCI 17659 23:59:22.665101 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:22.676327 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:22.687349 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:22.698439 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:22.709597 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:59:22.720688 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:59:22.838997 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:59:22.957964 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:59:23.455132 run create_hlr_db(pid=31201): Launched 23:59:23.585336 bus /sierra_2: Setting Powered False 23:59:24.648754 run create_hlr_db(pid=31201): Terminated: ok {rc=0} 23:59:25.079579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31203): Launched 23:59:25.383313 run osmo-hlr_10.42.42.2(pid=31204): Launched 23:59:25.499219 run osmo-stp_10.42.42.5: Starting osmo-stp 23:59:26.032814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31206): Launched 23:59:26.334493 run osmo-stp_10.42.42.5(pid=31207): Launched 23:59:26.449510 run osmo-msc_10.42.42.6: Starting osmo-msc 23:59:26.996929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31209): Launched 23:59:27.300405 run osmo-msc_10.42.42.6(pid=31210): Launched 23:59:27.470542 run osmo-stp_10.42.42.5(pid=31207): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31207)] 23:59:27.600751 run osmo-stp_10.42.42.5(pid=31207): stdout: | (launched: 2022-12-08_23:59:26.279575) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:27.729966 run osmo-stp_10.42.42.5(pid=31207): stderr: | [0;m[38;5;43m20221208235926448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235926448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235926449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235926449 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235926450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235926450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235926450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:27.856167 run osmo-stp_10.42.42.5(pid=31207): stdout: | (launched: 2022-12-08_23:59:26.279575) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:27.976559 run osmo-stp_10.42.42.5(pid=31207): stderr: | [0;m[38;5;43m20221208235926448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235926448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235926449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235926449 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235926450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235926450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235926450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:28.120386 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31207): Process ended prematurely: osmo-stp_10.42.42.5(pid=31207) [trial-2351↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31207)] [trial-2351↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 23:59:28.129311 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:59:28.155747 run osmo-hlr_10.42.42.2(pid=31204): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31204)] 23:59:28.203141 run osmo-hlr_10.42.42.2(pid=31204): stdout: | (launched: 2022-12-08_23:59:25.328394) 23:59:28.251908 run osmo-hlr_10.42.42.2(pid=31204): stderr: | [0;m[1;31m20221208235925505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235925505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235925505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235925505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235925505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235925505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235925518 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235925527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235925527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235925527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:59:28.319776 run osmo-msc_10.42.42.6(pid=31210): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31210)] 23:59:28.367061 run osmo-msc_10.42.42.6(pid=31210): stdout: | (launched: 2022-12-08_23:59:27.245251) 23:59:28.415371 run osmo-msc_10.42.42.6(pid=31210): stderr: | [0;m[38;5;43m20221208235927519 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235927519 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbb7a0d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235927519 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235927519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235927519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235927519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235927521 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235927521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235927522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235927522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:59:28.465171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31203): Terminating (SIGTERM) 23:59:28.504367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31206): Terminating (SIGTERM) 23:59:28.543239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31209): Terminating (SIGTERM) 23:59:28.582885 --- ParallelTerminationStrategy: PID 31203 died... 23:59:28.601929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31203): Terminated: ok {rc=0} 23:59:28.645710 --- ParallelTerminationStrategy: PID 31206 died... 23:59:28.664008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31206): Terminated: ok {rc=0} 23:59:28.707269 --- ParallelTerminationStrategy: PID 31209 died... 23:59:28.726701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31209): Terminated: ok {rc=0} 23:59:28.811546 bus /sierra_3: Setting Powered False 23:59:29.909941 bus /sierra_3: Setting Powered False 23:59:31.033497 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 emergency:trx-lms --------------------------------------------------------------------- 23:59:32.280489 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:59:32.284773 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 23:59:32.318168 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 23:59:32.344184 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 23:59:32.426954 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 23:59:32.459319 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 23:59:32.486232 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 23:59:33.071896 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2351 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 23:59:33.078070 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:33.089274 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 23:59:33.138286 tst emergency_mo_mt_call.py: using LAC 17659 23:59:33.256607 tst emergency_mo_mt_call.py: using RAC 64 23:59:33.373384 tst emergency_mo_mt_call.py: using CellId 17659 23:59:33.491496 tst emergency_mo_mt_call.py: using BVCI 17660 23:59:33.600173 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:33.610758 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:33.621132 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:33.631596 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:33.642881 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:33.653320 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 23:59:33.771079 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 23:59:33.889779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:59:34.349209 run create_hlr_db(pid=31217): Launched 23:59:34.462381 bus /sierra_2: Setting Powered False 23:59:35.521288 run create_hlr_db(pid=31217): Terminated: ok {rc=0} 23:59:35.936368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31219): Launched 23:59:36.233456 run osmo-hlr_10.42.42.2(pid=31220): Launched 23:59:36.346859 run osmo-stp_10.42.42.5: Starting osmo-stp 23:59:36.870753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31222): Launched 23:59:37.167095 run osmo-stp_10.42.42.5(pid=31223): Launched 23:59:37.290597 tst emergency_mo_mt_call.py: using MSISDN 6917 23:59:37.441695 run osmo-msc_10.42.42.6: Starting osmo-msc 23:59:37.975027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31225): Launched 23:59:38.272171 run osmo-msc_10.42.42.6(pid=31226): Launched 23:59:38.439455 run osmo-stp_10.42.42.5(pid=31223): ERR: Terminated: ERROR {rc=1} [trial-2351↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31223)] 23:59:38.565993 run osmo-stp_10.42.42.5(pid=31223): stdout: | (launched: 2022-12-08_23:59:37.113021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:38.692879 run osmo-stp_10.42.42.5(pid=31223): stderr: | [0;m[38;5;43m20221208235937281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235937282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235937282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235937283 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235937283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235937284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235937284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:38.816783 run osmo-stp_10.42.42.5(pid=31223): stdout: | (launched: 2022-12-08_23:59:37.113021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:38.935750 run osmo-stp_10.42.42.5(pid=31223): stderr: | [0;m[38;5;43m20221208235937281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235937282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235937282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235937283 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235937283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235937284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235937284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:39.077719 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=31223): Process ended prematurely: osmo-stp_10.42.42.5(pid=31223) [trial-2351↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31223)] [trial-2351↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 23:59:39.086159 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 23:59:39.112132 run osmo-hlr_10.42.42.2(pid=31220): ERR: Terminated: ERROR {rc=237} [trial-2351↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31220)] 23:59:39.160111 run osmo-hlr_10.42.42.2(pid=31220): stdout: | (launched: 2022-12-08_23:59:36.179248) 23:59:39.209175 run osmo-hlr_10.42.42.2(pid=31220): stderr: | [0;m[1;31m20221208235936354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235936354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235936354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235936354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235936355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235936355 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235936367 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235936375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235936376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235936376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:59:39.277098 run osmo-msc_10.42.42.6(pid=31226): ERR: Terminated: ERROR {rc=2} [trial-2351↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31226)] 23:59:39.324122 run osmo-msc_10.42.42.6(pid=31226): stdout: | (launched: 2022-12-08_23:59:38.218045) 23:59:39.372848 run osmo-msc_10.42.42.6(pid=31226): stderr: | [0;m[38;5;43m20221208235938489 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235938489 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f66f36c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235938489 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235938489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235938490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235938490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235938491 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235938492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235938492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235938492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:59:39.421889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31219): Terminating (SIGTERM) 23:59:39.460612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31222): Terminating (SIGTERM) 23:59:39.499947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31225): Terminating (SIGTERM) 23:59:39.539617 --- ParallelTerminationStrategy: PID 31219 died... 23:59:39.558156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31219): Terminated: ok {rc=0} 23:59:39.602113 --- ParallelTerminationStrategy: PID 31222 died... 23:59:39.620159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31222): Terminated: ok {rc=0} 23:59:39.663269 --- ParallelTerminationStrategy: PID 31225 died... 23:59:39.681780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31225): Terminated: ok {rc=0} 23:59:39.764109 bus /sierra_3: Setting Powered False 23:59:40.861315 bus /sierra_3: Setting Powered False 23:59:41.974833 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 23:59:43.063794 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:43.074936 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 23:59:43.124787 tst emergency_preemptive_call.py: using LAC 17660 23:59:43.242219 tst emergency_preemptive_call.py: using RAC 65 23:59:43.363139 tst emergency_preemptive_call.py: using CellId 17660 23:59:43.486961 tst emergency_preemptive_call.py: using BVCI 17661 23:59:43.601334 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:43.612532 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:43.623601 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:43.634440 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:43.647177 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:43.658033 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 23:59:43.772004 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 23:59:43.886933 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 23:59:44.000506 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 23:59:44.113378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:59:44.573409 run create_hlr_db(pid=31228): Launched 23:59:44.687939 bus /sierra_2: Setting Powered False 23:59:45.747052 run create_hlr_db(pid=31228): Terminated: ok {rc=0} 23:59:46.207211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31230): Launched 23:59:46.551516 run osmo-hlr_10.42.42.2(pid=31231): Launched 23:59:46.700549 run osmo-stp_10.42.42.5: Starting osmo-stp 23:59:47.370384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31233): Launched 23:59:47.669410 run osmo-stp_10.42.42.5(pid=31234): Launched 23:59:47.791044 tst emergency_preemptive_call.py: using MSISDN 6918 23:59:47.957677 run osmo-msc_10.42.42.6: Starting osmo-msc 23:59:48.488794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31236): Launched 23:59:48.786862 run osmo-msc_10.42.42.6(pid=31237): Launched 23:59:48.952323 run osmo-stp_10.42.42.5(pid=31234): ERR: Terminated: ERROR {rc=1} [trial-2351↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31234)] 23:59:49.078880 run osmo-stp_10.42.42.5(pid=31234): stdout: | (launched: 2022-12-08_23:59:47.615004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:49.205357 run osmo-stp_10.42.42.5(pid=31234): stderr: | [0;m[38;5;43m20221208235947786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235947786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235947786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235947787 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235947787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235947787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235947788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:49.329176 run osmo-stp_10.42.42.5(pid=31234): stdout: | (launched: 2022-12-08_23:59:47.615004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:49.446807 run osmo-stp_10.42.42.5(pid=31234): stderr: | [0;m[38;5;43m20221208235947786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208235947786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208235947786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208235947787 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208235947787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208235947787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208235947788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:49.587889 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=31234): Process ended prematurely: osmo-stp_10.42.42.5(pid=31234) [trial-2351↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31234)] [trial-2351↪emergency:trx-lms↪emergency_preemptive_call.py:32] 23:59:49.596146 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 23:59:49.622418 run osmo-hlr_10.42.42.2(pid=31231): ERR: Terminated: ERROR {rc=237} [trial-2351↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31231)] 23:59:49.669919 run osmo-hlr_10.42.42.2(pid=31231): stdout: | (launched: 2022-12-08_23:59:46.485308) 23:59:49.718979 run osmo-hlr_10.42.42.2(pid=31231): stderr: | [0;m[1;31m20221208235946888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208235946888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208235946888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208235946888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208235946888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208235946888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208235946910 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208235946932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208235946933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208235946933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:59:49.787462 run osmo-msc_10.42.42.6(pid=31237): ERR: Terminated: ERROR {rc=2} [trial-2351↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31237)] 23:59:49.835271 run osmo-msc_10.42.42.6(pid=31237): stdout: | (launched: 2022-12-08_23:59:48.732229) 23:59:49.884907 run osmo-msc_10.42.42.6(pid=31237): stderr: | [0;m[38;5;43m20221208235949003 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208235949003 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe23af91c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208235949003 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208235949003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208235949003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208235949003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208235949005 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208235949006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208235949006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208235949006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:59:49.934983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31230): Terminating (SIGTERM) 23:59:49.974026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31233): Terminating (SIGTERM) 23:59:50.013634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31236): Terminating (SIGTERM) 23:59:50.053320 --- ParallelTerminationStrategy: PID 31230 died... 23:59:50.072497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31230): Terminated: ok {rc=0} 23:59:50.116199 --- ParallelTerminationStrategy: PID 31233 died... 23:59:50.134895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31233): Terminated: ok {rc=0} 23:59:50.178522 --- ParallelTerminationStrategy: PID 31236 died... 23:59:50.197300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31236): Terminated: ok {rc=0} 23:59:50.280724 bus /sierra_9: Setting Powered False 23:59:51.377294 bus /sierra_9: Setting Powered False 23:59:52.494349 bus /sierra_8: Setting Powered False 23:59:53.591127 bus /sierra_8: Setting Powered False 23:59:54.708824 bus /sierra_3: Setting Powered False 23:59:55.806750 bus /sierra_3: Setting Powered False 23:59:56.922428 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-lms --------------------------------------------------------------------- 23:59:58.199638 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:59:58.204130 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 23:59:58.237597 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 23:59:58.277199 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 23:59:58.364605 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 23:59:58.398011 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 23:59:58.437136 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 23:59:59.027470 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 23:59:59.079993 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:59.090877 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 23:59:59.139527 tst cs_paging_gprs_active.py: using LAC 17661 23:59:59.260682 tst cs_paging_gprs_active.py: using RAC 66 23:59:59.380433 tst cs_paging_gprs_active.py: using CellId 17661 23:59:59.501515 tst cs_paging_gprs_active.py: using BVCI 17662 23:59:59.611410 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:59.622076 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:59.632474 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:59.642716 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:59.653233 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:59.663894 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:59.674481 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:59.684876 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:59.695950 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 23:59:59.810336 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 23:59:59.924260 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:00:00.127516 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:00.431465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31242): Launched 00:00:00.696500 run iperf3-srv_10.42.42.10(pid=31243): Launched 00:00:00.810885 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:00:01.090429 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:01.434548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31251): Launched 00:00:01.741869 run iperf3-srv_10.42.42.10(pid=31252): Launched 00:00:01.920268 tst cs_paging_gprs_active.py:38: start network... 00:00:02.201056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:00:02.789694 run create_hlr_db(pid=31264): Launched 00:00:02.984636 bus /sierra_2: Setting Powered False 00:00:04.069215 run create_hlr_db(pid=31264): Terminated: ok {rc=0} 00:00:04.584774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31281): Launched 00:00:04.941729 run osmo-hlr_10.42.42.2(pid=31282): Launched 00:00:05.185728 run osmo-stp_10.42.42.5: Starting osmo-stp 00:00:05.890282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31291): Launched 00:00:06.303189 run osmo-stp_10.42.42.5(pid=31293): Launched 00:00:06.624597 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:00:07.301668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31303): Launched 00:00:07.434713 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:00:07.720549 run patchelf(pid=31304): Launched 00:00:07.914626 run osmo-stp_10.42.42.5(pid=31293): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31293)] 00:00:08.055337 run osmo-stp_10.42.42.5(pid=31293): stdout: | (launched: 2022-12-09_00:00:06.203749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:08.196750 run osmo-stp_10.42.42.5(pid=31293): stderr: | [0;m[38;5;43m20221209000006599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000006599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000006600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000006600 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000006600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000006600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000006605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:08.338680 run osmo-stp_10.42.42.5(pid=31293): stdout: | (launched: 2022-12-09_00:00:06.203749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:08.473612 run osmo-stp_10.42.42.5(pid=31293): stderr: | [0;m[38;5;43m20221209000006599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000006599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000006600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000006600 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000006600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000006600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000006605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:08.635507 run patchelf(pid=31304): Terminating (SIGINT) 00:00:08.821571 run patchelf(pid=31304): Terminated: ok {rc=0} 00:00:08.956015 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31293): Process ended prematurely: osmo-stp_10.42.42.5(pid=31293) [trial-2351↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31293)] [trial-2351↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 00:00:08.967662 tst cs_paging_gprs_active.py:38: Test FAILED (9.9 sec) 00:00:08.999655 run osmo-hlr_10.42.42.2(pid=31282): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31282)] 00:00:09.051616 run osmo-hlr_10.42.42.2(pid=31282): stdout: | (launched: 2022-12-09_00:00:04.867451) 00:00:09.105554 run osmo-hlr_10.42.42.2(pid=31282): stderr: | [0;m[1;31m20221209000005181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000005181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000005181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000005181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000005181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000005181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000005208 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000005217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000005217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000005217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:00:09.161684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31242): Terminating (SIGTERM) 00:00:09.206160 run iperf3-srv_10.42.42.10(pid=31243): Terminating (SIGTERM) 00:00:09.251811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31251): Terminating (SIGTERM) 00:00:09.297793 run iperf3-srv_10.42.42.10(pid=31252): Terminating (SIGTERM) 00:00:09.345971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31281): Terminating (SIGTERM) 00:00:09.390357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31291): Terminating (SIGTERM) 00:00:09.434901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31303): Terminating (SIGTERM) 00:00:09.481356 --- ParallelTerminationStrategy: PID 31242 died... 00:00:09.502958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31242): Terminated: ok {rc=0} 00:00:09.553258 --- ParallelTerminationStrategy: PID 31243 died... 00:00:09.574820 run iperf3-srv_10.42.42.10(pid=31243): Terminated {rc=256} 00:00:09.623613 --- ParallelTerminationStrategy: PID 31251 died... 00:00:09.644219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31251): Terminated: ok {rc=0} 00:00:09.694398 --- ParallelTerminationStrategy: PID 31252 died... 00:00:09.714537 run iperf3-srv_10.42.42.10(pid=31252): Terminated {rc=256} 00:00:09.764906 --- ParallelTerminationStrategy: PID 31281 died... 00:00:09.788110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31281): Terminated: ok {rc=0} 00:00:09.836425 --- ParallelTerminationStrategy: PID 31291 died... 00:00:09.856620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31291): Terminated: ok {rc=0} 00:00:09.905072 --- ParallelTerminationStrategy: PID 31303 died... 00:00:09.925202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31303): Terminated: ok {rc=0} 00:00:10.014884 bus /gobi_0: Setting Powered False 00:00:11.117205 bus /gobi_0: Setting Powered False 00:00:12.237254 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms iperf3.py ---------------------------------------------- 00:00:13.387712 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:13.399984 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 00:00:13.450344 tst iperf3.py: using LAC 17662 00:00:13.571766 tst iperf3.py: using RAC 67 00:00:13.696325 tst iperf3.py: using CellId 17662 00:00:13.817092 tst iperf3.py: using BVCI 17663 00:00:13.930146 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:13.941129 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:13.951766 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:13.963045 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:13.974037 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:13.984762 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:13.995605 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:14.006745 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:14.017549 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 00:00:14.135114 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:00:14.344484 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:14.661782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31310): Launched 00:00:14.950981 run iperf3-srv_10.42.42.10(pid=31311): Launched 00:00:15.067583 tst iperf3.py:8: start network... 00:00:15.277105 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:00:15.771754 run create_hlr_db(pid=31313): Launched 00:00:15.940653 bus /gobi_6: Setting Powered False 00:00:17.037120 run create_hlr_db(pid=31313): Terminated: ok {rc=0} 00:00:17.589521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31316): Launched 00:00:17.953002 run osmo-hlr_10.42.42.2(pid=31317): Launched 00:00:18.198368 run osmo-stp_10.42.42.5: Starting osmo-stp 00:00:18.865260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31319): Launched 00:00:19.208857 run osmo-stp_10.42.42.5(pid=31320): Launched 00:00:19.457346 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:00:20.100209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31322): Launched 00:00:20.236125 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:00:20.518990 run patchelf(pid=31323): Launched 00:00:20.717072 run osmo-stp_10.42.42.5(pid=31320): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31320)] 00:00:20.857134 run osmo-stp_10.42.42.5(pid=31320): stdout: | (launched: 2022-12-09_00:00:19.143801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:20.999496 run osmo-stp_10.42.42.5(pid=31320): stderr: | [0;m[38;5;43m20221209000019448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000019448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000019448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000019449 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000019449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000019449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000019449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:21.140578 run osmo-stp_10.42.42.5(pid=31320): stdout: | (launched: 2022-12-09_00:00:19.143801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:21.274978 run osmo-stp_10.42.42.5(pid=31320): stderr: | [0;m[38;5;43m20221209000019448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000019448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000019448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000019449 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000019449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000019449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000019449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:21.441248 run patchelf(pid=31323): Terminating (SIGINT) 00:00:21.623335 run patchelf(pid=31323): Terminated: ok {rc=0} 00:00:21.754024 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31320): Process ended prematurely: osmo-stp_10.42.42.5(pid=31320) [trial-2351↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31320)] [trial-2351↪gprs:trx-lms↪iperf3.py:8] 00:00:21.764245 tst iperf3.py:8: Test FAILED (8.4 sec) 00:00:21.793378 run osmo-hlr_10.42.42.2(pid=31317): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31317)] 00:00:21.843967 run osmo-hlr_10.42.42.2(pid=31317): stdout: | (launched: 2022-12-09_00:00:17.886585) 00:00:21.896158 run osmo-hlr_10.42.42.2(pid=31317): stderr: | [0;m[1;31m20221209000018191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000018191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000018191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000018191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000018191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000018191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000018214 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000018222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000018222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000018222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:00:21.948853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31310): Terminating (SIGTERM) 00:00:21.991139 run iperf3-srv_10.42.42.10(pid=31311): Terminating (SIGTERM) 00:00:22.033112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31316): Terminating (SIGTERM) 00:00:22.074811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31319): Terminating (SIGTERM) 00:00:22.117422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31322): Terminating (SIGTERM) 00:00:22.159425 --- ParallelTerminationStrategy: PID 31310 died... 00:00:22.179862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31310): Terminated: ok {rc=0} 00:00:22.226398 --- ParallelTerminationStrategy: PID 31311 died... 00:00:22.246220 run iperf3-srv_10.42.42.10(pid=31311): Terminated {rc=256} 00:00:22.292703 --- ParallelTerminationStrategy: PID 31316 died... 00:00:22.312331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31316): Terminated: ok {rc=0} 00:00:22.358890 --- ParallelTerminationStrategy: PID 31319 died... 00:00:22.378550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31319): Terminated: ok {rc=0} 00:00:22.424733 --- ParallelTerminationStrategy: PID 31322 died... 00:00:22.444628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31322): Terminated: ok {rc=0} 00:00:22.532783 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms iperf3m4.py ---------------------------------------------- 00:00:23.684076 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:23.695648 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 00:00:23.745597 tst iperf3m4.py: using LAC 17663 00:00:23.865176 tst iperf3m4.py: using RAC 68 00:00:23.983437 tst iperf3m4.py: using CellId 17663 00:00:24.102192 tst iperf3m4.py: using BVCI 17664 00:00:24.213194 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:24.223813 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:24.234329 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:24.244693 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:24.255181 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:24.265663 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:24.276285 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:24.286512 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:24.297046 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 00:00:24.412611 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 00:00:24.536817 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 00:00:24.655787 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 00:00:24.775032 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:00:24.993148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:25.315555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31329): Launched 00:00:25.596266 run iperf3-srv_10.42.42.10(pid=31330): Launched 00:00:25.717674 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:00:25.935377 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:26.259255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31331): Launched 00:00:26.538673 run iperf3-srv_10.42.42.10(pid=31332): Launched 00:00:26.659534 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:00:26.877075 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:27.200615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31333): Launched 00:00:27.480917 run iperf3-srv_10.42.42.10(pid=31334): Launched 00:00:27.602683 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:00:27.815507 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:28.118075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31335): Launched 00:00:28.381056 run iperf3-srv_10.42.42.10(pid=31336): Launched 00:00:28.494580 tst iperf3m4.py:8: start network... 00:00:28.697275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:00:29.164500 run create_hlr_db(pid=31337): Launched 00:00:29.287531 bus /gobi_6: Setting Powered False 00:00:30.347861 run create_hlr_db(pid=31337): Terminated: ok {rc=0} 00:00:30.767318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31339): Launched 00:00:31.118876 run osmo-hlr_10.42.42.2(pid=31340): Launched 00:00:31.357942 run osmo-stp_10.42.42.5: Starting osmo-stp 00:00:31.969773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31342): Launched 00:00:32.295741 run osmo-stp_10.42.42.5(pid=31343): Launched 00:00:32.514302 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:00:33.070941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31345): Launched 00:00:33.195262 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:00:33.467573 run patchelf(pid=31346): Launched 00:00:33.647229 run osmo-stp_10.42.42.5(pid=31343): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31343)] 00:00:33.784158 run osmo-stp_10.42.42.5(pid=31343): stdout: | (launched: 2022-12-09_00:00:32.225439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:33.922617 run osmo-stp_10.42.42.5(pid=31343): stderr: | [0;m[38;5;43m20221209000032440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000032440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000032440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000032441 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000032441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000032441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000032441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:34.061312 run osmo-stp_10.42.42.5(pid=31343): stdout: | (launched: 2022-12-09_00:00:32.225439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:34.193370 run osmo-stp_10.42.42.5(pid=31343): stderr: | [0;m[38;5;43m20221209000032440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000032440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000032440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000032441 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000032441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000032441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000032441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:34.349466 run patchelf(pid=31346): Terminating (SIGINT) 00:00:34.529254 run patchelf(pid=31346): Terminated: ok {rc=0} 00:00:34.659343 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31343): Process ended prematurely: osmo-stp_10.42.42.5(pid=31343) [trial-2351↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31343)] [trial-2351↪gprs:trx-lms↪iperf3m4.py:8] 00:00:34.669404 tst iperf3m4.py:8: Test FAILED (11.0 sec) 00:00:34.698045 run osmo-hlr_10.42.42.2(pid=31340): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31340)] 00:00:34.749127 run osmo-hlr_10.42.42.2(pid=31340): stdout: | (launched: 2022-12-09_00:00:31.053931) 00:00:34.800770 run osmo-hlr_10.42.42.2(pid=31340): stderr: | [0;m[1;31m20221209000031266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000031266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000031267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000031267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000031267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000031267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000031279 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000031299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000031299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000031299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:00:34.852120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31329): Terminating (SIGTERM) 00:00:34.893897 run iperf3-srv_10.42.42.10(pid=31330): Terminating (SIGTERM) 00:00:34.935352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31331): Terminating (SIGTERM) 00:00:34.977683 run iperf3-srv_10.42.42.10(pid=31332): Terminating (SIGTERM) 00:00:35.019284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31333): Terminating (SIGTERM) 00:00:35.061058 run iperf3-srv_10.42.42.10(pid=31334): Terminating (SIGTERM) 00:00:35.102463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31335): Terminating (SIGTERM) 00:00:35.144494 run iperf3-srv_10.42.42.10(pid=31336): Terminating (SIGTERM) 00:00:35.185969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31339): Terminating (SIGTERM) 00:00:35.227365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31342): Terminating (SIGTERM) 00:00:35.269192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31345): Terminating (SIGTERM) 00:00:35.310701 --- ParallelTerminationStrategy: PID 31329 died... 00:00:35.330810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31329): Terminated: ok {rc=0} 00:00:35.377609 --- ParallelTerminationStrategy: PID 31330 died... 00:00:35.396904 run iperf3-srv_10.42.42.10(pid=31330): Terminated {rc=256} 00:00:35.443118 --- ParallelTerminationStrategy: PID 31331 died... 00:00:35.462676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31331): Terminated: ok {rc=0} 00:00:35.508814 --- ParallelTerminationStrategy: PID 31332 died... 00:00:35.528398 run iperf3-srv_10.42.42.10(pid=31332): Terminated {rc=256} 00:00:35.574418 --- ParallelTerminationStrategy: PID 31333 died... 00:00:35.593950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31333): Terminated: ok {rc=0} 00:00:35.640864 --- ParallelTerminationStrategy: PID 31334 died... 00:00:35.660336 run iperf3-srv_10.42.42.10(pid=31334): Terminated {rc=256} 00:00:35.706487 --- ParallelTerminationStrategy: PID 31335 died... 00:00:35.725987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31335): Terminated: ok {rc=0} 00:00:35.772486 --- ParallelTerminationStrategy: PID 31336 died... 00:00:35.791895 run iperf3-srv_10.42.42.10(pid=31336): Terminated {rc=256} 00:00:35.838221 --- ParallelTerminationStrategy: PID 31339 died... 00:00:35.857879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31339): Terminated: ok {rc=0} 00:00:35.904073 --- ParallelTerminationStrategy: PID 31342 died... 00:00:35.923670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31342): Terminated: ok {rc=0} 00:00:35.970178 --- ParallelTerminationStrategy: PID 31345 died... 00:00:35.990044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31345): Terminated: ok {rc=0} 00:00:36.077014 bus /gobi_4: Setting Powered False 00:00:37.175235 bus /gobi_4: Setting Powered False 00:00:38.289786 bus /gobi_1: Setting Powered False 00:00:39.383497 bus /gobi_1: Setting Powered False 00:00:40.497842 bus /gobi_0: Setting Powered False 00:00:41.592241 bus /gobi_0: Setting Powered False 00:00:42.705286 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms ping.py ---------------------------------------------- 00:00:43.807459 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:43.819068 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 00:00:43.870323 tst ping.py: using LAC 17664 00:00:43.994828 tst ping.py: using RAC 69 00:00:44.123370 tst ping.py: using CellId 17664 00:00:44.245931 tst ping.py: using BVCI 17665 00:00:44.360404 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:44.371352 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:44.382244 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:44.393026 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:44.404204 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:44.415648 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:44.427555 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:44.438622 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 00:00:44.553895 tst ping.py:19: start network... 00:00:44.751952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:00:45.209818 run create_hlr_db(pid=31347): Launched 00:00:45.330707 bus /gobi_6: Setting Powered False 00:00:46.388414 run create_hlr_db(pid=31347): Terminated: ok {rc=0} 00:00:46.823855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31349): Launched 00:00:47.134910 run osmo-hlr_10.42.42.2(pid=31350): Launched 00:00:47.246898 run osmo-stp_10.42.42.5: Starting osmo-stp 00:00:47.810876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31352): Launched 00:00:48.108585 run osmo-stp_10.42.42.5(pid=31353): Launched 00:00:48.221194 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:00:48.733693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31355): Launched 00:00:48.847519 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:00:49.098411 run patchelf(pid=31356): Launched 00:00:49.263808 run osmo-stp_10.42.42.5(pid=31353): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31353)] 00:00:49.389980 run osmo-stp_10.42.42.5(pid=31353): stdout: | (launched: 2022-12-09_00:00:48.053851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:49.519331 run osmo-stp_10.42.42.5(pid=31353): stderr: | [0;m[38;5;43m20221209000048225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000048225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000048226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000048226 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000048226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000048227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000048227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:49.647657 run osmo-stp_10.42.42.5(pid=31353): stdout: | (launched: 2022-12-09_00:00:48.053851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:49.769452 run osmo-stp_10.42.42.5(pid=31353): stderr: | [0;m[38;5;43m20221209000048225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000048225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000048226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000048226 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000048226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000048227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000048227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:49.914065 run patchelf(pid=31356): Terminating (SIGINT) 00:00:50.080515 run patchelf(pid=31356): Terminated: ok {rc=0} 00:00:50.200686 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31353): Process ended prematurely: osmo-stp_10.42.42.5(pid=31353) [trial-2351↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31353)] [trial-2351↪gprs:trx-lms↪ping.py:22] 00:00:50.209786 tst ping.py:22: Test FAILED (6.4 sec) 00:00:50.236197 run osmo-hlr_10.42.42.2(pid=31350): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31350)] 00:00:50.283028 run osmo-hlr_10.42.42.2(pid=31350): stdout: | (launched: 2022-12-09_00:00:47.071096) 00:00:50.331646 run osmo-hlr_10.42.42.2(pid=31350): stderr: | [0;m[1;31m20221209000047366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000047367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000047367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000047367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000047367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000047367 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000047379 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000047389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000047389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000047389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:00:50.380624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31349): Terminating (SIGTERM) 00:00:50.419627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31352): Terminating (SIGTERM) 00:00:50.458509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31355): Terminating (SIGTERM) 00:00:50.498021 --- ParallelTerminationStrategy: PID 31349 died... 00:00:50.516753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31349): Terminated: ok {rc=0} 00:00:50.560129 --- ParallelTerminationStrategy: PID 31352 died... 00:00:50.578641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31352): Terminated: ok {rc=0} 00:00:50.622309 --- ParallelTerminationStrategy: PID 31355 died... 00:00:50.640727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31355): Terminated: ok {rc=0} 00:00:50.725575 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 00:00:51.812312 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:51.823482 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 00:00:51.873310 tst ping_idle_ping.py: using LAC 17665 00:00:51.992177 tst ping_idle_ping.py: using RAC 70 00:00:52.118042 tst ping_idle_ping.py: using CellId 17665 00:00:52.240244 tst ping_idle_ping.py: using BVCI 17666 00:00:52.349570 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:52.360172 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:52.370946 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:52.381887 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:52.392266 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:52.403016 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:52.414679 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:52.425251 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 00:00:52.543204 tst ping_idle_ping.py:24: start network... 00:00:52.758018 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:00:53.250442 run create_hlr_db(pid=31357): Launched 00:00:53.372124 bus /gobi_6: Setting Powered False 00:00:54.435862 run create_hlr_db(pid=31357): Terminated: ok {rc=0} 00:00:54.863851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31359): Launched 00:00:55.164327 run osmo-hlr_10.42.42.2(pid=31360): Launched 00:00:55.278468 run osmo-stp_10.42.42.5: Starting osmo-stp 00:00:55.794668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31362): Launched 00:00:56.091949 run osmo-stp_10.42.42.5(pid=31363): Launched 00:00:56.205702 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:00:56.720194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31365): Launched 00:00:56.834676 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:00:57.085987 run patchelf(pid=31366): Launched 00:00:57.251639 run osmo-stp_10.42.42.5(pid=31363): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31363)] 00:00:57.377274 run osmo-stp_10.42.42.5(pid=31363): stdout: | (launched: 2022-12-09_00:00:56.037265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:57.505431 run osmo-stp_10.42.42.5(pid=31363): stderr: | [0;m[38;5;43m20221209000056207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000056207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000056207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000056208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000056210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000056210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000056210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:57.633452 run osmo-stp_10.42.42.5(pid=31363): stdout: | (launched: 2022-12-09_00:00:56.037265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:57.755145 run osmo-stp_10.42.42.5(pid=31363): stderr: | [0;m[38;5;43m20221209000056207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000056207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000056207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000056208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000056210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000056210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000056210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:57.898848 run patchelf(pid=31366): Terminating (SIGINT) 00:00:58.065478 run patchelf(pid=31366): Terminated: ok {rc=0} 00:00:58.185312 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31363): Process ended prematurely: osmo-stp_10.42.42.5(pid=31363) [trial-2351↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31363)] [trial-2351↪gprs:trx-lms↪ping_idle_ping.py:27] 00:00:58.194372 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 00:00:58.220504 run osmo-hlr_10.42.42.2(pid=31360): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31360)] 00:00:58.267386 run osmo-hlr_10.42.42.2(pid=31360): stdout: | (launched: 2022-12-09_00:00:55.109496) 00:00:58.315844 run osmo-hlr_10.42.42.2(pid=31360): stderr: | [0;m[1;31m20221209000055285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000055285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000055285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000055285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000055285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000055285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000055300 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000055311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000055311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000055311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:00:58.364682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31359): Terminating (SIGTERM) 00:00:58.403850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31362): Terminating (SIGTERM) 00:00:58.443176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31365): Terminating (SIGTERM) 00:00:58.482583 --- ParallelTerminationStrategy: PID 31359 died... 00:00:58.501448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31359): Terminated: ok {rc=0} 00:00:58.544885 --- ParallelTerminationStrategy: PID 31362 died... 00:00:58.563307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31362): Terminated: ok {rc=0} 00:00:58.606530 --- ParallelTerminationStrategy: PID 31365 died... 00:00:58.624840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31365): Terminated: ok {rc=0} 00:00:58.707706 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 00:00:59.997648 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:01:00.002816 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 00:01:00.034849 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 00:01:00.072585 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 00:01:00.157870 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 00:01:00.190207 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 00:01:00.228304 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 00:01:00.820102 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 00:01:00.870738 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:00.882915 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:01:00.945061 tst cs_paging_gprs_active.py: using LAC 17666 00:01:01.081619 tst cs_paging_gprs_active.py: using RAC 71 00:01:01.238480 tst cs_paging_gprs_active.py: using CellId 17666 00:01:01.386800 tst cs_paging_gprs_active.py: using BVCI 17667 00:01:01.543017 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:01.555165 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:01.566871 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:01.578441 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:01.589996 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:01.602282 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:01.614892 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:01.626833 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:01.638932 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:01:01.760216 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:01:01.880304 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:01:02.161863 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:02.485715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31370): Launched 00:01:02.751424 run iperf3-srv_10.42.42.10(pid=31371): Launched 00:01:02.865501 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:01:03.069490 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:03.374325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31372): Launched 00:01:03.639436 run iperf3-srv_10.42.42.10(pid=31373): Launched 00:01:03.753208 tst cs_paging_gprs_active.py:38: start network... 00:01:03.957898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:01:04.429025 run create_hlr_db(pid=31374): Launched 00:01:04.552119 bus /gobi_6: Setting Powered False 00:01:05.612552 run create_hlr_db(pid=31374): Terminated: ok {rc=0} 00:01:06.034479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31376): Launched 00:01:06.337383 run osmo-hlr_10.42.42.2(pid=31377): Launched 00:01:06.452169 run osmo-stp_10.42.42.5: Starting osmo-stp 00:01:06.977624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31379): Launched 00:01:07.281207 run osmo-stp_10.42.42.5(pid=31380): Launched 00:01:07.397782 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:01:07.923194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31382): Launched 00:01:08.039081 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:01:08.294908 run patchelf(pid=31383): Launched 00:01:08.464854 run osmo-stp_10.42.42.5(pid=31380): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31380)] 00:01:08.593596 run osmo-stp_10.42.42.5(pid=31380): stdout: | (launched: 2022-12-09_00:01:07.225592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:08.723536 run osmo-stp_10.42.42.5(pid=31380): stderr: | [0;m[38;5;43m20221209000107397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000107397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000107397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000107398 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000107398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000107398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000107398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:08.853212 run osmo-stp_10.42.42.5(pid=31380): stdout: | (launched: 2022-12-09_00:01:07.225592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:08.977912 run osmo-stp_10.42.42.5(pid=31380): stderr: | [0;m[38;5;43m20221209000107397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000107397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000107397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000107398 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000107398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000107398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000107398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:09.125416 run patchelf(pid=31383): Terminating (SIGINT) 00:01:09.295568 run patchelf(pid=31383): Terminated: ok {rc=0} 00:01:09.417949 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31380): Process ended prematurely: osmo-stp_10.42.42.5(pid=31380) [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31380)] [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 00:01:09.427394 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 00:01:09.453953 run osmo-hlr_10.42.42.2(pid=31377): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31377)] 00:01:09.500308 run osmo-hlr_10.42.42.2(pid=31377): stdout: | (launched: 2022-12-09_00:01:06.281663) 00:01:09.548434 run osmo-hlr_10.42.42.2(pid=31377): stderr: | [0;m[1;31m20221209000106460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000106460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000106460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000106460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000106460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000106460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000106472 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000106481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000106481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000106481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:01:09.597179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31370): Terminating (SIGTERM) 00:01:09.636440 run iperf3-srv_10.42.42.10(pid=31371): Terminating (SIGTERM) 00:01:09.675164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31372): Terminating (SIGTERM) 00:01:09.714075 run iperf3-srv_10.42.42.10(pid=31373): Terminating (SIGTERM) 00:01:09.752792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31376): Terminating (SIGTERM) 00:01:09.791536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31379): Terminating (SIGTERM) 00:01:09.830436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31382): Terminating (SIGTERM) 00:01:09.869500 --- ParallelTerminationStrategy: PID 31370 died... 00:01:09.888328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31370): Terminated: ok {rc=0} 00:01:09.931607 --- ParallelTerminationStrategy: PID 31371 died... 00:01:09.949698 run iperf3-srv_10.42.42.10(pid=31371): Terminated {rc=256} 00:01:09.992444 --- ParallelTerminationStrategy: PID 31372 died... 00:01:10.010845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31372): Terminated: ok {rc=0} 00:01:10.053770 --- ParallelTerminationStrategy: PID 31373 died... 00:01:10.071971 run iperf3-srv_10.42.42.10(pid=31373): Terminated {rc=256} 00:01:10.114821 --- ParallelTerminationStrategy: PID 31376 died... 00:01:10.133105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31376): Terminated: ok {rc=0} 00:01:10.176082 --- ParallelTerminationStrategy: PID 31379 died... 00:01:10.194322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31379): Terminated: ok {rc=0} 00:01:10.237170 --- ParallelTerminationStrategy: PID 31382 died... 00:01:10.255379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31382): Terminated: ok {rc=0} 00:01:10.336860 bus /gobi_0: Setting Powered False 00:01:11.430291 bus /gobi_0: Setting Powered False 00:01:12.544196 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 00:01:13.690133 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:13.701464 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:01:13.754979 tst iperf3.py: using LAC 17667 00:01:13.873387 tst iperf3.py: using RAC 72 00:01:13.993948 tst iperf3.py: using CellId 17667 00:01:14.111673 tst iperf3.py: using BVCI 17668 00:01:14.221722 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:14.232587 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:14.243388 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:14.254429 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:14.265367 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:14.275717 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:14.286718 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:14.297076 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:14.308028 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:01:14.423794 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:01:14.626171 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:14.929774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31384): Launched 00:01:15.193743 run iperf3-srv_10.42.42.10(pid=31385): Launched 00:01:15.307447 tst iperf3.py:8: start network... 00:01:15.510638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:01:16.000002 run create_hlr_db(pid=31386): Launched 00:01:16.161280 bus /gobi_6: Setting Powered False 00:01:17.220679 run create_hlr_db(pid=31386): Terminated: ok {rc=0} 00:01:17.648633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31388): Launched 00:01:17.954266 run osmo-hlr_10.42.42.2(pid=31389): Launched 00:01:18.070501 run osmo-stp_10.42.42.5: Starting osmo-stp 00:01:18.592061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31391): Launched 00:01:18.895211 run osmo-stp_10.42.42.5(pid=31392): Launched 00:01:19.010628 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:01:19.533127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31394): Launched 00:01:19.649898 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:01:19.906491 run patchelf(pid=31395): Launched 00:01:20.075401 run osmo-stp_10.42.42.5(pid=31392): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31392)] 00:01:20.203682 run osmo-stp_10.42.42.5(pid=31392): stdout: | (launched: 2022-12-09_00:01:18.839943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:20.334102 run osmo-stp_10.42.42.5(pid=31392): stderr: | [0;m[38;5;43m20221209000119012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000119012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000119013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000119013 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000119014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000119014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000119014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:20.464380 run osmo-stp_10.42.42.5(pid=31392): stdout: | (launched: 2022-12-09_00:01:18.839943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:20.588680 run osmo-stp_10.42.42.5(pid=31392): stderr: | [0;m[38;5;43m20221209000119012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000119012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000119013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000119013 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000119014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000119014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000119014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:20.735499 run patchelf(pid=31395): Terminating (SIGINT) 00:01:20.905305 run patchelf(pid=31395): Terminated: ok {rc=0} 00:01:21.028031 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31392): Process ended prematurely: osmo-stp_10.42.42.5(pid=31392) [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31392)] [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 00:01:21.037556 tst iperf3.py:8: Test FAILED (7.4 sec) 00:01:21.064414 run osmo-hlr_10.42.42.2(pid=31389): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31389)] 00:01:21.111736 run osmo-hlr_10.42.42.2(pid=31389): stdout: | (launched: 2022-12-09_00:01:17.898518) 00:01:21.160784 run osmo-hlr_10.42.42.2(pid=31389): stderr: | [0;m[1;31m20221209000118072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000118072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000118072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000118072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000118073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000118073 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000118097 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000118106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000118106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000118106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:01:21.210297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31384): Terminating (SIGTERM) 00:01:21.250151 run iperf3-srv_10.42.42.10(pid=31385): Terminating (SIGTERM) 00:01:21.289611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31388): Terminating (SIGTERM) 00:01:21.329150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31391): Terminating (SIGTERM) 00:01:21.368757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31394): Terminating (SIGTERM) 00:01:21.408534 --- ParallelTerminationStrategy: PID 31384 died... 00:01:21.427655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31384): Terminated: ok {rc=0} 00:01:21.471235 --- ParallelTerminationStrategy: PID 31385 died... 00:01:21.490027 run iperf3-srv_10.42.42.10(pid=31385): Terminated {rc=256} 00:01:21.533450 --- ParallelTerminationStrategy: PID 31388 died... 00:01:21.551908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31388): Terminated: ok {rc=0} 00:01:21.595398 --- ParallelTerminationStrategy: PID 31391 died... 00:01:21.613801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31391): Terminated: ok {rc=0} 00:01:21.657236 --- ParallelTerminationStrategy: PID 31394 died... 00:01:21.675714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31394): Terminated: ok {rc=0} 00:01:21.760855 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 00:01:22.907701 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:22.919117 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:01:22.969629 tst iperf3m4.py: using LAC 17668 00:01:23.091023 tst iperf3m4.py: using RAC 73 00:01:23.212361 tst iperf3m4.py: using CellId 17668 00:01:23.332527 tst iperf3m4.py: using BVCI 17669 00:01:23.444294 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:23.455055 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:23.465529 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:23.475873 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:23.486399 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:23.497599 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:23.508282 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:23.518881 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:23.530079 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:01:23.644668 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:01:23.765911 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:01:23.886324 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:01:24.004020 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:01:24.207642 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:24.513608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31396): Launched 00:01:24.777606 run iperf3-srv_10.42.42.10(pid=31397): Launched 00:01:24.891437 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:01:25.094744 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:25.398385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31398): Launched 00:01:25.662035 run iperf3-srv_10.42.42.10(pid=31399): Launched 00:01:25.776479 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:01:25.979588 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:26.284739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31400): Launched 00:01:26.549820 run iperf3-srv_10.42.42.10(pid=31401): Launched 00:01:26.663505 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:01:26.866488 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:27.170359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31402): Launched 00:01:27.434106 run iperf3-srv_10.42.42.10(pid=31403): Launched 00:01:27.548022 tst iperf3m4.py:8: start network... 00:01:27.751178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:01:28.221938 run create_hlr_db(pid=31404): Launched 00:01:28.345509 bus /gobi_6: Setting Powered False 00:01:29.405682 run create_hlr_db(pid=31404): Terminated: ok {rc=0} 00:01:29.845690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31406): Launched 00:01:30.169923 run osmo-hlr_10.42.42.2(pid=31407): Launched 00:01:30.293283 run osmo-stp_10.42.42.5: Starting osmo-stp 00:01:30.873690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31409): Launched 00:01:31.207962 run osmo-stp_10.42.42.5(pid=31410): Launched 00:01:31.446353 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:01:32.153766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31412): Launched 00:01:32.281129 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:01:32.553675 run patchelf(pid=31413): Launched 00:01:32.732795 run osmo-stp_10.42.42.5(pid=31410): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31410)] 00:01:32.869351 run osmo-stp_10.42.42.5(pid=31410): stdout: | (launched: 2022-12-09_00:01:31.142717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:33.008233 run osmo-stp_10.42.42.5(pid=31410): stderr: | [0;m[38;5;43m20221209000131482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000131482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000131482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000131482 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000131483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000131483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000131483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:33.146863 run osmo-stp_10.42.42.5(pid=31410): stdout: | (launched: 2022-12-09_00:01:31.142717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:33.279045 run osmo-stp_10.42.42.5(pid=31410): stderr: | [0;m[38;5;43m20221209000131482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000131482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000131482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000131482 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000131483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000131483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000131483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:33.435552 run patchelf(pid=31413): Terminating (SIGINT) 00:01:33.615876 run patchelf(pid=31413): Terminated: ok {rc=0} 00:01:33.746189 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31410): Process ended prematurely: osmo-stp_10.42.42.5(pid=31410) [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31410)] [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 00:01:33.756225 tst iperf3m4.py:8: Test FAILED (10.9 sec) 00:01:33.785383 run osmo-hlr_10.42.42.2(pid=31407): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31407)] 00:01:33.836137 run osmo-hlr_10.42.42.2(pid=31407): stdout: | (launched: 2022-12-09_00:01:30.111265) 00:01:33.888097 run osmo-hlr_10.42.42.2(pid=31407): stderr: | [0;m[1;31m20221209000130311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000130311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000130311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000130311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000130311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000130311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000130323 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000130332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000130332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000130332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:01:33.939893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31396): Terminating (SIGTERM) 00:01:33.981972 run iperf3-srv_10.42.42.10(pid=31397): Terminating (SIGTERM) 00:01:34.024383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31398): Terminating (SIGTERM) 00:01:34.067279 run iperf3-srv_10.42.42.10(pid=31399): Terminating (SIGTERM) 00:01:34.110666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31400): Terminating (SIGTERM) 00:01:34.153846 run iperf3-srv_10.42.42.10(pid=31401): Terminating (SIGTERM) 00:01:34.193312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31402): Terminating (SIGTERM) 00:01:34.233294 run iperf3-srv_10.42.42.10(pid=31403): Terminating (SIGTERM) 00:01:34.272715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31406): Terminating (SIGTERM) 00:01:34.312209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31409): Terminating (SIGTERM) 00:01:34.351576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31412): Terminating (SIGTERM) 00:01:34.391142 --- ParallelTerminationStrategy: PID 31396 died... 00:01:34.409750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31396): Terminated: ok {rc=0} 00:01:34.453560 --- ParallelTerminationStrategy: PID 31397 died... 00:01:34.471884 run iperf3-srv_10.42.42.10(pid=31397): Terminated {rc=256} 00:01:34.515053 --- ParallelTerminationStrategy: PID 31398 died... 00:01:34.533551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31398): Terminated: ok {rc=0} 00:01:34.577483 --- ParallelTerminationStrategy: PID 31399 died... 00:01:34.595913 run iperf3-srv_10.42.42.10(pid=31399): Terminated {rc=256} 00:01:34.639354 --- ParallelTerminationStrategy: PID 31400 died... 00:01:34.657831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31400): Terminated: ok {rc=0} 00:01:34.701292 --- ParallelTerminationStrategy: PID 31401 died... 00:01:34.719644 run iperf3-srv_10.42.42.10(pid=31401): Terminated {rc=256} 00:01:34.763163 --- ParallelTerminationStrategy: PID 31402 died... 00:01:34.781756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31402): Terminated: ok {rc=0} 00:01:34.825422 --- ParallelTerminationStrategy: PID 31403 died... 00:01:34.844019 run iperf3-srv_10.42.42.10(pid=31403): Terminated {rc=256} 00:01:34.887298 --- ParallelTerminationStrategy: PID 31406 died... 00:01:34.905903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31406): Terminated: ok {rc=0} 00:01:34.949515 --- ParallelTerminationStrategy: PID 31409 died... 00:01:34.968447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31409): Terminated: ok {rc=0} 00:01:35.011937 --- ParallelTerminationStrategy: PID 31412 died... 00:01:35.030880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31412): Terminated: ok {rc=0} 00:01:35.115753 bus /gobi_4: Setting Powered False 00:01:36.216553 bus /gobi_4: Setting Powered False 00:01:37.331721 bus /gobi_1: Setting Powered False 00:01:38.430519 bus /gobi_1: Setting Powered False 00:01:39.544154 bus /gobi_0: Setting Powered False 00:01:40.643306 bus /gobi_0: Setting Powered False 00:01:41.759661 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 00:01:42.862201 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:42.873438 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:01:42.923456 tst ping.py: using LAC 17669 00:01:43.041844 tst ping.py: using RAC 74 00:01:43.167838 tst ping.py: using CellId 17669 00:01:43.293518 tst ping.py: using BVCI 17670 00:01:43.401752 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:43.412496 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:43.423077 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:43.433668 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:43.444086 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:43.454591 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:43.465176 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:43.475631 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:01:43.587758 tst ping.py:19: start network... 00:01:43.786219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:01:44.246699 run create_hlr_db(pid=31414): Launched 00:01:44.367465 bus /gobi_6: Setting Powered False 00:01:45.427539 run create_hlr_db(pid=31414): Terminated: ok {rc=0} 00:01:45.881312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31416): Launched 00:01:46.198357 run osmo-hlr_10.42.42.2(pid=31417): Launched 00:01:46.430172 run osmo-stp_10.42.42.5: Starting osmo-stp 00:01:47.110158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31419): Launched 00:01:47.443803 run osmo-stp_10.42.42.5(pid=31420): Launched 00:01:47.606357 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:01:48.154650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31422): Launched 00:01:48.276498 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:01:48.544333 run patchelf(pid=31423): Launched 00:01:48.721582 run osmo-stp_10.42.42.5(pid=31420): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31420)] 00:01:48.856386 run osmo-stp_10.42.42.5(pid=31420): stdout: | (launched: 2022-12-09_00:01:47.370921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:48.993278 run osmo-stp_10.42.42.5(pid=31420): stderr: | [0;m[38;5;43m20221209000147597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000147597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000147597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000147598 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000147598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000147598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000147598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:49.130374 run osmo-stp_10.42.42.5(pid=31420): stdout: | (launched: 2022-12-09_00:01:47.370921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:49.260827 run osmo-stp_10.42.42.5(pid=31420): stderr: | [0;m[38;5;43m20221209000147597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000147597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000147597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000147598 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000147598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000147598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000147598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:49.415390 run patchelf(pid=31423): Terminating (SIGINT) 00:01:49.593511 run patchelf(pid=31423): Terminated: ok {rc=0} 00:01:49.721551 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31420): Process ended prematurely: osmo-stp_10.42.42.5(pid=31420) [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31420)] [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 00:01:49.731185 tst ping.py:22: Test FAILED (6.9 sec) 00:01:49.759762 run osmo-hlr_10.42.42.2(pid=31417): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31417)] 00:01:49.810669 run osmo-hlr_10.42.42.2(pid=31417): stdout: | (launched: 2022-12-09_00:01:46.134636) 00:01:49.862981 run osmo-hlr_10.42.42.2(pid=31417): stderr: | [0;m[1;31m20221209000146411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000146411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000146411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000146411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000146411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000146411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000146426 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000146454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000146454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000146454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:01:49.915585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31416): Terminating (SIGTERM) 00:01:49.957653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31419): Terminating (SIGTERM) 00:01:50.000617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31422): Terminating (SIGTERM) 00:01:50.042918 --- ParallelTerminationStrategy: PID 31416 died... 00:01:50.063577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31416): Terminated: ok {rc=0} 00:01:50.110873 --- ParallelTerminationStrategy: PID 31419 died... 00:01:50.130571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31419): Terminated: ok {rc=0} 00:01:50.177054 --- ParallelTerminationStrategy: PID 31422 died... 00:01:50.197118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31422): Terminated: ok {rc=0} 00:01:50.286038 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 00:01:51.372701 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:51.384662 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:01:51.438333 tst ping_idle_ping.py: using LAC 17670 00:01:51.557125 tst ping_idle_ping.py: using RAC 75 00:01:51.675052 tst ping_idle_ping.py: using CellId 17670 00:01:51.792020 tst ping_idle_ping.py: using BVCI 17671 00:01:51.901515 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:51.912336 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:51.923030 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:51.933555 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:51.943912 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:51.954778 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:51.965570 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:51.976062 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:01:52.092632 tst ping_idle_ping.py:24: start network... 00:01:52.306927 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:01:52.799017 run create_hlr_db(pid=31424): Launched 00:01:52.921373 bus /gobi_6: Setting Powered False 00:01:53.984316 run create_hlr_db(pid=31424): Terminated: ok {rc=0} 00:01:54.412803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31426): Launched 00:01:54.711594 run osmo-hlr_10.42.42.2(pid=31427): Launched 00:01:54.825476 run osmo-stp_10.42.42.5: Starting osmo-stp 00:01:55.339150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31429): Launched 00:01:55.636760 run osmo-stp_10.42.42.5(pid=31430): Launched 00:01:55.749601 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:01:56.263718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31432): Launched 00:01:56.378497 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:01:56.629773 run patchelf(pid=31433): Launched 00:01:56.795803 run osmo-stp_10.42.42.5(pid=31430): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31430)] 00:01:56.921844 run osmo-stp_10.42.42.5(pid=31430): stdout: | (launched: 2022-12-09_00:01:55.582544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:57.049727 run osmo-stp_10.42.42.5(pid=31430): stderr: | [0;m[38;5;43m20221209000155752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000155753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000155753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000155753 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000155755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000155756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000155756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:57.177958 run osmo-stp_10.42.42.5(pid=31430): stdout: | (launched: 2022-12-09_00:01:55.582544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:57.299841 run osmo-stp_10.42.42.5(pid=31430): stderr: | [0;m[38;5;43m20221209000155752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000155753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000155753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000155753 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000155755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000155756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000155756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:57.443940 run patchelf(pid=31433): Terminating (SIGINT) 00:01:57.610458 run patchelf(pid=31433): Terminated: ok {rc=0} 00:01:57.730371 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31430): Process ended prematurely: osmo-stp_10.42.42.5(pid=31430) [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31430)] [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 00:01:57.739130 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 00:01:57.765998 run osmo-hlr_10.42.42.2(pid=31427): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31427)] 00:01:57.812872 run osmo-hlr_10.42.42.2(pid=31427): stdout: | (launched: 2022-12-09_00:01:54.657105) 00:01:57.861387 run osmo-hlr_10.42.42.2(pid=31427): stderr: | [0;m[1;31m20221209000154834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000154834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000154835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000154835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000154835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000154835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000154847 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000154856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000154856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000154856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:01:57.910289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31426): Terminating (SIGTERM) 00:01:57.949155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31429): Terminating (SIGTERM) 00:01:57.988228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31432): Terminating (SIGTERM) 00:01:58.028426 --- ParallelTerminationStrategy: PID 31426 died... 00:01:58.046925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31426): Terminated: ok {rc=0} 00:01:58.090682 --- ParallelTerminationStrategy: PID 31429 died... 00:01:58.109365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31429): Terminated: ok {rc=0} 00:01:58.152915 --- ParallelTerminationStrategy: PID 31432 died... 00:01:58.171372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31432): Terminated: ok {rc=0} 00:01:58.256595 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 00:01:59.557571 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:01:59.564089 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 00:01:59.598047 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 00:01:59.635878 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 00:01:59.722245 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 00:01:59.755001 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 00:01:59.792594 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 00:02:00.383774 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 00:02:00.432706 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:00.443486 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:02:00.515335 tst cs_paging_gprs_active.py: using LAC 17671 00:02:00.634016 tst cs_paging_gprs_active.py: using RAC 76 00:02:00.754024 tst cs_paging_gprs_active.py: using CellId 17671 00:02:00.892906 tst cs_paging_gprs_active.py: using BVCI 17672 00:02:01.016022 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:01.027969 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:01.039641 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:01.052246 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:01.064665 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:01.076432 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:01.089471 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:01.102018 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:01.114561 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:02:01.236436 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:02:01.382530 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:02:01.601064 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:01.925302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31437): Launched 00:02:02.224539 run iperf3-srv_10.42.42.10(pid=31438): Launched 00:02:02.361426 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:02:02.580295 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:02.904620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31439): Launched 00:02:03.185629 run iperf3-srv_10.42.42.10(pid=31440): Launched 00:02:03.306878 tst cs_paging_gprs_active.py:38: start network... 00:02:03.525125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:02:04.025189 run create_hlr_db(pid=31441): Launched 00:02:04.151918 bus /gobi_6: Setting Powered False 00:02:05.212868 run create_hlr_db(pid=31441): Terminated: ok {rc=0} 00:02:05.653096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31443): Launched 00:02:05.985493 run osmo-hlr_10.42.42.2(pid=31444): Launched 00:02:06.109462 run osmo-stp_10.42.42.5: Starting osmo-stp 00:02:06.632641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31446): Launched 00:02:06.935502 run osmo-stp_10.42.42.5(pid=31447): Launched 00:02:07.051294 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:02:07.574792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31449): Launched 00:02:07.690384 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:02:07.953496 run patchelf(pid=31450): Launched 00:02:08.123800 run osmo-stp_10.42.42.5(pid=31447): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31447)] 00:02:08.253089 run osmo-stp_10.42.42.5(pid=31447): stdout: | (launched: 2022-12-09_00:02:06.880533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:08.383538 run osmo-stp_10.42.42.5(pid=31447): stderr: | [0;m[38;5;43m20221209000207050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000207050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000207051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000207051 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000207051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000207052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000207052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:08.513175 run osmo-stp_10.42.42.5(pid=31447): stdout: | (launched: 2022-12-09_00:02:06.880533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:08.638022 run osmo-stp_10.42.42.5(pid=31447): stderr: | [0;m[38;5;43m20221209000207050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000207050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000207051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000207051 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000207051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000207052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000207052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:08.786335 run patchelf(pid=31450): Terminating (SIGINT) 00:02:08.957171 run patchelf(pid=31450): Terminated: ok {rc=0} 00:02:09.080322 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31447): Process ended prematurely: osmo-stp_10.42.42.5(pid=31447) [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31447)] [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 00:02:09.089858 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 00:02:09.116892 run osmo-hlr_10.42.42.2(pid=31444): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31444)] 00:02:09.163982 run osmo-hlr_10.42.42.2(pid=31444): stdout: | (launched: 2022-12-09_00:02:05.926894) 00:02:09.212645 run osmo-hlr_10.42.42.2(pid=31444): stderr: | [0;m[1;31m20221209000206124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000206124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000206124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000206124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000206124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000206124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000206137 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000206145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000206145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000206145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:02:09.261542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31437): Terminating (SIGTERM) 00:02:09.300686 run iperf3-srv_10.42.42.10(pid=31438): Terminating (SIGTERM) 00:02:09.340542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31439): Terminating (SIGTERM) 00:02:09.379823 run iperf3-srv_10.42.42.10(pid=31440): Terminating (SIGTERM) 00:02:09.418984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31443): Terminating (SIGTERM) 00:02:09.458248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31446): Terminating (SIGTERM) 00:02:09.497457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31449): Terminating (SIGTERM) 00:02:09.537212 --- ParallelTerminationStrategy: PID 31437 died... 00:02:09.556119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31437): Terminated: ok {rc=0} 00:02:09.599632 --- ParallelTerminationStrategy: PID 31438 died... 00:02:09.617830 run iperf3-srv_10.42.42.10(pid=31438): Terminated {rc=256} 00:02:09.660772 --- ParallelTerminationStrategy: PID 31439 died... 00:02:09.679160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31439): Terminated: ok {rc=0} 00:02:09.722394 --- ParallelTerminationStrategy: PID 31440 died... 00:02:09.740429 run iperf3-srv_10.42.42.10(pid=31440): Terminated {rc=256} 00:02:09.784088 --- ParallelTerminationStrategy: PID 31443 died... 00:02:09.802652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31443): Terminated: ok {rc=0} 00:02:09.846000 --- ParallelTerminationStrategy: PID 31446 died... 00:02:09.864347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31446): Terminated: ok {rc=0} 00:02:09.907800 --- ParallelTerminationStrategy: PID 31449 died... 00:02:09.926216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31449): Terminated: ok {rc=0} 00:02:10.008658 bus /gobi_0: Setting Powered False 00:02:11.105240 bus /gobi_0: Setting Powered False 00:02:12.219460 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 00:02:13.360369 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:13.372208 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:02:13.440812 tst iperf3.py: using LAC 17672 00:02:13.560388 tst iperf3.py: using RAC 77 00:02:13.688100 tst iperf3.py: using CellId 17672 00:02:13.815326 tst iperf3.py: using BVCI 17673 00:02:13.934751 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:13.946221 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:13.957655 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:13.969357 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:13.980736 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:13.992386 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:14.003621 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:14.015730 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:14.027004 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:02:14.149942 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:02:14.354356 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:14.658717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31451): Launched 00:02:14.923258 run iperf3-srv_10.42.42.10(pid=31452): Launched 00:02:15.038005 tst iperf3.py:8: start network... 00:02:15.242187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:02:15.712530 run create_hlr_db(pid=31453): Launched 00:02:15.847216 bus /gobi_6: Setting Powered False 00:02:16.909863 run create_hlr_db(pid=31453): Terminated: ok {rc=0} 00:02:17.355975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31455): Launched 00:02:17.659479 run osmo-hlr_10.42.42.2(pid=31456): Launched 00:02:17.774698 run osmo-stp_10.42.42.5: Starting osmo-stp 00:02:18.298787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31458): Launched 00:02:18.601910 run osmo-stp_10.42.42.5(pid=31459): Launched 00:02:18.716801 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:02:19.240047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31461): Launched 00:02:19.356678 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:02:19.612484 run patchelf(pid=31462): Launched 00:02:19.780856 run osmo-stp_10.42.42.5(pid=31459): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31459)] 00:02:19.908722 run osmo-stp_10.42.42.5(pid=31459): stdout: | (launched: 2022-12-09_00:02:18.546417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:20.038757 run osmo-stp_10.42.42.5(pid=31459): stderr: | [0;m[38;5;43m20221209000218718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000218718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000218718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000218719 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000218719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000218719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000218719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:20.169792 run osmo-stp_10.42.42.5(pid=31459): stdout: | (launched: 2022-12-09_00:02:18.546417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:20.294313 run osmo-stp_10.42.42.5(pid=31459): stderr: | [0;m[38;5;43m20221209000218718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000218718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000218718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000218719 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000218719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000218719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000218719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:20.440723 run patchelf(pid=31462): Terminating (SIGINT) 00:02:20.610183 run patchelf(pid=31462): Terminated: ok {rc=0} 00:02:20.732156 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31459): Process ended prematurely: osmo-stp_10.42.42.5(pid=31459) [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31459)] [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 00:02:20.741607 tst iperf3.py:8: Test FAILED (7.4 sec) 00:02:20.768363 run osmo-hlr_10.42.42.2(pid=31456): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31456)] 00:02:20.814916 run osmo-hlr_10.42.42.2(pid=31456): stdout: | (launched: 2022-12-09_00:02:17.604482) 00:02:20.863193 run osmo-hlr_10.42.42.2(pid=31456): stderr: | [0;m[1;31m20221209000217785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000217785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000217785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000217785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000217785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000217785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000217824 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000217835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000217835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000217835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:02:20.911816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31451): Terminating (SIGTERM) 00:02:20.950538 run iperf3-srv_10.42.42.10(pid=31452): Terminating (SIGTERM) 00:02:20.989284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31455): Terminating (SIGTERM) 00:02:21.027813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31458): Terminating (SIGTERM) 00:02:21.066377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31461): Terminating (SIGTERM) 00:02:21.105398 --- ParallelTerminationStrategy: PID 31451 died... 00:02:21.124049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31451): Terminated: ok {rc=0} 00:02:21.167104 --- ParallelTerminationStrategy: PID 31452 died... 00:02:21.185388 run iperf3-srv_10.42.42.10(pid=31452): Terminated {rc=256} 00:02:21.228179 --- ParallelTerminationStrategy: PID 31455 died... 00:02:21.246439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31455): Terminated: ok {rc=0} 00:02:21.289216 --- ParallelTerminationStrategy: PID 31458 died... 00:02:21.307494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31458): Terminated: ok {rc=0} 00:02:21.350782 --- ParallelTerminationStrategy: PID 31461 died... 00:02:21.369417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31461): Terminated: ok {rc=0} 00:02:21.453078 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 00:02:22.598898 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:22.610423 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:02:22.679722 tst iperf3m4.py: using LAC 17673 00:02:22.798602 tst iperf3m4.py: using RAC 78 00:02:22.919151 tst iperf3m4.py: using CellId 17673 00:02:23.045482 tst iperf3m4.py: using BVCI 17674 00:02:23.155747 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:23.166583 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:23.177168 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:23.187712 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:23.198261 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:23.208716 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:23.219962 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:23.230631 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:23.241608 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:02:23.357517 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:02:23.478772 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:02:23.595176 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:02:23.714409 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:02:23.922766 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:24.228211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31463): Launched 00:02:24.493687 run iperf3-srv_10.42.42.10(pid=31464): Launched 00:02:24.608085 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:02:24.811693 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:25.116015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31465): Launched 00:02:25.381386 run iperf3-srv_10.42.42.10(pid=31466): Launched 00:02:25.495277 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:02:25.698065 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:26.001702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31467): Launched 00:02:26.267176 run iperf3-srv_10.42.42.10(pid=31468): Launched 00:02:26.381168 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:02:26.584266 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:26.888858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31469): Launched 00:02:27.153884 run iperf3-srv_10.42.42.10(pid=31470): Launched 00:02:27.267778 tst iperf3m4.py:8: start network... 00:02:27.470444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:02:27.940372 run create_hlr_db(pid=31471): Launched 00:02:28.064398 bus /gobi_6: Setting Powered False 00:02:29.125232 run create_hlr_db(pid=31471): Terminated: ok {rc=0} 00:02:29.566127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31473): Launched 00:02:29.889081 run osmo-hlr_10.42.42.2(pid=31474): Launched 00:02:30.012267 run osmo-stp_10.42.42.5: Starting osmo-stp 00:02:30.568495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31476): Launched 00:02:30.915139 run osmo-stp_10.42.42.5(pid=31477): Launched 00:02:31.134436 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:02:31.723198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31479): Launched 00:02:31.860220 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:02:32.147579 run patchelf(pid=31480): Launched 00:02:32.375928 run osmo-stp_10.42.42.5(pid=31477): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31477)] 00:02:32.515644 run osmo-stp_10.42.42.5(pid=31477): stdout: | (launched: 2022-12-09_00:02:30.841150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:32.654439 run osmo-stp_10.42.42.5(pid=31477): stderr: | [0;m[38;5;43m20221209000231031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000231031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000231031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000231032 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000231032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000231032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000231032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:32.793381 run osmo-stp_10.42.42.5(pid=31477): stdout: | (launched: 2022-12-09_00:02:30.841150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:32.925605 run osmo-stp_10.42.42.5(pid=31477): stderr: | [0;m[38;5;43m20221209000231031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000231031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000231031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000231032 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000231032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000231032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000231032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:33.082930 run patchelf(pid=31480): Terminating (SIGINT) 00:02:33.263038 run patchelf(pid=31480): Terminated: ok {rc=0} 00:02:33.393275 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31477): Process ended prematurely: osmo-stp_10.42.42.5(pid=31477) [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31477)] [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 00:02:33.403697 tst iperf3m4.py:8: Test FAILED (10.8 sec) 00:02:33.432428 run osmo-hlr_10.42.42.2(pid=31474): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31474)] 00:02:33.483082 run osmo-hlr_10.42.42.2(pid=31474): stdout: | (launched: 2022-12-09_00:02:29.830294) 00:02:33.534914 run osmo-hlr_10.42.42.2(pid=31474): stderr: | [0;m[1;31m20221209000230028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000230028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000230028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000230028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000230028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000230028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000230041 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000230049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000230049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000230049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:02:33.587688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31463): Terminating (SIGTERM) 00:02:33.629706 run iperf3-srv_10.42.42.10(pid=31464): Terminating (SIGTERM) 00:02:33.672122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31465): Terminating (SIGTERM) 00:02:33.714321 run iperf3-srv_10.42.42.10(pid=31466): Terminating (SIGTERM) 00:02:33.756182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31467): Terminating (SIGTERM) 00:02:33.798823 run iperf3-srv_10.42.42.10(pid=31468): Terminating (SIGTERM) 00:02:33.840925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31469): Terminating (SIGTERM) 00:02:33.883077 run iperf3-srv_10.42.42.10(pid=31470): Terminating (SIGTERM) 00:02:33.924674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31473): Terminating (SIGTERM) 00:02:33.967159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31476): Terminating (SIGTERM) 00:02:34.009010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31479): Terminating (SIGTERM) 00:02:34.051746 --- ParallelTerminationStrategy: PID 31463 died... 00:02:34.072428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31463): Terminated: ok {rc=0} 00:02:34.119555 --- ParallelTerminationStrategy: PID 31464 died... 00:02:34.139336 run iperf3-srv_10.42.42.10(pid=31464): Terminated {rc=256} 00:02:34.185983 --- ParallelTerminationStrategy: PID 31465 died... 00:02:34.205676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31465): Terminated: ok {rc=0} 00:02:34.252570 --- ParallelTerminationStrategy: PID 31466 died... 00:02:34.272237 run iperf3-srv_10.42.42.10(pid=31466): Terminated {rc=256} 00:02:34.319053 --- ParallelTerminationStrategy: PID 31467 died... 00:02:34.338832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31467): Terminated: ok {rc=0} 00:02:34.385617 --- ParallelTerminationStrategy: PID 31468 died... 00:02:34.405661 run iperf3-srv_10.42.42.10(pid=31468): Terminated {rc=256} 00:02:34.452342 --- ParallelTerminationStrategy: PID 31469 died... 00:02:34.472180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31469): Terminated: ok {rc=0} 00:02:34.518618 --- ParallelTerminationStrategy: PID 31470 died... 00:02:34.538744 run iperf3-srv_10.42.42.10(pid=31470): Terminated {rc=256} 00:02:34.586205 --- ParallelTerminationStrategy: PID 31473 died... 00:02:34.605929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31473): Terminated: ok {rc=0} 00:02:34.652784 --- ParallelTerminationStrategy: PID 31476 died... 00:02:34.672885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31476): Terminated: ok {rc=0} 00:02:34.719670 --- ParallelTerminationStrategy: PID 31479 died... 00:02:34.739979 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31479): Terminated: ok {rc=0} 00:02:34.828217 bus /gobi_4: Setting Powered False 00:02:35.924867 bus /gobi_4: Setting Powered False 00:02:37.039776 bus /gobi_1: Setting Powered False 00:02:38.139186 bus /gobi_1: Setting Powered False 00:02:39.253967 bus /gobi_0: Setting Powered False 00:02:40.352331 bus /gobi_0: Setting Powered False 00:02:41.467969 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 00:02:42.569656 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:42.581539 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:02:42.653222 tst ping.py: using LAC 17674 00:02:42.776681 tst ping.py: using RAC 79 00:02:42.900296 tst ping.py: using CellId 17674 00:02:43.024144 tst ping.py: using BVCI 17675 00:02:43.140714 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:43.152080 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:43.163154 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:43.174612 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:43.185723 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:43.197512 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:43.208555 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:43.219957 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:02:43.335322 tst ping.py:19: start network... 00:02:43.534168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:02:43.995045 run create_hlr_db(pid=31482): Launched 00:02:44.116622 bus /gobi_6: Setting Powered False 00:02:45.176492 run create_hlr_db(pid=31482): Terminated: ok {rc=0} 00:02:45.609843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31484): Launched 00:02:45.950722 run osmo-hlr_10.42.42.2(pid=31485): Launched 00:02:46.120892 run osmo-stp_10.42.42.5: Starting osmo-stp 00:02:46.906087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31487): Launched 00:02:47.251686 run osmo-stp_10.42.42.5(pid=31488): Launched 00:02:47.444499 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:02:47.956157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31490): Launched 00:02:48.070454 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:02:48.321174 run patchelf(pid=31491): Launched 00:02:48.487508 run osmo-stp_10.42.42.5(pid=31488): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31488)] 00:02:48.614033 run osmo-stp_10.42.42.5(pid=31488): stdout: | (launched: 2022-12-09_00:02:47.178565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:48.742068 run osmo-stp_10.42.42.5(pid=31488): stderr: | [0;m[38;5;43m20221209000247398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000247398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000247398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000247398 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000247399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000247399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000247399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:48.870073 run osmo-stp_10.42.42.5(pid=31488): stdout: | (launched: 2022-12-09_00:02:47.178565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:48.992423 run osmo-stp_10.42.42.5(pid=31488): stderr: | [0;m[38;5;43m20221209000247398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000247398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000247398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000247398 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000247399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000247399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000247399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:49.137072 run patchelf(pid=31491): Terminating (SIGINT) 00:02:49.303286 run patchelf(pid=31491): Terminated: ok {rc=0} 00:02:49.423128 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31488): Process ended prematurely: osmo-stp_10.42.42.5(pid=31488) [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31488)] [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 00:02:49.431842 tst ping.py:22: Test FAILED (6.9 sec) 00:02:49.458302 run osmo-hlr_10.42.42.2(pid=31485): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31485)] 00:02:49.505662 run osmo-hlr_10.42.42.2(pid=31485): stdout: | (launched: 2022-12-09_00:02:45.875705) 00:02:49.554219 run osmo-hlr_10.42.42.2(pid=31485): stderr: | [0;m[1;31m20221209000246228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000246228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000246228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000246228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000246228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000246228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000246251 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000246267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000246267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000246267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:02:49.603473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31484): Terminating (SIGTERM) 00:02:49.642881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31487): Terminating (SIGTERM) 00:02:49.682288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31490): Terminating (SIGTERM) 00:02:49.721916 --- ParallelTerminationStrategy: PID 31484 died... 00:02:49.740699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31484): Terminated: ok {rc=0} 00:02:49.784840 --- ParallelTerminationStrategy: PID 31487 died... 00:02:49.803325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31487): Terminated: ok {rc=0} 00:02:49.846693 --- ParallelTerminationStrategy: PID 31490 died... 00:02:49.865240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31490): Terminated: ok {rc=0} 00:02:49.948136 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 00:02:51.034215 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:51.046632 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:02:51.119261 tst ping_idle_ping.py: using LAC 17675 00:02:51.242520 tst ping_idle_ping.py: using RAC 80 00:02:51.365368 tst ping_idle_ping.py: using CellId 17675 00:02:51.488804 tst ping_idle_ping.py: using BVCI 17676 00:02:51.604428 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:51.615750 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:51.626835 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:51.638678 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:51.649870 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:51.662396 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:51.674076 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:51.686460 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:02:51.805626 tst ping_idle_ping.py:24: start network... 00:02:52.020197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:02:52.515734 run create_hlr_db(pid=31492): Launched 00:02:52.637347 bus /gobi_6: Setting Powered False 00:02:53.700099 run create_hlr_db(pid=31492): Terminated: ok {rc=0} 00:02:54.127359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31494): Launched 00:02:54.429717 run osmo-hlr_10.42.42.2(pid=31495): Launched 00:02:54.552433 run osmo-stp_10.42.42.5: Starting osmo-stp 00:02:55.100507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31497): Launched 00:02:55.417513 run osmo-stp_10.42.42.5(pid=31498): Launched 00:02:55.539320 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:02:56.087904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31500): Launched 00:02:56.210529 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:02:56.479007 run patchelf(pid=31501): Launched 00:02:56.656429 run osmo-stp_10.42.42.5(pid=31498): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31498)] 00:02:56.791671 run osmo-stp_10.42.42.5(pid=31498): stdout: | (launched: 2022-12-09_00:02:55.360130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:56.929180 run osmo-stp_10.42.42.5(pid=31498): stderr: | [0;m[38;5;43m20221209000255551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000255551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000255551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000255552 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000255552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000255552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000255552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:57.066674 run osmo-stp_10.42.42.5(pid=31498): stdout: | (launched: 2022-12-09_00:02:55.360130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:57.197541 run osmo-stp_10.42.42.5(pid=31498): stderr: | [0;m[38;5;43m20221209000255551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000255551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000255551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000255552 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000255552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000255552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000255552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:57.352184 run patchelf(pid=31501): Terminating (SIGINT) 00:02:57.530593 run patchelf(pid=31501): Terminated: ok {rc=0} 00:02:57.659007 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31498): Process ended prematurely: osmo-stp_10.42.42.5(pid=31498) [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31498)] [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 00:02:57.668400 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 00:02:57.696675 run osmo-hlr_10.42.42.2(pid=31495): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31495)] 00:02:57.747221 run osmo-hlr_10.42.42.2(pid=31495): stdout: | (launched: 2022-12-09_00:02:54.371104) 00:02:57.799128 run osmo-hlr_10.42.42.2(pid=31495): stderr: | [0;m[1;31m20221209000254571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000254571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000254571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000254571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000254571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000254571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000254583 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000254591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000254591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000254592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:02:57.851620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31494): Terminating (SIGTERM) 00:02:57.894173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31497): Terminating (SIGTERM) 00:02:57.936076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31500): Terminating (SIGTERM) 00:02:57.978739 --- ParallelTerminationStrategy: PID 31494 died... 00:02:57.998696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31494): Terminated: ok {rc=0} 00:02:58.045914 --- ParallelTerminationStrategy: PID 31497 died... 00:02:58.065586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31497): Terminated: ok {rc=0} 00:02:58.112263 --- ParallelTerminationStrategy: PID 31500 died... 00:02:58.131959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31500): Terminated: ok {rc=0} 00:02:58.221666 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:02:59.523847 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:02:59.530439 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:02:59.564933 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 00:02:59.603925 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 00:02:59.691106 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:02:59.724232 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 00:02:59.763462 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 00:03:00.358726 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 00:03:00.410810 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:00.421987 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:03:00.492581 tst cs_paging_gprs_active.py: using LAC 17676 00:03:00.619156 tst cs_paging_gprs_active.py: using RAC 81 00:03:00.745229 tst cs_paging_gprs_active.py: using CellId 17676 00:03:00.874527 tst cs_paging_gprs_active.py: using BVCI 17677 00:03:01.005296 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:01.018924 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:01.031364 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:01.043419 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:01.056636 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:01.071546 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:01.086589 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:01.098514 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:01.111690 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:03:01.236385 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:03:01.359489 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:03:01.571757 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:03:01.935937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31506): Launched 00:03:02.225969 run iperf3-srv_10.42.42.10(pid=31507): Launched 00:03:02.355853 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:03:02.560636 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:03:02.865617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31508): Launched 00:03:03.129757 run iperf3-srv_10.42.42.10(pid=31509): Launched 00:03:03.242840 tst cs_paging_gprs_active.py:38: start network... 00:03:03.445585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:03:03.914931 run create_hlr_db(pid=31510): Launched 00:03:04.039440 bus /gobi_6: Setting Powered False 00:03:05.099705 run create_hlr_db(pid=31510): Terminated: ok {rc=0} 00:03:05.521541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31512): Launched 00:03:05.824202 run osmo-hlr_10.42.42.2(pid=31513): Launched 00:03:05.940039 run osmo-stp_10.42.42.5: Starting osmo-stp 00:03:06.469936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31515): Launched 00:03:06.774938 run osmo-stp_10.42.42.5(pid=31516): Launched 00:03:06.890367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:03:07.415044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31518): Launched 00:03:07.531692 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:03:07.788798 run patchelf(pid=31519): Launched 00:03:07.960101 run osmo-stp_10.42.42.5(pid=31516): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31516)] 00:03:08.089112 run osmo-stp_10.42.42.5(pid=31516): stdout: | (launched: 2022-12-09_00:03:06.719062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:08.218934 run osmo-stp_10.42.42.5(pid=31516): stderr: | [0;m[38;5;43m20221209000306890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000306890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000306890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000306891 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000306893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000306893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000306893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:08.349384 run osmo-stp_10.42.42.5(pid=31516): stdout: | (launched: 2022-12-09_00:03:06.719062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:08.474106 run osmo-stp_10.42.42.5(pid=31516): stderr: | [0;m[38;5;43m20221209000306890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000306890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000306890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000306891 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000306893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000306893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000306893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:08.622655 run patchelf(pid=31519): Terminating (SIGINT) 00:03:08.793218 run patchelf(pid=31519): Terminated: ok {rc=0} 00:03:08.915739 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31516): Process ended prematurely: osmo-stp_10.42.42.5(pid=31516) [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31516)] [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 00:03:08.925263 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 00:03:08.952085 run osmo-hlr_10.42.42.2(pid=31513): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31513)] 00:03:08.998675 run osmo-hlr_10.42.42.2(pid=31513): stdout: | (launched: 2022-12-09_00:03:05.768594) 00:03:09.047009 run osmo-hlr_10.42.42.2(pid=31513): stderr: | [0;m[1;31m20221209000305944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000305944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000305944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000305945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000305945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000305945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000305957 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000305966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000305966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000305966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:03:09.095958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31506): Terminating (SIGTERM) 00:03:09.134823 run iperf3-srv_10.42.42.10(pid=31507): Terminating (SIGTERM) 00:03:09.173473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31508): Terminating (SIGTERM) 00:03:09.212677 run iperf3-srv_10.42.42.10(pid=31509): Terminating (SIGTERM) 00:03:09.251494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31512): Terminating (SIGTERM) 00:03:09.290300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31515): Terminating (SIGTERM) 00:03:09.329015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31518): Terminating (SIGTERM) 00:03:09.367806 --- ParallelTerminationStrategy: PID 31506 died... 00:03:09.386513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31506): Terminated: ok {rc=0} 00:03:09.429537 --- ParallelTerminationStrategy: PID 31507 died... 00:03:09.447758 run iperf3-srv_10.42.42.10(pid=31507): Terminated {rc=256} 00:03:09.490845 --- ParallelTerminationStrategy: PID 31508 died... 00:03:09.509156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31508): Terminated: ok {rc=0} 00:03:09.552123 --- ParallelTerminationStrategy: PID 31509 died... 00:03:09.570448 run iperf3-srv_10.42.42.10(pid=31509): Terminated {rc=256} 00:03:09.613311 --- ParallelTerminationStrategy: PID 31512 died... 00:03:09.631702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31512): Terminated: ok {rc=0} 00:03:09.674608 --- ParallelTerminationStrategy: PID 31515 died... 00:03:09.692748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31515): Terminated: ok {rc=0} 00:03:09.736231 --- ParallelTerminationStrategy: PID 31518 died... 00:03:09.754759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31518): Terminated: ok {rc=0} 00:03:09.839479 bus /gobi_0: Setting Powered False 00:03:10.936698 bus /gobi_0: Setting Powered False 00:03:12.047580 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 00:03:13.187883 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:13.199270 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:03:13.268567 tst iperf3.py: using LAC 17677 00:03:13.389114 tst iperf3.py: using RAC 82 00:03:13.507917 tst iperf3.py: using CellId 17677 00:03:13.633406 tst iperf3.py: using BVCI 17678 00:03:13.743887 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:13.754748 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:13.765564 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:13.775896 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:13.786280 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:13.796697 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:13.807542 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:13.818183 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:13.828693 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:03:13.946700 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:03:14.166066 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:03:14.488515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31520): Launched 00:03:14.769271 run iperf3-srv_10.42.42.10(pid=31521): Launched 00:03:14.891411 tst iperf3.py:8: start network... 00:03:15.110292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:03:15.611304 run create_hlr_db(pid=31522): Launched 00:03:15.735696 bus /gobi_6: Setting Powered False 00:03:16.799314 run create_hlr_db(pid=31522): Terminated: ok {rc=0} 00:03:17.254220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31524): Launched 00:03:17.588259 run osmo-hlr_10.42.42.2(pid=31525): Launched 00:03:17.712342 run osmo-stp_10.42.42.5: Starting osmo-stp 00:03:18.272349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31527): Launched 00:03:18.594826 run osmo-stp_10.42.42.5(pid=31528): Launched 00:03:18.718647 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:03:19.277116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31530): Launched 00:03:19.401584 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:03:19.674038 run patchelf(pid=31531): Launched 00:03:19.853923 run osmo-stp_10.42.42.5(pid=31528): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31528)] 00:03:19.991115 run osmo-stp_10.42.42.5(pid=31528): stdout: | (launched: 2022-12-09_00:03:18.536128) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:20.130638 run osmo-stp_10.42.42.5(pid=31528): stderr: | [0;m[38;5;43m20221209000318729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000318730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000318730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000318730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000318731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000318731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000318731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:20.269643 run osmo-stp_10.42.42.5(pid=31528): stdout: | (launched: 2022-12-09_00:03:18.536128) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:20.401980 run osmo-stp_10.42.42.5(pid=31528): stderr: | [0;m[38;5;43m20221209000318729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000318730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000318730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000318730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000318731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000318731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000318731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:20.559062 run patchelf(pid=31531): Terminating (SIGINT) 00:03:20.740270 run patchelf(pid=31531): Terminated: ok {rc=0} 00:03:20.870657 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31528): Process ended prematurely: osmo-stp_10.42.42.5(pid=31528) [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31528)] [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 00:03:20.880691 tst iperf3.py:8: Test FAILED (7.7 sec) 00:03:20.909252 run osmo-hlr_10.42.42.2(pid=31525): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31525)] 00:03:20.959597 run osmo-hlr_10.42.42.2(pid=31525): stdout: | (launched: 2022-12-09_00:03:17.529470) 00:03:21.011095 run osmo-hlr_10.42.42.2(pid=31525): stderr: | [0;m[1;31m20221209000317726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000317726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000317726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000317726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000317726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000317726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000317742 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000317753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000317753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000317753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:03:21.063489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31520): Terminating (SIGTERM) 00:03:21.105431 run iperf3-srv_10.42.42.10(pid=31521): Terminating (SIGTERM) 00:03:21.146752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31524): Terminating (SIGTERM) 00:03:21.188752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31527): Terminating (SIGTERM) 00:03:21.230659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31530): Terminating (SIGTERM) 00:03:21.272360 --- ParallelTerminationStrategy: PID 31520 died... 00:03:21.292514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31520): Terminated: ok {rc=0} 00:03:21.338549 --- ParallelTerminationStrategy: PID 31521 died... 00:03:21.358186 run iperf3-srv_10.42.42.10(pid=31521): Terminated {rc=256} 00:03:21.403852 --- ParallelTerminationStrategy: PID 31524 died... 00:03:21.423560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31524): Terminated: ok {rc=0} 00:03:21.469662 --- ParallelTerminationStrategy: PID 31527 died... 00:03:21.489359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31527): Terminated: ok {rc=0} 00:03:21.535627 --- ParallelTerminationStrategy: PID 31530 died... 00:03:21.555141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31530): Terminated: ok {rc=0} 00:03:21.642528 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 00:03:22.794711 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:22.806641 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:03:22.878622 tst iperf3m4.py: using LAC 17678 00:03:23.005957 tst iperf3m4.py: using RAC 83 00:03:23.134396 tst iperf3m4.py: using CellId 17678 00:03:23.265146 tst iperf3m4.py: using BVCI 17679 00:03:23.383403 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:23.394769 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:23.405879 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:23.416831 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:23.428295 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:23.439661 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:23.451186 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:23.462163 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:23.473811 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:03:23.592478 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:03:23.714597 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:03:23.833534 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:03:23.954901 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:03:24.159948 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:03:24.464375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31532): Launched 00:03:24.731237 run iperf3-srv_10.42.42.10(pid=31533): Launched 00:03:24.845558 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:03:25.049629 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:03:25.356309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31534): Launched 00:03:25.622158 run iperf3-srv_10.42.42.10(pid=31535): Launched 00:03:25.736026 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:03:25.939797 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:03:26.245330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31536): Launched 00:03:26.509726 run iperf3-srv_10.42.42.10(pid=31537): Launched 00:03:26.623686 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:03:26.828232 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:03:27.134042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31538): Launched 00:03:27.399184 run iperf3-srv_10.42.42.10(pid=31539): Launched 00:03:27.513847 tst iperf3m4.py:8: start network... 00:03:27.717370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:03:28.189682 run create_hlr_db(pid=31540): Launched 00:03:28.314404 bus /gobi_6: Setting Powered False 00:03:29.375085 run create_hlr_db(pid=31540): Terminated: ok {rc=0} 00:03:29.816784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31542): Launched 00:03:30.141403 run osmo-hlr_10.42.42.2(pid=31543): Launched 00:03:30.265502 run osmo-stp_10.42.42.5: Starting osmo-stp 00:03:30.824520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31545): Launched 00:03:31.181707 run osmo-stp_10.42.42.5(pid=31546): Launched 00:03:31.324334 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:03:32.025712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31548): Launched 00:03:32.155845 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:03:32.415968 run patchelf(pid=31549): Launched 00:03:32.584905 run osmo-stp_10.42.42.5(pid=31546): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31546)] 00:03:32.713322 run osmo-stp_10.42.42.5(pid=31546): stdout: | (launched: 2022-12-09_00:03:31.107546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:32.844167 run osmo-stp_10.42.42.5(pid=31546): stderr: | [0;m[38;5;43m20221209000331456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000331456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000331456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000331457 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000331457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000331457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000331457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:32.974229 run osmo-stp_10.42.42.5(pid=31546): stdout: | (launched: 2022-12-09_00:03:31.107546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:33.098047 run osmo-stp_10.42.42.5(pid=31546): stderr: | [0;m[38;5;43m20221209000331456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000331456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000331456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000331457 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000331457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000331457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000331457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:33.244535 run patchelf(pid=31549): Terminating (SIGINT) 00:03:33.413989 run patchelf(pid=31549): Terminated: ok {rc=0} 00:03:33.536107 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31546): Process ended prematurely: osmo-stp_10.42.42.5(pid=31546) [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31546)] [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 00:03:33.545698 tst iperf3m4.py:8: Test FAILED (10.8 sec) 00:03:33.572541 run osmo-hlr_10.42.42.2(pid=31543): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31543)] 00:03:33.619512 run osmo-hlr_10.42.42.2(pid=31543): stdout: | (launched: 2022-12-09_00:03:30.082325) 00:03:33.668073 run osmo-hlr_10.42.42.2(pid=31543): stderr: | [0;m[1;31m20221209000330282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000330282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000330282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000330282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000330282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000330282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000330294 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000330302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000330302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000330302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:03:33.716684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31532): Terminating (SIGTERM) 00:03:33.755736 run iperf3-srv_10.42.42.10(pid=31533): Terminating (SIGTERM) 00:03:33.794673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31534): Terminating (SIGTERM) 00:03:33.833952 run iperf3-srv_10.42.42.10(pid=31535): Terminating (SIGTERM) 00:03:33.873448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31536): Terminating (SIGTERM) 00:03:33.912686 run iperf3-srv_10.42.42.10(pid=31537): Terminating (SIGTERM) 00:03:33.952228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31538): Terminating (SIGTERM) 00:03:33.991297 run iperf3-srv_10.42.42.10(pid=31539): Terminating (SIGTERM) 00:03:34.030198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31542): Terminating (SIGTERM) 00:03:34.069730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31545): Terminating (SIGTERM) 00:03:34.109214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31548): Terminating (SIGTERM) 00:03:34.148683 --- ParallelTerminationStrategy: PID 31532 died... 00:03:34.167694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31532): Terminated: ok {rc=0} 00:03:34.211148 --- ParallelTerminationStrategy: PID 31533 died... 00:03:34.229689 run iperf3-srv_10.42.42.10(pid=31533): Terminated {rc=256} 00:03:34.272567 --- ParallelTerminationStrategy: PID 31534 died... 00:03:34.291114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31534): Terminated: ok {rc=0} 00:03:34.334359 --- ParallelTerminationStrategy: PID 31535 died... 00:03:34.352820 run iperf3-srv_10.42.42.10(pid=31535): Terminated {rc=256} 00:03:34.396023 --- ParallelTerminationStrategy: PID 31536 died... 00:03:34.414527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31536): Terminated: ok {rc=0} 00:03:34.457734 --- ParallelTerminationStrategy: PID 31537 died... 00:03:34.476206 run iperf3-srv_10.42.42.10(pid=31537): Terminated {rc=256} 00:03:34.519996 --- ParallelTerminationStrategy: PID 31538 died... 00:03:34.538558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31538): Terminated: ok {rc=0} 00:03:34.581856 --- ParallelTerminationStrategy: PID 31539 died... 00:03:34.600092 run iperf3-srv_10.42.42.10(pid=31539): Terminated {rc=256} 00:03:34.643553 --- ParallelTerminationStrategy: PID 31542 died... 00:03:34.662149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31542): Terminated: ok {rc=0} 00:03:34.705489 --- ParallelTerminationStrategy: PID 31545 died... 00:03:34.724015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31545): Terminated: ok {rc=0} 00:03:34.767778 --- ParallelTerminationStrategy: PID 31548 died... 00:03:34.786569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31548): Terminated: ok {rc=0} 00:03:34.869222 bus /gobi_4: Setting Powered False 00:03:35.967095 bus /gobi_4: Setting Powered False 00:03:37.083996 bus /gobi_1: Setting Powered False 00:03:38.182603 bus /gobi_1: Setting Powered False 00:03:39.297197 bus /gobi_0: Setting Powered False 00:03:40.394006 bus /gobi_0: Setting Powered False 00:03:41.508785 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 00:03:42.607302 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:42.618650 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:03:42.688610 tst ping.py: using LAC 17679 00:03:42.805430 tst ping.py: using RAC 84 00:03:42.923044 tst ping.py: using CellId 17679 00:03:43.040175 tst ping.py: using BVCI 17680 00:03:43.149150 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:43.160023 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:43.170730 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:43.181412 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:43.191862 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:43.202463 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:43.213169 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:43.223774 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:03:43.339834 tst ping.py:19: start network... 00:03:43.555323 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:03:44.047447 run create_hlr_db(pid=31550): Launched 00:03:44.169755 bus /gobi_6: Setting Powered False 00:03:45.233506 run create_hlr_db(pid=31550): Terminated: ok {rc=0} 00:03:45.663655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31552): Launched 00:03:46.001690 run osmo-hlr_10.42.42.2(pid=31553): Launched 00:03:46.378899 run osmo-stp_10.42.42.5: Starting osmo-stp 00:03:47.003201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31555): Launched 00:03:47.405147 run osmo-stp_10.42.42.5(pid=31556): Launched 00:03:47.528927 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:03:48.082831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31558): Launched 00:03:48.206125 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:03:48.474590 run patchelf(pid=31559): Launched 00:03:48.651610 run osmo-stp_10.42.42.5(pid=31556): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31556)] 00:03:48.786642 run osmo-stp_10.42.42.5(pid=31556): stdout: | (launched: 2022-12-09_00:03:47.345421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:48.923413 run osmo-stp_10.42.42.5(pid=31556): stderr: | [0;m[38;5;43m20221209000347537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000347537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000347537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000347538 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000347538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000347538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000347538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:49.060666 run osmo-stp_10.42.42.5(pid=31556): stdout: | (launched: 2022-12-09_00:03:47.345421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:49.190898 run osmo-stp_10.42.42.5(pid=31556): stderr: | [0;m[38;5;43m20221209000347537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000347537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000347537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000347538 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000347538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000347538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000347538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:49.345376 run patchelf(pid=31559): Terminating (SIGINT) 00:03:49.523208 run patchelf(pid=31559): Terminated: ok {rc=0} 00:03:49.651628 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31556): Process ended prematurely: osmo-stp_10.42.42.5(pid=31556) [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31556)] [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 00:03:49.661166 tst ping.py:22: Test FAILED (7.0 sec) 00:03:49.689321 run osmo-hlr_10.42.42.2(pid=31553): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31553)] 00:03:49.739230 run osmo-hlr_10.42.42.2(pid=31553): stdout: | (launched: 2022-12-09_00:03:45.931946) 00:03:49.790544 run osmo-hlr_10.42.42.2(pid=31553): stderr: | [0;m[1;31m20221209000346288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000346288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000346288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000346288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000346288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000346288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000346311 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000346319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000346319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000346319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:03:49.842385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31552): Terminating (SIGTERM) 00:03:49.883699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31555): Terminating (SIGTERM) 00:03:49.925573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31558): Terminating (SIGTERM) 00:03:49.967342 --- ParallelTerminationStrategy: PID 31552 died... 00:03:49.987726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31552): Terminated: ok {rc=0} 00:03:50.034152 --- ParallelTerminationStrategy: PID 31555 died... 00:03:50.053670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31555): Terminated: ok {rc=0} 00:03:50.099949 --- ParallelTerminationStrategy: PID 31558 died... 00:03:50.119478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31558): Terminated: ok {rc=0} 00:03:50.206649 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 00:03:51.293484 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:51.309073 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:03:51.382051 tst ping_idle_ping.py: using LAC 17680 00:03:51.507394 tst ping_idle_ping.py: using RAC 85 00:03:51.634547 tst ping_idle_ping.py: using CellId 17680 00:03:51.758397 tst ping_idle_ping.py: using BVCI 17681 00:03:51.874010 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:51.885555 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:51.896542 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:51.907964 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:51.918963 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:51.930581 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:51.942041 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:51.953451 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:03:52.068359 tst ping_idle_ping.py:24: start network... 00:03:52.269522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:03:52.736604 run create_hlr_db(pid=31561): Launched 00:03:52.860037 bus /gobi_6: Setting Powered False 00:03:53.920757 run create_hlr_db(pid=31561): Terminated: ok {rc=0} 00:03:54.359520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31563): Launched 00:03:54.679269 run osmo-hlr_10.42.42.2(pid=31564): Launched 00:03:54.800803 run osmo-stp_10.42.42.5: Starting osmo-stp 00:03:55.349225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31566): Launched 00:03:55.667695 run osmo-stp_10.42.42.5(pid=31567): Launched 00:03:55.789340 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:03:56.339277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31569): Launched 00:03:56.461787 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:03:56.730640 run patchelf(pid=31570): Launched 00:03:56.907439 run osmo-stp_10.42.42.5(pid=31567): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31567)] 00:03:57.042655 run osmo-stp_10.42.42.5(pid=31567): stdout: | (launched: 2022-12-09_00:03:55.609503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:57.179755 run osmo-stp_10.42.42.5(pid=31567): stderr: | [0;m[38;5;43m20221209000355803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000355803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000355803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000355804 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000355804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000355804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000355804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:57.316334 run osmo-stp_10.42.42.5(pid=31567): stdout: | (launched: 2022-12-09_00:03:55.609503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:57.447124 run osmo-stp_10.42.42.5(pid=31567): stderr: | [0;m[38;5;43m20221209000355803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000355803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000355803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000355804 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000355804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000355804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000355804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:57.601992 run patchelf(pid=31570): Terminating (SIGINT) 00:03:57.779634 run patchelf(pid=31570): Terminated: ok {rc=0} 00:03:57.907815 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31567): Process ended prematurely: osmo-stp_10.42.42.5(pid=31567) [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31567)] [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 00:03:57.917386 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 00:03:57.945403 run osmo-hlr_10.42.42.2(pid=31564): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31564)] 00:03:57.995800 run osmo-hlr_10.42.42.2(pid=31564): stdout: | (launched: 2022-12-09_00:03:54.621408) 00:03:58.047704 run osmo-hlr_10.42.42.2(pid=31564): stderr: | [0;m[1;31m20221209000354820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000354820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000354820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000354820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000354820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000354820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000354832 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000354841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000354841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000354841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:03:58.099715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31563): Terminating (SIGTERM) 00:03:58.142277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31566): Terminating (SIGTERM) 00:03:58.184191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31569): Terminating (SIGTERM) 00:03:58.226657 --- ParallelTerminationStrategy: PID 31563 died... 00:03:58.246429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31563): Terminated: ok {rc=0} 00:03:58.293163 --- ParallelTerminationStrategy: PID 31566 died... 00:03:58.312758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31566): Terminated: ok {rc=0} 00:03:58.359548 --- ParallelTerminationStrategy: PID 31569 died... 00:03:58.379093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31569): Terminated: ok {rc=0} 00:03:58.465788 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:03:59.772377 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:03:59.779866 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:03:59.814621 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 00:03:59.849769 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:03:59.903245 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:03:59.936837 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 00:03:59.972060 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:04:00.533406 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2351 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 00:04:00.538913 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:04:00.552469 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:04:00.625209 tst switch_tch_pdch.py: using LAC 17681 00:04:00.749196 tst switch_tch_pdch.py: using RAC 86 00:04:00.888600 tst switch_tch_pdch.py: using CellId 17681 00:04:01.021377 tst switch_tch_pdch.py: using BVCI 17682 00:04:01.132684 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:04:01.144435 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:04:01.157146 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:04:01.168774 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:04:01.180814 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:04:01.192440 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:04:01.205324 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:04:01.216933 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:04:01.333931 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:04:01.462790 tst switch_tch_pdch.py:51: start network... 00:04:01.740940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:04:02.359239 run create_hlr_db(pid=31575): Launched 00:04:02.500177 bus /gobi_6: Setting Powered False 00:04:03.559126 run create_hlr_db(pid=31575): Terminated: ok {rc=0} 00:04:03.974924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31577): Launched 00:04:04.273631 run osmo-hlr_10.42.42.2(pid=31578): Launched 00:04:04.387930 run osmo-stp_10.42.42.5: Starting osmo-stp 00:04:04.899901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31580): Launched 00:04:05.197887 run osmo-stp_10.42.42.5(pid=31581): Launched 00:04:05.311231 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:04:05.826457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31583): Launched 00:04:05.940566 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:04:06.192020 run patchelf(pid=31584): Launched 00:04:06.358199 run osmo-stp_10.42.42.5(pid=31581): ERR: Terminated: ERROR {rc=1} [trial-2351↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31581)] 00:04:06.484116 run osmo-stp_10.42.42.5(pid=31581): stdout: | (launched: 2022-12-09_00:04:05.143715) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:06.612424 run osmo-stp_10.42.42.5(pid=31581): stderr: | [0;m[38;5;43m20221209000405312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000405312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000405312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000405313 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000405315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000405315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000405315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:06.740126 run osmo-stp_10.42.42.5(pid=31581): stdout: | (launched: 2022-12-09_00:04:05.143715) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:06.862428 run osmo-stp_10.42.42.5(pid=31581): stderr: | [0;m[38;5;43m20221209000405312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000405312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000405312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000405313 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000405315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000405315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000405315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:07.006720 run patchelf(pid=31584): Terminating (SIGINT) 00:04:07.174296 run patchelf(pid=31584): Terminated: ok {rc=0} 00:04:07.294494 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31581): Process ended prematurely: osmo-stp_10.42.42.5(pid=31581) [trial-2351↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31581)] [trial-2351↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 00:04:07.303348 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 00:04:07.329620 run osmo-hlr_10.42.42.2(pid=31578): ERR: Terminated: ERROR {rc=237} [trial-2351↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31578)] 00:04:07.376310 run osmo-hlr_10.42.42.2(pid=31578): stdout: | (launched: 2022-12-09_00:04:04.218969) 00:04:07.425132 run osmo-hlr_10.42.42.2(pid=31578): stderr: | [0;m[1;31m20221209000404393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000404393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000404393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000404393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000404394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000404394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000404406 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000404415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000404415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000404415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:04:07.474158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31577): Terminating (SIGTERM) 00:04:07.513202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31580): Terminating (SIGTERM) 00:04:07.552300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31583): Terminating (SIGTERM) 00:04:07.591675 --- ParallelTerminationStrategy: PID 31577 died... 00:04:07.610796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31577): Terminated: ok {rc=0} 00:04:07.654450 --- ParallelTerminationStrategy: PID 31580 died... 00:04:07.673000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31580): Terminated: ok {rc=0} 00:04:07.716404 --- ParallelTerminationStrategy: PID 31583 died... 00:04:07.734832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31583): Terminated: ok {rc=0} 00:04:07.816679 bus /gobi_0: Setting Powered False 00:04:08.913520 bus /gobi_0: Setting Powered False 00:04:10.028244 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 00:04:11.282894 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:04:11.289107 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 00:04:11.322483 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 00:04:11.358601 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 00:04:11.411717 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 00:04:11.445132 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 00:04:11.479946 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 00:04:12.036593 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2351 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 00:04:12.041935 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:04:12.053258 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 00:04:12.123693 tst switch_tch_pdch.py: using LAC 17682 00:04:12.249169 tst switch_tch_pdch.py: using RAC 87 00:04:12.373131 tst switch_tch_pdch.py: using CellId 17682 00:04:12.502196 tst switch_tch_pdch.py: using BVCI 17683 00:04:12.619242 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:04:12.630613 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:04:12.641685 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:04:12.652767 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:04:12.664336 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:04:12.675598 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:04:12.687145 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:04:12.698402 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:04:12.817507 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:04:12.935974 tst switch_tch_pdch.py:51: start network... 00:04:13.150859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:04:13.613575 run create_hlr_db(pid=31588): Launched 00:04:13.734650 bus /gobi_6: Setting Powered False 00:04:14.798574 run create_hlr_db(pid=31588): Terminated: ok {rc=0} 00:04:15.199761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31590): Launched 00:04:15.497667 run osmo-hlr_10.42.42.2(pid=31591): Launched 00:04:15.611567 run osmo-stp_10.42.42.5: Starting osmo-stp 00:04:16.138405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31593): Launched 00:04:16.493931 run osmo-stp_10.42.42.5(pid=31594): Launched 00:04:16.735496 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:04:17.386264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31596): Launched 00:04:17.508786 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:04:17.777132 run patchelf(pid=31597): Launched 00:04:17.953817 run osmo-stp_10.42.42.5(pid=31594): ERR: Terminated: ERROR {rc=1} [trial-2351↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31594)] 00:04:18.088570 run osmo-stp_10.42.42.5(pid=31594): stdout: | (launched: 2022-12-09_00:04:16.428712) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:18.225459 run osmo-stp_10.42.42.5(pid=31594): stderr: | [0;m[38;5;43m20221209000416725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000416725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000416725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000416726 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000416728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000416728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000416728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:18.362069 run osmo-stp_10.42.42.5(pid=31594): stdout: | (launched: 2022-12-09_00:04:16.428712) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:18.492415 run osmo-stp_10.42.42.5(pid=31594): stderr: | [0;m[38;5;43m20221209000416725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000416725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000416725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000416726 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000416728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000416728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000416728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:18.646602 run patchelf(pid=31597): Terminating (SIGINT) 00:04:18.824394 run patchelf(pid=31597): Terminated: ok {rc=0} 00:04:18.952761 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31594): Process ended prematurely: osmo-stp_10.42.42.5(pid=31594) [trial-2351↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31594)] [trial-2351↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 00:04:18.962379 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 00:04:18.989993 run osmo-hlr_10.42.42.2(pid=31591): ERR: Terminated: ERROR {rc=237} [trial-2351↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31591)] 00:04:19.039936 run osmo-hlr_10.42.42.2(pid=31591): stdout: | (launched: 2022-12-09_00:04:15.443014) 00:04:19.091749 run osmo-hlr_10.42.42.2(pid=31591): stderr: | [0;m[1;31m20221209000415622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000415622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000415622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000415622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000415622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000415622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000415635 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000415643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000415643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000415643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:04:19.144087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31590): Terminating (SIGTERM) 00:04:19.185918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31593): Terminating (SIGTERM) 00:04:19.227316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31596): Terminating (SIGTERM) 00:04:19.269166 --- ParallelTerminationStrategy: PID 31590 died... 00:04:19.288825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31590): Terminated: ok {rc=0} 00:04:19.335253 --- ParallelTerminationStrategy: PID 31593 died... 00:04:19.354661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31593): Terminated: ok {rc=0} 00:04:19.400800 --- ParallelTerminationStrategy: PID 31596 died... 00:04:19.420602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31596): Terminated: ok {rc=0} 00:04:19.508585 bus /gobi_0: Setting Powered False 00:04:20.606692 bus /gobi_0: Setting Powered False 00:04:21.721372 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 00:04:22.962260 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:04:22.966020 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 00:04:22.994479 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 00:04:23.001073 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 00:04:23.052241 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 00:04:23.082481 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 00:04:23.090071 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 00:04:23.625384 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 00:04:23.630162 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 00:04:23.640818 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:04:23.688482 tst mo_mt_sms.py: using LAC 17683 00:04:23.812625 tst mo_mt_sms.py: using RAC 88 00:04:23.934635 tst mo_mt_sms.py: using CellId 17683 00:04:24.057336 tst mo_mt_sms.py: using BVCI 17684 00:04:24.172527 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:04:24.287555 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:04:24.404089 tst mo_mt_sms.py:9: start nitb and bts... 00:04:24.619546 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:04:25.265735 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31601): Launched 00:04:25.582930 run osmo-nitb_10.42.42.2(pid=31602): Launched 00:04:25.758580 run osmo-nitb_10.42.42.2(pid=31602): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31602)] 00:04:25.901255 run osmo-nitb_10.42.42.2(pid=31602): stdout: | (launched: 2022-12-09_00:04:25.524907) 00:04:26.045444 run osmo-nitb_10.42.42.2(pid=31602): stderr: | (launched: 2022-12-09_00:04:25.572236) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:04:26.190310 run osmo-nitb_10.42.42.2(pid=31602): stdout: | (launched: 2022-12-09_00:04:25.524907) 00:04:26.328661 run osmo-nitb_10.42.42.2(pid=31602): stderr: | (launched: 2022-12-09_00:04:25.572236) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6f22fc268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31602): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31602) [trial-2351↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31602)] 00:04:26.702695 tst osmo-nitb_10.42.42.2(pid=31602): stdout: | (launched: 2022-12-09_00:04:25.524907) 00:04:26.831164 tst osmo-nitb_10.42.42.2(pid=31602): stderr: | (launched: 2022-12-09_00:04:25.572236) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:04:26.982546 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=31602): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31602) [trial-2351↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31602)] [trial-2351↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 00:04:26.991514 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 00:04:26.998718 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31601): Terminating (SIGTERM) 00:04:27.209538 --- ParallelTerminationStrategy: PID 31601 died... 00:04:27.231111 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31601): Terminated: ok {rc=0} 00:04:27.319057 bus /sierra_3: Setting Powered False 00:04:28.417225 bus /sierra_3: Setting Powered False 00:04:29.532864 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 00:04:30.725687 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:04:30.729944 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 00:04:30.759237 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:04:30.787352 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 00:04:30.857986 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 00:04:30.888275 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:04:30.916809 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 00:04:31.466182 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 00:04:31.473680 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:31.490384 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:04:31.546400 tst mo_mt_sms.py: using LAC 17684 00:04:31.700194 tst mo_mt_sms.py: using RAC 89 00:04:31.821807 tst mo_mt_sms.py: using CellId 17684 00:04:31.975786 tst mo_mt_sms.py: using BVCI 17685 00:04:32.094834 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:32.106888 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:32.118986 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:32.130981 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:32.143786 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:32.156369 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:04:32.272447 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:04:32.388018 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:04:32.849900 run create_hlr_db(pid=31606): Launched 00:04:32.971072 bus /sierra_2: Setting Powered False 00:04:34.030828 run create_hlr_db(pid=31606): Terminated: ok {rc=0} 00:04:34.466183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31608): Launched 00:04:34.784049 run osmo-hlr_10.42.42.2(pid=31609): Launched 00:04:34.904832 run osmo-stp_10.42.42.5: Starting osmo-stp 00:04:35.452466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31611): Launched 00:04:35.769844 run osmo-stp_10.42.42.5(pid=31612): Launched 00:04:35.890397 run osmo-msc_10.42.42.6: Starting osmo-msc 00:04:36.467568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31614): Launched 00:04:36.787205 run osmo-msc_10.42.42.6(pid=31615): Launched 00:04:36.964370 run osmo-stp_10.42.42.5(pid=31612): ERR: Terminated: ERROR {rc=1} [trial-2351↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31612)] 00:04:37.100154 run osmo-stp_10.42.42.5(pid=31612): stdout: | (launched: 2022-12-09_00:04:35.712266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:37.235873 run osmo-stp_10.42.42.5(pid=31612): stderr: | [0;m[38;5;43m20221209000435904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000435904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000435905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000435905 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000435906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000435906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000435906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:37.370949 run osmo-stp_10.42.42.5(pid=31612): stdout: | (launched: 2022-12-09_00:04:35.712266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:37.498013 run osmo-stp_10.42.42.5(pid=31612): stderr: | [0;m[38;5;43m20221209000435904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000435904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000435905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000435905 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000435906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000435906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000435906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:37.650054 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=31612): Process ended prematurely: osmo-stp_10.42.42.5(pid=31612) [trial-2351↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31612)] [trial-2351↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 00:04:37.659095 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 00:04:37.686809 run osmo-hlr_10.42.42.2(pid=31609): ERR: Terminated: ERROR {rc=237} [trial-2351↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31609)] 00:04:37.737582 run osmo-hlr_10.42.42.2(pid=31609): stdout: | (launched: 2022-12-09_00:04:34.726194) 00:04:37.789799 run osmo-hlr_10.42.42.2(pid=31609): stderr: | [0;m[1;31m20221209000434924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000434924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000434924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000434924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000434925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000434925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000434940 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000434949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000434950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000434950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:04:37.862074 run osmo-msc_10.42.42.6(pid=31615): ERR: Terminated: ERROR {rc=2} [trial-2351↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31615)] 00:04:37.912081 run osmo-msc_10.42.42.6(pid=31615): stdout: | (launched: 2022-12-09_00:04:36.729411) 00:04:37.964543 run osmo-msc_10.42.42.6(pid=31615): stderr: | [0;m[38;5;43m20221209000437049 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209000437050 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fde17c72c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209000437050 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209000437050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209000437050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209000437050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209000437054 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209000437054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209000437054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209000437054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:04:38.017439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31608): Terminating (SIGTERM) 00:04:38.059629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31611): Terminating (SIGTERM) 00:04:38.102307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31614): Terminating (SIGTERM) 00:04:38.144793 --- ParallelTerminationStrategy: PID 31608 died... 00:04:38.165067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31608): Terminated: ok {rc=0} 00:04:38.212254 --- ParallelTerminationStrategy: PID 31611 died... 00:04:38.231936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31611): Terminated: ok {rc=0} 00:04:38.278830 --- ParallelTerminationStrategy: PID 31614 died... 00:04:38.298554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31614): Terminated: ok {rc=0} 00:04:38.387268 bus /sierra_3: Setting Powered False 00:04:39.485464 bus /sierra_3: Setting Powered False 00:04:40.600259 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 00:04:41.828835 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:04:41.833125 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 00:04:41.863533 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 00:04:41.870953 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 00:04:41.906527 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 00:04:41.936302 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 00:04:41.943710 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 00:04:42.461763 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2351 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 00:04:42.467950 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 00:04:42.479337 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:04:42.522612 tst assert_extension.py: using LAC 17685 00:04:42.642011 tst assert_extension.py: using RAC 90 00:04:42.763159 tst assert_extension.py: using CellId 17685 00:04:42.881485 tst assert_extension.py: using BVCI 17686 00:04:42.990833 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 00:04:43.106197 tst assert_extension.py:10: start nitb and bts... 00:04:43.322165 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:04:43.971422 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31620): Launched 00:04:44.291142 run osmo-nitb_10.42.42.2(pid=31621): Launched 00:04:44.467805 run osmo-nitb_10.42.42.2(pid=31621): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31621)] 00:04:44.611243 run osmo-nitb_10.42.42.2(pid=31621): stdout: | (launched: 2022-12-09_00:04:44.233342) 00:04:44.756291 run osmo-nitb_10.42.42.2(pid=31621): stderr: | (launched: 2022-12-09_00:04:44.280790) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:04:44.901355 run osmo-nitb_10.42.42.2(pid=31621): stdout: | (launched: 2022-12-09_00:04:44.233342) 00:04:45.039978 run osmo-nitb_10.42.42.2(pid=31621): stderr: | (launched: 2022-12-09_00:04:44.280790) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6f22fc268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31621): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31621) [trial-2351↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31621)] 00:04:45.411646 tst osmo-nitb_10.42.42.2(pid=31621): stdout: | (launched: 2022-12-09_00:04:44.233342) 00:04:45.541021 tst osmo-nitb_10.42.42.2(pid=31621): stderr: | (launched: 2022-12-09_00:04:44.280790) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:04:45.692881 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=31621): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31621) [trial-2351↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31621)] [trial-2351↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 00:04:45.702062 tst assert_extension.py:12: Test FAILED (3.2 sec) 00:04:45.709474 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31620): Terminating (SIGTERM) 00:04:45.920421 --- ParallelTerminationStrategy: PID 31620 died... 00:04:45.941193 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31620): Terminated: ok {rc=0} 00:04:46.031446 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 00:04:47.202235 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:04:47.208224 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 00:04:47.239911 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:04:47.270365 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 00:04:47.306708 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 00:04:47.335642 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:04:47.362870 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 00:04:47.892724 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2351 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 00:04:47.898696 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:47.910379 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:04:47.954910 tst assert_extension.py: using LAC 17686 00:04:48.079975 tst assert_extension.py: using RAC 91 00:04:48.203658 tst assert_extension.py: using CellId 17686 00:04:48.327783 tst assert_extension.py: using BVCI 17687 00:04:48.442715 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:48.453965 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:48.464931 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:48.476134 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:48.487386 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:48.498715 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 00:04:48.615829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:04:49.078465 run create_hlr_db(pid=31625): Launched 00:04:49.201241 bus /sierra_2: Setting Powered False 00:04:50.261254 run create_hlr_db(pid=31625): Terminated: ok {rc=0} 00:04:50.698599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31627): Launched 00:04:51.018069 run osmo-hlr_10.42.42.2(pid=31628): Launched 00:04:51.140448 run osmo-stp_10.42.42.5: Starting osmo-stp 00:04:51.694542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31630): Launched 00:04:52.013274 run osmo-stp_10.42.42.5(pid=31631): Launched 00:04:52.135606 run osmo-msc_10.42.42.6: Starting osmo-msc 00:04:52.714529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31633): Launched 00:04:53.033043 run osmo-msc_10.42.42.6(pid=31634): Launched 00:04:53.211507 run osmo-stp_10.42.42.5(pid=31631): ERR: Terminated: ERROR {rc=1} [trial-2351↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31631)] 00:04:53.346473 run osmo-stp_10.42.42.5(pid=31631): stdout: | (launched: 2022-12-09_00:04:51.955306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:53.481742 run osmo-stp_10.42.42.5(pid=31631): stderr: | [0;m[38;5;43m20221209000452147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000452147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000452147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000452148 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000452148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000452148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000452148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:53.615541 run osmo-stp_10.42.42.5(pid=31631): stdout: | (launched: 2022-12-09_00:04:51.955306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:53.742270 run osmo-stp_10.42.42.5(pid=31631): stderr: | [0;m[38;5;43m20221209000452147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000452147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000452147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000452148 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000452148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000452148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000452148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:53.893784 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=31631): Process ended prematurely: osmo-stp_10.42.42.5(pid=31631) [trial-2351↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31631)] [trial-2351↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 00:04:53.902472 tst assert_extension.py:17: Test FAILED (6.0 sec) 00:04:53.930067 run osmo-hlr_10.42.42.2(pid=31628): ERR: Terminated: ERROR {rc=237} [trial-2351↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31628)] 00:04:53.979964 run osmo-hlr_10.42.42.2(pid=31628): stdout: | (launched: 2022-12-09_00:04:50.960187) 00:04:54.031191 run osmo-hlr_10.42.42.2(pid=31628): stderr: | [0;m[1;31m20221209000451160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000451160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000451160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000451160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000451160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000451160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000451173 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000451181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000451181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000451182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:04:54.103139 run osmo-msc_10.42.42.6(pid=31634): ERR: Terminated: ERROR {rc=2} [trial-2351↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31634)] 00:04:54.152864 run osmo-msc_10.42.42.6(pid=31634): stdout: | (launched: 2022-12-09_00:04:52.975174) 00:04:54.204254 run osmo-msc_10.42.42.6(pid=31634): stderr: | [0;m[38;5;43m20221209000453295 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209000453295 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdaae333c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209000453295 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209000453295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209000453296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209000453296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209000453297 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209000453298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209000453298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209000453298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:04:54.256344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31627): Terminating (SIGTERM) 00:04:54.297581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31630): Terminating (SIGTERM) 00:04:54.339592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31633): Terminating (SIGTERM) 00:04:54.381237 --- ParallelTerminationStrategy: PID 31627 died... 00:04:54.401314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31627): Terminated: ok {rc=0} 00:04:54.446969 --- ParallelTerminationStrategy: PID 31630 died... 00:04:54.466406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31630): Terminated: ok {rc=0} 00:04:54.512559 --- ParallelTerminationStrategy: PID 31633 died... 00:04:54.531886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31633): Terminated: ok {rc=0} 00:04:54.619714 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 00:04:55.827415 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:04:55.834316 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 00:04:55.863944 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 00:04:55.892433 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 00:04:55.944589 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 00:04:55.974222 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 00:04:56.001615 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 00:04:56.554261 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 00:04:56.604597 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:56.615911 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:04:56.680765 tst mo_mt_call.py: using LAC 17687 00:04:56.799937 tst mo_mt_call.py: using RAC 92 00:04:56.925839 tst mo_mt_call.py: using CellId 17687 00:04:57.044625 tst mo_mt_call.py: using BVCI 17688 00:04:57.154622 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:57.165784 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:57.176722 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:57.187662 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:57.198679 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:57.209562 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:04:57.327985 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:04:57.444689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:04:57.916313 run create_hlr_db(pid=31640): Launched 00:04:58.039660 bus /sierra_2: Setting Powered False 00:04:59.099662 run create_hlr_db(pid=31640): Terminated: ok {rc=0} 00:04:59.542312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31642): Launched 00:04:59.867941 run osmo-hlr_10.42.42.2(pid=31643): Launched 00:04:59.991397 run osmo-stp_10.42.42.5: Starting osmo-stp 00:05:00.549198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31645): Launched 00:05:00.873362 run osmo-stp_10.42.42.5(pid=31646): Launched 00:05:01.104486 run osmo-msc_10.42.42.6: Starting osmo-msc 00:05:01.812733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31648): Launched 00:05:02.160610 run osmo-msc_10.42.42.6(pid=31652): Launched 00:05:02.366482 run osmo-stp_10.42.42.5(pid=31646): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31646)] 00:05:02.503340 run osmo-stp_10.42.42.5(pid=31646): stdout: | (launched: 2022-12-09_00:05:00.813763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:02.640844 run osmo-stp_10.42.42.5(pid=31646): stderr: | [0;m[38;5;43m20221209000501134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000501134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000501134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000501135 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000501137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000501137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000501137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:02.778855 run osmo-stp_10.42.42.5(pid=31646): stdout: | (launched: 2022-12-09_00:05:00.813763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:02.908171 run osmo-stp_10.42.42.5(pid=31646): stderr: | [0;m[38;5;43m20221209000501134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000501134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000501134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000501135 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000501137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000501137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000501137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:03.062403 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31646): Process ended prematurely: osmo-stp_10.42.42.5(pid=31646) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31646)] [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 00:05:03.071894 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 00:05:03.100054 run osmo-hlr_10.42.42.2(pid=31643): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31643)] 00:05:03.150479 run osmo-hlr_10.42.42.2(pid=31643): stdout: | (launched: 2022-12-09_00:04:59.808797) 00:05:03.202434 run osmo-hlr_10.42.42.2(pid=31643): stderr: | [0;m[1;31m20221209000500009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000500009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000500009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000500009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000500009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000500009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000500021 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000500030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000500030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000500030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:05:03.274729 run osmo-msc_10.42.42.6(pid=31652): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31652)] 00:05:03.324701 run osmo-msc_10.42.42.6(pid=31652): stdout: | (launched: 2022-12-09_00:05:02.097699) 00:05:03.376323 run osmo-msc_10.42.42.6(pid=31652): stderr: | [0;m[38;5;43m20221209000502506 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209000502506 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f30f78f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209000502506 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209000502506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209000502506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209000502506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209000502508 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209000502508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209000502508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209000502509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:05:03.428431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31642): Terminating (SIGTERM) 00:05:03.470175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31645): Terminating (SIGTERM) 00:05:03.512698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31648): Terminating (SIGTERM) 00:05:03.555530 --- ParallelTerminationStrategy: PID 31642 died... 00:05:03.575474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31642): Terminated: ok {rc=0} 00:05:03.621767 --- ParallelTerminationStrategy: PID 31645 died... 00:05:03.641466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31645): Terminated: ok {rc=0} 00:05:03.687900 --- ParallelTerminationStrategy: PID 31648 died... 00:05:03.707835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31648): Terminated: ok {rc=0} 00:05:03.794468 bus /sierra_3: Setting Powered False 00:05:04.892906 bus /sierra_3: Setting Powered False 00:05:06.008227 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 00:05:07.157475 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:05:07.169895 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:05:07.236899 tst mo_mt_call_osmux.py: using LAC 17688 00:05:07.363912 tst mo_mt_call_osmux.py: using RAC 93 00:05:07.490476 tst mo_mt_call_osmux.py: using CellId 17688 00:05:07.618828 tst mo_mt_call_osmux.py: using BVCI 17689 00:05:07.738519 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:05:07.750374 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:05:07.762040 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:05:07.773880 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:05:07.785994 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:05:07.797608 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:05:07.917818 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:05:08.034401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:05:08.506858 run create_hlr_db(pid=31654): Launched 00:05:08.631630 bus /sierra_2: Setting Powered False 00:05:09.693057 run create_hlr_db(pid=31654): Terminated: ok {rc=0} 00:05:10.115597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31656): Launched 00:05:10.420782 run osmo-hlr_10.42.42.2(pid=31657): Launched 00:05:10.537138 run osmo-stp_10.42.42.5: Starting osmo-stp 00:05:11.061292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31659): Launched 00:05:11.365332 run osmo-stp_10.42.42.5(pid=31660): Launched 00:05:11.481413 run osmo-msc_10.42.42.6: Starting osmo-msc 00:05:12.035129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31662): Launched 00:05:12.339724 run osmo-msc_10.42.42.6(pid=31663): Launched 00:05:12.509791 run osmo-stp_10.42.42.5(pid=31660): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31660)] 00:05:12.637743 run osmo-stp_10.42.42.5(pid=31660): stdout: | (launched: 2022-12-09_00:05:11.309322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:12.766401 run osmo-stp_10.42.42.5(pid=31660): stderr: | [0;m[38;5;43m20221209000511480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000511480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000511481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000511481 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000511482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000511482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000511482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:12.892490 run osmo-stp_10.42.42.5(pid=31660): stdout: | (launched: 2022-12-09_00:05:11.309322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:13.012583 run osmo-stp_10.42.42.5(pid=31660): stderr: | [0;m[38;5;43m20221209000511480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000511480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000511481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000511481 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000511482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000511482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000511482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:13.156579 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31660): Process ended prematurely: osmo-stp_10.42.42.5(pid=31660) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31660)] [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 00:05:13.165414 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 00:05:13.191626 run osmo-hlr_10.42.42.2(pid=31657): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31657)] 00:05:13.238580 run osmo-hlr_10.42.42.2(pid=31657): stdout: | (launched: 2022-12-09_00:05:10.364850) 00:05:13.286906 run osmo-hlr_10.42.42.2(pid=31657): stderr: | [0;m[1;31m20221209000510539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000510539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000510539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000510539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000510539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000510539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000510552 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000510562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000510563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000510563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:05:13.354610 run osmo-msc_10.42.42.6(pid=31663): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31663)] 00:05:13.401067 run osmo-msc_10.42.42.6(pid=31663): stdout: | (launched: 2022-12-09_00:05:12.283799) 00:05:13.449340 run osmo-msc_10.42.42.6(pid=31663): stderr: | [0;m[38;5;43m20221209000512556 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209000512556 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1a42899c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209000512556 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209000512556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209000512556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209000512556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209000512560 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209000512560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209000512561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209000512561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:05:13.497869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31656): Terminating (SIGTERM) 00:05:13.536735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31659): Terminating (SIGTERM) 00:05:13.576296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31662): Terminating (SIGTERM) 00:05:13.615629 --- ParallelTerminationStrategy: PID 31656 died... 00:05:13.634401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31656): Terminated: ok {rc=0} 00:05:13.677981 --- ParallelTerminationStrategy: PID 31659 died... 00:05:13.696073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31659): Terminated: ok {rc=0} 00:05:13.739292 --- ParallelTerminationStrategy: PID 31662 died... 00:05:13.757593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31662): Terminated: ok {rc=0} 00:05:13.839238 bus /sierra_3: Setting Powered False 00:05:14.931754 bus /sierra_3: Setting Powered False 00:05:16.055780 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 00:05:17.301139 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:05:17.307874 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 00:05:17.336142 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 00:05:17.362186 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 00:05:17.421874 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 00:05:17.451750 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 00:05:17.477636 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 00:05:18.025244 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 00:05:18.074978 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:18.086128 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:05:18.153575 tst mo_mt_call.py: using LAC 17689 00:05:18.273567 tst mo_mt_call.py: using RAC 94 00:05:18.393199 tst mo_mt_call.py: using CellId 17689 00:05:18.513914 tst mo_mt_call.py: using BVCI 17690 00:05:18.625243 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:18.636200 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:18.647066 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:18.657989 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:18.668928 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:18.679828 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:05:18.800397 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:05:18.918005 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:05:19.391672 run create_hlr_db(pid=31668): Launched 00:05:19.514901 bus /sierra_2: Setting Powered False 00:05:20.578200 run create_hlr_db(pid=31668): Terminated: ok {rc=0} 00:05:21.012302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31670): Launched 00:05:21.317725 run osmo-hlr_10.42.42.2(pid=31671): Launched 00:05:21.432444 run osmo-stp_10.42.42.5: Starting osmo-stp 00:05:21.971203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31673): Launched 00:05:22.275620 run osmo-stp_10.42.42.5(pid=31674): Launched 00:05:22.391351 run osmo-msc_10.42.42.6: Starting osmo-msc 00:05:22.941155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31676): Launched 00:05:23.244891 run osmo-msc_10.42.42.6(pid=31677): Launched 00:05:23.414948 run osmo-stp_10.42.42.5(pid=31674): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31674)] 00:05:23.543641 run osmo-stp_10.42.42.5(pid=31674): stdout: | (launched: 2022-12-09_00:05:22.220035) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:23.672734 run osmo-stp_10.42.42.5(pid=31674): stderr: | [0;m[38;5;43m20221209000522391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000522392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000522392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000522392 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000522394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000522395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000522395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:23.798603 run osmo-stp_10.42.42.5(pid=31674): stdout: | (launched: 2022-12-09_00:05:22.220035) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:23.919226 run osmo-stp_10.42.42.5(pid=31674): stderr: | [0;m[38;5;43m20221209000522391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000522392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000522392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000522392 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000522394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000522395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000522395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:24.063282 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31674): Process ended prematurely: osmo-stp_10.42.42.5(pid=31674) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31674)] [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 00:05:24.072021 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 00:05:24.098607 run osmo-hlr_10.42.42.2(pid=31671): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31671)] 00:05:24.145756 run osmo-hlr_10.42.42.2(pid=31671): stdout: | (launched: 2022-12-09_00:05:21.262162) 00:05:24.194446 run osmo-hlr_10.42.42.2(pid=31671): stderr: | [0;m[1;31m20221209000521439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000521439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000521439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000521439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000521439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000521439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000521452 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000521461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000521461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000521461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:05:24.262553 run osmo-msc_10.42.42.6(pid=31677): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31677)] 00:05:24.309122 run osmo-msc_10.42.42.6(pid=31677): stdout: | (launched: 2022-12-09_00:05:23.189207) 00:05:24.357458 run osmo-msc_10.42.42.6(pid=31677): stderr: | [0;m[38;5;43m20221209000523462 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209000523462 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8f8dd63c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209000523462 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209000523462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209000523463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209000523463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209000523464 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209000523465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209000523465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209000523465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:05:24.406892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31670): Terminating (SIGTERM) 00:05:24.445962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31673): Terminating (SIGTERM) 00:05:24.484714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31676): Terminating (SIGTERM) 00:05:24.523901 --- ParallelTerminationStrategy: PID 31670 died... 00:05:24.542732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31670): Terminated: ok {rc=0} 00:05:24.585824 --- ParallelTerminationStrategy: PID 31673 died... 00:05:24.603893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31673): Terminated: ok {rc=0} 00:05:24.647044 --- ParallelTerminationStrategy: PID 31676 died... 00:05:24.665346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31676): Terminated: ok {rc=0} 00:05:24.749278 bus /sierra_3: Setting Powered False 00:05:25.848153 bus /sierra_3: Setting Powered False 00:05:26.965308 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 00:05:28.110427 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:28.122229 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:05:28.187523 tst mo_mt_call_osmux.py: using LAC 17690 00:05:28.306933 tst mo_mt_call_osmux.py: using RAC 95 00:05:28.426671 tst mo_mt_call_osmux.py: using CellId 17690 00:05:28.548161 tst mo_mt_call_osmux.py: using BVCI 17691 00:05:28.660068 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:28.671345 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:28.682366 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:28.693299 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:28.704268 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:28.715270 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:05:28.834191 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:05:28.952471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:05:29.424621 run create_hlr_db(pid=31679): Launched 00:05:29.550054 bus /sierra_2: Setting Powered False 00:05:30.611429 run create_hlr_db(pid=31679): Terminated: ok {rc=0} 00:05:31.118948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31681): Launched 00:05:31.471366 run osmo-hlr_10.42.42.2(pid=31682): Launched 00:05:31.689699 run osmo-stp_10.42.42.5: Starting osmo-stp 00:05:32.389069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31684): Launched 00:05:32.713734 run osmo-stp_10.42.42.5(pid=31685): Launched 00:05:32.837345 run osmo-msc_10.42.42.6: Starting osmo-msc 00:05:33.425188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31687): Launched 00:05:33.750209 run osmo-msc_10.42.42.6(pid=31688): Launched 00:05:33.930741 run osmo-stp_10.42.42.5(pid=31685): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31685)] 00:05:34.067447 run osmo-stp_10.42.42.5(pid=31685): stdout: | (launched: 2022-12-09_00:05:32.655003) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:34.206660 run osmo-stp_10.42.42.5(pid=31685): stderr: | [0;m[38;5;43m20221209000532848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000532848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000532849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000532849 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000532849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000532850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000532850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:34.343670 run osmo-stp_10.42.42.5(pid=31685): stdout: | (launched: 2022-12-09_00:05:32.655003) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:34.473474 run osmo-stp_10.42.42.5(pid=31685): stderr: | [0;m[38;5;43m20221209000532848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000532848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000532849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000532849 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000532849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000532850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000532850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:34.628491 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31685): Process ended prematurely: osmo-stp_10.42.42.5(pid=31685) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31685)] [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 00:05:34.638376 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 00:05:34.666660 run osmo-hlr_10.42.42.2(pid=31682): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31682)] 00:05:34.717770 run osmo-hlr_10.42.42.2(pid=31682): stdout: | (launched: 2022-12-09_00:05:31.403492) 00:05:34.769918 run osmo-hlr_10.42.42.2(pid=31682): stderr: | [0;m[1;31m20221209000531798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000531798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000531798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000531798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000531800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000531800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000531825 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000531842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000531844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000531848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:05:34.842437 run osmo-msc_10.42.42.6(pid=31688): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31688)] 00:05:34.892585 run osmo-msc_10.42.42.6(pid=31688): stdout: | (launched: 2022-12-09_00:05:33.691026) 00:05:34.944689 run osmo-msc_10.42.42.6(pid=31688): stderr: | [0;m[38;5;43m20221209000534016 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209000534016 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd0f04d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209000534016 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209000534016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209000534017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209000534017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209000534018 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209000534019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209000534019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209000534019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:05:34.997152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31681): Terminating (SIGTERM) 00:05:35.038857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31684): Terminating (SIGTERM) 00:05:35.081080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31687): Terminating (SIGTERM) 00:05:35.124344 --- ParallelTerminationStrategy: PID 31681 died... 00:05:35.144519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31681): Terminated: ok {rc=0} 00:05:35.191029 --- ParallelTerminationStrategy: PID 31684 died... 00:05:35.211079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31684): Terminated: ok {rc=0} 00:05:35.257759 --- ParallelTerminationStrategy: PID 31687 died... 00:05:35.277517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31687): Terminated: ok {rc=0} 00:05:35.364538 bus /sierra_3: Setting Powered False 00:05:36.462200 bus /sierra_3: Setting Powered False 00:05:37.576836 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 00:05:38.820930 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:05:38.827694 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 00:05:38.855903 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 00:05:38.881972 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 00:05:38.933142 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 00:05:38.961705 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 00:05:38.988241 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 00:05:39.538826 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 00:05:39.587222 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:39.598427 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:05:39.662642 tst mo_mt_call.py: using LAC 17691 00:05:39.788068 tst mo_mt_call.py: using RAC 96 00:05:39.914005 tst mo_mt_call.py: using CellId 17691 00:05:40.039789 tst mo_mt_call.py: using BVCI 17692 00:05:40.158275 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:40.170318 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:40.182167 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:40.194271 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:40.206170 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:40.218243 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:05:40.334919 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:05:40.450244 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:05:40.923134 run create_hlr_db(pid=31694): Launched 00:05:41.047787 bus /sierra_2: Setting Powered False 00:05:42.108118 run create_hlr_db(pid=31694): Terminated: ok {rc=0} 00:05:42.552725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31696): Launched 00:05:42.880150 run osmo-hlr_10.42.42.2(pid=31697): Launched 00:05:43.004756 run osmo-stp_10.42.42.5: Starting osmo-stp 00:05:43.567583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31699): Launched 00:05:43.892545 run osmo-stp_10.42.42.5(pid=31700): Launched 00:05:44.017523 run osmo-msc_10.42.42.6: Starting osmo-msc 00:05:44.606950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31702): Launched 00:05:44.933015 run osmo-msc_10.42.42.6(pid=31703): Launched 00:05:45.115020 run osmo-stp_10.42.42.5(pid=31700): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31700)] 00:05:45.251878 run osmo-stp_10.42.42.5(pid=31700): stdout: | (launched: 2022-12-09_00:05:43.833513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:45.389427 run osmo-stp_10.42.42.5(pid=31700): stderr: | [0;m[38;5;43m20221209000544029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000544029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000544030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000544030 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000544030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000544030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000544031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:45.525809 run osmo-stp_10.42.42.5(pid=31700): stdout: | (launched: 2022-12-09_00:05:43.833513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:45.654750 run osmo-stp_10.42.42.5(pid=31700): stderr: | [0;m[38;5;43m20221209000544029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000544029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000544030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000544030 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000544030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000544030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000544031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:45.809504 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31700): Process ended prematurely: osmo-stp_10.42.42.5(pid=31700) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31700)] [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 00:05:45.819395 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 00:05:45.850812 run osmo-hlr_10.42.42.2(pid=31697): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31697)] 00:05:45.908426 run osmo-hlr_10.42.42.2(pid=31697): stdout: | (launched: 2022-12-09_00:05:42.820803) 00:05:45.964760 run osmo-hlr_10.42.42.2(pid=31697): stderr: | [0;m[1;31m20221209000543023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000543023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000543023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000543023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000543023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000543023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000543035 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000543043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000543043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000543044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:05:46.037873 run osmo-msc_10.42.42.6(pid=31703): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31703)] 00:05:46.088323 run osmo-msc_10.42.42.6(pid=31703): stdout: | (launched: 2022-12-09_00:05:44.874054) 00:05:46.141355 run osmo-msc_10.42.42.6(pid=31703): stderr: | [0;m[38;5;43m20221209000545197 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209000545198 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f38b7df4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209000545198 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209000545198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209000545198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209000545198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209000545200 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209000545200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209000545200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209000545200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:05:46.194024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31696): Terminating (SIGTERM) 00:05:46.237198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31699): Terminating (SIGTERM) 00:05:46.281835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31702): Terminating (SIGTERM) 00:05:46.326033 --- ParallelTerminationStrategy: PID 31696 died... 00:05:46.346491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31696): Terminated: ok {rc=0} 00:05:46.393553 --- ParallelTerminationStrategy: PID 31699 died... 00:05:46.413442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31699): Terminated: ok {rc=0} 00:05:46.460486 --- ParallelTerminationStrategy: PID 31702 died... 00:05:46.480406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31702): Terminated: ok {rc=0} 00:05:46.568868 bus /sierra_3: Setting Powered False 00:05:47.666880 bus /sierra_3: Setting Powered False 00:05:48.780313 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 00:05:49.928870 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:49.941218 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:05:50.006810 tst mo_mt_call_osmux.py: using LAC 17692 00:05:50.136407 tst mo_mt_call_osmux.py: using RAC 97 00:05:50.262333 tst mo_mt_call_osmux.py: using CellId 17692 00:05:50.387933 tst mo_mt_call_osmux.py: using BVCI 17693 00:05:50.505495 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:50.516935 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:50.528432 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:50.539850 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:50.552004 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:50.563524 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:05:50.682696 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:05:50.799882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:05:51.272400 run create_hlr_db(pid=31705): Launched 00:05:51.397768 bus /sierra_2: Setting Powered False 00:05:52.458493 run create_hlr_db(pid=31705): Terminated: ok {rc=0} 00:05:52.900898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31707): Launched 00:05:53.224710 run osmo-hlr_10.42.42.2(pid=31708): Launched 00:05:53.348127 run osmo-stp_10.42.42.5: Starting osmo-stp 00:05:53.906158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31710): Launched 00:05:54.231052 run osmo-stp_10.42.42.5(pid=31711): Launched 00:05:54.354653 run osmo-msc_10.42.42.6: Starting osmo-msc 00:05:54.940808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31713): Launched 00:05:55.265780 run osmo-msc_10.42.42.6(pid=31714): Launched 00:05:55.447230 run osmo-stp_10.42.42.5(pid=31711): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31711)] 00:05:55.583855 run osmo-stp_10.42.42.5(pid=31711): stdout: | (launched: 2022-12-09_00:05:54.172002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:55.721754 run osmo-stp_10.42.42.5(pid=31711): stderr: | [0;m[38;5;43m20221209000554366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000554366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000554366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000554367 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000554367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000554367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000554367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:55.858071 run osmo-stp_10.42.42.5(pid=31711): stdout: | (launched: 2022-12-09_00:05:54.172002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:55.987605 run osmo-stp_10.42.42.5(pid=31711): stderr: | [0;m[38;5;43m20221209000554366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000554366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000554366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000554367 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000554367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000554367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000554367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:56.142175 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31711): Process ended prematurely: osmo-stp_10.42.42.5(pid=31711) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31711)] [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 00:05:56.151740 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 00:05:56.180431 run osmo-hlr_10.42.42.2(pid=31708): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31708)] 00:05:56.230667 run osmo-hlr_10.42.42.2(pid=31708): stdout: | (launched: 2022-12-09_00:05:53.165937) 00:05:56.282531 run osmo-hlr_10.42.42.2(pid=31708): stderr: | [0;m[1;31m20221209000553366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000553366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000553366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000553366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000553366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000553366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000553378 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000553387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000553387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000553387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:05:56.354553 run osmo-msc_10.42.42.6(pid=31714): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31714)] 00:05:56.404250 run osmo-msc_10.42.42.6(pid=31714): stdout: | (launched: 2022-12-09_00:05:55.206821) 00:05:56.456058 run osmo-msc_10.42.42.6(pid=31714): stderr: | [0;m[38;5;43m20221209000555529 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209000555529 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5a77adbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209000555530 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209000555530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209000555530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209000555530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209000555532 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209000555532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209000555532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209000555532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:05:56.508061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31707): Terminating (SIGTERM) 00:05:56.549402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31710): Terminating (SIGTERM) 00:05:56.590966 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31713): Terminating (SIGTERM) 00:05:56.633076 --- ParallelTerminationStrategy: PID 31707 died... 00:05:56.652866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31707): Terminated: ok {rc=0} 00:05:56.698872 --- ParallelTerminationStrategy: PID 31710 died... 00:05:56.718439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31710): Terminated: ok {rc=0} 00:05:56.764748 --- ParallelTerminationStrategy: PID 31713 died... 00:05:56.784234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31713): Terminated: ok {rc=0} 00:05:56.870864 bus /sierra_3: Setting Powered False 00:05:57.964763 bus /sierra_3: Setting Powered False 00:05:59.078812 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 00:06:00.317584 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:06:00.323743 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 00:06:00.352347 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 00:06:00.378979 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 00:06:00.430209 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 00:06:00.460468 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 00:06:00.487712 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 00:06:01.045688 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 00:06:01.119913 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:06:01.134381 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 00:06:01.209699 tst mo_mt_call.py: using LAC 17693 00:06:01.372822 tst mo_mt_call.py: using RAC 98 00:06:01.530432 tst mo_mt_call.py: using CellId 17693 00:06:01.659917 tst mo_mt_call.py: using BVCI 17694 00:06:01.772316 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:06:01.784042 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:06:01.795621 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:06:01.807233 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:06:01.818906 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:06:01.830567 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:06:01.947000 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:06:02.060130 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:06:02.534909 run create_hlr_db(pid=31719): Launched 00:06:02.659612 bus /sierra_2: Setting Powered False 00:06:03.719486 run create_hlr_db(pid=31719): Terminated: ok {rc=0} 00:06:04.142221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31721): Launched 00:06:04.446905 run osmo-hlr_10.42.42.2(pid=31722): Launched 00:06:04.562034 run osmo-stp_10.42.42.5: Starting osmo-stp 00:06:05.097881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31724): Launched 00:06:05.401525 run osmo-stp_10.42.42.5(pid=31725): Launched 00:06:05.516513 run osmo-msc_10.42.42.6: Starting osmo-msc 00:06:06.081706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31727): Launched 00:06:06.386892 run osmo-msc_10.42.42.6(pid=31728): Launched 00:06:06.557899 run osmo-stp_10.42.42.5(pid=31725): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31725)] 00:06:06.687282 run osmo-stp_10.42.42.5(pid=31725): stdout: | (launched: 2022-12-09_00:06:05.345599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:06.816044 run osmo-stp_10.42.42.5(pid=31725): stderr: | [0;m[38;5;43m20221209000605516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000605516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000605516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000605517 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000605519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000605519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000605519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:06.942881 run osmo-stp_10.42.42.5(pid=31725): stdout: | (launched: 2022-12-09_00:06:05.345599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:07.063683 run osmo-stp_10.42.42.5(pid=31725): stderr: | [0;m[38;5;43m20221209000605516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000605516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000605516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000605517 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000605519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000605519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000605519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:07.208297 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31725): Process ended prematurely: osmo-stp_10.42.42.5(pid=31725) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31725)] [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 00:06:07.217240 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:06:07.243364 run osmo-hlr_10.42.42.2(pid=31722): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31722)] 00:06:07.289839 run osmo-hlr_10.42.42.2(pid=31722): stdout: | (launched: 2022-12-09_00:06:04.391080) 00:06:07.338116 run osmo-hlr_10.42.42.2(pid=31722): stderr: | [0;m[1;31m20221209000604569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000604570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000604570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000604570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000604570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000604570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000604582 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000604591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000604591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000604591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:06:07.405991 run osmo-msc_10.42.42.6(pid=31728): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31728)] 00:06:07.452441 run osmo-msc_10.42.42.6(pid=31728): stdout: | (launched: 2022-12-09_00:06:06.330878) 00:06:07.500649 run osmo-msc_10.42.42.6(pid=31728): stderr: | [0;m[38;5;43m20221209000606605 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209000606605 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f30847b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209000606605 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209000606605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209000606605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209000606606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209000606607 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209000606608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209000606608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209000606608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:06:07.549370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31721): Terminating (SIGTERM) 00:06:07.588555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31724): Terminating (SIGTERM) 00:06:07.627361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31727): Terminating (SIGTERM) 00:06:07.666610 --- ParallelTerminationStrategy: PID 31721 died... 00:06:07.685376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31721): Terminated: ok {rc=0} 00:06:07.728457 --- ParallelTerminationStrategy: PID 31724 died... 00:06:07.746880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31724): Terminated: ok {rc=0} 00:06:07.789893 --- ParallelTerminationStrategy: PID 31727 died... 00:06:07.808510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31727): Terminated: ok {rc=0} 00:06:07.890059 bus /sierra_3: Setting Powered False 00:06:08.986956 bus /sierra_3: Setting Powered False 00:06:10.100480 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 00:06:11.248916 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:06:11.261362 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 00:06:11.329550 tst mo_mt_call_osmux.py: using LAC 17694 00:06:11.457082 tst mo_mt_call_osmux.py: using RAC 99 00:06:11.583859 tst mo_mt_call_osmux.py: using CellId 17694 00:06:11.710076 tst mo_mt_call_osmux.py: using BVCI 17695 00:06:11.827867 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:06:11.839749 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:06:11.851399 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:06:11.863134 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:06:11.875171 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:06:11.887113 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:06:12.005248 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:06:12.124564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:06:12.627484 run create_hlr_db(pid=31730): Launched 00:06:12.751323 bus /sierra_2: Setting Powered False 00:06:13.814903 run create_hlr_db(pid=31730): Terminated: ok {rc=0} 00:06:14.250030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31732): Launched 00:06:14.555811 run osmo-hlr_10.42.42.2(pid=31733): Launched 00:06:14.672579 run osmo-stp_10.42.42.5: Starting osmo-stp 00:06:15.212057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31735): Launched 00:06:15.517189 run osmo-stp_10.42.42.5(pid=31736): Launched 00:06:15.634634 run osmo-msc_10.42.42.6: Starting osmo-msc 00:06:16.214051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31738): Launched 00:06:16.581740 run osmo-msc_10.42.42.6(pid=31739): Launched 00:06:16.829573 run osmo-stp_10.42.42.5(pid=31736): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31736)] 00:06:17.110867 run osmo-stp_10.42.42.5(pid=31736): stdout: | (launched: 2022-12-09_00:06:15.461242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:17.317663 run osmo-stp_10.42.42.5(pid=31736): stderr: | [0;m[38;5;43m20221209000615636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000615636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000615636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000615637 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000615637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000615637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000615637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:17.453263 run osmo-stp_10.42.42.5(pid=31736): stdout: | (launched: 2022-12-09_00:06:15.461242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:17.582606 run osmo-stp_10.42.42.5(pid=31736): stderr: | [0;m[38;5;43m20221209000615636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000615636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000615636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000615637 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000615637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000615637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000615637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:17.737376 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31736): Process ended prematurely: osmo-stp_10.42.42.5(pid=31736) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31736)] [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 00:06:17.747078 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 00:06:17.775405 run osmo-hlr_10.42.42.2(pid=31733): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31733)] 00:06:17.825651 run osmo-hlr_10.42.42.2(pid=31733): stdout: | (launched: 2022-12-09_00:06:14.499397) 00:06:17.877735 run osmo-hlr_10.42.42.2(pid=31733): stderr: | [0;m[1;31m20221209000614676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000614676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000614676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000614676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000614676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000614676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000614688 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000614698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000614699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000614699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:06:17.950537 run osmo-msc_10.42.42.6(pid=31739): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31739)] 00:06:18.000412 run osmo-msc_10.42.42.6(pid=31739): stdout: | (launched: 2022-12-09_00:06:16.507427) 00:06:18.052086 run osmo-msc_10.42.42.6(pid=31739): stderr: | [0;m[38;5;43m20221209000617055 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209000617055 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f41ec718c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209000617055 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209000617055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209000617055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209000617056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209000617070 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209000617070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209000617070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209000617070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:06:18.105358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31732): Terminating (SIGTERM) 00:06:18.147372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31735): Terminating (SIGTERM) 00:06:18.189789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31738): Terminating (SIGTERM) 00:06:18.232433 --- ParallelTerminationStrategy: PID 31732 died... 00:06:18.252507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31732): Terminated: ok {rc=0} 00:06:18.298794 --- ParallelTerminationStrategy: PID 31735 died... 00:06:18.318510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31735): Terminated: ok {rc=0} 00:06:18.364611 --- ParallelTerminationStrategy: PID 31738 died... 00:06:18.384224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31738): Terminated: ok {rc=0} 00:06:18.471170 bus /sierra_3: Setting Powered False 00:06:19.567999 bus /sierra_3: Setting Powered False 00:06:20.683233 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 00:06:21.931850 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:06:21.938541 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 00:06:21.967659 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 00:06:21.993824 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 00:06:22.043206 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 00:06:22.071686 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 00:06:22.098249 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 00:06:22.655019 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 00:06:22.703787 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:22.714996 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:06:22.777386 tst mo_mt_call.py: using LAC 17695 00:06:22.895308 tst mo_mt_call.py: using RAC 100 00:06:23.017548 tst mo_mt_call.py: using CellId 17695 00:06:23.136526 tst mo_mt_call.py: using BVCI 17696 00:06:23.246256 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:23.257440 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:23.268265 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:23.279160 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:23.290112 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:23.300895 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:06:23.419835 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:06:23.532637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:06:24.004002 run create_hlr_db(pid=31744): Launched 00:06:24.128124 bus /sierra_2: Setting Powered False 00:06:25.187877 run create_hlr_db(pid=31744): Terminated: ok {rc=0} 00:06:25.631190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31746): Launched 00:06:25.956107 run osmo-hlr_10.42.42.2(pid=31747): Launched 00:06:26.079548 run osmo-stp_10.42.42.5: Starting osmo-stp 00:06:26.637324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31749): Launched 00:06:26.961526 run osmo-stp_10.42.42.5(pid=31750): Launched 00:06:27.085131 run osmo-msc_10.42.42.6: Starting osmo-msc 00:06:27.670115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31752): Launched 00:06:27.994696 run osmo-msc_10.42.42.6(pid=31753): Launched 00:06:28.175621 run osmo-stp_10.42.42.5(pid=31750): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31750)] 00:06:28.312408 run osmo-stp_10.42.42.5(pid=31750): stdout: | (launched: 2022-12-09_00:06:26.901992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:28.450380 run osmo-stp_10.42.42.5(pid=31750): stderr: | [0;m[38;5;43m20221209000627094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000627094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000627095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000627095 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000627095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000627096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000627096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:28.587176 run osmo-stp_10.42.42.5(pid=31750): stdout: | (launched: 2022-12-09_00:06:26.901992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:28.716240 run osmo-stp_10.42.42.5(pid=31750): stderr: | [0;m[38;5;43m20221209000627094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000627094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000627095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000627095 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000627095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000627096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000627096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:28.870643 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31750): Process ended prematurely: osmo-stp_10.42.42.5(pid=31750) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31750)] [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 00:06:28.880347 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:06:28.908031 run osmo-hlr_10.42.42.2(pid=31747): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31747)] 00:06:28.957849 run osmo-hlr_10.42.42.2(pid=31747): stdout: | (launched: 2022-12-09_00:06:25.897085) 00:06:29.009480 run osmo-hlr_10.42.42.2(pid=31747): stderr: | [0;m[1;31m20221209000626095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000626095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000626096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000626096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000626096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000626096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000626107 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000626116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000626116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000626116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:06:29.081206 run osmo-msc_10.42.42.6(pid=31753): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31753)] 00:06:29.130219 run osmo-msc_10.42.42.6(pid=31753): stdout: | (launched: 2022-12-09_00:06:27.935649) 00:06:29.182061 run osmo-msc_10.42.42.6(pid=31753): stderr: | [0;m[38;5;43m20221209000628259 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209000628259 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5b4795fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209000628259 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209000628259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209000628259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209000628260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209000628261 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209000628262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209000628262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209000628262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:06:29.233863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31746): Terminating (SIGTERM) 00:06:29.275153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31749): Terminating (SIGTERM) 00:06:29.316548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31752): Terminating (SIGTERM) 00:06:29.358417 --- ParallelTerminationStrategy: PID 31746 died... 00:06:29.378623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31746): Terminated: ok {rc=0} 00:06:29.424699 --- ParallelTerminationStrategy: PID 31749 died... 00:06:29.443862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31749): Terminated: ok {rc=0} 00:06:29.489605 --- ParallelTerminationStrategy: PID 31752 died... 00:06:29.509282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31752): Terminated: ok {rc=0} 00:06:29.597348 bus /sierra_3: Setting Powered False 00:06:30.693684 bus /sierra_3: Setting Powered False 00:06:31.804017 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 00:06:32.950351 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:32.962595 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:06:33.029567 tst mo_mt_call_osmux.py: using LAC 17696 00:06:33.149785 tst mo_mt_call_osmux.py: using RAC 101 00:06:33.273247 tst mo_mt_call_osmux.py: using CellId 17696 00:06:33.392849 tst mo_mt_call_osmux.py: using BVCI 17697 00:06:33.503333 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:33.515036 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:33.526338 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:33.537421 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:33.548925 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:33.561253 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:06:33.676064 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:06:33.795065 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:06:34.269027 run create_hlr_db(pid=31755): Launched 00:06:34.392210 bus /sierra_2: Setting Powered False 00:06:35.452856 run create_hlr_db(pid=31755): Terminated: ok {rc=0} 00:06:35.895833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31757): Launched 00:06:36.221754 run osmo-hlr_10.42.42.2(pid=31758): Launched 00:06:36.346084 run osmo-stp_10.42.42.5: Starting osmo-stp 00:06:36.903347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31760): Launched 00:06:37.228208 run osmo-stp_10.42.42.5(pid=31761): Launched 00:06:37.352393 run osmo-msc_10.42.42.6: Starting osmo-msc 00:06:37.938459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31763): Launched 00:06:38.264688 run osmo-msc_10.42.42.6(pid=31764): Launched 00:06:38.445976 run osmo-stp_10.42.42.5(pid=31761): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31761)] 00:06:38.582367 run osmo-stp_10.42.42.5(pid=31761): stdout: | (launched: 2022-12-09_00:06:37.169436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:38.720076 run osmo-stp_10.42.42.5(pid=31761): stderr: | [0;m[38;5;43m20221209000637362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000637363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000637363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000637363 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000637364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000637364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000637364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:38.856844 run osmo-stp_10.42.42.5(pid=31761): stdout: | (launched: 2022-12-09_00:06:37.169436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:38.985987 run osmo-stp_10.42.42.5(pid=31761): stderr: | [0;m[38;5;43m20221209000637362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000637363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000637363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000637363 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000637364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000637364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000637364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:39.140286 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31761): Process ended prematurely: osmo-stp_10.42.42.5(pid=31761) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31761)] [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 00:06:39.150481 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:06:39.178792 run osmo-hlr_10.42.42.2(pid=31758): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31758)] 00:06:39.228771 run osmo-hlr_10.42.42.2(pid=31758): stdout: | (launched: 2022-12-09_00:06:36.162510) 00:06:39.280517 run osmo-hlr_10.42.42.2(pid=31758): stderr: | [0;m[1;31m20221209000636363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000636363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000636363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000636363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000636363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000636363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000636374 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000636382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000636383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000636383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:06:39.352585 run osmo-msc_10.42.42.6(pid=31764): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31764)] 00:06:39.402104 run osmo-msc_10.42.42.6(pid=31764): stdout: | (launched: 2022-12-09_00:06:38.205205) 00:06:39.453519 run osmo-msc_10.42.42.6(pid=31764): stderr: | [0;m[38;5;43m20221209000638528 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209000638528 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f51afcf9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209000638528 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209000638528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209000638528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209000638529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209000638530 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209000638531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209000638531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209000638531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:06:39.505609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31757): Terminating (SIGTERM) 00:06:39.546786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31760): Terminating (SIGTERM) 00:06:39.588171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31763): Terminating (SIGTERM) 00:06:39.630344 --- ParallelTerminationStrategy: PID 31757 died... 00:06:39.650130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31757): Terminated: ok {rc=0} 00:06:39.696042 --- ParallelTerminationStrategy: PID 31760 died... 00:06:39.715638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31760): Terminated: ok {rc=0} 00:06:39.762088 --- ParallelTerminationStrategy: PID 31763 died... 00:06:39.781673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31763): Terminated: ok {rc=0} 00:06:39.868336 bus /sierra_3: Setting Powered False 00:06:40.965983 bus /sierra_3: Setting Powered False 00:06:42.081131 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:06:43.327842 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:06:43.335172 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:06:43.363606 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 00:06:43.389815 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:06:43.442191 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:06:43.473605 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 00:06:43.500695 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:06:44.047897 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 00:06:44.096180 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:44.107498 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:06:44.172212 tst mo_mt_call.py: using LAC 17697 00:06:44.293133 tst mo_mt_call.py: using RAC 102 00:06:44.413820 tst mo_mt_call.py: using CellId 17697 00:06:44.534516 tst mo_mt_call.py: using BVCI 17698 00:06:44.644315 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:44.655590 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:44.666655 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:44.677638 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:44.688571 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:44.699642 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:06:44.819326 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:06:44.940672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:06:45.444071 run create_hlr_db(pid=31769): Launched 00:06:45.568274 bus /sierra_2: Setting Powered False 00:06:46.628475 run create_hlr_db(pid=31769): Terminated: ok {rc=0} 00:06:47.121785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31771): Launched 00:06:47.441724 run osmo-hlr_10.42.42.2(pid=31772): Launched 00:06:47.559146 run osmo-stp_10.42.42.5: Starting osmo-stp 00:06:48.096105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31774): Launched 00:06:48.400860 run osmo-stp_10.42.42.5(pid=31775): Launched 00:06:48.516123 run osmo-msc_10.42.42.6: Starting osmo-msc 00:06:49.066506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31777): Launched 00:06:49.370533 run osmo-msc_10.42.42.6(pid=31778): Launched 00:06:49.540208 run osmo-stp_10.42.42.5(pid=31775): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31775)] 00:06:49.669517 run osmo-stp_10.42.42.5(pid=31775): stdout: | (launched: 2022-12-09_00:06:48.345128) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:49.798460 run osmo-stp_10.42.42.5(pid=31775): stderr: | [0;m[38;5;43m20221209000648515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000648515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000648515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000648516 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000648518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000648518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000648518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:49.925222 run osmo-stp_10.42.42.5(pid=31775): stdout: | (launched: 2022-12-09_00:06:48.345128) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:50.046279 run osmo-stp_10.42.42.5(pid=31775): stderr: | [0;m[38;5;43m20221209000648515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000648515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000648515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000648516 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000648518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000648518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000648518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:50.191269 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31775): Process ended prematurely: osmo-stp_10.42.42.5(pid=31775) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31775)] [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 00:06:50.200040 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 00:06:50.226122 run osmo-hlr_10.42.42.2(pid=31772): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31772)] 00:06:50.272679 run osmo-hlr_10.42.42.2(pid=31772): stdout: | (launched: 2022-12-09_00:06:47.386223) 00:06:50.321554 run osmo-hlr_10.42.42.2(pid=31772): stderr: | [0;m[1;31m20221209000647566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000647566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000647566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000647566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000647566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000647566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000647578 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000647587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000647587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000647587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:06:50.389458 run osmo-msc_10.42.42.6(pid=31778): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31778)] 00:06:50.435806 run osmo-msc_10.42.42.6(pid=31778): stdout: | (launched: 2022-12-09_00:06:49.314606) 00:06:50.483865 run osmo-msc_10.42.42.6(pid=31778): stderr: | [0;m[38;5;43m20221209000649588 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209000649588 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efc90c13c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209000649588 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209000649588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209000649589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209000649589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209000649591 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209000649591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209000649591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209000649591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:06:50.532338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31771): Terminating (SIGTERM) 00:06:50.570831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31774): Terminating (SIGTERM) 00:06:50.609186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31777): Terminating (SIGTERM) 00:06:50.648059 --- ParallelTerminationStrategy: PID 31771 died... 00:06:50.666807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31771): Terminated: ok {rc=0} 00:06:50.709792 --- ParallelTerminationStrategy: PID 31774 died... 00:06:50.728025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31774): Terminated: ok {rc=0} 00:06:50.770686 --- ParallelTerminationStrategy: PID 31777 died... 00:06:50.789049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31777): Terminated: ok {rc=0} 00:06:50.872242 bus /sierra_3: Setting Powered False 00:06:51.970190 bus /sierra_3: Setting Powered False 00:06:53.083888 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 00:06:54.230223 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:54.242496 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:06:54.310498 tst mo_mt_call_osmux.py: using LAC 17698 00:06:54.440497 tst mo_mt_call_osmux.py: using RAC 103 00:06:54.566356 tst mo_mt_call_osmux.py: using CellId 17698 00:06:54.691434 tst mo_mt_call_osmux.py: using BVCI 17699 00:06:54.802888 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:54.814151 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:54.825331 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:54.836272 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:54.847623 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:54.858639 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:06:54.973305 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:06:55.093779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:06:55.597487 run create_hlr_db(pid=31780): Launched 00:06:55.721334 bus /sierra_2: Setting Powered False 00:06:56.785985 run create_hlr_db(pid=31780): Terminated: ok {rc=0} 00:06:57.236787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31782): Launched 00:06:57.561680 run osmo-hlr_10.42.42.2(pid=31783): Launched 00:06:57.685522 run osmo-stp_10.42.42.5: Starting osmo-stp 00:06:58.247352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31785): Launched 00:06:58.573490 run osmo-stp_10.42.42.5(pid=31786): Launched 00:06:58.697570 run osmo-msc_10.42.42.6: Starting osmo-msc 00:06:59.284724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31788): Launched 00:06:59.609503 run osmo-msc_10.42.42.6(pid=31789): Launched 00:06:59.790560 run osmo-stp_10.42.42.5(pid=31786): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31786)] 00:06:59.927482 run osmo-stp_10.42.42.5(pid=31786): stdout: | (launched: 2022-12-09_00:06:58.514138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:00.065677 run osmo-stp_10.42.42.5(pid=31786): stderr: | [0;m[38;5;43m20221209000658708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000658708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000658709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000658709 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000658710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000658710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000658710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:00.203091 run osmo-stp_10.42.42.5(pid=31786): stdout: | (launched: 2022-12-09_00:06:58.514138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:00.331987 run osmo-stp_10.42.42.5(pid=31786): stderr: | [0;m[38;5;43m20221209000658708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000658708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000658709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000658709 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000658710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000658710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000658710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:00.486737 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31786): Process ended prematurely: osmo-stp_10.42.42.5(pid=31786) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31786)] [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 00:07:00.496213 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 00:07:00.523967 run osmo-hlr_10.42.42.2(pid=31783): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31783)] 00:07:00.574313 run osmo-hlr_10.42.42.2(pid=31783): stdout: | (launched: 2022-12-09_00:06:57.502563) 00:07:00.625753 run osmo-hlr_10.42.42.2(pid=31783): stderr: | [0;m[1;31m20221209000657702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000657702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000657702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000657702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000657702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000657702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000657714 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000657722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000657723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000657723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:07:00.697637 run osmo-msc_10.42.42.6(pid=31789): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31789)] 00:07:00.747134 run osmo-msc_10.42.42.6(pid=31789): stdout: | (launched: 2022-12-09_00:06:59.550287) 00:07:00.798560 run osmo-msc_10.42.42.6(pid=31789): stderr: | [0;m[38;5;43m20221209000659875 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209000659875 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5bbcd59c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209000659875 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209000659875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209000659875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209000659875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209000659877 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209000659877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209000659878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209000659878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:07:00.871808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31782): Terminating (SIGTERM) 00:07:00.918459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31785): Terminating (SIGTERM) 00:07:00.961666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31788): Terminating (SIGTERM) 00:07:01.008663 --- ParallelTerminationStrategy: PID 31782 died... 00:07:01.028534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31782): Terminated: ok {rc=0} 00:07:01.076244 --- ParallelTerminationStrategy: PID 31785 died... 00:07:01.095931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31785): Terminated: ok {rc=0} 00:07:01.142908 --- ParallelTerminationStrategy: PID 31788 died... 00:07:01.163414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31788): Terminated: ok {rc=0} 00:07:01.251037 bus /sierra_3: Setting Powered False 00:07:02.345383 bus /sierra_3: Setting Powered False 00:07:03.459312 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:07:04.709450 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:07:04.715340 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:07:04.744045 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 00:07:04.769975 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 00:07:04.819903 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:07:04.848210 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 00:07:04.874172 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 00:07:05.425506 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 00:07:05.475386 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:07:05.486629 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:07:05.553017 tst mo_mt_call.py: using LAC 17699 00:07:05.674545 tst mo_mt_call.py: using RAC 104 00:07:05.796598 tst mo_mt_call.py: using CellId 17699 00:07:05.918298 tst mo_mt_call.py: using BVCI 17700 00:07:06.030868 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:07:06.041994 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:07:06.052669 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:07:06.063420 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:07:06.074176 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:07:06.084804 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:07:06.203161 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:07:06.319189 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:07:06.792082 run create_hlr_db(pid=31794): Launched 00:07:06.917273 bus /sierra_2: Setting Powered False 00:07:07.978151 run create_hlr_db(pid=31794): Terminated: ok {rc=0} 00:07:08.402959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31796): Launched 00:07:08.708448 run osmo-hlr_10.42.42.2(pid=31797): Launched 00:07:08.823745 run osmo-stp_10.42.42.5: Starting osmo-stp 00:07:09.363238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31799): Launched 00:07:09.672266 run osmo-stp_10.42.42.5(pid=31800): Launched 00:07:09.787244 run osmo-msc_10.42.42.6: Starting osmo-msc 00:07:10.350292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31802): Launched 00:07:10.657125 run osmo-msc_10.42.42.6(pid=31803): Launched 00:07:10.828152 run osmo-stp_10.42.42.5(pid=31800): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31800)] 00:07:10.958034 run osmo-stp_10.42.42.5(pid=31800): stdout: | (launched: 2022-12-09_00:07:09.616502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:11.087812 run osmo-stp_10.42.42.5(pid=31800): stderr: | [0;m[38;5;43m20221209000709790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000709790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000709790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000709791 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000709793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000709793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000709793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:11.215678 run osmo-stp_10.42.42.5(pid=31800): stdout: | (launched: 2022-12-09_00:07:09.616502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:11.336694 run osmo-stp_10.42.42.5(pid=31800): stderr: | [0;m[38;5;43m20221209000709790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000709790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000709790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000709791 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000709793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000709793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000709793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:11.481760 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31800): Process ended prematurely: osmo-stp_10.42.42.5(pid=31800) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31800)] [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 00:07:11.490770 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 00:07:11.517285 run osmo-hlr_10.42.42.2(pid=31797): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31797)] 00:07:11.564423 run osmo-hlr_10.42.42.2(pid=31797): stdout: | (launched: 2022-12-09_00:07:08.652593) 00:07:11.613139 run osmo-hlr_10.42.42.2(pid=31797): stderr: | [0;m[1;31m20221209000708832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000708832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000708832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000708832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000708832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000708832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000708844 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000708853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000708853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000708853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:07:11.681339 run osmo-msc_10.42.42.6(pid=31803): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31803)] 00:07:11.728346 run osmo-msc_10.42.42.6(pid=31803): stdout: | (launched: 2022-12-09_00:07:10.601099) 00:07:11.776690 run osmo-msc_10.42.42.6(pid=31803): stderr: | [0;m[38;5;43m20221209000710872 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209000710872 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6c6d1f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209000710872 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209000710873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209000710873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209000710873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209000710875 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209000710875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209000710875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209000710875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:07:11.825619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31796): Terminating (SIGTERM) 00:07:11.864556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31799): Terminating (SIGTERM) 00:07:11.903673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31802): Terminating (SIGTERM) 00:07:11.943361 --- ParallelTerminationStrategy: PID 31796 died... 00:07:11.962400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31796): Terminated: ok {rc=0} 00:07:12.005764 --- ParallelTerminationStrategy: PID 31799 died... 00:07:12.024236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31799): Terminated: ok {rc=0} 00:07:12.068081 --- ParallelTerminationStrategy: PID 31802 died... 00:07:12.086701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31802): Terminated: ok {rc=0} 00:07:12.169638 bus /sierra_3: Setting Powered False 00:07:13.266295 bus /sierra_3: Setting Powered False 00:07:14.383180 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 00:07:15.526393 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:07:15.538294 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:07:15.606862 tst mo_mt_call_osmux.py: using LAC 17700 00:07:15.734626 tst mo_mt_call_osmux.py: using RAC 105 00:07:15.868579 tst mo_mt_call_osmux.py: using CellId 17700 00:07:16.016034 tst mo_mt_call_osmux.py: using BVCI 17701 00:07:16.129632 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:07:16.141734 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:07:16.153143 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:07:16.166114 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:07:16.178236 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:07:16.190440 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:07:16.308863 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:07:16.455368 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:07:17.003057 run create_hlr_db(pid=31805): Launched 00:07:17.160499 bus /sierra_2: Setting Powered False 00:07:18.221708 run create_hlr_db(pid=31805): Terminated: ok {rc=0} 00:07:18.676361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31807): Launched 00:07:19.001959 run osmo-hlr_10.42.42.2(pid=31808): Launched 00:07:19.125459 run osmo-stp_10.42.42.5: Starting osmo-stp 00:07:19.685625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31810): Launched 00:07:20.009167 run osmo-stp_10.42.42.5(pid=31811): Launched 00:07:20.132627 run osmo-msc_10.42.42.6: Starting osmo-msc 00:07:20.718303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31813): Launched 00:07:21.043390 run osmo-msc_10.42.42.6(pid=31814): Launched 00:07:21.224876 run osmo-stp_10.42.42.5(pid=31811): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31811)] 00:07:21.362394 run osmo-stp_10.42.42.5(pid=31811): stdout: | (launched: 2022-12-09_00:07:19.950105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:21.500089 run osmo-stp_10.42.42.5(pid=31811): stderr: | [0;m[38;5;43m20221209000720141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000720141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000720141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000720141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000720142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000720142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000720142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:21.637223 run osmo-stp_10.42.42.5(pid=31811): stdout: | (launched: 2022-12-09_00:07:19.950105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:21.766951 run osmo-stp_10.42.42.5(pid=31811): stderr: | [0;m[38;5;43m20221209000720141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000720141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000720141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000720141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000720142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000720142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000720142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:21.921806 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31811): Process ended prematurely: osmo-stp_10.42.42.5(pid=31811) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31811)] [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 00:07:21.931567 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 00:07:21.959350 run osmo-hlr_10.42.42.2(pid=31808): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31808)] 00:07:22.009838 run osmo-hlr_10.42.42.2(pid=31808): stdout: | (launched: 2022-12-09_00:07:18.942826) 00:07:22.061134 run osmo-hlr_10.42.42.2(pid=31808): stderr: | [0;m[1;31m20221209000719142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000719142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000719142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000719142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000719142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000719142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000719158 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000719167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000719167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000719167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:07:22.132725 run osmo-msc_10.42.42.6(pid=31814): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31814)] 00:07:22.182450 run osmo-msc_10.42.42.6(pid=31814): stdout: | (launched: 2022-12-09_00:07:20.984095) 00:07:22.233704 run osmo-msc_10.42.42.6(pid=31814): stderr: | [0;m[38;5;43m20221209000721304 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209000721305 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff189c29c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209000721305 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209000721305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209000721305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209000721305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209000721307 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209000721307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209000721307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209000721308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:07:22.285424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31807): Terminating (SIGTERM) 00:07:22.326744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31810): Terminating (SIGTERM) 00:07:22.367916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31813): Terminating (SIGTERM) 00:07:22.410052 --- ParallelTerminationStrategy: PID 31807 died... 00:07:22.430566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31807): Terminated: ok {rc=0} 00:07:22.476749 --- ParallelTerminationStrategy: PID 31810 died... 00:07:22.496511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31810): Terminated: ok {rc=0} 00:07:22.542639 --- ParallelTerminationStrategy: PID 31813 died... 00:07:22.562356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31813): Terminated: ok {rc=0} 00:07:22.649870 bus /sierra_3: Setting Powered False 00:07:23.746861 bus /sierra_3: Setting Powered False 00:07:24.861335 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 00:07:26.107682 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:07:26.112373 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 00:07:26.142250 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:07:26.170240 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 00:07:26.254713 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 00:07:26.284194 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:07:26.311504 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 00:07:26.898626 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2351 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 00:07:26.903749 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:26.914957 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:07:26.960865 tst emergency_mo_mt_call.py: using LAC 17701 00:07:27.085381 tst emergency_mo_mt_call.py: using RAC 106 00:07:27.208574 tst emergency_mo_mt_call.py: using CellId 17701 00:07:27.331435 tst emergency_mo_mt_call.py: using BVCI 17702 00:07:27.448482 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:27.459806 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:27.470759 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:27.482081 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:27.493046 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:27.504538 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:27.618541 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:27.735726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:07:28.229890 run create_hlr_db(pid=31819): Launched 00:07:28.351753 bus /sierra_2: Setting Powered False 00:07:29.415771 run create_hlr_db(pid=31819): Terminated: ok {rc=0} 00:07:29.846238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31821): Launched 00:07:30.146994 run osmo-hlr_10.42.42.2(pid=31822): Launched 00:07:30.260847 run osmo-stp_10.42.42.5: Starting osmo-stp 00:07:30.792079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31824): Launched 00:07:31.149213 run osmo-stp_10.42.42.5(pid=31825): Launched 00:07:31.375334 tst emergency_mo_mt_call.py: using MSISDN 6919 00:07:31.652295 run osmo-msc_10.42.42.6: Starting osmo-msc 00:07:32.225239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31827): Launched 00:07:32.525625 run osmo-msc_10.42.42.6(pid=31828): Launched 00:07:32.693993 run osmo-stp_10.42.42.5(pid=31825): ERR: Terminated: ERROR {rc=1} [trial-2351↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31825)] 00:07:32.821561 run osmo-stp_10.42.42.5(pid=31825): stdout: | (launched: 2022-12-09_00:07:31.088303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:32.948290 run osmo-stp_10.42.42.5(pid=31825): stderr: | [0;m[38;5;43m20221209000731413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000731413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000731413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000731414 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000731414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000731414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000731414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:33.072156 run osmo-stp_10.42.42.5(pid=31825): stdout: | (launched: 2022-12-09_00:07:31.088303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:33.191148 run osmo-stp_10.42.42.5(pid=31825): stderr: | [0;m[38;5;43m20221209000731413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000731413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000731413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000731414 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000731414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000731414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000731414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:33.333223 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=31825): Process ended prematurely: osmo-stp_10.42.42.5(pid=31825) [trial-2351↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31825)] [trial-2351↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 00:07:33.341257 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 00:07:33.366906 run osmo-hlr_10.42.42.2(pid=31822): ERR: Terminated: ERROR {rc=237} [trial-2351↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31822)] 00:07:33.413606 run osmo-hlr_10.42.42.2(pid=31822): stdout: | (launched: 2022-12-09_00:07:30.091995) 00:07:33.461964 run osmo-hlr_10.42.42.2(pid=31822): stderr: | [0;m[1;31m20221209000730270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000730270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000730270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000730270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000730271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000730271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000730283 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000730292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000730292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000730292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:07:33.529462 run osmo-msc_10.42.42.6(pid=31828): ERR: Terminated: ERROR {rc=2} [trial-2351↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31828)] 00:07:33.575971 run osmo-msc_10.42.42.6(pid=31828): stdout: | (launched: 2022-12-09_00:07:32.470702) 00:07:33.624046 run osmo-msc_10.42.42.6(pid=31828): stderr: | [0;m[38;5;43m20221209000732743 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209000732743 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f83d2ec7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209000732743 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209000732743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209000732743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209000732743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209000732745 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209000732746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209000732746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209000732746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:07:33.672624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31821): Terminating (SIGTERM) 00:07:33.711459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31824): Terminating (SIGTERM) 00:07:33.750169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31827): Terminating (SIGTERM) 00:07:33.789325 --- ParallelTerminationStrategy: PID 31821 died... 00:07:33.808060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31821): Terminated: ok {rc=0} 00:07:33.850883 --- ParallelTerminationStrategy: PID 31824 died... 00:07:33.869172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31824): Terminated: ok {rc=0} 00:07:33.911805 --- ParallelTerminationStrategy: PID 31827 died... 00:07:33.930157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31827): Terminated: ok {rc=0} 00:07:34.011853 bus /sierra_3: Setting Powered False 00:07:35.104563 bus /sierra_3: Setting Powered False 00:07:36.216609 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 00:07:37.303123 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:37.314713 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:07:37.361536 tst emergency_preemptive_call.py: using LAC 17702 00:07:37.487964 tst emergency_preemptive_call.py: using RAC 107 00:07:37.606301 tst emergency_preemptive_call.py: using CellId 17702 00:07:37.724634 tst emergency_preemptive_call.py: using BVCI 17703 00:07:37.832101 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:37.843071 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:37.853816 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:37.864511 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:37.875286 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:37.886348 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:38.004049 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:38.120848 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:38.240299 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:38.354707 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:07:38.850030 run create_hlr_db(pid=31830): Launched 00:07:38.971565 bus /sierra_2: Setting Powered False 00:07:40.034459 run create_hlr_db(pid=31830): Terminated: ok {rc=0} 00:07:40.480929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31832): Launched 00:07:40.800794 run osmo-hlr_10.42.42.2(pid=31833): Launched 00:07:40.923758 run osmo-stp_10.42.42.5: Starting osmo-stp 00:07:41.477686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31835): Launched 00:07:41.796493 run osmo-stp_10.42.42.5(pid=31836): Launched 00:07:41.928631 tst emergency_preemptive_call.py: using MSISDN 6920 00:07:42.092910 run osmo-msc_10.42.42.6: Starting osmo-msc 00:07:42.666373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31838): Launched 00:07:42.986148 run osmo-msc_10.42.42.6(pid=31839): Launched 00:07:43.165434 run osmo-stp_10.42.42.5(pid=31836): ERR: Terminated: ERROR {rc=1} [trial-2351↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31836)] 00:07:43.301620 run osmo-stp_10.42.42.5(pid=31836): stdout: | (launched: 2022-12-09_00:07:41.738309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:43.438231 run osmo-stp_10.42.42.5(pid=31836): stderr: | [0;m[38;5;43m20221209000741933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000741933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000741933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000741934 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000741934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000741934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000741934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:43.573559 run osmo-stp_10.42.42.5(pid=31836): stdout: | (launched: 2022-12-09_00:07:41.738309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:43.701385 run osmo-stp_10.42.42.5(pid=31836): stderr: | [0;m[38;5;43m20221209000741933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000741933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000741933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000741934 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000741934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000741934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000741934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:43.853741 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=31836): Process ended prematurely: osmo-stp_10.42.42.5(pid=31836) [trial-2351↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31836)] [trial-2351↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 00:07:43.862887 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 00:07:43.891016 run osmo-hlr_10.42.42.2(pid=31833): ERR: Terminated: ERROR {rc=237} [trial-2351↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31833)] 00:07:43.941554 run osmo-hlr_10.42.42.2(pid=31833): stdout: | (launched: 2022-12-09_00:07:40.742384) 00:07:43.993696 run osmo-hlr_10.42.42.2(pid=31833): stderr: | [0;m[1;31m20221209000740940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000740940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000740940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000740940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000740940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000740940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000740953 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000740961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000740962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000740962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:07:44.066226 run osmo-msc_10.42.42.6(pid=31839): ERR: Terminated: ERROR {rc=2} [trial-2351↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31839)] 00:07:44.116289 run osmo-msc_10.42.42.6(pid=31839): stdout: | (launched: 2022-12-09_00:07:42.928051) 00:07:44.168044 run osmo-msc_10.42.42.6(pid=31839): stderr: | [0;m[38;5;43m20221209000743249 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209000743249 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f30b9004c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209000743249 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209000743249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209000743249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209000743249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209000743251 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209000743252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209000743252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209000743252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:07:44.220607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31832): Terminating (SIGTERM) 00:07:44.262919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31835): Terminating (SIGTERM) 00:07:44.304604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31838): Terminating (SIGTERM) 00:07:44.347372 --- ParallelTerminationStrategy: PID 31832 died... 00:07:44.367918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31832): Terminated: ok {rc=0} 00:07:44.414603 --- ParallelTerminationStrategy: PID 31835 died... 00:07:44.434254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31835): Terminated: ok {rc=0} 00:07:44.480725 --- ParallelTerminationStrategy: PID 31838 died... 00:07:44.500357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31838): Terminated: ok {rc=0} 00:07:44.588941 bus /sierra_9: Setting Powered False 00:07:45.686415 bus /sierra_9: Setting Powered False 00:07:46.814019 bus /sierra_8: Setting Powered False 00:07:47.912183 bus /sierra_8: Setting Powered False 00:07:49.027899 bus /sierra_3: Setting Powered False 00:07:50.125067 bus /sierra_3: Setting Powered False 00:07:51.241200 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 00:07:52.515832 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:07:52.520678 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 00:07:52.550749 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 00:07:52.590375 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 00:07:52.678863 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 00:07:52.708665 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 00:07:52.748537 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 00:07:53.345460 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 00:07:53.398951 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:53.410251 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:07:53.454349 tst cs_paging_gprs_active.py: using LAC 17703 00:07:53.582627 tst cs_paging_gprs_active.py: using RAC 108 00:07:53.708697 tst cs_paging_gprs_active.py: using CellId 17703 00:07:53.834665 tst cs_paging_gprs_active.py: using BVCI 17704 00:07:53.953051 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:53.964245 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:53.975233 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:53.986178 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:53.997529 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:54.008232 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:54.019715 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:54.030763 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:54.042810 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:54.161499 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:54.283159 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:07:54.489695 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:07:54.796375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31844): Launched 00:07:55.065024 run iperf3-srv_10.42.42.10(pid=31845): Launched 00:07:55.180206 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:07:55.386525 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:07:55.694058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31846): Launched 00:07:55.960686 run iperf3-srv_10.42.42.10(pid=31847): Launched 00:07:56.075602 tst cs_paging_gprs_active.py:38: start network... 00:07:56.281555 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:07:56.756658 run create_hlr_db(pid=31848): Launched 00:07:56.882064 bus /sierra_2: Setting Powered False 00:07:57.943313 run create_hlr_db(pid=31848): Terminated: ok {rc=0} 00:07:58.389115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31850): Launched 00:07:58.715101 run osmo-hlr_10.42.42.2(pid=31851): Launched 00:07:58.839772 run osmo-stp_10.42.42.5: Starting osmo-stp 00:07:59.403057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31853): Launched 00:07:59.729995 run osmo-stp_10.42.42.5(pid=31854): Launched 00:07:59.855301 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:08:00.419522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31856): Launched 00:08:00.544574 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:08:00.819687 run patchelf(pid=31857): Launched 00:08:01.026392 run osmo-stp_10.42.42.5(pid=31854): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31854)] 00:08:01.160501 run osmo-stp_10.42.42.5(pid=31854): stdout: | (launched: 2022-12-09_00:07:59.670331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:01.331992 run osmo-stp_10.42.42.5(pid=31854): stderr: | [0;m[38;5;43m20221209000759863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000759863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000759863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000759864 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000759864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000759864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000759864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:01.484928 run osmo-stp_10.42.42.5(pid=31854): stdout: | (launched: 2022-12-09_00:07:59.670331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:01.619316 run osmo-stp_10.42.42.5(pid=31854): stderr: | [0;m[38;5;43m20221209000759863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000759863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000759863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000759864 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000759864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000759864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000759864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:01.780420 run patchelf(pid=31857): Terminating (SIGINT) 00:08:01.956221 run patchelf(pid=31857): Terminated: ok {rc=0} 00:08:02.098659 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31854): Process ended prematurely: osmo-stp_10.42.42.5(pid=31854) [trial-2351↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31854)] [trial-2351↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 00:08:02.109746 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 00:08:02.148740 run osmo-hlr_10.42.42.2(pid=31851): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31851)] 00:08:02.209087 run osmo-hlr_10.42.42.2(pid=31851): stdout: | (launched: 2022-12-09_00:07:58.655643) 00:08:02.262890 run osmo-hlr_10.42.42.2(pid=31851): stderr: | [0;m[1;31m20221209000758856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000758856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000758856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000758856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000758856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000758856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000758868 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000758877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000758877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000758877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:08:02.313695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31844): Terminating (SIGTERM) 00:08:02.354205 run iperf3-srv_10.42.42.10(pid=31845): Terminating (SIGTERM) 00:08:02.395457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31846): Terminating (SIGTERM) 00:08:02.435640 run iperf3-srv_10.42.42.10(pid=31847): Terminating (SIGTERM) 00:08:02.476455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31850): Terminating (SIGTERM) 00:08:02.520776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31853): Terminating (SIGTERM) 00:08:02.563973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31856): Terminating (SIGTERM) 00:08:02.616689 --- ParallelTerminationStrategy: PID 31844 died... 00:08:02.636196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31844): Terminated: ok {rc=0} 00:08:02.688860 --- ParallelTerminationStrategy: PID 31845 died... 00:08:02.713158 run iperf3-srv_10.42.42.10(pid=31845): Terminated {rc=256} 00:08:02.759865 --- ParallelTerminationStrategy: PID 31846 died... 00:08:02.780496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31846): Terminated: ok {rc=0} 00:08:02.830349 --- ParallelTerminationStrategy: PID 31847 died... 00:08:02.851442 run iperf3-srv_10.42.42.10(pid=31847): Terminated {rc=256} 00:08:02.902404 --- ParallelTerminationStrategy: PID 31850 died... 00:08:02.926194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31850): Terminated: ok {rc=0} 00:08:02.975757 --- ParallelTerminationStrategy: PID 31853 died... 00:08:02.995179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31853): Terminated: ok {rc=0} 00:08:03.044849 --- ParallelTerminationStrategy: PID 31856 died... 00:08:03.068619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31856): Terminated: ok {rc=0} 00:08:03.156629 bus /gobi_0: Setting Powered False 00:08:04.267274 bus /gobi_0: Setting Powered False 00:08:05.381602 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 00:08:06.554202 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:06.569955 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:08:06.623270 tst iperf3.py: using LAC 17704 00:08:06.756808 tst iperf3.py: using RAC 109 00:08:06.889117 tst iperf3.py: using CellId 17704 00:08:07.017793 tst iperf3.py: using BVCI 17705 00:08:07.139789 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:07.151965 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:07.165032 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:07.177116 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:07.191459 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:07.204330 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:07.216441 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:07.228324 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:07.242236 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:08:07.367085 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:08:07.594290 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:07.930625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32130): Launched 00:08:08.237577 run iperf3-srv_10.42.42.10(pid=32131): Launched 00:08:08.376569 tst iperf3.py:8: start network... 00:08:08.601958 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:08:09.124633 run create_hlr_db(pid=32132): Launched 00:08:09.288521 bus /gobi_6: Setting Powered False 00:08:10.355016 run create_hlr_db(pid=32132): Terminated: ok {rc=0} 00:08:10.826476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32134): Launched 00:08:11.175595 run osmo-hlr_10.42.42.2(pid=32135): Launched 00:08:11.427667 run osmo-stp_10.42.42.5: Starting osmo-stp 00:08:12.113664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32137): Launched 00:08:12.465694 run osmo-stp_10.42.42.5(pid=32138): Launched 00:08:12.710435 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:08:13.402995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32140): Launched 00:08:13.533138 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:08:13.803954 run patchelf(pid=32141): Launched 00:08:13.990641 run osmo-stp_10.42.42.5(pid=32138): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32138)] 00:08:14.123135 run osmo-stp_10.42.42.5(pid=32138): stdout: | (launched: 2022-12-09_00:08:12.399038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:14.257590 run osmo-stp_10.42.42.5(pid=32138): stderr: | [0;m[38;5;43m20221209000812728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000812728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000812728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000812728 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000812729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000812729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000812729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:14.391822 run osmo-stp_10.42.42.5(pid=32138): stdout: | (launched: 2022-12-09_00:08:12.399038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:14.519610 run osmo-stp_10.42.42.5(pid=32138): stderr: | [0;m[38;5;43m20221209000812728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000812728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000812728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000812728 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000812729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000812729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000812729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:14.671096 run patchelf(pid=32141): Terminating (SIGINT) 00:08:14.845853 run patchelf(pid=32141): Terminated: ok {rc=0} 00:08:14.971929 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32138): Process ended prematurely: osmo-stp_10.42.42.5(pid=32138) [trial-2351↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32138)] [trial-2351↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 00:08:14.982542 tst iperf3.py:8: Test FAILED (8.5 sec) 00:08:15.011986 run osmo-hlr_10.42.42.2(pid=32135): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32135)] 00:08:15.061325 run osmo-hlr_10.42.42.2(pid=32135): stdout: | (launched: 2022-12-09_00:08:11.110445) 00:08:15.111817 run osmo-hlr_10.42.42.2(pid=32135): stderr: | [0;m[1;31m20221209000811423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000811423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000811423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000811423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000811423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000811423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000811445 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000811462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000811462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000811462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:08:15.163093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32130): Terminating (SIGTERM) 00:08:15.204116 run iperf3-srv_10.42.42.10(pid=32131): Terminating (SIGTERM) 00:08:15.245184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32134): Terminating (SIGTERM) 00:08:15.287630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32137): Terminating (SIGTERM) 00:08:15.330772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32140): Terminating (SIGTERM) 00:08:15.374791 --- ParallelTerminationStrategy: PID 32130 died... 00:08:15.394820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32130): Terminated: ok {rc=0} 00:08:15.441917 --- ParallelTerminationStrategy: PID 32131 died... 00:08:15.461358 run iperf3-srv_10.42.42.10(pid=32131): Terminated {rc=256} 00:08:15.506752 --- ParallelTerminationStrategy: PID 32134 died... 00:08:15.526720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32134): Terminated: ok {rc=0} 00:08:15.572228 --- ParallelTerminationStrategy: PID 32137 died... 00:08:15.591947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32137): Terminated: ok {rc=0} 00:08:15.637524 --- ParallelTerminationStrategy: PID 32140 died... 00:08:15.656805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32140): Terminated: ok {rc=0} 00:08:15.742837 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 00:08:16.891937 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:16.903859 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:08:16.948479 tst iperf3m4.py: using LAC 17705 00:08:17.114533 tst iperf3m4.py: using RAC 110 00:08:17.259630 tst iperf3m4.py: using CellId 17705 00:08:17.405583 tst iperf3m4.py: using BVCI 17706 00:08:17.551460 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:17.565179 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:17.579191 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:17.591881 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:17.605131 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:17.618867 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:17.633853 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:17.648629 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:17.662565 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:08:17.787457 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:08:17.903085 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:08:18.017275 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:08:18.132255 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:08:18.341680 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:18.662446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32142): Launched 00:08:18.957700 run iperf3-srv_10.42.42.10(pid=32143): Launched 00:08:19.086059 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:08:19.296250 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:19.617160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32144): Launched 00:08:19.910163 run iperf3-srv_10.42.42.10(pid=32145): Launched 00:08:20.042254 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:08:20.252071 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:20.572794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32146): Launched 00:08:20.864353 run iperf3-srv_10.42.42.10(pid=32147): Launched 00:08:20.996247 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:08:21.206954 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:21.527734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32148): Launched 00:08:21.820280 run iperf3-srv_10.42.42.10(pid=32149): Launched 00:08:21.952471 tst iperf3m4.py:8: start network... 00:08:22.161006 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:08:22.654480 run create_hlr_db(pid=32150): Launched 00:08:22.817046 bus /gobi_6: Setting Powered False 00:08:23.879164 run create_hlr_db(pid=32150): Terminated: ok {rc=0} 00:08:24.329503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32152): Launched 00:08:24.678740 run osmo-hlr_10.42.42.2(pid=32154): Launched 00:08:24.803499 run osmo-stp_10.42.42.5: Starting osmo-stp 00:08:25.462162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32156): Launched 00:08:25.780753 run osmo-stp_10.42.42.5(pid=32157): Launched 00:08:25.902557 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:08:26.453519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32159): Launched 00:08:26.575933 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:08:26.845528 run patchelf(pid=32160): Launched 00:08:27.022929 run osmo-stp_10.42.42.5(pid=32157): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32157)] 00:08:27.158987 run osmo-stp_10.42.42.5(pid=32157): stdout: | (launched: 2022-12-09_00:08:25.722857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:27.297212 run osmo-stp_10.42.42.5(pid=32157): stderr: | [0;m[38;5;43m20221209000825915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000825915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000825915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000825915 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000825916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000825916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000825916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:27.434599 run osmo-stp_10.42.42.5(pid=32157): stdout: | (launched: 2022-12-09_00:08:25.722857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:27.566239 run osmo-stp_10.42.42.5(pid=32157): stderr: | [0;m[38;5;43m20221209000825915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000825915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000825915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000825915 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000825916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000825916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000825916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:27.721870 run patchelf(pid=32160): Terminating (SIGINT) 00:08:27.900383 run patchelf(pid=32160): Terminated: ok {rc=0} 00:08:28.029863 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32157): Process ended prematurely: osmo-stp_10.42.42.5(pid=32157) [trial-2351↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32157)] [trial-2351↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 00:08:28.040139 tst iperf3m4.py:8: Test FAILED (11.2 sec) 00:08:28.068898 run osmo-hlr_10.42.42.2(pid=32154): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32154)] 00:08:28.119281 run osmo-hlr_10.42.42.2(pid=32154): stdout: | (launched: 2022-12-09_00:08:24.619563) 00:08:28.171543 run osmo-hlr_10.42.42.2(pid=32154): stderr: | [0;m[1;31m20221209000824818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000824818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000824818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000824818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000824818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000824818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000824830 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000824838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000824838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000824838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:08:28.223677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32142): Terminating (SIGTERM) 00:08:28.264900 run iperf3-srv_10.42.42.10(pid=32143): Terminating (SIGTERM) 00:08:28.306272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32144): Terminating (SIGTERM) 00:08:28.348421 run iperf3-srv_10.42.42.10(pid=32145): Terminating (SIGTERM) 00:08:28.390376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32146): Terminating (SIGTERM) 00:08:28.431614 run iperf3-srv_10.42.42.10(pid=32147): Terminating (SIGTERM) 00:08:28.473037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32148): Terminating (SIGTERM) 00:08:28.514756 run iperf3-srv_10.42.42.10(pid=32149): Terminating (SIGTERM) 00:08:28.557316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32152): Terminating (SIGTERM) 00:08:28.599033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32156): Terminating (SIGTERM) 00:08:28.640679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32159): Terminating (SIGTERM) 00:08:28.682794 --- ParallelTerminationStrategy: PID 32142 died... 00:08:28.702628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32142): Terminated: ok {rc=0} 00:08:28.749108 --- ParallelTerminationStrategy: PID 32143 died... 00:08:28.768593 run iperf3-srv_10.42.42.10(pid=32143): Terminated {rc=256} 00:08:28.814991 --- ParallelTerminationStrategy: PID 32144 died... 00:08:28.834371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32144): Terminated: ok {rc=0} 00:08:28.880177 --- ParallelTerminationStrategy: PID 32145 died... 00:08:28.899543 run iperf3-srv_10.42.42.10(pid=32145): Terminated {rc=256} 00:08:28.946398 --- ParallelTerminationStrategy: PID 32146 died... 00:08:28.965903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32146): Terminated: ok {rc=0} 00:08:29.012204 --- ParallelTerminationStrategy: PID 32147 died... 00:08:29.031740 run iperf3-srv_10.42.42.10(pid=32147): Terminated {rc=256} 00:08:29.077959 --- ParallelTerminationStrategy: PID 32148 died... 00:08:29.097483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32148): Terminated: ok {rc=0} 00:08:29.143546 --- ParallelTerminationStrategy: PID 32149 died... 00:08:29.163588 run iperf3-srv_10.42.42.10(pid=32149): Terminated {rc=256} 00:08:29.210375 --- ParallelTerminationStrategy: PID 32152 died... 00:08:29.229971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32152): Terminated: ok {rc=0} 00:08:29.275780 --- ParallelTerminationStrategy: PID 32156 died... 00:08:29.295675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32156): Terminated: ok {rc=0} 00:08:29.342062 --- ParallelTerminationStrategy: PID 32159 died... 00:08:29.361441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32159): Terminated: ok {rc=0} 00:08:29.447782 bus /gobi_4: Setting Powered False 00:08:30.544330 bus /gobi_4: Setting Powered False 00:08:31.665584 bus /gobi_1: Setting Powered False 00:08:32.768589 bus /gobi_1: Setting Powered False 00:08:33.881610 bus /gobi_0: Setting Powered False 00:08:34.978775 bus /gobi_0: Setting Powered False 00:08:36.093682 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 00:08:37.195755 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:37.206987 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:08:37.250966 tst ping.py: using LAC 17706 00:08:37.374552 tst ping.py: using RAC 111 00:08:37.496636 tst ping.py: using CellId 17706 00:08:37.619752 tst ping.py: using BVCI 17707 00:08:37.733696 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:37.744827 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:37.756041 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:37.767587 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:37.778434 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:37.789661 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:37.800848 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:37.812497 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:08:37.926896 tst ping.py:19: start network... 00:08:38.122801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:08:38.577476 run create_hlr_db(pid=32161): Launched 00:08:38.690756 bus /gobi_6: Setting Powered False 00:08:39.749563 run create_hlr_db(pid=32161): Terminated: ok {rc=0} 00:08:40.180204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32163): Launched 00:08:40.496198 run osmo-hlr_10.42.42.2(pid=32164): Launched 00:08:40.616223 run osmo-stp_10.42.42.5: Starting osmo-stp 00:08:41.159152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32166): Launched 00:08:41.473160 run osmo-stp_10.42.42.5(pid=32167): Launched 00:08:41.593703 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:08:42.156644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32169): Launched 00:08:42.277804 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:08:42.542122 run patchelf(pid=32170): Launched 00:08:42.716519 run osmo-stp_10.42.42.5(pid=32167): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32167)] 00:08:42.849689 run osmo-stp_10.42.42.5(pid=32167): stdout: | (launched: 2022-12-09_00:08:41.416211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:42.984602 run osmo-stp_10.42.42.5(pid=32167): stderr: | [0;m[38;5;43m20221209000841608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000841608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000841609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000841609 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000841610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000841610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000841610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:43.119656 run osmo-stp_10.42.42.5(pid=32167): stdout: | (launched: 2022-12-09_00:08:41.416211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:43.249121 run osmo-stp_10.42.42.5(pid=32167): stderr: | [0;m[38;5;43m20221209000841608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000841608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000841609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000841609 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000841610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000841610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000841610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:43.401421 run patchelf(pid=32170): Terminating (SIGINT) 00:08:43.577478 run patchelf(pid=32170): Terminated: ok {rc=0} 00:08:43.704467 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32167): Process ended prematurely: osmo-stp_10.42.42.5(pid=32167) [trial-2351↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32167)] [trial-2351↪gprs:trx-lms-limenet-micro↪ping.py:22] 00:08:43.714149 tst ping.py:22: Test FAILED (6.5 sec) 00:08:43.741901 run osmo-hlr_10.42.42.2(pid=32164): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32164)] 00:08:43.792347 run osmo-hlr_10.42.42.2(pid=32164): stdout: | (launched: 2022-12-09_00:08:40.439022) 00:08:43.843887 run osmo-hlr_10.42.42.2(pid=32164): stderr: | [0;m[1;31m20221209000840634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000840634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000840634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000840634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000840634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000840634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000840647 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000840655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000840655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000840656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:08:43.895771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32163): Terminating (SIGTERM) 00:08:43.937042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32166): Terminating (SIGTERM) 00:08:43.978902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32169): Terminating (SIGTERM) 00:08:44.020741 --- ParallelTerminationStrategy: PID 32163 died... 00:08:44.040229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32163): Terminated: ok {rc=0} 00:08:44.088252 --- ParallelTerminationStrategy: PID 32166 died... 00:08:44.107423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32166): Terminated: ok {rc=0} 00:08:44.153030 --- ParallelTerminationStrategy: PID 32169 died... 00:08:44.172409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32169): Terminated: ok {rc=0} 00:08:44.260142 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 00:08:45.343127 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:45.354528 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:08:45.401793 tst ping_idle_ping.py: using LAC 17707 00:08:45.517758 tst ping_idle_ping.py: using RAC 112 00:08:45.638857 tst ping_idle_ping.py: using CellId 17707 00:08:45.754191 tst ping_idle_ping.py: using BVCI 17708 00:08:45.869755 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:45.880922 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:45.900473 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:45.912347 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:45.923777 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:45.935279 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:45.946915 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:45.958083 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:08:46.091051 tst ping_idle_ping.py:24: start network... 00:08:46.325824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:08:46.880504 run create_hlr_db(pid=32171): Launched 00:08:47.043021 bus /gobi_6: Setting Powered False 00:08:48.101606 run create_hlr_db(pid=32171): Terminated: ok {rc=0} 00:08:48.550519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32173): Launched 00:08:48.865904 run osmo-hlr_10.42.42.2(pid=32174): Launched 00:08:48.986285 run osmo-stp_10.42.42.5: Starting osmo-stp 00:08:49.529577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32176): Launched 00:08:49.844063 run osmo-stp_10.42.42.5(pid=32177): Launched 00:08:49.964458 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:08:50.508599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32179): Launched 00:08:50.629575 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:08:50.894760 run patchelf(pid=32180): Launched 00:08:51.069499 run osmo-stp_10.42.42.5(pid=32177): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32177)] 00:08:51.203353 run osmo-stp_10.42.42.5(pid=32177): stdout: | (launched: 2022-12-09_00:08:49.786620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:51.339447 run osmo-stp_10.42.42.5(pid=32177): stderr: | [0;m[38;5;43m20221209000849979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000849979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000849979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000849980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000849980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000849980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000849980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:51.474850 run osmo-stp_10.42.42.5(pid=32177): stdout: | (launched: 2022-12-09_00:08:49.786620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:51.604083 run osmo-stp_10.42.42.5(pid=32177): stderr: | [0;m[38;5;43m20221209000849979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000849979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000849979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000849980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000849980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000849980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000849980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:51.757382 run patchelf(pid=32180): Terminating (SIGINT) 00:08:51.933528 run patchelf(pid=32180): Terminated: ok {rc=0} 00:08:52.061046 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32177): Process ended prematurely: osmo-stp_10.42.42.5(pid=32177) [trial-2351↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32177)] [trial-2351↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 00:08:52.070570 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 00:08:52.098348 run osmo-hlr_10.42.42.2(pid=32174): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32174)] 00:08:52.148033 run osmo-hlr_10.42.42.2(pid=32174): stdout: | (launched: 2022-12-09_00:08:48.808672) 00:08:52.199290 run osmo-hlr_10.42.42.2(pid=32174): stderr: | [0;m[1;31m20221209000849007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000849007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000849007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000849007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000849007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000849007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000849020 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000849030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000849030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000849030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:08:52.251290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32173): Terminating (SIGTERM) 00:08:52.292501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32176): Terminating (SIGTERM) 00:08:52.334527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32179): Terminating (SIGTERM) 00:08:52.376405 --- ParallelTerminationStrategy: PID 32173 died... 00:08:52.396019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32173): Terminated: ok {rc=0} 00:08:52.441818 --- ParallelTerminationStrategy: PID 32176 died... 00:08:52.461556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32176): Terminated: ok {rc=0} 00:08:52.507613 --- ParallelTerminationStrategy: PID 32179 died... 00:08:52.526883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32179): Terminated: ok {rc=0} 00:08:52.613818 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 00:08:53.913392 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:08:53.919599 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 00:08:53.949349 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 00:08:53.989157 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 00:08:54.078777 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 00:08:54.108332 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 00:08:54.146198 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 00:08:54.743505 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 00:08:54.796588 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:54.807921 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:08:54.855474 tst cs_paging_gprs_active.py: using LAC 17708 00:08:54.982422 tst cs_paging_gprs_active.py: using RAC 113 00:08:55.107622 tst cs_paging_gprs_active.py: using CellId 17708 00:08:55.234492 tst cs_paging_gprs_active.py: using BVCI 17709 00:08:55.345770 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:55.356723 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:55.367752 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:55.378851 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:55.389668 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:55.400482 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:55.411391 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:55.422233 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:55.433209 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:08:55.552643 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:08:55.668550 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:08:55.871413 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:56.172859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32184): Launched 00:08:56.435500 run iperf3-srv_10.42.42.10(pid=32185): Launched 00:08:56.548866 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:08:56.751712 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:57.054914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32186): Launched 00:08:57.316725 run iperf3-srv_10.42.42.10(pid=32187): Launched 00:08:57.430565 tst cs_paging_gprs_active.py:38: start network... 00:08:57.632498 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:08:58.100789 run create_hlr_db(pid=32188): Launched 00:08:58.224779 bus /gobi_6: Setting Powered False 00:08:59.285289 run create_hlr_db(pid=32188): Terminated: ok {rc=0} 00:08:59.722755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32190): Launched 00:09:00.043271 run osmo-hlr_10.42.42.2(pid=32191): Launched 00:09:00.166106 run osmo-stp_10.42.42.5: Starting osmo-stp 00:09:00.717147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32193): Launched 00:09:01.069768 run osmo-stp_10.42.42.5(pid=32194): Launched 00:09:01.219504 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:09:01.951247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32196): Launched 00:09:02.085104 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:09:02.347207 run patchelf(pid=32197): Launched 00:09:02.515389 run osmo-stp_10.42.42.5(pid=32194): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32194)] 00:09:02.643374 run osmo-stp_10.42.42.5(pid=32194): stdout: | (launched: 2022-12-09_00:09:01.001984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:02.772621 run osmo-stp_10.42.42.5(pid=32194): stderr: | [0;m[38;5;43m20221209000901362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000901362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000901362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000901363 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000901363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000901363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000901363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:02.901626 run osmo-stp_10.42.42.5(pid=32194): stdout: | (launched: 2022-12-09_00:09:01.001984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:03.025721 run osmo-stp_10.42.42.5(pid=32194): stderr: | [0;m[38;5;43m20221209000901362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000901362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000901362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000901363 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000901363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000901363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000901363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:03.171852 run patchelf(pid=32197): Terminating (SIGINT) 00:09:03.341637 run patchelf(pid=32197): Terminated: ok {rc=0} 00:09:03.464714 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32194): Process ended prematurely: osmo-stp_10.42.42.5(pid=32194) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32194)] [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 00:09:03.474416 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 00:09:03.501635 run osmo-hlr_10.42.42.2(pid=32191): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32191)] 00:09:03.548168 run osmo-hlr_10.42.42.2(pid=32191): stdout: | (launched: 2022-12-09_00:08:59.985189) 00:09:03.596843 run osmo-hlr_10.42.42.2(pid=32191): stderr: | [0;m[1;31m20221209000900184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000900184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000900184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000900184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000900185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000900185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000900196 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000900205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000900205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000900205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:09:03.645618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32184): Terminating (SIGTERM) 00:09:03.684296 run iperf3-srv_10.42.42.10(pid=32185): Terminating (SIGTERM) 00:09:03.722886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32186): Terminating (SIGTERM) 00:09:03.761534 run iperf3-srv_10.42.42.10(pid=32187): Terminating (SIGTERM) 00:09:03.800024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32190): Terminating (SIGTERM) 00:09:03.838694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32193): Terminating (SIGTERM) 00:09:03.877851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32196): Terminating (SIGTERM) 00:09:03.916811 --- ParallelTerminationStrategy: PID 32184 died... 00:09:03.935482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32184): Terminated: ok {rc=0} 00:09:03.978411 --- ParallelTerminationStrategy: PID 32185 died... 00:09:03.996316 run iperf3-srv_10.42.42.10(pid=32185): Terminated {rc=256} 00:09:04.038960 --- ParallelTerminationStrategy: PID 32186 died... 00:09:04.057222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32186): Terminated: ok {rc=0} 00:09:04.100151 --- ParallelTerminationStrategy: PID 32187 died... 00:09:04.118357 run iperf3-srv_10.42.42.10(pid=32187): Terminated {rc=256} 00:09:04.161036 --- ParallelTerminationStrategy: PID 32190 died... 00:09:04.179281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32190): Terminated: ok {rc=0} 00:09:04.222054 --- ParallelTerminationStrategy: PID 32193 died... 00:09:04.240298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32193): Terminated: ok {rc=0} 00:09:04.283311 --- ParallelTerminationStrategy: PID 32196 died... 00:09:04.301698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32196): Terminated: ok {rc=0} 00:09:04.388401 bus /gobi_0: Setting Powered False 00:09:05.484721 bus /gobi_0: Setting Powered False 00:09:06.599402 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 00:09:07.743476 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:07.754956 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:09:07.800481 tst iperf3.py: using LAC 17709 00:09:07.921258 tst iperf3.py: using RAC 114 00:09:08.038586 tst iperf3.py: using CellId 17709 00:09:08.156879 tst iperf3.py: using BVCI 17710 00:09:08.265473 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:08.276310 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:08.287012 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:08.297687 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:08.308214 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:08.318838 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:08.329622 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:08.340140 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:08.351312 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:09:08.470013 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:09:08.686136 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:09.006312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32198): Launched 00:09:09.285616 run iperf3-srv_10.42.42.10(pid=32199): Launched 00:09:09.406408 tst iperf3.py:8: start network... 00:09:09.623145 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:09:10.118828 run create_hlr_db(pid=32200): Launched 00:09:10.243424 bus /gobi_6: Setting Powered False 00:09:11.306571 run create_hlr_db(pid=32200): Terminated: ok {rc=0} 00:09:11.753327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32202): Launched 00:09:12.073064 run osmo-hlr_10.42.42.2(pid=32203): Launched 00:09:12.196185 run osmo-stp_10.42.42.5: Starting osmo-stp 00:09:12.746340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32205): Launched 00:09:13.065267 run osmo-stp_10.42.42.5(pid=32206): Launched 00:09:13.187313 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:09:13.739744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32208): Launched 00:09:13.863076 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:09:14.133257 run patchelf(pid=32209): Launched 00:09:14.311611 run osmo-stp_10.42.42.5(pid=32206): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32206)] 00:09:14.447736 run osmo-stp_10.42.42.5(pid=32206): stdout: | (launched: 2022-12-09_00:09:13.007124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:14.585700 run osmo-stp_10.42.42.5(pid=32206): stderr: | [0;m[38;5;43m20221209000913200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000913200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000913200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000913200 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000913201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000913201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000913201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:14.723721 run osmo-stp_10.42.42.5(pid=32206): stdout: | (launched: 2022-12-09_00:09:13.007124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:14.855415 run osmo-stp_10.42.42.5(pid=32206): stderr: | [0;m[38;5;43m20221209000913200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000913200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000913200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000913200 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000913201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000913201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000913201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:15.010984 run patchelf(pid=32209): Terminating (SIGINT) 00:09:15.190590 run patchelf(pid=32209): Terminated: ok {rc=0} 00:09:15.320516 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32206): Process ended prematurely: osmo-stp_10.42.42.5(pid=32206) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32206)] [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 00:09:15.330714 tst iperf3.py:8: Test FAILED (7.6 sec) 00:09:15.358984 run osmo-hlr_10.42.42.2(pid=32203): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32203)] 00:09:15.408817 run osmo-hlr_10.42.42.2(pid=32203): stdout: | (launched: 2022-12-09_00:09:12.014636) 00:09:15.459981 run osmo-hlr_10.42.42.2(pid=32203): stderr: | [0;m[1;31m20221209000912211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000912211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000912211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000912211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000912211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000912211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000912223 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000912231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000912232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000912232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:09:15.512096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32198): Terminating (SIGTERM) 00:09:15.553354 run iperf3-srv_10.42.42.10(pid=32199): Terminating (SIGTERM) 00:09:15.595107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32202): Terminating (SIGTERM) 00:09:15.636536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32205): Terminating (SIGTERM) 00:09:15.678410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32208): Terminating (SIGTERM) 00:09:15.719763 --- ParallelTerminationStrategy: PID 32198 died... 00:09:15.739903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32198): Terminated: ok {rc=0} 00:09:15.785963 --- ParallelTerminationStrategy: PID 32199 died... 00:09:15.805260 run iperf3-srv_10.42.42.10(pid=32199): Terminated {rc=256} 00:09:15.853509 --- ParallelTerminationStrategy: PID 32202 died... 00:09:15.877391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32202): Terminated: ok {rc=0} 00:09:15.922824 --- ParallelTerminationStrategy: PID 32205 died... 00:09:15.941706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32205): Terminated: ok {rc=0} 00:09:15.987538 --- ParallelTerminationStrategy: PID 32208 died... 00:09:16.006411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32208): Terminated: ok {rc=0} 00:09:16.093131 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 00:09:17.244246 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:17.257181 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:09:17.306399 tst iperf3m4.py: using LAC 17710 00:09:17.436257 tst iperf3m4.py: using RAC 115 00:09:17.562142 tst iperf3m4.py: using CellId 17710 00:09:17.687902 tst iperf3m4.py: using BVCI 17711 00:09:17.804017 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:17.815579 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:17.826955 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:17.838395 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:17.849813 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:17.861007 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:17.872589 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:17.884101 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:17.895678 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:09:18.018295 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:09:18.131761 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:09:18.250640 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:09:18.366687 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:09:18.569442 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:18.871177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32210): Launched 00:09:19.133234 run iperf3-srv_10.42.42.10(pid=32211): Launched 00:09:19.246112 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:09:19.447391 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:19.750143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32212): Launched 00:09:20.013415 run iperf3-srv_10.42.42.10(pid=32213): Launched 00:09:20.126110 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:09:20.327316 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:20.628338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32214): Launched 00:09:20.890317 run iperf3-srv_10.42.42.10(pid=32215): Launched 00:09:21.002890 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:09:21.204084 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:21.505717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32216): Launched 00:09:21.767611 run iperf3-srv_10.42.42.10(pid=32217): Launched 00:09:21.880201 tst iperf3m4.py:8: start network... 00:09:22.081881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:09:22.548713 run create_hlr_db(pid=32218): Launched 00:09:22.673270 bus /gobi_6: Setting Powered False 00:09:23.733440 run create_hlr_db(pid=32218): Terminated: ok {rc=0} 00:09:24.170647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32220): Launched 00:09:24.493147 run osmo-hlr_10.42.42.2(pid=32221): Launched 00:09:24.616871 run osmo-stp_10.42.42.5: Starting osmo-stp 00:09:25.172144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32223): Launched 00:09:25.493126 run osmo-stp_10.42.42.5(pid=32224): Launched 00:09:25.616552 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:09:26.170732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32226): Launched 00:09:26.295038 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:09:26.566076 run patchelf(pid=32227): Launched 00:09:26.744793 run osmo-stp_10.42.42.5(pid=32224): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32224)] 00:09:26.881024 run osmo-stp_10.42.42.5(pid=32224): stdout: | (launched: 2022-12-09_00:09:25.434579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:27.019146 run osmo-stp_10.42.42.5(pid=32224): stderr: | [0;m[38;5;43m20221209000925626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000925626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000925626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000925626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000925627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000925627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000925627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:27.157296 run osmo-stp_10.42.42.5(pid=32224): stdout: | (launched: 2022-12-09_00:09:25.434579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:27.289491 run osmo-stp_10.42.42.5(pid=32224): stderr: | [0;m[38;5;43m20221209000925626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000925626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000925626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000925626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000925627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000925627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000925627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:27.445502 run patchelf(pid=32227): Terminating (SIGINT) 00:09:27.625645 run patchelf(pid=32227): Terminated: ok {rc=0} 00:09:27.755490 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32224): Process ended prematurely: osmo-stp_10.42.42.5(pid=32224) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32224)] [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 00:09:27.765894 tst iperf3m4.py:8: Test FAILED (10.6 sec) 00:09:27.794471 run osmo-hlr_10.42.42.2(pid=32221): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32221)] 00:09:27.844347 run osmo-hlr_10.42.42.2(pid=32221): stdout: | (launched: 2022-12-09_00:09:24.434775) 00:09:27.895814 run osmo-hlr_10.42.42.2(pid=32221): stderr: | [0;m[1;31m20221209000924632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000924633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000924633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000924633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000924633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000924633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000924645 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000924653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000924653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000924653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:09:27.947531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32210): Terminating (SIGTERM) 00:09:27.989557 run iperf3-srv_10.42.42.10(pid=32211): Terminating (SIGTERM) 00:09:28.031173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32212): Terminating (SIGTERM) 00:09:28.072647 run iperf3-srv_10.42.42.10(pid=32213): Terminating (SIGTERM) 00:09:28.114059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32214): Terminating (SIGTERM) 00:09:28.155230 run iperf3-srv_10.42.42.10(pid=32215): Terminating (SIGTERM) 00:09:28.196547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32216): Terminating (SIGTERM) 00:09:28.238835 run iperf3-srv_10.42.42.10(pid=32217): Terminating (SIGTERM) 00:09:28.280927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32220): Terminating (SIGTERM) 00:09:28.322638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32223): Terminating (SIGTERM) 00:09:28.363660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32226): Terminating (SIGTERM) 00:09:28.405474 --- ParallelTerminationStrategy: PID 32210 died... 00:09:28.425394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32210): Terminated: ok {rc=0} 00:09:28.471203 --- ParallelTerminationStrategy: PID 32211 died... 00:09:28.490308 run iperf3-srv_10.42.42.10(pid=32211): Terminated {rc=256} 00:09:28.536071 --- ParallelTerminationStrategy: PID 32212 died... 00:09:28.555270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32212): Terminated: ok {rc=0} 00:09:28.600845 --- ParallelTerminationStrategy: PID 32213 died... 00:09:28.620683 run iperf3-srv_10.42.42.10(pid=32213): Terminated {rc=256} 00:09:28.666684 --- ParallelTerminationStrategy: PID 32214 died... 00:09:28.685890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32214): Terminated: ok {rc=0} 00:09:28.731584 --- ParallelTerminationStrategy: PID 32215 died... 00:09:28.750736 run iperf3-srv_10.42.42.10(pid=32215): Terminated {rc=256} 00:09:28.796459 --- ParallelTerminationStrategy: PID 32216 died... 00:09:28.815706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32216): Terminated: ok {rc=0} 00:09:28.861206 --- ParallelTerminationStrategy: PID 32217 died... 00:09:28.880515 run iperf3-srv_10.42.42.10(pid=32217): Terminated {rc=256} 00:09:28.926057 --- ParallelTerminationStrategy: PID 32220 died... 00:09:28.945739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32220): Terminated: ok {rc=0} 00:09:28.991609 --- ParallelTerminationStrategy: PID 32223 died... 00:09:29.010913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32223): Terminated: ok {rc=0} 00:09:29.056467 --- ParallelTerminationStrategy: PID 32226 died... 00:09:29.076410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32226): Terminated: ok {rc=0} 00:09:29.163363 bus /gobi_4: Setting Powered False 00:09:30.261536 bus /gobi_4: Setting Powered False 00:09:31.380609 bus /gobi_1: Setting Powered False 00:09:32.476016 bus /gobi_1: Setting Powered False 00:09:33.590250 bus /gobi_0: Setting Powered False 00:09:34.688128 bus /gobi_0: Setting Powered False 00:09:35.803773 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 00:09:36.907038 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:36.919149 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:09:36.968235 tst ping.py: using LAC 17711 00:09:37.087702 tst ping.py: using RAC 116 00:09:37.203138 tst ping.py: using CellId 17711 00:09:37.317273 tst ping.py: using BVCI 17712 00:09:37.423819 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:37.434777 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:37.445565 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:37.456311 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:37.466961 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:37.478023 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:37.488836 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:37.499644 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:09:37.616536 tst ping.py:19: start network... 00:09:37.829163 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:09:38.315629 run create_hlr_db(pid=32228): Launched 00:09:38.435737 bus /gobi_6: Setting Powered False 00:09:39.498399 run create_hlr_db(pid=32228): Terminated: ok {rc=0} 00:09:39.921021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32230): Launched 00:09:40.216923 run osmo-hlr_10.42.42.2(pid=32231): Launched 00:09:40.329480 run osmo-stp_10.42.42.5: Starting osmo-stp 00:09:40.841807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32233): Launched 00:09:41.135472 run osmo-stp_10.42.42.5(pid=32234): Launched 00:09:41.247572 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:09:41.759250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32236): Launched 00:09:41.872735 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:09:42.123325 run patchelf(pid=32237): Launched 00:09:42.287709 run osmo-stp_10.42.42.5(pid=32234): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32234)] 00:09:42.413207 run osmo-stp_10.42.42.5(pid=32234): stdout: | (launched: 2022-12-09_00:09:41.082016) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:42.540324 run osmo-stp_10.42.42.5(pid=32234): stderr: | [0;m[38;5;43m20221209000941252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000941252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000941252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000941253 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000941253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000941253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000941254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:42.667554 run osmo-stp_10.42.42.5(pid=32234): stdout: | (launched: 2022-12-09_00:09:41.082016) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:42.788548 run osmo-stp_10.42.42.5(pid=32234): stderr: | [0;m[38;5;43m20221209000941252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000941252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000941252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000941253 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000941253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000941253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000941254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:42.931807 run patchelf(pid=32237): Terminating (SIGINT) 00:09:43.097676 run patchelf(pid=32237): Terminated: ok {rc=0} 00:09:43.217568 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32234): Process ended prematurely: osmo-stp_10.42.42.5(pid=32234) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32234)] [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 00:09:43.226336 tst ping.py:22: Test FAILED (6.3 sec) 00:09:43.252515 run osmo-hlr_10.42.42.2(pid=32231): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32231)] 00:09:43.299460 run osmo-hlr_10.42.42.2(pid=32231): stdout: | (launched: 2022-12-09_00:09:40.162951) 00:09:43.348227 run osmo-hlr_10.42.42.2(pid=32231): stderr: | [0;m[1;31m20221209000940337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000940337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000940337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000940337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000940337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000940337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000940350 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000940359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000940359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000940359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:09:43.397257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32230): Terminating (SIGTERM) 00:09:43.436115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32233): Terminating (SIGTERM) 00:09:43.475034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32236): Terminating (SIGTERM) 00:09:43.514268 --- ParallelTerminationStrategy: PID 32230 died... 00:09:43.532775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32230): Terminated: ok {rc=0} 00:09:43.575930 --- ParallelTerminationStrategy: PID 32233 died... 00:09:43.594154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32233): Terminated: ok {rc=0} 00:09:43.636937 --- ParallelTerminationStrategy: PID 32236 died... 00:09:43.655183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32236): Terminated: ok {rc=0} 00:09:43.737224 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 00:09:44.819422 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:44.830896 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:09:44.877728 tst ping_idle_ping.py: using LAC 17712 00:09:44.999920 tst ping_idle_ping.py: using RAC 117 00:09:45.115614 tst ping_idle_ping.py: using CellId 17712 00:09:45.240354 tst ping_idle_ping.py: using BVCI 17713 00:09:45.355290 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:45.367030 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:45.378445 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:45.389817 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:45.401529 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:45.412889 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:45.424273 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:45.435725 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:09:45.551835 tst ping_idle_ping.py:24: start network... 00:09:45.765319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:09:46.258038 run create_hlr_db(pid=32238): Launched 00:09:46.418230 bus /gobi_6: Setting Powered False 00:09:47.477490 run create_hlr_db(pid=32238): Terminated: ok {rc=0} 00:09:47.913856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32240): Launched 00:09:48.230106 run osmo-hlr_10.42.42.2(pid=32241): Launched 00:09:48.350547 run osmo-stp_10.42.42.5: Starting osmo-stp 00:09:48.892536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32243): Launched 00:09:49.207847 run osmo-stp_10.42.42.5(pid=32244): Launched 00:09:49.328787 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:09:49.874322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32246): Launched 00:09:49.995263 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:09:50.262309 run patchelf(pid=32247): Launched 00:09:50.438484 run osmo-stp_10.42.42.5(pid=32244): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32244)] 00:09:50.572511 run osmo-stp_10.42.42.5(pid=32244): stdout: | (launched: 2022-12-09_00:09:49.150601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:50.708597 run osmo-stp_10.42.42.5(pid=32244): stderr: | [0;m[38;5;43m20221209000949343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000949344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000949344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000949344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000949345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000949345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000949345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:50.844706 run osmo-stp_10.42.42.5(pid=32244): stdout: | (launched: 2022-12-09_00:09:49.150601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:50.974619 run osmo-stp_10.42.42.5(pid=32244): stderr: | [0;m[38;5;43m20221209000949343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209000949344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209000949344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209000949344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209000949345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209000949345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209000949345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:51.128660 run patchelf(pid=32247): Terminating (SIGINT) 00:09:51.306534 run patchelf(pid=32247): Terminated: ok {rc=0} 00:09:51.434659 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32244): Process ended prematurely: osmo-stp_10.42.42.5(pid=32244) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32244)] [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 00:09:51.444218 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 00:09:51.471912 run osmo-hlr_10.42.42.2(pid=32241): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32241)] 00:09:51.522040 run osmo-hlr_10.42.42.2(pid=32241): stdout: | (launched: 2022-12-09_00:09:48.172524) 00:09:51.572806 run osmo-hlr_10.42.42.2(pid=32241): stderr: | [0;m[1;31m20221209000948368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000948368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000948368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000948368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000948368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000948368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000948385 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000948393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000948393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000948393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:09:51.624709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32240): Terminating (SIGTERM) 00:09:51.665887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32243): Terminating (SIGTERM) 00:09:51.707401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32246): Terminating (SIGTERM) 00:09:51.749158 --- ParallelTerminationStrategy: PID 32240 died... 00:09:51.769214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32240): Terminated: ok {rc=0} 00:09:51.815117 --- ParallelTerminationStrategy: PID 32243 died... 00:09:51.834534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32243): Terminated: ok {rc=0} 00:09:51.880364 --- ParallelTerminationStrategy: PID 32246 died... 00:09:51.899908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32246): Terminated: ok {rc=0} 00:09:51.986644 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 00:09:53.285699 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:09:53.292610 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 00:09:53.321330 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 00:09:53.358847 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 00:09:53.443195 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 00:09:53.471529 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 00:09:53.509281 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 00:09:54.105863 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 00:09:54.160485 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:54.172067 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:09:54.240261 tst cs_paging_gprs_active.py: using LAC 17713 00:09:54.360133 tst cs_paging_gprs_active.py: using RAC 118 00:09:54.480632 tst cs_paging_gprs_active.py: using CellId 17713 00:09:54.600861 tst cs_paging_gprs_active.py: using BVCI 17714 00:09:54.710408 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:54.721356 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:54.731967 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:54.742752 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:54.753536 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:54.764441 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:54.775211 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:54.786340 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:54.797103 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:09:54.916040 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:09:55.034669 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:09:55.238908 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:55.542289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32253): Launched 00:09:55.808252 run iperf3-srv_10.42.42.10(pid=32254): Launched 00:09:55.922645 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:09:56.126149 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:56.430521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32255): Launched 00:09:56.694708 run iperf3-srv_10.42.42.10(pid=32256): Launched 00:09:56.808460 tst cs_paging_gprs_active.py:38: start network... 00:09:57.011600 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:09:57.481777 run create_hlr_db(pid=32257): Launched 00:09:57.604558 bus /gobi_6: Setting Powered False 00:09:58.665207 run create_hlr_db(pid=32257): Terminated: ok {rc=0} 00:09:59.105094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32259): Launched 00:09:59.429067 run osmo-hlr_10.42.42.2(pid=32260): Launched 00:09:59.553045 run osmo-stp_10.42.42.5: Starting osmo-stp 00:10:00.108310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32262): Launched 00:10:00.431251 run osmo-stp_10.42.42.5(pid=32263): Launched 00:10:00.553883 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:10:01.146968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32268): Launched 00:10:01.281323 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:10:01.550918 run patchelf(pid=32269): Launched 00:10:01.733612 run osmo-stp_10.42.42.5(pid=32263): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32263)] 00:10:01.867444 run osmo-stp_10.42.42.5(pid=32263): stdout: | (launched: 2022-12-09_00:10:00.372658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:02.002037 run osmo-stp_10.42.42.5(pid=32263): stderr: | [0;m[38;5;43m20221209001000565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001000565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001000565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001000566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001000566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001000566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001000566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:02.134969 run osmo-stp_10.42.42.5(pid=32263): stdout: | (launched: 2022-12-09_00:10:00.372658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:02.262213 run osmo-stp_10.42.42.5(pid=32263): stderr: | [0;m[38;5;43m20221209001000565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001000565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001000565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001000566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001000566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001000566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001000566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:02.409850 run patchelf(pid=32269): Terminating (SIGINT) 00:10:02.580385 run patchelf(pid=32269): Terminated: ok {rc=0} 00:10:02.703535 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32263): Process ended prematurely: osmo-stp_10.42.42.5(pid=32263) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32263)] [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 00:10:02.713147 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 00:10:02.740019 run osmo-hlr_10.42.42.2(pid=32260): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32260)] 00:10:02.786972 run osmo-hlr_10.42.42.2(pid=32260): stdout: | (launched: 2022-12-09_00:09:59.370347) 00:10:02.835666 run osmo-hlr_10.42.42.2(pid=32260): stderr: | [0;m[1;31m20221209000959568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209000959568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209000959568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209000959568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209000959568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209000959568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209000959581 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209000959589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209000959589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209000959589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:10:02.884714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32253): Terminating (SIGTERM) 00:10:02.923810 run iperf3-srv_10.42.42.10(pid=32254): Terminating (SIGTERM) 00:10:02.962757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32255): Terminating (SIGTERM) 00:10:03.001657 run iperf3-srv_10.42.42.10(pid=32256): Terminating (SIGTERM) 00:10:03.040369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32259): Terminating (SIGTERM) 00:10:03.079306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32262): Terminating (SIGTERM) 00:10:03.118208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32268): Terminating (SIGTERM) 00:10:03.157215 --- ParallelTerminationStrategy: PID 32253 died... 00:10:03.175901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32253): Terminated: ok {rc=0} 00:10:03.219048 --- ParallelTerminationStrategy: PID 32254 died... 00:10:03.237277 run iperf3-srv_10.42.42.10(pid=32254): Terminated {rc=256} 00:10:03.280108 --- ParallelTerminationStrategy: PID 32255 died... 00:10:03.298338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32255): Terminated: ok {rc=0} 00:10:03.341315 --- ParallelTerminationStrategy: PID 32256 died... 00:10:03.359577 run iperf3-srv_10.42.42.10(pid=32256): Terminated {rc=256} 00:10:03.402558 --- ParallelTerminationStrategy: PID 32259 died... 00:10:03.420741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32259): Terminated: ok {rc=0} 00:10:03.464013 --- ParallelTerminationStrategy: PID 32262 died... 00:10:03.482374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32262): Terminated: ok {rc=0} 00:10:03.525476 --- ParallelTerminationStrategy: PID 32268 died... 00:10:03.543719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32268): Terminated: ok {rc=0} 00:10:03.626347 bus /gobi_0: Setting Powered False 00:10:04.720543 bus /gobi_0: Setting Powered False 00:10:05.833412 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 00:10:06.981729 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:06.993875 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:10:07.063903 tst iperf3.py: using LAC 17714 00:10:07.191531 tst iperf3.py: using RAC 119 00:10:07.317151 tst iperf3.py: using CellId 17714 00:10:07.444030 tst iperf3.py: using BVCI 17715 00:10:07.560750 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:07.572185 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:07.583589 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:07.595091 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:07.606628 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:07.618055 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:07.629755 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:07.641160 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:07.652633 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:10:07.771828 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:10:07.989576 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:08.312919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32270): Launched 00:10:08.593098 run iperf3-srv_10.42.42.10(pid=32271): Launched 00:10:08.713827 tst iperf3.py:8: start network... 00:10:08.930742 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:10:09.429502 run create_hlr_db(pid=32272): Launched 00:10:09.551769 bus /gobi_6: Setting Powered False 00:10:10.614861 run create_hlr_db(pid=32272): Terminated: ok {rc=0} 00:10:11.044373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32274): Launched 00:10:11.367803 run osmo-hlr_10.42.42.2(pid=32275): Launched 00:10:11.491103 run osmo-stp_10.42.42.5: Starting osmo-stp 00:10:12.054277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32277): Launched 00:10:12.377039 run osmo-stp_10.42.42.5(pid=32278): Launched 00:10:12.499969 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:10:13.056161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32280): Launched 00:10:13.180431 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:10:13.453007 run patchelf(pid=32281): Launched 00:10:13.631541 run osmo-stp_10.42.42.5(pid=32278): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32278)] 00:10:13.767821 run osmo-stp_10.42.42.5(pid=32278): stdout: | (launched: 2022-12-09_00:10:12.318355) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:13.906158 run osmo-stp_10.42.42.5(pid=32278): stderr: | [0;m[38;5;43m20221209001012508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001012508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001012509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001012509 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001012511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001012512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001012512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:14.044632 run osmo-stp_10.42.42.5(pid=32278): stdout: | (launched: 2022-12-09_00:10:12.318355) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:14.176664 run osmo-stp_10.42.42.5(pid=32278): stderr: | [0;m[38;5;43m20221209001012508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001012508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001012509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001012509 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001012511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001012512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001012512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:14.333744 run patchelf(pid=32281): Terminating (SIGINT) 00:10:14.514247 run patchelf(pid=32281): Terminated: ok {rc=0} 00:10:14.644678 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32278): Process ended prematurely: osmo-stp_10.42.42.5(pid=32278) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32278)] [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 00:10:14.655051 tst iperf3.py:8: Test FAILED (7.7 sec) 00:10:14.683716 run osmo-hlr_10.42.42.2(pid=32275): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32275)] 00:10:14.733637 run osmo-hlr_10.42.42.2(pid=32275): stdout: | (launched: 2022-12-09_00:10:11.309593) 00:10:14.785214 run osmo-hlr_10.42.42.2(pid=32275): stderr: | [0;m[1;31m20221209001011509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001011509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001011509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001011509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001011509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001011509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001011521 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001011529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001011530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001011530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:10:14.836930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32270): Terminating (SIGTERM) 00:10:14.878738 run iperf3-srv_10.42.42.10(pid=32271): Terminating (SIGTERM) 00:10:14.920317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32274): Terminating (SIGTERM) 00:10:14.962492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32277): Terminating (SIGTERM) 00:10:15.003934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32280): Terminating (SIGTERM) 00:10:15.045865 --- ParallelTerminationStrategy: PID 32270 died... 00:10:15.065512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32270): Terminated: ok {rc=0} 00:10:15.111816 --- ParallelTerminationStrategy: PID 32271 died... 00:10:15.131027 run iperf3-srv_10.42.42.10(pid=32271): Terminated {rc=256} 00:10:15.176774 --- ParallelTerminationStrategy: PID 32274 died... 00:10:15.196373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32274): Terminated: ok {rc=0} 00:10:15.242669 --- ParallelTerminationStrategy: PID 32277 died... 00:10:15.261923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32277): Terminated: ok {rc=0} 00:10:15.308105 --- ParallelTerminationStrategy: PID 32280 died... 00:10:15.327360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32280): Terminated: ok {rc=0} 00:10:15.413828 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 00:10:16.575418 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:16.590849 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:10:16.669352 tst iperf3m4.py: using LAC 17715 00:10:16.795447 tst iperf3m4.py: using RAC 120 00:10:16.917634 tst iperf3m4.py: using CellId 17715 00:10:17.039389 tst iperf3m4.py: using BVCI 17716 00:10:17.193704 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:17.206087 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:17.218260 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:17.231467 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:17.244903 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:17.257813 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:17.270905 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:17.283810 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:17.296837 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:10:17.416447 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:10:17.535662 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:10:17.651299 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:10:17.766277 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:10:17.969438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:18.272718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32282): Launched 00:10:18.536183 run iperf3-srv_10.42.42.10(pid=32283): Launched 00:10:18.649542 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:10:18.852434 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:19.156189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32284): Launched 00:10:19.419921 run iperf3-srv_10.42.42.10(pid=32285): Launched 00:10:19.533454 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:10:19.735912 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:20.039363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32286): Launched 00:10:20.302606 run iperf3-srv_10.42.42.10(pid=32287): Launched 00:10:20.415791 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:10:20.617915 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:20.921166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32288): Launched 00:10:21.184397 run iperf3-srv_10.42.42.10(pid=32289): Launched 00:10:21.297679 tst iperf3m4.py:8: start network... 00:10:21.500377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:10:21.968157 run create_hlr_db(pid=32290): Launched 00:10:22.092347 bus /gobi_6: Setting Powered False 00:10:23.153152 run create_hlr_db(pid=32290): Terminated: ok {rc=0} 00:10:23.572835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32292): Launched 00:10:23.874625 run osmo-hlr_10.42.42.2(pid=32293): Launched 00:10:23.989357 run osmo-stp_10.42.42.5: Starting osmo-stp 00:10:24.510854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32295): Launched 00:10:24.813112 run osmo-stp_10.42.42.5(pid=32296): Launched 00:10:24.928449 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:10:25.450711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32298): Launched 00:10:25.566080 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:10:25.821472 run patchelf(pid=32299): Launched 00:10:25.989393 run osmo-stp_10.42.42.5(pid=32296): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32296)] 00:10:26.117539 run osmo-stp_10.42.42.5(pid=32296): stdout: | (launched: 2022-12-09_00:10:24.757393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:26.246858 run osmo-stp_10.42.42.5(pid=32296): stderr: | [0;m[38;5;43m20221209001024929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001024929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001024929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001024929 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001024930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001024930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001024930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:26.376190 run osmo-stp_10.42.42.5(pid=32296): stdout: | (launched: 2022-12-09_00:10:24.757393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:26.499700 run osmo-stp_10.42.42.5(pid=32296): stderr: | [0;m[38;5;43m20221209001024929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001024929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001024929 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001024929 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001024930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001024930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001024930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:26.645728 run patchelf(pid=32299): Terminating (SIGINT) 00:10:26.814255 run patchelf(pid=32299): Terminated: ok {rc=0} 00:10:26.935779 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32296): Process ended prematurely: osmo-stp_10.42.42.5(pid=32296) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32296)] [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 00:10:26.945321 tst iperf3m4.py:8: Test FAILED (10.4 sec) 00:10:26.972116 run osmo-hlr_10.42.42.2(pid=32293): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32293)] 00:10:27.018510 run osmo-hlr_10.42.42.2(pid=32293): stdout: | (launched: 2022-12-09_00:10:23.819328) 00:10:27.066815 run osmo-hlr_10.42.42.2(pid=32293): stderr: | [0;m[1;31m20221209001023995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001023995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001023995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001023995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001023995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001023995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001024008 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001024017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001024018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001024018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:10:27.115438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32282): Terminating (SIGTERM) 00:10:27.154063 run iperf3-srv_10.42.42.10(pid=32283): Terminating (SIGTERM) 00:10:27.192514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32284): Terminating (SIGTERM) 00:10:27.231378 run iperf3-srv_10.42.42.10(pid=32285): Terminating (SIGTERM) 00:10:27.270095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32286): Terminating (SIGTERM) 00:10:27.308833 run iperf3-srv_10.42.42.10(pid=32287): Terminating (SIGTERM) 00:10:27.347436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32288): Terminating (SIGTERM) 00:10:27.386135 run iperf3-srv_10.42.42.10(pid=32289): Terminating (SIGTERM) 00:10:27.424765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32292): Terminating (SIGTERM) 00:10:27.463578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32295): Terminating (SIGTERM) 00:10:27.502232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32298): Terminating (SIGTERM) 00:10:27.541208 --- ParallelTerminationStrategy: PID 32282 died... 00:10:27.559807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32282): Terminated: ok {rc=0} 00:10:27.602915 --- ParallelTerminationStrategy: PID 32283 died... 00:10:27.621191 run iperf3-srv_10.42.42.10(pid=32283): Terminated {rc=256} 00:10:27.664371 --- ParallelTerminationStrategy: PID 32284 died... 00:10:27.682588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32284): Terminated: ok {rc=0} 00:10:27.725388 --- ParallelTerminationStrategy: PID 32285 died... 00:10:27.743423 run iperf3-srv_10.42.42.10(pid=32285): Terminated {rc=256} 00:10:27.786020 --- ParallelTerminationStrategy: PID 32286 died... 00:10:27.804243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32286): Terminated: ok {rc=0} 00:10:27.847040 --- ParallelTerminationStrategy: PID 32287 died... 00:10:27.865234 run iperf3-srv_10.42.42.10(pid=32287): Terminated {rc=256} 00:10:27.908026 --- ParallelTerminationStrategy: PID 32288 died... 00:10:27.926389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32288): Terminated: ok {rc=0} 00:10:27.969489 --- ParallelTerminationStrategy: PID 32289 died... 00:10:27.987787 run iperf3-srv_10.42.42.10(pid=32289): Terminated {rc=256} 00:10:28.030679 --- ParallelTerminationStrategy: PID 32292 died... 00:10:28.049491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32292): Terminated: ok {rc=0} 00:10:28.092532 --- ParallelTerminationStrategy: PID 32295 died... 00:10:28.110933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32295): Terminated: ok {rc=0} 00:10:28.153884 --- ParallelTerminationStrategy: PID 32298 died... 00:10:28.172247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32298): Terminated: ok {rc=0} 00:10:28.256352 bus /gobi_4: Setting Powered False 00:10:29.355224 bus /gobi_4: Setting Powered False 00:10:30.469434 bus /gobi_1: Setting Powered False 00:10:31.564800 bus /gobi_1: Setting Powered False 00:10:32.678130 bus /gobi_0: Setting Powered False 00:10:33.774231 bus /gobi_0: Setting Powered False 00:10:34.890269 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 00:10:35.993292 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:36.005031 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:10:36.070251 tst ping.py: using LAC 17716 00:10:36.187826 tst ping.py: using RAC 121 00:10:36.305376 tst ping.py: using CellId 17716 00:10:36.420783 tst ping.py: using BVCI 17717 00:10:36.527473 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:36.538526 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:36.549373 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:36.560161 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:36.571333 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:36.582284 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:36.593273 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:36.604166 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:10:36.721712 tst ping.py:19: start network... 00:10:36.934414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:10:37.423324 run create_hlr_db(pid=32300): Launched 00:10:37.544241 bus /gobi_6: Setting Powered False 00:10:38.607532 run create_hlr_db(pid=32300): Terminated: ok {rc=0} 00:10:39.030879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32302): Launched 00:10:39.327492 run osmo-hlr_10.42.42.2(pid=32303): Launched 00:10:39.440696 run osmo-stp_10.42.42.5: Starting osmo-stp 00:10:39.955025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32305): Launched 00:10:40.251646 run osmo-stp_10.42.42.5(pid=32306): Launched 00:10:40.364409 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:10:40.877036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32308): Launched 00:10:40.990625 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:10:41.240940 run patchelf(pid=32309): Launched 00:10:41.405946 run osmo-stp_10.42.42.5(pid=32306): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32306)] 00:10:41.531537 run osmo-stp_10.42.42.5(pid=32306): stdout: | (launched: 2022-12-09_00:10:40.197352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:41.658903 run osmo-stp_10.42.42.5(pid=32306): stderr: | [0;m[38;5;43m20221209001040366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001040366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001040366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001040367 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001040369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001040369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001040369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:41.786503 run osmo-stp_10.42.42.5(pid=32306): stdout: | (launched: 2022-12-09_00:10:40.197352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:41.908194 run osmo-stp_10.42.42.5(pid=32306): stderr: | [0;m[38;5;43m20221209001040366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001040366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001040366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001040367 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001040369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001040369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001040369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:42.051830 run patchelf(pid=32309): Terminating (SIGINT) 00:10:42.218545 run patchelf(pid=32309): Terminated: ok {rc=0} 00:10:42.338196 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32306): Process ended prematurely: osmo-stp_10.42.42.5(pid=32306) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32306)] [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 00:10:42.347097 tst ping.py:22: Test FAILED (6.3 sec) 00:10:42.373438 run osmo-hlr_10.42.42.2(pid=32303): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32303)] 00:10:42.419820 run osmo-hlr_10.42.42.2(pid=32303): stdout: | (launched: 2022-12-09_00:10:39.272820) 00:10:42.468023 run osmo-hlr_10.42.42.2(pid=32303): stderr: | [0;m[1;31m20221209001039447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001039447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001039447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001039447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001039447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001039447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001039459 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001039467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001039468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001039468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:10:42.516515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32302): Terminating (SIGTERM) 00:10:42.554943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32305): Terminating (SIGTERM) 00:10:42.593342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32308): Terminating (SIGTERM) 00:10:42.632142 --- ParallelTerminationStrategy: PID 32302 died... 00:10:42.650692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32302): Terminated: ok {rc=0} 00:10:42.694245 --- ParallelTerminationStrategy: PID 32305 died... 00:10:42.712215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32305): Terminated: ok {rc=0} 00:10:42.754992 --- ParallelTerminationStrategy: PID 32308 died... 00:10:42.773068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32308): Terminated: ok {rc=0} 00:10:42.857088 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 00:10:43.942526 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:43.954174 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:10:44.020036 tst ping_idle_ping.py: using LAC 17717 00:10:44.137175 tst ping_idle_ping.py: using RAC 122 00:10:44.254342 tst ping_idle_ping.py: using CellId 17717 00:10:44.375711 tst ping_idle_ping.py: using BVCI 17718 00:10:44.484560 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:44.495633 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:44.506452 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:44.517238 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:44.527889 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:44.538702 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:44.549526 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:44.560165 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:10:44.677110 tst ping_idle_ping.py:24: start network... 00:10:44.891000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:10:45.384043 run create_hlr_db(pid=32310): Launched 00:10:45.505118 bus /gobi_6: Setting Powered False 00:10:46.566556 run create_hlr_db(pid=32310): Terminated: ok {rc=0} 00:10:47.020155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32312): Launched 00:10:47.350136 run osmo-hlr_10.42.42.2(pid=32313): Launched 00:10:47.471814 run osmo-stp_10.42.42.5: Starting osmo-stp 00:10:48.017965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32315): Launched 00:10:48.335039 run osmo-stp_10.42.42.5(pid=32316): Launched 00:10:48.456632 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:10:49.003707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32318): Launched 00:10:49.125770 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:10:49.394212 run patchelf(pid=32319): Launched 00:10:49.570482 run osmo-stp_10.42.42.5(pid=32316): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32316)] 00:10:49.704837 run osmo-stp_10.42.42.5(pid=32316): stdout: | (launched: 2022-12-09_00:10:48.277515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:49.841067 run osmo-stp_10.42.42.5(pid=32316): stderr: | [0;m[38;5;43m20221209001048468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001048468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001048468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001048468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001048471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001048471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001048471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:49.977452 run osmo-stp_10.42.42.5(pid=32316): stdout: | (launched: 2022-12-09_00:10:48.277515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:50.107663 run osmo-stp_10.42.42.5(pid=32316): stderr: | [0;m[38;5;43m20221209001048468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001048468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001048468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001048468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001048471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001048471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001048471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:50.262378 run patchelf(pid=32319): Terminating (SIGINT) 00:10:50.439851 run patchelf(pid=32319): Terminated: ok {rc=0} 00:10:50.568227 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32316): Process ended prematurely: osmo-stp_10.42.42.5(pid=32316) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32316)] [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 00:10:50.577921 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 00:10:50.606037 run osmo-hlr_10.42.42.2(pid=32313): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32313)] 00:10:50.655276 run osmo-hlr_10.42.42.2(pid=32313): stdout: | (launched: 2022-12-09_00:10:47.292427) 00:10:50.706693 run osmo-hlr_10.42.42.2(pid=32313): stderr: | [0;m[1;31m20221209001047489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001047489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001047489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001047489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001047489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001047489 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001047501 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001047509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001047509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001047510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:10:50.758359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32312): Terminating (SIGTERM) 00:10:50.799817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32315): Terminating (SIGTERM) 00:10:50.841049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32318): Terminating (SIGTERM) 00:10:50.884014 --- ParallelTerminationStrategy: PID 32312 died... 00:10:50.904090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32312): Terminated: ok {rc=0} 00:10:50.950048 --- ParallelTerminationStrategy: PID 32315 died... 00:10:50.969262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32315): Terminated: ok {rc=0} 00:10:51.015039 --- ParallelTerminationStrategy: PID 32318 died... 00:10:51.034284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32318): Terminated: ok {rc=0} 00:10:51.121663 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:10:52.416273 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:10:52.422230 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:10:52.450628 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 00:10:52.488074 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 00:10:52.573058 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:10:52.601611 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 00:10:52.638891 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 00:10:53.235926 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 00:10:53.284517 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:53.295547 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:10:53.360301 tst cs_paging_gprs_active.py: using LAC 17718 00:10:53.478561 tst cs_paging_gprs_active.py: using RAC 123 00:10:53.598417 tst cs_paging_gprs_active.py: using CellId 17718 00:10:53.718435 tst cs_paging_gprs_active.py: using BVCI 17719 00:10:53.830026 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:53.841038 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:53.851801 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:53.862544 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:53.873252 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:53.883943 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:53.894737 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:53.905386 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:53.916088 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:10:54.033509 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:10:54.151995 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:10:54.356357 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:54.659737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32324): Launched 00:10:54.923942 run iperf3-srv_10.42.42.10(pid=32325): Launched 00:10:55.037314 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:10:55.240625 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:55.545197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32326): Launched 00:10:55.809737 run iperf3-srv_10.42.42.10(pid=32327): Launched 00:10:55.923194 tst cs_paging_gprs_active.py:38: start network... 00:10:56.127040 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:10:56.598722 run create_hlr_db(pid=32328): Launched 00:10:56.721552 bus /gobi_6: Setting Powered False 00:10:57.781962 run create_hlr_db(pid=32328): Terminated: ok {rc=0} 00:10:58.223033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32330): Launched 00:10:58.548026 run osmo-hlr_10.42.42.2(pid=32331): Launched 00:10:58.672089 run osmo-stp_10.42.42.5: Starting osmo-stp 00:10:59.231249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32333): Launched 00:10:59.553809 run osmo-stp_10.42.42.5(pid=32334): Launched 00:10:59.677831 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:11:00.234578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32336): Launched 00:11:00.359095 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:11:00.638713 run patchelf(pid=32337): Launched 00:11:00.818977 run osmo-stp_10.42.42.5(pid=32334): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32334)] 00:11:00.975960 run osmo-stp_10.42.42.5(pid=32334): stdout: | (launched: 2022-12-09_00:10:59.495029) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:01.118197 run osmo-stp_10.42.42.5(pid=32334): stderr: | [0;m[38;5;43m20221209001059687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001059687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001059687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001059688 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001059688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001059688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001059688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:01.260870 run osmo-stp_10.42.42.5(pid=32334): stdout: | (launched: 2022-12-09_00:10:59.495029) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:01.399296 run osmo-stp_10.42.42.5(pid=32334): stderr: | [0;m[38;5;43m20221209001059687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001059687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001059687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001059688 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001059688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001059688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001059688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:01.575056 run patchelf(pid=32337): Terminating (SIGINT) 00:11:01.763454 run patchelf(pid=32337): Terminated: ok {rc=0} 00:11:01.899473 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32334): Process ended prematurely: osmo-stp_10.42.42.5(pid=32334) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32334)] [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 00:11:01.910807 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 00:11:01.940453 run osmo-hlr_10.42.42.2(pid=32331): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32331)] 00:11:01.993725 run osmo-hlr_10.42.42.2(pid=32331): stdout: | (launched: 2022-12-09_00:10:58.489094) 00:11:02.047586 run osmo-hlr_10.42.42.2(pid=32331): stderr: | [0;m[1;31m20221209001058688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001058688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001058688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001058688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001058688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001058689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001058701 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001058709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001058709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001058709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:11:02.102028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32324): Terminating (SIGTERM) 00:11:02.146126 run iperf3-srv_10.42.42.10(pid=32325): Terminating (SIGTERM) 00:11:02.189520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32326): Terminating (SIGTERM) 00:11:02.231745 run iperf3-srv_10.42.42.10(pid=32327): Terminating (SIGTERM) 00:11:02.273664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32330): Terminating (SIGTERM) 00:11:02.315183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32333): Terminating (SIGTERM) 00:11:02.357228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32336): Terminating (SIGTERM) 00:11:02.399321 --- ParallelTerminationStrategy: PID 32324 died... 00:11:02.419151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32324): Terminated: ok {rc=0} 00:11:02.464927 --- ParallelTerminationStrategy: PID 32325 died... 00:11:02.484491 run iperf3-srv_10.42.42.10(pid=32325): Terminated {rc=256} 00:11:02.530459 --- ParallelTerminationStrategy: PID 32326 died... 00:11:02.549699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32326): Terminated: ok {rc=0} 00:11:02.595502 --- ParallelTerminationStrategy: PID 32327 died... 00:11:02.615186 run iperf3-srv_10.42.42.10(pid=32327): Terminated {rc=256} 00:11:02.661099 --- ParallelTerminationStrategy: PID 32330 died... 00:11:02.680494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32330): Terminated: ok {rc=0} 00:11:02.726275 --- ParallelTerminationStrategy: PID 32333 died... 00:11:02.745866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32333): Terminated: ok {rc=0} 00:11:02.791607 --- ParallelTerminationStrategy: PID 32336 died... 00:11:02.811099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32336): Terminated: ok {rc=0} 00:11:02.898303 bus /gobi_0: Setting Powered False 00:11:03.994065 bus /gobi_0: Setting Powered False 00:11:05.108916 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 00:11:06.249370 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:06.260741 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:11:06.329505 tst iperf3.py: using LAC 17719 00:11:06.447644 tst iperf3.py: using RAC 124 00:11:06.565091 tst iperf3.py: using CellId 17719 00:11:06.681768 tst iperf3.py: using BVCI 17720 00:11:06.791156 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:06.802191 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:06.812848 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:06.823692 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:06.834473 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:06.845227 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:06.855967 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:06.866630 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:06.877580 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:11:06.992347 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:11:07.196273 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:11:07.501065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32338): Launched 00:11:07.764937 run iperf3-srv_10.42.42.10(pid=32339): Launched 00:11:07.878501 tst iperf3.py:8: start network... 00:11:08.081954 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:11:08.552437 run create_hlr_db(pid=32340): Launched 00:11:08.676189 bus /gobi_6: Setting Powered False 00:11:09.735481 run create_hlr_db(pid=32340): Terminated: ok {rc=0} 00:11:10.156518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32342): Launched 00:11:10.460107 run osmo-hlr_10.42.42.2(pid=32343): Launched 00:11:10.576238 run osmo-stp_10.42.42.5: Starting osmo-stp 00:11:11.099344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32345): Launched 00:11:11.403262 run osmo-stp_10.42.42.5(pid=32346): Launched 00:11:11.518495 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:11:12.042313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32348): Launched 00:11:12.158387 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:11:12.414588 run patchelf(pid=32349): Launched 00:11:12.583392 run osmo-stp_10.42.42.5(pid=32346): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32346)] 00:11:12.711642 run osmo-stp_10.42.42.5(pid=32346): stdout: | (launched: 2022-12-09_00:11:11.347891) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:12.842152 run osmo-stp_10.42.42.5(pid=32346): stderr: | [0;m[38;5;43m20221209001111519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001111519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001111519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001111520 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001111520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001111520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001111520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:12.972592 run osmo-stp_10.42.42.5(pid=32346): stdout: | (launched: 2022-12-09_00:11:11.347891) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:13.096521 run osmo-stp_10.42.42.5(pid=32346): stderr: | [0;m[38;5;43m20221209001111519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001111519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001111519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001111520 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001111520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001111520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001111520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:13.243607 run patchelf(pid=32349): Terminating (SIGINT) 00:11:13.413564 run patchelf(pid=32349): Terminated: ok {rc=0} 00:11:13.535740 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32346): Process ended prematurely: osmo-stp_10.42.42.5(pid=32346) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32346)] [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 00:11:13.545360 tst iperf3.py:8: Test FAILED (7.3 sec) 00:11:13.572037 run osmo-hlr_10.42.42.2(pid=32343): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32343)] 00:11:13.618358 run osmo-hlr_10.42.42.2(pid=32343): stdout: | (launched: 2022-12-09_00:11:10.404593) 00:11:13.666662 run osmo-hlr_10.42.42.2(pid=32343): stderr: | [0;m[1;31m20221209001110581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001110581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001110581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001110581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001110581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001110582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001110593 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001110602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001110602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001110602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:11:13.715224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32338): Terminating (SIGTERM) 00:11:13.753981 run iperf3-srv_10.42.42.10(pid=32339): Terminating (SIGTERM) 00:11:13.792749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32342): Terminating (SIGTERM) 00:11:13.831457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32345): Terminating (SIGTERM) 00:11:13.870134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32348): Terminating (SIGTERM) 00:11:13.909097 --- ParallelTerminationStrategy: PID 32338 died... 00:11:13.927759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32338): Terminated: ok {rc=0} 00:11:13.970781 --- ParallelTerminationStrategy: PID 32339 died... 00:11:13.989345 run iperf3-srv_10.42.42.10(pid=32339): Terminated {rc=256} 00:11:14.032060 --- ParallelTerminationStrategy: PID 32342 died... 00:11:14.050264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32342): Terminated: ok {rc=0} 00:11:14.092857 --- ParallelTerminationStrategy: PID 32345 died... 00:11:14.111316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32345): Terminated: ok {rc=0} 00:11:14.153886 --- ParallelTerminationStrategy: PID 32348 died... 00:11:14.172079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32348): Terminated: ok {rc=0} 00:11:14.255831 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 00:11:15.402060 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:15.413626 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:11:15.481880 tst iperf3m4.py: using LAC 17720 00:11:15.613187 tst iperf3m4.py: using RAC 125 00:11:15.739034 tst iperf3m4.py: using CellId 17720 00:11:15.870820 tst iperf3m4.py: using BVCI 17721 00:11:15.999460 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:16.011467 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:16.023246 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:16.035075 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:16.047084 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:16.058940 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:16.072091 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:16.085491 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:16.098510 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:11:16.220684 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:11:16.366299 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:11:16.483948 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:11:16.624172 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:11:16.863496 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:11:17.210355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32350): Launched 00:11:17.485990 run iperf3-srv_10.42.42.10(pid=32351): Launched 00:11:17.599886 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:11:17.802865 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:11:18.106750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32352): Launched 00:11:18.371017 run iperf3-srv_10.42.42.10(pid=32353): Launched 00:11:18.485310 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:11:18.687579 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:11:18.991921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32354): Launched 00:11:19.255128 run iperf3-srv_10.42.42.10(pid=32355): Launched 00:11:19.368513 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:11:19.570421 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:11:19.873678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32356): Launched 00:11:20.137045 run iperf3-srv_10.42.42.10(pid=32357): Launched 00:11:20.250434 tst iperf3m4.py:8: start network... 00:11:20.452809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:11:20.922430 run create_hlr_db(pid=32358): Launched 00:11:21.047721 bus /gobi_6: Setting Powered False 00:11:22.107612 run create_hlr_db(pid=32358): Terminated: ok {rc=0} 00:11:22.530020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32360): Launched 00:11:22.833246 run osmo-hlr_10.42.42.2(pid=32361): Launched 00:11:22.948006 run osmo-stp_10.42.42.5: Starting osmo-stp 00:11:23.474817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32363): Launched 00:11:23.778531 run osmo-stp_10.42.42.5(pid=32364): Launched 00:11:23.894210 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:11:24.417112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32366): Launched 00:11:24.533728 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:11:24.790066 run patchelf(pid=32367): Launched 00:11:24.957987 run osmo-stp_10.42.42.5(pid=32364): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32364)] 00:11:25.085562 run osmo-stp_10.42.42.5(pid=32364): stdout: | (launched: 2022-12-09_00:11:23.722250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:25.215440 run osmo-stp_10.42.42.5(pid=32364): stderr: | [0;m[38;5;43m20221209001123893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001123893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001123894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001123894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001123895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001123895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001123895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:25.345173 run osmo-stp_10.42.42.5(pid=32364): stdout: | (launched: 2022-12-09_00:11:23.722250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:25.468565 run osmo-stp_10.42.42.5(pid=32364): stderr: | [0;m[38;5;43m20221209001123893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001123893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001123894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001123894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001123895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001123895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001123895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:25.615341 run patchelf(pid=32367): Terminating (SIGINT) 00:11:25.784246 run patchelf(pid=32367): Terminated: ok {rc=0} 00:11:25.906053 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32364): Process ended prematurely: osmo-stp_10.42.42.5(pid=32364) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32364)] [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 00:11:25.915610 tst iperf3m4.py:8: Test FAILED (10.5 sec) 00:11:25.942689 run osmo-hlr_10.42.42.2(pid=32361): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32361)] 00:11:25.989554 run osmo-hlr_10.42.42.2(pid=32361): stdout: | (launched: 2022-12-09_00:11:22.777150) 00:11:26.037768 run osmo-hlr_10.42.42.2(pid=32361): stderr: | [0;m[1;31m20221209001122954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001122954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001122954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001122954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001122954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001122954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001122966 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001122976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001122977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001122977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:11:26.086514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32350): Terminating (SIGTERM) 00:11:26.125696 run iperf3-srv_10.42.42.10(pid=32351): Terminating (SIGTERM) 00:11:26.164661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32352): Terminating (SIGTERM) 00:11:26.203582 run iperf3-srv_10.42.42.10(pid=32353): Terminating (SIGTERM) 00:11:26.242274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32354): Terminating (SIGTERM) 00:11:26.281159 run iperf3-srv_10.42.42.10(pid=32355): Terminating (SIGTERM) 00:11:26.319756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32356): Terminating (SIGTERM) 00:11:26.358703 run iperf3-srv_10.42.42.10(pid=32357): Terminating (SIGTERM) 00:11:26.397435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32360): Terminating (SIGTERM) 00:11:26.436304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32363): Terminating (SIGTERM) 00:11:26.475173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32366): Terminating (SIGTERM) 00:11:26.514550 --- ParallelTerminationStrategy: PID 32350 died... 00:11:26.533546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32350): Terminated: ok {rc=0} 00:11:26.577303 --- ParallelTerminationStrategy: PID 32351 died... 00:11:26.595452 run iperf3-srv_10.42.42.10(pid=32351): Terminated {rc=256} 00:11:26.638568 --- ParallelTerminationStrategy: PID 32352 died... 00:11:26.656823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32352): Terminated: ok {rc=0} 00:11:26.699712 --- ParallelTerminationStrategy: PID 32353 died... 00:11:26.717898 run iperf3-srv_10.42.42.10(pid=32353): Terminated {rc=256} 00:11:26.760854 --- ParallelTerminationStrategy: PID 32354 died... 00:11:26.779666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32354): Terminated: ok {rc=0} 00:11:26.822693 --- ParallelTerminationStrategy: PID 32355 died... 00:11:26.841076 run iperf3-srv_10.42.42.10(pid=32355): Terminated {rc=256} 00:11:26.883879 --- ParallelTerminationStrategy: PID 32356 died... 00:11:26.902735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32356): Terminated: ok {rc=0} 00:11:26.945803 --- ParallelTerminationStrategy: PID 32357 died... 00:11:26.963982 run iperf3-srv_10.42.42.10(pid=32357): Terminated {rc=256} 00:11:27.006918 --- ParallelTerminationStrategy: PID 32360 died... 00:11:27.025127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32360): Terminated: ok {rc=0} 00:11:27.067820 --- ParallelTerminationStrategy: PID 32363 died... 00:11:27.086051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32363): Terminated: ok {rc=0} 00:11:27.128941 --- ParallelTerminationStrategy: PID 32366 died... 00:11:27.147281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32366): Terminated: ok {rc=0} 00:11:27.231629 bus /gobi_4: Setting Powered False 00:11:28.329559 bus /gobi_4: Setting Powered False 00:11:29.444049 bus /gobi_1: Setting Powered False 00:11:30.540851 bus /gobi_1: Setting Powered False 00:11:31.666345 bus /gobi_0: Setting Powered False 00:11:32.779685 bus /gobi_0: Setting Powered False 00:11:33.893428 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 00:11:34.994309 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:35.005862 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:11:35.074238 tst ping.py: using LAC 17721 00:11:35.197576 tst ping.py: using RAC 126 00:11:35.320204 tst ping.py: using CellId 17721 00:11:35.437093 tst ping.py: using BVCI 17722 00:11:35.544177 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:35.555368 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:35.566396 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:35.577353 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:35.588375 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:35.599562 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:35.610401 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:35.621207 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:11:35.733952 tst ping.py:19: start network... 00:11:35.931914 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:11:36.389402 run create_hlr_db(pid=32368): Launched 00:11:36.510775 bus /gobi_6: Setting Powered False 00:11:37.571045 run create_hlr_db(pid=32368): Terminated: ok {rc=0} 00:11:38.004063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32370): Launched 00:11:38.321658 run osmo-hlr_10.42.42.2(pid=32371): Launched 00:11:38.442775 run osmo-stp_10.42.42.5: Starting osmo-stp 00:11:38.990646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32373): Launched 00:11:39.307681 run osmo-stp_10.42.42.5(pid=32374): Launched 00:11:39.429647 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:11:39.979186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32376): Launched 00:11:40.101456 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:11:40.369425 run patchelf(pid=32377): Launched 00:11:40.545224 run osmo-stp_10.42.42.5(pid=32374): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32374)] 00:11:40.679575 run osmo-stp_10.42.42.5(pid=32374): stdout: | (launched: 2022-12-09_00:11:39.249629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:40.815118 run osmo-stp_10.42.42.5(pid=32374): stderr: | [0;m[38;5;43m20221209001139442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001139442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001139443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001139443 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001139443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001139443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001139443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:40.950834 run osmo-stp_10.42.42.5(pid=32374): stdout: | (launched: 2022-12-09_00:11:39.249629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:41.080519 run osmo-stp_10.42.42.5(pid=32374): stderr: | [0;m[38;5;43m20221209001139442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001139442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001139443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001139443 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001139443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001139443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001139443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:41.234437 run patchelf(pid=32377): Terminating (SIGINT) 00:11:41.411798 run patchelf(pid=32377): Terminated: ok {rc=0} 00:11:41.539387 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32374): Process ended prematurely: osmo-stp_10.42.42.5(pid=32374) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32374)] [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 00:11:41.548835 tst ping.py:22: Test FAILED (6.5 sec) 00:11:41.577055 run osmo-hlr_10.42.42.2(pid=32371): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32371)] 00:11:41.626868 run osmo-hlr_10.42.42.2(pid=32371): stdout: | (launched: 2022-12-09_00:11:38.263695) 00:11:41.678551 run osmo-hlr_10.42.42.2(pid=32371): stderr: | [0;m[1;31m20221209001138460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001138460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001138460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001138460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001138460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001138460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001138477 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001138486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001138486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001138486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:11:41.730113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32370): Terminating (SIGTERM) 00:11:41.771300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32373): Terminating (SIGTERM) 00:11:41.813010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32376): Terminating (SIGTERM) 00:11:41.854918 --- ParallelTerminationStrategy: PID 32370 died... 00:11:41.874922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32370): Terminated: ok {rc=0} 00:11:41.921028 --- ParallelTerminationStrategy: PID 32373 died... 00:11:41.940832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32373): Terminated: ok {rc=0} 00:11:41.986331 --- ParallelTerminationStrategy: PID 32376 died... 00:11:42.005848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32376): Terminated: ok {rc=0} 00:11:42.093164 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 00:11:43.177454 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:43.189600 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:11:43.258571 tst ping_idle_ping.py: using LAC 17722 00:11:43.383579 tst ping_idle_ping.py: using RAC 127 00:11:43.501068 tst ping_idle_ping.py: using CellId 17722 00:11:43.616289 tst ping_idle_ping.py: using BVCI 17723 00:11:43.723995 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:43.735113 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:43.746110 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:43.757075 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:43.767706 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:43.778692 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:43.789693 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:43.800878 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:11:43.914878 tst ping_idle_ping.py:24: start network... 00:11:44.114846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:11:44.578727 run create_hlr_db(pid=32378): Launched 00:11:44.701666 bus /gobi_6: Setting Powered False 00:11:45.761963 run create_hlr_db(pid=32378): Terminated: ok {rc=0} 00:11:46.207452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32380): Launched 00:11:46.529718 run osmo-hlr_10.42.42.2(pid=32381): Launched 00:11:46.711958 run osmo-stp_10.42.42.5: Starting osmo-stp 00:11:47.470200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32383): Launched 00:11:47.768636 run osmo-stp_10.42.42.5(pid=32384): Launched 00:11:47.881460 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:11:48.395455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32386): Launched 00:11:48.509651 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:11:48.762373 run patchelf(pid=32387): Launched 00:11:48.928371 run osmo-stp_10.42.42.5(pid=32384): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32384)] 00:11:49.054651 run osmo-stp_10.42.42.5(pid=32384): stdout: | (launched: 2022-12-09_00:11:47.713711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:49.182550 run osmo-stp_10.42.42.5(pid=32384): stderr: | [0;m[38;5;43m20221209001147884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001147884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001147885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001147885 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001147885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001147886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001147886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:49.310352 run osmo-stp_10.42.42.5(pid=32384): stdout: | (launched: 2022-12-09_00:11:47.713711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:49.432473 run osmo-stp_10.42.42.5(pid=32384): stderr: | [0;m[38;5;43m20221209001147884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001147884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001147885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001147885 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001147885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001147886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001147886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:49.577017 run patchelf(pid=32387): Terminating (SIGINT) 00:11:49.743308 run patchelf(pid=32387): Terminated: ok {rc=0} 00:11:49.863663 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32384): Process ended prematurely: osmo-stp_10.42.42.5(pid=32384) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32384)] [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 00:11:49.872667 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 00:11:49.899099 run osmo-hlr_10.42.42.2(pid=32381): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32381)] 00:11:49.945875 run osmo-hlr_10.42.42.2(pid=32381): stdout: | (launched: 2022-12-09_00:11:46.467755) 00:11:49.994391 run osmo-hlr_10.42.42.2(pid=32381): stderr: | [0;m[1;31m20221209001146750 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001146750 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001146750 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001146750 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001146750 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001146750 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001146768 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001146780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001146780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001146780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:11:50.043347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32380): Terminating (SIGTERM) 00:11:50.082470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32383): Terminating (SIGTERM) 00:11:50.121369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32386): Terminating (SIGTERM) 00:11:50.160889 --- ParallelTerminationStrategy: PID 32380 died... 00:11:50.179753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32380): Terminated: ok {rc=0} 00:11:50.222975 --- ParallelTerminationStrategy: PID 32383 died... 00:11:50.241191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32383): Terminated: ok {rc=0} 00:11:50.283991 --- ParallelTerminationStrategy: PID 32386 died... 00:11:50.302301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32386): Terminated: ok {rc=0} 00:11:50.384937 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:11:51.679654 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:11:51.688150 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:11:51.718999 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 00:11:51.755202 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:11:51.811093 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:11:51.842944 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 00:11:51.878889 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:11:52.436825 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2351 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 00:11:52.442015 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:52.453736 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:11:52.520911 tst switch_tch_pdch.py: using LAC 17723 00:11:52.645286 tst switch_tch_pdch.py: using RAC 128 00:11:52.770310 tst switch_tch_pdch.py: using CellId 17723 00:11:52.894872 tst switch_tch_pdch.py: using BVCI 17724 00:11:53.009350 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:53.020911 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:53.032504 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:53.044083 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:53.056240 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:53.068202 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:53.080060 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:53.091801 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:11:53.206626 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:11:53.325427 tst switch_tch_pdch.py:51: start network... 00:11:53.538698 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:11:54.027727 run create_hlr_db(pid=32391): Launched 00:11:54.147577 bus /gobi_6: Setting Powered False 00:11:55.210265 run create_hlr_db(pid=32391): Terminated: ok {rc=0} 00:11:55.636116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32393): Launched 00:11:55.934877 run osmo-hlr_10.42.42.2(pid=32394): Launched 00:11:56.048486 run osmo-stp_10.42.42.5: Starting osmo-stp 00:11:56.560656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32396): Launched 00:11:56.858476 run osmo-stp_10.42.42.5(pid=32397): Launched 00:11:56.970756 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:11:57.484784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32399): Launched 00:11:57.607899 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:11:57.874835 run patchelf(pid=32400): Launched 00:11:58.050560 run osmo-stp_10.42.42.5(pid=32397): ERR: Terminated: ERROR {rc=1} [trial-2351↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32397)] 00:11:58.184641 run osmo-stp_10.42.42.5(pid=32397): stdout: | (launched: 2022-12-09_00:11:56.804062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:58.320898 run osmo-stp_10.42.42.5(pid=32397): stderr: | [0;m[38;5;43m20221209001156973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001156973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001156973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001156974 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001156974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001156974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001156974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:58.457308 run osmo-stp_10.42.42.5(pid=32397): stdout: | (launched: 2022-12-09_00:11:56.804062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:58.586980 run osmo-stp_10.42.42.5(pid=32397): stderr: | [0;m[38;5;43m20221209001156973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001156973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001156973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001156974 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001156974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001156974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001156974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:58.740592 run patchelf(pid=32400): Terminating (SIGINT) 00:11:58.918091 run patchelf(pid=32400): Terminated: ok {rc=0} 00:11:59.045582 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32397): Process ended prematurely: osmo-stp_10.42.42.5(pid=32397) [trial-2351↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32397)] [trial-2351↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 00:11:59.055263 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 00:11:59.083138 run osmo-hlr_10.42.42.2(pid=32394): ERR: Terminated: ERROR {rc=237} [trial-2351↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32394)] 00:11:59.133601 run osmo-hlr_10.42.42.2(pid=32394): stdout: | (launched: 2022-12-09_00:11:55.880231) 00:11:59.185366 run osmo-hlr_10.42.42.2(pid=32394): stderr: | [0;m[1;31m20221209001156057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001156057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001156057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001156057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001156057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001156057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001156070 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001156078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001156079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001156079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:11:59.236813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32393): Terminating (SIGTERM) 00:11:59.278382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32396): Terminating (SIGTERM) 00:11:59.320693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32399): Terminating (SIGTERM) 00:11:59.362399 --- ParallelTerminationStrategy: PID 32393 died... 00:11:59.382097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32393): Terminated: ok {rc=0} 00:11:59.428449 --- ParallelTerminationStrategy: PID 32396 died... 00:11:59.447815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32396): Terminated: ok {rc=0} 00:11:59.493767 --- ParallelTerminationStrategy: PID 32399 died... 00:11:59.512910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32399): Terminated: ok {rc=0} 00:11:59.601207 bus /gobi_0: Setting Powered False 00:12:00.697570 bus /gobi_0: Setting Powered False 00:12:01.814845 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 00:12:03.070339 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:12:03.075886 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 00:12:03.104055 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 00:12:03.137801 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 00:12:03.188703 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 00:12:03.216708 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 00:12:03.250547 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 00:12:03.807753 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2351 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 00:12:03.812654 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:12:03.823790 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 00:12:03.888233 tst switch_tch_pdch.py: using LAC 17724 00:12:04.004720 tst switch_tch_pdch.py: using RAC 129 00:12:04.121907 tst switch_tch_pdch.py: using CellId 17724 00:12:04.240349 tst switch_tch_pdch.py: using BVCI 17725 00:12:04.349554 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:12:04.360929 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:12:04.371790 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:12:04.382621 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:12:04.393390 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:12:04.404552 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:12:04.415430 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:12:04.426206 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:12:04.543172 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:12:04.658396 tst switch_tch_pdch.py:51: start network... 00:12:04.857807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:12:05.291180 run create_hlr_db(pid=32405): Launched 00:12:05.411512 bus /gobi_6: Setting Powered False 00:12:06.470236 run create_hlr_db(pid=32405): Terminated: ok {rc=0} 00:12:06.876940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32407): Launched 00:12:07.192790 run osmo-hlr_10.42.42.2(pid=32408): Launched 00:12:07.313729 run osmo-stp_10.42.42.5: Starting osmo-stp 00:12:07.803656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32410): Launched 00:12:08.099882 run osmo-stp_10.42.42.5(pid=32411): Launched 00:12:08.211628 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:12:08.697099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32413): Launched 00:12:08.810816 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:12:09.062275 run patchelf(pid=32414): Launched 00:12:09.227363 run osmo-stp_10.42.42.5(pid=32411): ERR: Terminated: ERROR {rc=1} [trial-2351↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32411)] 00:12:09.353173 run osmo-stp_10.42.42.5(pid=32411): stdout: | (launched: 2022-12-09_00:12:08.045707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:09.480797 run osmo-stp_10.42.42.5(pid=32411): stderr: | [0;m[38;5;43m20221209001208215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001208215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001208215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001208216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001208218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001208218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001208218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:09.608258 run osmo-stp_10.42.42.5(pid=32411): stdout: | (launched: 2022-12-09_00:12:08.045707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:09.729319 run osmo-stp_10.42.42.5(pid=32411): stderr: | [0;m[38;5;43m20221209001208215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001208215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001208215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001208216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001208218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001208218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001208218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:09.873406 run patchelf(pid=32414): Terminating (SIGINT) 00:12:10.038927 run patchelf(pid=32414): Terminated: ok {rc=0} 00:12:10.158439 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32411): Process ended prematurely: osmo-stp_10.42.42.5(pid=32411) [trial-2351↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32411)] [trial-2351↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 00:12:10.167222 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 00:12:10.193480 run osmo-hlr_10.42.42.2(pid=32408): ERR: Terminated: ERROR {rc=237} [trial-2351↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32408)] 00:12:10.239824 run osmo-hlr_10.42.42.2(pid=32408): stdout: | (launched: 2022-12-09_00:12:07.135386) 00:12:10.288014 run osmo-hlr_10.42.42.2(pid=32408): stderr: | [0;m[1;31m20221209001207333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001207333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001207333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001207333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001207333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001207333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001207345 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001207353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001207354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001207354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:12:10.336788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32407): Terminating (SIGTERM) 00:12:10.375668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32410): Terminating (SIGTERM) 00:12:10.414386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32413): Terminating (SIGTERM) 00:12:10.453508 --- ParallelTerminationStrategy: PID 32407 died... 00:12:10.472073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32407): Terminated: ok {rc=0} 00:12:10.515243 --- ParallelTerminationStrategy: PID 32410 died... 00:12:10.533510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32410): Terminated: ok {rc=0} 00:12:10.576464 --- ParallelTerminationStrategy: PID 32413 died... 00:12:10.594775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32413): Terminated: ok {rc=0} 00:12:10.678999 bus /gobi_0: Setting Powered False 00:12:11.778298 bus /gobi_0: Setting Powered False 00:12:12.892814 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 nitb_sms:nanobts --------------------------------------------------------------------- 00:12:14.141132 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:12:14.145463 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 00:12:14.169195 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 00:12:14.175671 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 00:12:14.225347 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 00:12:14.248483 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 00:12:14.255141 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 00:12:14.793401 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 00:12:14.798284 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 00:12:14.808754 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 00:12:14.845349 tst mo_mt_sms.py: using LAC 17725 00:12:14.962764 tst mo_mt_sms.py: using RAC 130 00:12:15.079138 tst mo_mt_sms.py: using CellId 17725 00:12:15.194354 tst mo_mt_sms.py: using BVCI 17726 00:12:15.302676 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 00:12:15.418585 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 00:12:15.533196 tst mo_mt_sms.py:9: start nitb and bts... 00:12:15.732058 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:12:16.381944 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32418): Launched 00:12:16.689884 run osmo-nitb_10.42.42.2(pid=32419): Launched 00:12:16.874792 run osmo-nitb_10.42.42.2(pid=32419): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32419)] 00:12:17.011697 run osmo-nitb_10.42.42.2(pid=32419): stdout: | (launched: 2022-12-09_00:12:16.632320) 00:12:17.149798 run osmo-nitb_10.42.42.2(pid=32419): stderr: | (launched: 2022-12-09_00:12:16.677157) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:12:17.286282 run osmo-nitb_10.42.42.2(pid=32419): stdout: | (launched: 2022-12-09_00:12:16.632320) 00:12:17.415829 run osmo-nitb_10.42.42.2(pid=32419): stderr: | (launched: 2022-12-09_00:12:16.677157) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6f22fc268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32419): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32419) [trial-2351↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32419)] 00:12:17.820941 tst osmo-nitb_10.42.42.2(pid=32419): stdout: | (launched: 2022-12-09_00:12:16.632320) 00:12:17.940344 tst osmo-nitb_10.42.42.2(pid=32419): stderr: | (launched: 2022-12-09_00:12:16.677157) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:12:18.081062 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=32419): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32419) [trial-2351↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32419)] [trial-2351↪nitb_sms:nanobts↪mo_mt_sms.py:11] 00:12:18.089435 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 00:12:18.095831 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32418): Terminating (SIGTERM) 00:12:18.303532 --- ParallelTerminationStrategy: PID 32418 died... 00:12:18.323778 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32418): Terminated: ok {rc=0} 00:12:18.409508 bus /sierra_3: Setting Powered False 00:12:19.508335 bus /sierra_3: Setting Powered False 00:12:20.623706 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 sms:nanobts+band-1900 --------------------------------------------------------------------- 00:12:21.806321 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:12:21.811103 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 00:12:21.834299 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 00:12:21.860318 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 00:12:21.911050 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 00:12:21.934276 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 00:12:21.960073 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 00:12:22.507421 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 00:12:22.512484 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:22.523153 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:12:22.559383 tst mo_mt_sms.py: using LAC 17726 00:12:22.685494 tst mo_mt_sms.py: using RAC 131 00:12:22.810942 tst mo_mt_sms.py: using CellId 17726 00:12:22.935551 tst mo_mt_sms.py: using BVCI 17727 00:12:23.051836 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:23.062937 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:23.073983 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:23.085666 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:23.096728 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:23.107898 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 00:12:23.223239 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 00:12:23.338473 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:12:23.798097 run create_hlr_db(pid=32423): Launched 00:12:23.919981 bus /sierra_2: Setting Powered False 00:12:24.980609 run create_hlr_db(pid=32423): Terminated: ok {rc=0} 00:12:25.415095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32425): Launched 00:12:25.731712 run osmo-hlr_10.42.42.2(pid=32426): Launched 00:12:25.852747 run osmo-stp_10.42.42.5: Starting osmo-stp 00:12:26.397259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32428): Launched 00:12:26.713615 run osmo-stp_10.42.42.5(pid=32429): Launched 00:12:26.834266 run osmo-msc_10.42.42.6: Starting osmo-msc 00:12:27.407263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32431): Launched 00:12:27.724715 run osmo-msc_10.42.42.6(pid=32432): Launched 00:12:27.902224 run osmo-stp_10.42.42.5(pid=32429): ERR: Terminated: ERROR {rc=1} [trial-2351↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32429)] 00:12:28.036329 run osmo-stp_10.42.42.5(pid=32429): stdout: | (launched: 2022-12-09_00:12:26.655912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:28.171859 run osmo-stp_10.42.42.5(pid=32429): stderr: | [0;m[38;5;43m20221209001226850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001226850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001226850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001226851 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001226851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001226851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001226851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:28.305745 run osmo-stp_10.42.42.5(pid=32429): stdout: | (launched: 2022-12-09_00:12:26.655912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:28.432560 run osmo-stp_10.42.42.5(pid=32429): stderr: | [0;m[38;5;43m20221209001226850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001226850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001226850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001226851 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001226851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001226851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001226851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:28.584259 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=32429): Process ended prematurely: osmo-stp_10.42.42.5(pid=32429) [trial-2351↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32429)] [trial-2351↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 00:12:28.593225 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 00:12:28.620521 run osmo-hlr_10.42.42.2(pid=32426): ERR: Terminated: ERROR {rc=237} [trial-2351↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32426)] 00:12:28.670088 run osmo-hlr_10.42.42.2(pid=32426): stdout: | (launched: 2022-12-09_00:12:25.674256) 00:12:28.722151 run osmo-hlr_10.42.42.2(pid=32426): stderr: | [0;m[1;31m20221209001225872 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001225872 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001225872 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001225872 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001225872 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001225872 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001225885 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001225893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001225893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001225893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:12:28.793932 run osmo-msc_10.42.42.6(pid=32432): ERR: Terminated: ERROR {rc=2} [trial-2351↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32432)] 00:12:28.843479 run osmo-msc_10.42.42.6(pid=32432): stdout: | (launched: 2022-12-09_00:12:27.667034) 00:12:28.894950 run osmo-msc_10.42.42.6(pid=32432): stderr: | [0;m[38;5;43m20221209001227990 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001227990 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f93dfd62c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001227990 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001227990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001227990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001227991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001227992 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001227993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001227993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001227993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:12:28.946595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32425): Terminating (SIGTERM) 00:12:28.988622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32428): Terminating (SIGTERM) 00:12:29.030424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32431): Terminating (SIGTERM) 00:12:29.072439 --- ParallelTerminationStrategy: PID 32425 died... 00:12:29.092218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32425): Terminated: ok {rc=0} 00:12:29.138469 --- ParallelTerminationStrategy: PID 32428 died... 00:12:29.157791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32428): Terminated: ok {rc=0} 00:12:29.203795 --- ParallelTerminationStrategy: PID 32431 died... 00:12:29.223160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32431): Terminated: ok {rc=0} 00:12:29.310534 bus /sierra_3: Setting Powered False 00:12:30.407529 bus /sierra_3: Setting Powered False 00:12:31.522749 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 00:12:32.742164 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:12:32.746632 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 00:12:32.769585 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 00:12:32.776110 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 00:12:32.810471 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 00:12:32.834860 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 00:12:32.842272 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 00:12:33.360158 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2351 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 00:12:33.365041 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 00:12:33.375705 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:12:33.412123 tst assert_extension.py: using LAC 17727 00:12:33.528814 tst assert_extension.py: using RAC 132 00:12:33.645359 tst assert_extension.py: using CellId 17727 00:12:33.762407 tst assert_extension.py: using BVCI 17728 00:12:33.869518 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 00:12:33.986211 tst assert_extension.py:10: start nitb and bts... 00:12:34.200018 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:12:34.844393 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32437): Launched 00:12:35.161075 run osmo-nitb_10.42.42.2(pid=32438): Launched 00:12:35.336491 run osmo-nitb_10.42.42.2(pid=32438): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32438)] 00:12:35.478615 run osmo-nitb_10.42.42.2(pid=32438): stdout: | (launched: 2022-12-09_00:12:35.103582) 00:12:35.622492 run osmo-nitb_10.42.42.2(pid=32438): stderr: | (launched: 2022-12-09_00:12:35.150616) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:12:35.766940 run osmo-nitb_10.42.42.2(pid=32438): stdout: | (launched: 2022-12-09_00:12:35.103582) 00:12:35.904565 run osmo-nitb_10.42.42.2(pid=32438): stderr: | (launched: 2022-12-09_00:12:35.150616) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6f22fc268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32438): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32438) [trial-2351↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32438)] 00:12:36.279794 tst osmo-nitb_10.42.42.2(pid=32438): stdout: | (launched: 2022-12-09_00:12:35.103582) 00:12:36.408227 tst osmo-nitb_10.42.42.2(pid=32438): stderr: | (launched: 2022-12-09_00:12:35.150616) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:12:36.558621 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=32438): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32438) [trial-2351↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32438)] [trial-2351↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 00:12:36.567750 tst assert_extension.py:12: Test FAILED (3.2 sec) 00:12:36.574980 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32437): Terminating (SIGTERM) 00:12:36.786283 --- ParallelTerminationStrategy: PID 32437 died... 00:12:36.807916 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32437): Terminated: ok {rc=0} 00:12:36.894913 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 ussd:nanobts+band-1900 --------------------------------------------------------------------- 00:12:38.060519 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:12:38.065996 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 00:12:38.090260 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 00:12:38.118014 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 00:12:38.154229 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 00:12:38.178551 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 00:12:38.205876 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 00:12:38.735046 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2351 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 00:12:38.740517 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:38.751740 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:12:38.790773 tst assert_extension.py: using LAC 17728 00:12:38.914336 tst assert_extension.py: using RAC 133 00:12:39.032909 tst assert_extension.py: using CellId 17728 00:12:39.150748 tst assert_extension.py: using BVCI 17729 00:12:39.257593 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:39.268273 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:39.278755 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:39.289130 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:39.299622 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:39.310647 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 00:12:39.422613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:12:39.882932 run create_hlr_db(pid=32446): Launched 00:12:40.004004 bus /sierra_2: Setting Powered False 00:12:41.063818 run create_hlr_db(pid=32446): Terminated: ok {rc=0} 00:12:41.499041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32448): Launched 00:12:41.816882 run osmo-hlr_10.42.42.2(pid=32449): Launched 00:12:41.938788 run osmo-stp_10.42.42.5: Starting osmo-stp 00:12:42.486488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32451): Launched 00:12:42.803202 run osmo-stp_10.42.42.5(pid=32452): Launched 00:12:42.924349 run osmo-msc_10.42.42.6: Starting osmo-msc 00:12:43.498084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32454): Launched 00:12:43.814917 run osmo-msc_10.42.42.6(pid=32455): Launched 00:12:43.991905 run osmo-stp_10.42.42.5(pid=32452): ERR: Terminated: ERROR {rc=1} [trial-2351↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32452)] 00:12:44.126523 run osmo-stp_10.42.42.5(pid=32452): stdout: | (launched: 2022-12-09_00:12:42.745513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:44.261219 run osmo-stp_10.42.42.5(pid=32452): stderr: | [0;m[38;5;43m20221209001242937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001242937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001242937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001242937 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001242938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001242938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001242938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:44.395737 run osmo-stp_10.42.42.5(pid=32452): stdout: | (launched: 2022-12-09_00:12:42.745513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:44.522360 run osmo-stp_10.42.42.5(pid=32452): stderr: | [0;m[38;5;43m20221209001242937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001242937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001242937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001242937 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001242938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001242938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001242938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:44.673411 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=32452): Process ended prematurely: osmo-stp_10.42.42.5(pid=32452) [trial-2351↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32452)] [trial-2351↪ussd:nanobts+band-1900↪assert_extension.py:17] 00:12:44.682326 tst assert_extension.py:17: Test FAILED (5.9 sec) 00:12:44.709788 run osmo-hlr_10.42.42.2(pid=32449): ERR: Terminated: ERROR {rc=237} [trial-2351↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32449)] 00:12:44.759711 run osmo-hlr_10.42.42.2(pid=32449): stdout: | (launched: 2022-12-09_00:12:41.759324) 00:12:44.811439 run osmo-hlr_10.42.42.2(pid=32449): stderr: | [0;m[1;31m20221209001241957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001241957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001241957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001241957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001241957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001241957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001241969 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001241977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001241977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001241977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:12:44.883042 run osmo-msc_10.42.42.6(pid=32455): ERR: Terminated: ERROR {rc=2} [trial-2351↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32455)] 00:12:44.932536 run osmo-msc_10.42.42.6(pid=32455): stdout: | (launched: 2022-12-09_00:12:43.757275) 00:12:44.983990 run osmo-msc_10.42.42.6(pid=32455): stderr: | [0;m[38;5;43m20221209001244077 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001244077 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f53366f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001244077 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001244077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001244077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001244078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001244079 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001244080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001244080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001244080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:12:45.035902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32448): Terminating (SIGTERM) 00:12:45.077306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32451): Terminating (SIGTERM) 00:12:45.119551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32454): Terminating (SIGTERM) 00:12:45.161446 --- ParallelTerminationStrategy: PID 32448 died... 00:12:45.181745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32448): Terminated: ok {rc=0} 00:12:45.227713 --- ParallelTerminationStrategy: PID 32451 died... 00:12:45.247413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32451): Terminated: ok {rc=0} 00:12:45.293583 --- ParallelTerminationStrategy: PID 32454 died... 00:12:45.312859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32454): Terminated: ok {rc=0} 00:12:45.401346 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 00:12:46.628755 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:12:46.642690 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 00:12:46.678351 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 00:12:46.715905 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 00:12:46.777238 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 00:12:46.813625 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 00:12:46.841661 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 00:12:47.378112 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 00:12:47.431577 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:47.443513 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:12:47.504824 tst mo_mt_call.py: using LAC 17729 00:12:47.630311 tst mo_mt_call.py: using RAC 134 00:12:47.755654 tst mo_mt_call.py: using CellId 17729 00:12:47.882367 tst mo_mt_call.py: using BVCI 17730 00:12:47.998994 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:48.010850 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:48.022169 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:48.033514 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:48.045745 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:48.057476 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:12:48.174065 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:12:48.293322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:12:48.793616 run create_hlr_db(pid=32460): Launched 00:12:48.916842 bus /sierra_2: Setting Powered False 00:12:49.981074 run create_hlr_db(pid=32460): Terminated: ok {rc=0} 00:12:50.412870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32462): Launched 00:12:50.716754 run osmo-hlr_10.42.42.2(pid=32463): Launched 00:12:50.832847 run osmo-stp_10.42.42.5: Starting osmo-stp 00:12:51.368013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32465): Launched 00:12:51.670381 run osmo-stp_10.42.42.5(pid=32466): Launched 00:12:51.785206 run osmo-msc_10.42.42.6: Starting osmo-msc 00:12:52.332192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32468): Launched 00:12:52.636374 run osmo-msc_10.42.42.6(pid=32469): Launched 00:12:52.806266 run osmo-stp_10.42.42.5(pid=32466): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32466)] 00:12:52.934090 run osmo-stp_10.42.42.5(pid=32466): stdout: | (launched: 2022-12-09_00:12:51.614938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:53.062141 run osmo-stp_10.42.42.5(pid=32466): stderr: | [0;m[38;5;43m20221209001251785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001251786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001251786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001251786 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001251788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001251789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001251789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:53.187986 run osmo-stp_10.42.42.5(pid=32466): stdout: | (launched: 2022-12-09_00:12:51.614938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:53.309285 run osmo-stp_10.42.42.5(pid=32466): stderr: | [0;m[38;5;43m20221209001251785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001251786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001251786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001251786 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001251788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001251789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001251789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:53.452771 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32466): Process ended prematurely: osmo-stp_10.42.42.5(pid=32466) [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32466)] [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 00:12:53.461626 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 00:12:53.487592 run osmo-hlr_10.42.42.2(pid=32463): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32463)] 00:12:53.534141 run osmo-hlr_10.42.42.2(pid=32463): stdout: | (launched: 2022-12-09_00:12:50.661376) 00:12:53.582802 run osmo-hlr_10.42.42.2(pid=32463): stderr: | [0;m[1;31m20221209001250837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001250837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001250837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001250837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001250837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001250837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001250848 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001250857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001250857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001250857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:12:53.650427 run osmo-msc_10.42.42.6(pid=32469): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32469)] 00:12:53.697199 run osmo-msc_10.42.42.6(pid=32469): stdout: | (launched: 2022-12-09_00:12:52.580735) 00:12:53.745537 run osmo-msc_10.42.42.6(pid=32469): stderr: | [0;m[38;5;43m20221209001252852 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001252853 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f453d13dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001252853 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001252853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001252853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001252853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001252855 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001252855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001252855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001252856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:12:53.794306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32462): Terminating (SIGTERM) 00:12:53.832733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32465): Terminating (SIGTERM) 00:12:53.871161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32468): Terminating (SIGTERM) 00:12:53.909827 --- ParallelTerminationStrategy: PID 32462 died... 00:12:53.928396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32462): Terminated: ok {rc=0} 00:12:53.971288 --- ParallelTerminationStrategy: PID 32465 died... 00:12:53.989542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32465): Terminated: ok {rc=0} 00:12:54.032045 --- ParallelTerminationStrategy: PID 32468 died... 00:12:54.050165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32468): Terminated: ok {rc=0} 00:12:54.134110 bus /sierra_3: Setting Powered False 00:12:55.232171 bus /sierra_3: Setting Powered False 00:12:56.346457 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 00:12:57.493366 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:57.505733 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:12:57.566558 tst mo_mt_call_osmux.py: using LAC 17730 00:12:57.692534 tst mo_mt_call_osmux.py: using RAC 135 00:12:57.818489 tst mo_mt_call_osmux.py: using CellId 17730 00:12:57.944279 tst mo_mt_call_osmux.py: using BVCI 17731 00:12:58.060867 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:58.072423 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:58.083842 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:58.095478 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:58.107145 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:58.118455 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:12:58.236071 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:12:58.353646 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:12:58.853589 run create_hlr_db(pid=32471): Launched 00:12:58.976342 bus /sierra_2: Setting Powered False 00:13:00.035879 run create_hlr_db(pid=32471): Terminated: ok {rc=0} 00:13:00.465375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32473): Launched 00:13:00.769347 run osmo-hlr_10.42.42.2(pid=32474): Launched 00:13:00.892925 run osmo-stp_10.42.42.5: Starting osmo-stp 00:13:01.571152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32476): Launched 00:13:01.889254 run osmo-stp_10.42.42.5(pid=32477): Launched 00:13:02.128756 run osmo-msc_10.42.42.6: Starting osmo-msc 00:13:02.790653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32479): Launched 00:13:03.094873 run osmo-msc_10.42.42.6(pid=32480): Launched 00:13:03.264923 run osmo-stp_10.42.42.5(pid=32477): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32477)] 00:13:03.393573 run osmo-stp_10.42.42.5(pid=32477): stdout: | (launched: 2022-12-09_00:13:01.826511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:03.522450 run osmo-stp_10.42.42.5(pid=32477): stderr: | [0;m[38;5;43m20221209001302166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001302166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001302166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001302167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001302167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001302167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001302167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:03.648752 run osmo-stp_10.42.42.5(pid=32477): stdout: | (launched: 2022-12-09_00:13:01.826511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:03.769327 run osmo-stp_10.42.42.5(pid=32477): stderr: | [0;m[38;5;43m20221209001302166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001302166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001302166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001302167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001302167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001302167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001302167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:03.913568 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32477): Process ended prematurely: osmo-stp_10.42.42.5(pid=32477) [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32477)] [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 00:13:03.922859 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 00:13:03.948873 run osmo-hlr_10.42.42.2(pid=32474): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32474)] 00:13:03.995513 run osmo-hlr_10.42.42.2(pid=32474): stdout: | (launched: 2022-12-09_00:13:00.713609) 00:13:04.044166 run osmo-hlr_10.42.42.2(pid=32474): stderr: | [0;m[1;31m20221209001301009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001301009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001301009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001301009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001301009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001301009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001301025 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001301044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001301049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001301049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:13:04.111905 run osmo-msc_10.42.42.6(pid=32480): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32480)] 00:13:04.158209 run osmo-msc_10.42.42.6(pid=32480): stdout: | (launched: 2022-12-09_00:13:03.038824) 00:13:04.206356 run osmo-msc_10.42.42.6(pid=32480): stderr: | [0;m[38;5;43m20221209001303313 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001303313 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb797fbcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001303313 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001303313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001303313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001303314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001303315 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001303316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001303316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001303316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:13:04.254908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32473): Terminating (SIGTERM) 00:13:04.293747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32476): Terminating (SIGTERM) 00:13:04.332578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32479): Terminating (SIGTERM) 00:13:04.371542 --- ParallelTerminationStrategy: PID 32473 died... 00:13:04.390276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32473): Terminated: ok {rc=0} 00:13:04.433108 --- ParallelTerminationStrategy: PID 32476 died... 00:13:04.451408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32476): Terminated: ok {rc=0} 00:13:04.494168 --- ParallelTerminationStrategy: PID 32479 died... 00:13:04.512219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32479): Terminated: ok {rc=0} 00:13:04.595103 bus /sierra_3: Setting Powered False 00:13:05.693934 bus /sierra_3: Setting Powered False 00:13:06.805138 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 00:13:08.047676 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:13:08.055795 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 00:13:08.080662 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 00:13:08.107920 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 00:13:08.162865 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 00:13:08.187312 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 00:13:08.214328 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 00:13:08.760582 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 00:13:08.813666 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:13:08.825172 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:13:08.884717 tst mo_mt_call.py: using LAC 17731 00:13:09.011128 tst mo_mt_call.py: using RAC 136 00:13:09.137200 tst mo_mt_call.py: using CellId 17731 00:13:09.256870 tst mo_mt_call.py: using BVCI 17732 00:13:09.368283 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:13:09.379516 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:13:09.390644 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:13:09.401631 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:13:09.413211 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:13:09.424092 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:13:09.537941 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:13:09.657481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:13:10.155935 run create_hlr_db(pid=32486): Launched 00:13:10.279041 bus /sierra_2: Setting Powered False 00:13:11.343300 run create_hlr_db(pid=32486): Terminated: ok {rc=0} 00:13:11.775293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32488): Launched 00:13:12.079810 run osmo-hlr_10.42.42.2(pid=32489): Launched 00:13:12.195225 run osmo-stp_10.42.42.5: Starting osmo-stp 00:13:12.730972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32491): Launched 00:13:13.033382 run osmo-stp_10.42.42.5(pid=32492): Launched 00:13:13.148701 run osmo-msc_10.42.42.6: Starting osmo-msc 00:13:13.695488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32494): Launched 00:13:13.999418 run osmo-msc_10.42.42.6(pid=32495): Launched 00:13:14.169531 run osmo-stp_10.42.42.5(pid=32492): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32492)] 00:13:14.297735 run osmo-stp_10.42.42.5(pid=32492): stdout: | (launched: 2022-12-09_00:13:12.978214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:14.426548 run osmo-stp_10.42.42.5(pid=32492): stderr: | [0;m[38;5;43m20221209001313148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001313148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001313148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001313149 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001313149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001313149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001313149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:14.552727 run osmo-stp_10.42.42.5(pid=32492): stdout: | (launched: 2022-12-09_00:13:12.978214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:14.672726 run osmo-stp_10.42.42.5(pid=32492): stderr: | [0;m[38;5;43m20221209001313148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001313148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001313148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001313149 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001313149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001313149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001313149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:14.816229 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32492): Process ended prematurely: osmo-stp_10.42.42.5(pid=32492) [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32492)] [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 00:13:14.825152 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 00:13:14.851048 run osmo-hlr_10.42.42.2(pid=32489): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32489)] 00:13:14.897436 run osmo-hlr_10.42.42.2(pid=32489): stdout: | (launched: 2022-12-09_00:13:12.024507) 00:13:14.945731 run osmo-hlr_10.42.42.2(pid=32489): stderr: | [0;m[1;31m20221209001312204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001312204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001312204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001312204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001312204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001312204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001312216 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001312227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001312227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001312227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:13:15.013514 run osmo-msc_10.42.42.6(pid=32495): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32495)] 00:13:15.059920 run osmo-msc_10.42.42.6(pid=32495): stdout: | (launched: 2022-12-09_00:13:13.943798) 00:13:15.108298 run osmo-msc_10.42.42.6(pid=32495): stderr: | [0;m[38;5;43m20221209001314217 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001314217 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2d9b06ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001314217 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001314217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001314217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001314218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001314222 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001314222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001314223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001314223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:13:15.157038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32488): Terminating (SIGTERM) 00:13:15.195752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32491): Terminating (SIGTERM) 00:13:15.234504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32494): Terminating (SIGTERM) 00:13:15.273686 --- ParallelTerminationStrategy: PID 32488 died... 00:13:15.292271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32488): Terminated: ok {rc=0} 00:13:15.335503 --- ParallelTerminationStrategy: PID 32491 died... 00:13:15.353800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32491): Terminated: ok {rc=0} 00:13:15.397263 --- ParallelTerminationStrategy: PID 32494 died... 00:13:15.415526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32494): Terminated: ok {rc=0} 00:13:15.499914 bus /sierra_3: Setting Powered False 00:13:16.602084 bus /sierra_3: Setting Powered False 00:13:17.718320 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 00:13:18.862660 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:13:18.874260 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:13:18.933183 tst mo_mt_call_osmux.py: using LAC 17732 00:13:19.057169 tst mo_mt_call_osmux.py: using RAC 137 00:13:19.175502 tst mo_mt_call_osmux.py: using CellId 17732 00:13:19.293164 tst mo_mt_call_osmux.py: using BVCI 17733 00:13:19.403011 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:13:19.414166 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:13:19.425227 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:13:19.435997 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:13:19.446969 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:13:19.457757 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:13:19.577054 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:13:19.693227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:13:20.162900 run create_hlr_db(pid=32497): Launched 00:13:20.286205 bus /sierra_2: Setting Powered False 00:13:21.346841 run create_hlr_db(pid=32497): Terminated: ok {rc=0} 00:13:21.788908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32499): Launched 00:13:22.111649 run osmo-hlr_10.42.42.2(pid=32500): Launched 00:13:22.234631 run osmo-stp_10.42.42.5: Starting osmo-stp 00:13:22.791554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32502): Launched 00:13:23.113944 run osmo-stp_10.42.42.5(pid=32503): Launched 00:13:23.237164 run osmo-msc_10.42.42.6: Starting osmo-msc 00:13:23.819849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32505): Launched 00:13:24.143321 run osmo-msc_10.42.42.6(pid=32506): Launched 00:13:24.323276 run osmo-stp_10.42.42.5(pid=32503): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32503)] 00:13:24.460765 run osmo-stp_10.42.42.5(pid=32503): stdout: | (launched: 2022-12-09_00:13:23.055332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:24.598047 run osmo-stp_10.42.42.5(pid=32503): stderr: | [0;m[38;5;43m20221209001323249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001323249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001323249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001323250 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001323250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001323250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001323250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:24.734456 run osmo-stp_10.42.42.5(pid=32503): stdout: | (launched: 2022-12-09_00:13:23.055332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:24.863386 run osmo-stp_10.42.42.5(pid=32503): stderr: | [0;m[38;5;43m20221209001323249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001323249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001323249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001323250 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001323250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001323250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001323250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:25.017578 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32503): Process ended prematurely: osmo-stp_10.42.42.5(pid=32503) [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32503)] [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 00:13:25.027262 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:13:25.055558 run osmo-hlr_10.42.42.2(pid=32500): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32500)] 00:13:25.105215 run osmo-hlr_10.42.42.2(pid=32500): stdout: | (launched: 2022-12-09_00:13:22.053175) 00:13:25.156628 run osmo-hlr_10.42.42.2(pid=32500): stderr: | [0;m[1;31m20221209001322250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001322250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001322250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001322250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001322250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001322250 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001322263 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001322271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001322271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001322272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:13:25.228285 run osmo-msc_10.42.42.6(pid=32506): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32506)] 00:13:25.278023 run osmo-msc_10.42.42.6(pid=32506): stdout: | (launched: 2022-12-09_00:13:24.084335) 00:13:25.329303 run osmo-msc_10.42.42.6(pid=32506): stderr: | [0;m[38;5;43m20221209001324411 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001324411 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa6cc557c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001324411 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001324411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001324411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001324411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001324413 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001324413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001324414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001324414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:13:25.381455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32499): Terminating (SIGTERM) 00:13:25.423199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32502): Terminating (SIGTERM) 00:13:25.464263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32505): Terminating (SIGTERM) 00:13:25.506189 --- ParallelTerminationStrategy: PID 32499 died... 00:13:25.526290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32499): Terminated: ok {rc=0} 00:13:25.572121 --- ParallelTerminationStrategy: PID 32502 died... 00:13:25.591921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32502): Terminated: ok {rc=0} 00:13:25.637479 --- ParallelTerminationStrategy: PID 32505 died... 00:13:25.657321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32505): Terminated: ok {rc=0} 00:13:25.744679 bus /sierra_3: Setting Powered False 00:13:26.841490 bus /sierra_3: Setting Powered False 00:13:27.958865 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 00:13:29.192738 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:13:29.200138 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 00:13:29.223282 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 00:13:29.249196 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 00:13:29.299648 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 00:13:29.323065 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 00:13:29.349007 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 00:13:29.903827 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 00:13:29.956872 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:29.968665 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:13:30.044173 tst mo_mt_call.py: using LAC 17733 00:13:30.175382 tst mo_mt_call.py: using RAC 138 00:13:30.301677 tst mo_mt_call.py: using CellId 17733 00:13:30.422427 tst mo_mt_call.py: using BVCI 17734 00:13:30.534654 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:30.545943 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:30.556863 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:30.568098 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:30.579942 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:30.590916 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:13:30.704501 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:13:30.833760 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:13:31.368691 run create_hlr_db(pid=32511): Launched 00:13:31.529266 bus /sierra_2: Setting Powered False 00:13:32.592934 run create_hlr_db(pid=32511): Terminated: ok {rc=0} 00:13:33.024434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32513): Launched 00:13:33.327795 run osmo-hlr_10.42.42.2(pid=32514): Launched 00:13:33.444369 run osmo-stp_10.42.42.5: Starting osmo-stp 00:13:33.965672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32516): Launched 00:13:34.268081 run osmo-stp_10.42.42.5(pid=32517): Launched 00:13:34.383671 run osmo-msc_10.42.42.6: Starting osmo-msc 00:13:34.930032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32519): Launched 00:13:35.232090 run osmo-msc_10.42.42.6(pid=32520): Launched 00:13:35.401342 run osmo-stp_10.42.42.5(pid=32517): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32517)] 00:13:35.529603 run osmo-stp_10.42.42.5(pid=32517): stdout: | (launched: 2022-12-09_00:13:34.212670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:35.658241 run osmo-stp_10.42.42.5(pid=32517): stderr: | [0;m[38;5;43m20221209001334387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001334387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001334388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001334388 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001334389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001334389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001334389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:35.784261 run osmo-stp_10.42.42.5(pid=32517): stdout: | (launched: 2022-12-09_00:13:34.212670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:35.904047 run osmo-stp_10.42.42.5(pid=32517): stderr: | [0;m[38;5;43m20221209001334387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001334387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001334388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001334388 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001334389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001334389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001334389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:36.048013 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32517): Process ended prematurely: osmo-stp_10.42.42.5(pid=32517) [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32517)] [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 00:13:36.056802 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 00:13:36.083114 run osmo-hlr_10.42.42.2(pid=32514): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32514)] 00:13:36.129770 run osmo-hlr_10.42.42.2(pid=32514): stdout: | (launched: 2022-12-09_00:13:33.272215) 00:13:36.178140 run osmo-hlr_10.42.42.2(pid=32514): stderr: | [0;m[1;31m20221209001333451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001333451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001333451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001333451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001333451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001333451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001333466 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001333477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001333477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001333477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:13:36.245833 run osmo-msc_10.42.42.6(pid=32520): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32520)] 00:13:36.292288 run osmo-msc_10.42.42.6(pid=32520): stdout: | (launched: 2022-12-09_00:13:35.176820) 00:13:36.340636 run osmo-msc_10.42.42.6(pid=32520): stderr: | [0;m[38;5;43m20221209001335452 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001335452 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1c27e3cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001335453 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001335453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001335453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001335453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001335455 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001335455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001335455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001335455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:13:36.389812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32513): Terminating (SIGTERM) 00:13:36.428265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32516): Terminating (SIGTERM) 00:13:36.467107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32519): Terminating (SIGTERM) 00:13:36.506269 --- ParallelTerminationStrategy: PID 32513 died... 00:13:36.524854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32513): Terminated: ok {rc=0} 00:13:36.567490 --- ParallelTerminationStrategy: PID 32516 died... 00:13:36.585689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32516): Terminated: ok {rc=0} 00:13:36.628103 --- ParallelTerminationStrategy: PID 32519 died... 00:13:36.646191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32519): Terminated: ok {rc=0} 00:13:36.730815 bus /sierra_3: Setting Powered False 00:13:37.830087 bus /sierra_3: Setting Powered False 00:13:38.943594 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 00:13:40.087213 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:40.099036 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:13:40.159441 tst mo_mt_call_osmux.py: using LAC 17734 00:13:40.279782 tst mo_mt_call_osmux.py: using RAC 139 00:13:40.398522 tst mo_mt_call_osmux.py: using CellId 17734 00:13:40.518881 tst mo_mt_call_osmux.py: using BVCI 17735 00:13:40.629530 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:40.640486 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:40.651349 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:40.662253 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:40.673204 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:40.684237 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:13:40.796496 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:13:40.915997 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:13:41.417216 run create_hlr_db(pid=32522): Launched 00:13:41.540778 bus /sierra_2: Setting Powered False 00:13:42.603245 run create_hlr_db(pid=32522): Terminated: ok {rc=0} 00:13:43.050235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32524): Launched 00:13:43.372473 run osmo-hlr_10.42.42.2(pid=32525): Launched 00:13:43.496000 run osmo-stp_10.42.42.5: Starting osmo-stp 00:13:44.051784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32527): Launched 00:13:44.375239 run osmo-stp_10.42.42.5(pid=32528): Launched 00:13:44.498823 run osmo-msc_10.42.42.6: Starting osmo-msc 00:13:45.086499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32530): Launched 00:13:45.410192 run osmo-msc_10.42.42.6(pid=32531): Launched 00:13:45.590688 run osmo-stp_10.42.42.5(pid=32528): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32528)] 00:13:45.727152 run osmo-stp_10.42.42.5(pid=32528): stdout: | (launched: 2022-12-09_00:13:44.316126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:45.905449 run osmo-stp_10.42.42.5(pid=32528): stderr: | [0;m[38;5;43m20221209001344509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001344509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001344509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001344510 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001344512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001344512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001344512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:46.049202 run osmo-stp_10.42.42.5(pid=32528): stdout: | (launched: 2022-12-09_00:13:44.316126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:46.180893 run osmo-stp_10.42.42.5(pid=32528): stderr: | [0;m[38;5;43m20221209001344509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001344509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001344509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001344510 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001344512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001344512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001344512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:46.338419 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32528): Process ended prematurely: osmo-stp_10.42.42.5(pid=32528) [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32528)] [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 00:13:46.348883 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 00:13:46.379153 run osmo-hlr_10.42.42.2(pid=32525): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32525)] 00:13:46.431891 run osmo-hlr_10.42.42.2(pid=32525): stdout: | (launched: 2022-12-09_00:13:43.313669) 00:13:46.485328 run osmo-hlr_10.42.42.2(pid=32525): stderr: | [0;m[1;31m20221209001343510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001343510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001343510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001343510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001343510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001343510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001343523 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001343531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001343531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001343531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:13:46.558748 run osmo-msc_10.42.42.6(pid=32531): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32531)] 00:13:46.608567 run osmo-msc_10.42.42.6(pid=32531): stdout: | (launched: 2022-12-09_00:13:45.350899) 00:13:46.662666 run osmo-msc_10.42.42.6(pid=32531): stderr: | [0;m[38;5;43m20221209001345675 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001345675 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd0eef10c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001345675 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001345675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001345675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001345676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001345677 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001345678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001345678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001345678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:13:46.716333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32524): Terminating (SIGTERM) 00:13:46.759858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32527): Terminating (SIGTERM) 00:13:46.803263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32530): Terminating (SIGTERM) 00:13:46.845681 --- ParallelTerminationStrategy: PID 32524 died... 00:13:46.867128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32524): Terminated: ok {rc=0} 00:13:46.915750 --- ParallelTerminationStrategy: PID 32527 died... 00:13:46.935948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32527): Terminated: ok {rc=0} 00:13:46.984636 --- ParallelTerminationStrategy: PID 32530 died... 00:13:47.004849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32530): Terminated: ok {rc=0} 00:13:47.094649 bus /sierra_3: Setting Powered False 00:13:48.193453 bus /sierra_3: Setting Powered False 00:13:49.308030 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 00:13:50.546395 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:13:50.554007 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 00:13:50.577281 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 00:13:50.603316 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 00:13:50.654845 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 00:13:50.678609 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 00:13:50.704539 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 00:13:51.254878 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 00:13:51.303380 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:51.314645 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:13:51.371992 tst mo_mt_call.py: using LAC 17735 00:13:51.490633 tst mo_mt_call.py: using RAC 140 00:13:51.612928 tst mo_mt_call.py: using CellId 17735 00:13:51.731269 tst mo_mt_call.py: using BVCI 17736 00:13:51.840278 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:51.851372 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:51.862207 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:51.873114 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:51.884204 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:51.895921 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:13:52.013784 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:13:52.132593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:13:52.630575 run create_hlr_db(pid=32536): Launched 00:13:52.753589 bus /sierra_2: Setting Powered False 00:13:53.819220 run create_hlr_db(pid=32536): Terminated: ok {rc=0} 00:13:54.261586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32538): Launched 00:13:54.585121 run osmo-hlr_10.42.42.2(pid=32539): Launched 00:13:54.708417 run osmo-stp_10.42.42.5: Starting osmo-stp 00:13:55.266402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32541): Launched 00:13:55.589959 run osmo-stp_10.42.42.5(pid=32542): Launched 00:13:55.713219 run osmo-msc_10.42.42.6: Starting osmo-msc 00:13:56.296086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32544): Launched 00:13:56.619901 run osmo-msc_10.42.42.6(pid=32545): Launched 00:13:56.799137 run osmo-stp_10.42.42.5(pid=32542): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32542)] 00:13:56.935331 run osmo-stp_10.42.42.5(pid=32542): stdout: | (launched: 2022-12-09_00:13:55.530714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:57.071953 run osmo-stp_10.42.42.5(pid=32542): stderr: | [0;m[38;5;43m20221209001355722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001355722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001355723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001355723 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001355724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001355724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001355724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:57.208369 run osmo-stp_10.42.42.5(pid=32542): stdout: | (launched: 2022-12-09_00:13:55.530714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:57.337179 run osmo-stp_10.42.42.5(pid=32542): stderr: | [0;m[38;5;43m20221209001355722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001355722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001355723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001355723 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001355724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001355724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001355724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:57.491220 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32542): Process ended prematurely: osmo-stp_10.42.42.5(pid=32542) [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32542)] [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 00:13:57.500821 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:13:57.528475 run osmo-hlr_10.42.42.2(pid=32539): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32539)] 00:13:57.578118 run osmo-hlr_10.42.42.2(pid=32539): stdout: | (launched: 2022-12-09_00:13:54.526234) 00:13:57.630096 run osmo-hlr_10.42.42.2(pid=32539): stderr: | [0;m[1;31m20221209001354724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001354724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001354724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001354724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001354725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001354725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001354737 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001354745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001354746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001354746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:13:57.701723 run osmo-msc_10.42.42.6(pid=32545): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32545)] 00:13:57.751481 run osmo-msc_10.42.42.6(pid=32545): stdout: | (launched: 2022-12-09_00:13:56.560860) 00:13:57.803097 run osmo-msc_10.42.42.6(pid=32545): stderr: | [0;m[38;5;43m20221209001356885 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001356886 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa70d4c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001356886 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001356886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001356886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001356886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001356888 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001356888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001356888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001356888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:13:57.855115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32538): Terminating (SIGTERM) 00:13:57.896213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32541): Terminating (SIGTERM) 00:13:57.938068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32544): Terminating (SIGTERM) 00:13:57.980424 --- ParallelTerminationStrategy: PID 32538 died... 00:13:58.000207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32538): Terminated: ok {rc=0} 00:13:58.046384 --- ParallelTerminationStrategy: PID 32541 died... 00:13:58.065776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32541): Terminated: ok {rc=0} 00:13:58.111850 --- ParallelTerminationStrategy: PID 32544 died... 00:13:58.131211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32544): Terminated: ok {rc=0} 00:13:58.218594 bus /sierra_3: Setting Powered False 00:13:59.315450 bus /sierra_3: Setting Powered False 00:14:00.431736 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 00:14:01.576908 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:14:01.590368 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:14:01.654835 tst mo_mt_call_osmux.py: using LAC 17736 00:14:01.810258 tst mo_mt_call_osmux.py: using RAC 141 00:14:01.944677 tst mo_mt_call_osmux.py: using CellId 17736 00:14:02.099075 tst mo_mt_call_osmux.py: using BVCI 17737 00:14:02.225622 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:14:02.238223 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:14:02.250662 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:14:02.264104 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:14:02.278723 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:14:02.290819 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:14:02.408750 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:14:02.530948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:14:03.005971 run create_hlr_db(pid=32547): Launched 00:14:03.130311 bus /sierra_2: Setting Powered False 00:14:04.190945 run create_hlr_db(pid=32547): Terminated: ok {rc=0} 00:14:04.631684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32549): Launched 00:14:04.955148 run osmo-hlr_10.42.42.2(pid=32550): Launched 00:14:05.078734 run osmo-stp_10.42.42.5: Starting osmo-stp 00:14:05.638808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32552): Launched 00:14:05.961830 run osmo-stp_10.42.42.5(pid=32553): Launched 00:14:06.085374 run osmo-msc_10.42.42.6: Starting osmo-msc 00:14:06.669602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32555): Launched 00:14:06.992809 run osmo-msc_10.42.42.6(pid=32556): Launched 00:14:07.173245 run osmo-stp_10.42.42.5(pid=32553): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32553)] 00:14:07.309817 run osmo-stp_10.42.42.5(pid=32553): stdout: | (launched: 2022-12-09_00:14:05.903053) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:07.454118 run osmo-stp_10.42.42.5(pid=32553): stderr: | [0;m[38;5;43m20221209001406094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001406095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001406095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001406095 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001406098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001406098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001406098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:07.588319 run osmo-stp_10.42.42.5(pid=32553): stdout: | (launched: 2022-12-09_00:14:05.903053) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:07.716443 run osmo-stp_10.42.42.5(pid=32553): stderr: | [0;m[38;5;43m20221209001406094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001406095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001406095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001406095 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001406098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001406098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001406098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:07.869564 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32553): Process ended prematurely: osmo-stp_10.42.42.5(pid=32553) [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32553)] [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 00:14:07.879320 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 00:14:07.906825 run osmo-hlr_10.42.42.2(pid=32550): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32550)] 00:14:07.957147 run osmo-hlr_10.42.42.2(pid=32550): stdout: | (launched: 2022-12-09_00:14:04.896166) 00:14:08.008562 run osmo-hlr_10.42.42.2(pid=32550): stderr: | [0;m[1;31m20221209001405093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001405093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001405093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001405093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001405093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001405093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001405106 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001405114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001405115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001405115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:14:08.080315 run osmo-msc_10.42.42.6(pid=32556): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32556)] 00:14:08.130300 run osmo-msc_10.42.42.6(pid=32556): stdout: | (launched: 2022-12-09_00:14:06.933445) 00:14:08.181757 run osmo-msc_10.42.42.6(pid=32556): stderr: | [0;m[38;5;43m20221209001407275 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001407275 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8566d5ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001407275 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001407275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001407276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001407276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001407278 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001407278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001407278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001407278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:14:08.233463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32549): Terminating (SIGTERM) 00:14:08.274653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32552): Terminating (SIGTERM) 00:14:08.316069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32555): Terminating (SIGTERM) 00:14:08.358304 --- ParallelTerminationStrategy: PID 32549 died... 00:14:08.378479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32549): Terminated: ok {rc=0} 00:14:08.424642 --- ParallelTerminationStrategy: PID 32552 died... 00:14:08.443913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32552): Terminated: ok {rc=0} 00:14:08.489686 --- ParallelTerminationStrategy: PID 32555 died... 00:14:08.508734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32555): Terminated: ok {rc=0} 00:14:08.595378 bus /sierra_3: Setting Powered False 00:14:09.692931 bus /sierra_3: Setting Powered False 00:14:10.809550 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:14:12.044690 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:14:12.051973 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:14:12.075186 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 00:14:12.101601 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:14:12.154392 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:14:12.178088 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 00:14:12.204451 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:14:12.754199 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 00:14:12.803151 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:12.814581 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:14:12.874163 tst mo_mt_call.py: using LAC 17737 00:14:12.995841 tst mo_mt_call.py: using RAC 142 00:14:13.122674 tst mo_mt_call.py: using CellId 17737 00:14:13.248769 tst mo_mt_call.py: using BVCI 17738 00:14:13.365541 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:13.377517 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:13.389044 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:13.400395 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:13.412202 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:13.424243 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:14:13.541909 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:14:13.661865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:14:14.160749 run create_hlr_db(pid=32561): Launched 00:14:14.284092 bus /sierra_2: Setting Powered False 00:14:15.348133 run create_hlr_db(pid=32561): Terminated: ok {rc=0} 00:14:15.795050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32563): Launched 00:14:16.126791 run osmo-hlr_10.42.42.2(pid=32564): Launched 00:14:16.364628 run osmo-stp_10.42.42.5: Starting osmo-stp 00:14:17.001677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32566): Launched 00:14:17.337631 run osmo-stp_10.42.42.5(pid=32567): Launched 00:14:17.462393 run osmo-msc_10.42.42.6: Starting osmo-msc 00:14:18.048802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32569): Launched 00:14:18.371228 run osmo-msc_10.42.42.6(pid=32570): Launched 00:14:18.551503 run osmo-stp_10.42.42.5(pid=32567): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32567)] 00:14:18.688237 run osmo-stp_10.42.42.5(pid=32567): stdout: | (launched: 2022-12-09_00:14:17.277932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:18.825786 run osmo-stp_10.42.42.5(pid=32567): stderr: | [0;m[38;5;43m20221209001417473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001417473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001417473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001417474 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001417474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001417474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001417474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:18.962028 run osmo-stp_10.42.42.5(pid=32567): stdout: | (launched: 2022-12-09_00:14:17.277932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:19.090617 run osmo-stp_10.42.42.5(pid=32567): stderr: | [0;m[38;5;43m20221209001417473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001417473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001417473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001417474 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001417474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001417474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001417474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:19.244063 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32567): Process ended prematurely: osmo-stp_10.42.42.5(pid=32567) [trial-2351↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32567)] [trial-2351↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 00:14:19.253745 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 00:14:19.281413 run osmo-hlr_10.42.42.2(pid=32564): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32564)] 00:14:19.331442 run osmo-hlr_10.42.42.2(pid=32564): stdout: | (launched: 2022-12-09_00:14:16.062702) 00:14:19.382837 run osmo-hlr_10.42.42.2(pid=32564): stderr: | [0;m[1;31m20221209001416321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001416321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001416321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001416321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001416321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001416321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001416337 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001416362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001416363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001416363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:14:19.454813 run osmo-msc_10.42.42.6(pid=32570): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32570)] 00:14:19.504064 run osmo-msc_10.42.42.6(pid=32570): stdout: | (launched: 2022-12-09_00:14:18.312532) 00:14:19.555641 run osmo-msc_10.42.42.6(pid=32570): stderr: | [0;m[38;5;43m20221209001418635 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001418635 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9873c6ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001418635 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001418635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001418635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001418636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001418637 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001418638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001418638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001418638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:14:19.607429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32563): Terminating (SIGTERM) 00:14:19.648681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32566): Terminating (SIGTERM) 00:14:19.689902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32569): Terminating (SIGTERM) 00:14:19.731373 --- ParallelTerminationStrategy: PID 32563 died... 00:14:19.750973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32563): Terminated: ok {rc=0} 00:14:19.796563 --- ParallelTerminationStrategy: PID 32566 died... 00:14:19.816055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32566): Terminated: ok {rc=0} 00:14:19.861532 --- ParallelTerminationStrategy: PID 32569 died... 00:14:19.880682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32569): Terminated: ok {rc=0} 00:14:19.967391 bus /sierra_3: Setting Powered False 00:14:21.063913 bus /sierra_3: Setting Powered False 00:14:22.180279 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 00:14:23.324088 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:23.335938 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:14:23.394978 tst mo_mt_call_osmux.py: using LAC 17738 00:14:23.514376 tst mo_mt_call_osmux.py: using RAC 143 00:14:23.635757 tst mo_mt_call_osmux.py: using CellId 17738 00:14:23.756261 tst mo_mt_call_osmux.py: using BVCI 17739 00:14:23.867214 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:23.878593 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:23.889679 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:23.901064 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:23.912194 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:14:23.923692 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:14:24.041788 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:14:24.158865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:14:24.628258 run create_hlr_db(pid=32572): Launched 00:14:24.751522 bus /sierra_2: Setting Powered False 00:14:25.811330 run create_hlr_db(pid=32572): Terminated: ok {rc=0} 00:14:26.252494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32574): Launched 00:14:26.574935 run osmo-hlr_10.42.42.2(pid=32575): Launched 00:14:26.697750 run osmo-stp_10.42.42.5: Starting osmo-stp 00:14:27.257706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32577): Launched 00:14:27.581494 run osmo-stp_10.42.42.5(pid=32578): Launched 00:14:27.704321 run osmo-msc_10.42.42.6: Starting osmo-msc 00:14:28.287470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32580): Launched 00:14:28.611725 run osmo-msc_10.42.42.6(pid=32581): Launched 00:14:28.792244 run osmo-stp_10.42.42.5(pid=32578): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32578)] 00:14:28.928727 run osmo-stp_10.42.42.5(pid=32578): stdout: | (launched: 2022-12-09_00:14:27.522693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:29.066092 run osmo-stp_10.42.42.5(pid=32578): stderr: | [0;m[38;5;43m20221209001427717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001427717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001427717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001427718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001427718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001427718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001427718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:29.202602 run osmo-stp_10.42.42.5(pid=32578): stdout: | (launched: 2022-12-09_00:14:27.522693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:29.331753 run osmo-stp_10.42.42.5(pid=32578): stderr: | [0;m[38;5;43m20221209001427717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001427717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001427717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001427718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001427718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001427718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001427718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:29.486980 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32578): Process ended prematurely: osmo-stp_10.42.42.5(pid=32578) [trial-2351↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32578)] [trial-2351↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 00:14:29.496395 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:14:29.524171 run osmo-hlr_10.42.42.2(pid=32575): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32575)] 00:14:29.574214 run osmo-hlr_10.42.42.2(pid=32575): stdout: | (launched: 2022-12-09_00:14:26.516498) 00:14:29.625135 run osmo-hlr_10.42.42.2(pid=32575): stderr: | [0;m[1;31m20221209001426716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001426716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001426716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001426716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001426716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001426716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001426734 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001426744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001426744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001426744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:14:29.696487 run osmo-msc_10.42.42.6(pid=32581): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32581)] 00:14:29.745378 run osmo-msc_10.42.42.6(pid=32581): stdout: | (launched: 2022-12-09_00:14:28.552697) 00:14:29.796792 run osmo-msc_10.42.42.6(pid=32581): stderr: | [0;m[38;5;43m20221209001428875 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001428875 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdd6e0b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001428875 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001428875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001428875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001428876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001428877 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001428878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001428878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001428878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:14:29.848413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32574): Terminating (SIGTERM) 00:14:29.889436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32577): Terminating (SIGTERM) 00:14:29.930613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32580): Terminating (SIGTERM) 00:14:29.972383 --- ParallelTerminationStrategy: PID 32574 died... 00:14:29.992448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32574): Terminated: ok {rc=0} 00:14:30.038921 --- ParallelTerminationStrategy: PID 32577 died... 00:14:30.058557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32577): Terminated: ok {rc=0} 00:14:30.104438 --- ParallelTerminationStrategy: PID 32580 died... 00:14:30.123717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32580): Terminated: ok {rc=0} 00:14:30.209667 bus /sierra_3: Setting Powered False 00:14:31.316044 bus /sierra_3: Setting Powered False 00:14:32.443241 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 emergency:nanobts+band-1900 --------------------------------------------------------------------- 00:14:33.679309 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:14:33.684492 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 00:14:33.707743 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 00:14:33.733849 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 00:14:33.817049 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 00:14:33.840547 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 00:14:33.866714 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 00:14:34.454844 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2351 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 00:14:34.460077 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:34.471254 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:14:34.511322 tst emergency_mo_mt_call.py: using LAC 17739 00:14:34.637572 tst emergency_mo_mt_call.py: using RAC 144 00:14:34.755501 tst emergency_mo_mt_call.py: using CellId 17739 00:14:34.874619 tst emergency_mo_mt_call.py: using BVCI 17740 00:14:34.983579 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:34.994479 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:35.005074 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:35.015675 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:35.026174 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:35.036601 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:35.150557 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:35.269295 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:14:35.759576 run create_hlr_db(pid=32588): Launched 00:14:35.880582 bus /sierra_2: Setting Powered False 00:14:36.943501 run create_hlr_db(pid=32588): Terminated: ok {rc=0} 00:14:37.370398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32590): Launched 00:14:37.668323 run osmo-hlr_10.42.42.2(pid=32591): Launched 00:14:37.781717 run osmo-stp_10.42.42.5: Starting osmo-stp 00:14:38.310273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32593): Launched 00:14:38.608087 run osmo-stp_10.42.42.5(pid=32594): Launched 00:14:38.730792 tst emergency_mo_mt_call.py: using MSISDN 6921 00:14:38.882316 run osmo-msc_10.42.42.6: Starting osmo-msc 00:14:39.416640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32596): Launched 00:14:39.714417 run osmo-msc_10.42.42.6(pid=32597): Launched 00:14:39.880410 run osmo-stp_10.42.42.5(pid=32594): ERR: Terminated: ERROR {rc=1} [trial-2351↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32594)] 00:14:40.006132 run osmo-stp_10.42.42.5(pid=32594): stdout: | (launched: 2022-12-09_00:14:38.553281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:40.133513 run osmo-stp_10.42.42.5(pid=32594): stderr: | [0;m[38;5;43m20221209001438724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001438724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001438725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001438725 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001438726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001438726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001438726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:40.257677 run osmo-stp_10.42.42.5(pid=32594): stdout: | (launched: 2022-12-09_00:14:38.553281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:40.375980 run osmo-stp_10.42.42.5(pid=32594): stderr: | [0;m[38;5;43m20221209001438724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001438724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001438725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001438725 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001438726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001438726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001438726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:40.517596 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=32594): Process ended prematurely: osmo-stp_10.42.42.5(pid=32594) [trial-2351↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32594)] [trial-2351↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 00:14:40.526054 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 00:14:40.551790 run osmo-hlr_10.42.42.2(pid=32591): ERR: Terminated: ERROR {rc=237} [trial-2351↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32591)] 00:14:40.598780 run osmo-hlr_10.42.42.2(pid=32591): stdout: | (launched: 2022-12-09_00:14:37.613639) 00:14:40.647600 run osmo-hlr_10.42.42.2(pid=32591): stderr: | [0;m[1;31m20221209001437793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001437793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001437793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001437793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001437793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001437793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001437805 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001437814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001437814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001437814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:14:40.715559 run osmo-msc_10.42.42.6(pid=32597): ERR: Terminated: ERROR {rc=2} [trial-2351↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32597)] 00:14:40.762077 run osmo-msc_10.42.42.6(pid=32597): stdout: | (launched: 2022-12-09_00:14:39.659614) 00:14:40.810278 run osmo-msc_10.42.42.6(pid=32597): stderr: | [0;m[38;5;43m20221209001439932 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001439932 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9e6ae8cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001439932 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001439932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001439933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001439933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001439935 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001439935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001439935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001439935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:14:40.858788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32590): Terminating (SIGTERM) 00:14:40.897440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32593): Terminating (SIGTERM) 00:14:40.936197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32596): Terminating (SIGTERM) 00:14:40.975192 --- ParallelTerminationStrategy: PID 32590 died... 00:14:40.993938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32590): Terminated: ok {rc=0} 00:14:41.036940 --- ParallelTerminationStrategy: PID 32593 died... 00:14:41.055260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32593): Terminated: ok {rc=0} 00:14:41.098200 --- ParallelTerminationStrategy: PID 32596 died... 00:14:41.116373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32596): Terminated: ok {rc=0} 00:14:41.197976 bus /sierra_3: Setting Powered False 00:14:42.291977 bus /sierra_3: Setting Powered False 00:14:43.403648 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 00:14:44.488283 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:44.500061 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:14:44.541375 tst emergency_preemptive_call.py: using LAC 17740 00:14:44.666594 tst emergency_preemptive_call.py: using RAC 145 00:14:44.789955 tst emergency_preemptive_call.py: using CellId 17740 00:14:44.913210 tst emergency_preemptive_call.py: using BVCI 17741 00:14:45.027582 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:45.038832 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:45.049874 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:45.061135 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:45.072020 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:45.083641 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:45.197934 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:45.315128 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:45.428811 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:45.545946 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:14:46.071307 run create_hlr_db(pid=32599): Launched 00:14:46.224340 bus /sierra_2: Setting Powered False 00:14:47.282785 run create_hlr_db(pid=32599): Terminated: ok {rc=0} 00:14:47.733559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32601): Launched 00:14:48.051249 run osmo-hlr_10.42.42.2(pid=32602): Launched 00:14:48.172071 run osmo-stp_10.42.42.5: Starting osmo-stp 00:14:48.720419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32604): Launched 00:14:49.038665 run osmo-stp_10.42.42.5(pid=32605): Launched 00:14:49.168127 tst emergency_preemptive_call.py: using MSISDN 6922 00:14:49.334708 run osmo-msc_10.42.42.6: Starting osmo-msc 00:14:49.904619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32607): Launched 00:14:50.222327 run osmo-msc_10.42.42.6(pid=32608): Launched 00:14:50.399691 run osmo-stp_10.42.42.5(pid=32605): ERR: Terminated: ERROR {rc=1} [trial-2351↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32605)] 00:14:50.535055 run osmo-stp_10.42.42.5(pid=32605): stdout: | (launched: 2022-12-09_00:14:48.980761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:50.670664 run osmo-stp_10.42.42.5(pid=32605): stderr: | [0;m[38;5;43m20221209001449173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001449174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001449174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001449174 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001449175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001449175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001449175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:50.805427 run osmo-stp_10.42.42.5(pid=32605): stdout: | (launched: 2022-12-09_00:14:48.980761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:50.932346 run osmo-stp_10.42.42.5(pid=32605): stderr: | [0;m[38;5;43m20221209001449173 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001449174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001449174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001449174 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001449175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001449175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001449175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:51.084507 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=32605): Process ended prematurely: osmo-stp_10.42.42.5(pid=32605) [trial-2351↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32605)] [trial-2351↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 00:14:51.093515 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 00:14:51.121217 run osmo-hlr_10.42.42.2(pid=32602): ERR: Terminated: ERROR {rc=237} [trial-2351↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32602)] 00:14:51.171785 run osmo-hlr_10.42.42.2(pid=32602): stdout: | (launched: 2022-12-09_00:14:47.993514) 00:14:51.223433 run osmo-hlr_10.42.42.2(pid=32602): stderr: | [0;m[1;31m20221209001448193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001448193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001448193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001448193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001448193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001448193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001448204 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001448212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001448212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001448212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:14:51.295246 run osmo-msc_10.42.42.6(pid=32608): ERR: Terminated: ERROR {rc=2} [trial-2351↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32608)] 00:14:51.345467 run osmo-msc_10.42.42.6(pid=32608): stdout: | (launched: 2022-12-09_00:14:50.164307) 00:14:51.397390 run osmo-msc_10.42.42.6(pid=32608): stderr: | [0;m[38;5;43m20221209001450485 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001450485 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fac40552c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001450485 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001450485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001450486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001450486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001450488 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001450488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001450488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001450488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:14:51.449117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32601): Terminating (SIGTERM) 00:14:51.491231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32604): Terminating (SIGTERM) 00:14:51.533278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32607): Terminating (SIGTERM) 00:14:51.575367 --- ParallelTerminationStrategy: PID 32601 died... 00:14:51.595201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32601): Terminated: ok {rc=0} 00:14:51.641821 --- ParallelTerminationStrategy: PID 32604 died... 00:14:51.661343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32604): Terminated: ok {rc=0} 00:14:51.707549 --- ParallelTerminationStrategy: PID 32607 died... 00:14:51.727000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32607): Terminated: ok {rc=0} 00:14:51.815203 bus /sierra_9: Setting Powered False 00:14:52.913226 bus /sierra_9: Setting Powered False 00:14:54.029895 bus /sierra_8: Setting Powered False 00:14:55.128508 bus /sierra_8: Setting Powered False 00:14:56.241430 bus /sierra_3: Setting Powered False 00:14:57.337546 bus /sierra_3: Setting Powered False 00:14:58.453109 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:nanobts+band-1900 --------------------------------------------------------------------- 00:14:59.724304 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:14:59.730018 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 00:14:59.753917 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 00:14:59.793979 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 00:14:59.882717 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 00:14:59.907098 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 00:14:59.944470 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 00:15:00.533144 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 00:15:00.582676 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:00.593443 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:15:00.635937 tst cs_paging_gprs_active.py: using LAC 17741 00:15:00.754139 tst cs_paging_gprs_active.py: using RAC 146 00:15:00.892149 tst cs_paging_gprs_active.py: using CellId 17741 00:15:01.014291 tst cs_paging_gprs_active.py: using BVCI 17742 00:15:01.126957 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:01.138726 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:01.149771 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:01.160760 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:01.172077 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:01.182962 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:01.195054 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:01.206196 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:01.220568 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:15:01.361652 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:15:01.488745 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:15:01.698510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:02.024571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32616): Launched 00:15:02.349707 run iperf3-srv_10.42.42.10(pid=32617): Launched 00:15:02.471110 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:15:02.676386 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:02.982418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32618): Launched 00:15:03.246194 run iperf3-srv_10.42.42.10(pid=32619): Launched 00:15:03.360095 tst cs_paging_gprs_active.py:38: start network... 00:15:03.564317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:15:04.035462 run create_hlr_db(pid=32620): Launched 00:15:04.160487 bus /sierra_2: Setting Powered False 00:15:05.221723 run create_hlr_db(pid=32620): Terminated: ok {rc=0} 00:15:05.663399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32622): Launched 00:15:05.986845 run osmo-hlr_10.42.42.2(pid=32623): Launched 00:15:06.110974 run osmo-stp_10.42.42.5: Starting osmo-stp 00:15:06.672288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32625): Launched 00:15:06.994679 run osmo-stp_10.42.42.5(pid=32626): Launched 00:15:07.118144 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:15:07.681957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32628): Launched 00:15:07.805978 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:15:08.079707 run patchelf(pid=32629): Launched 00:15:08.259900 run osmo-stp_10.42.42.5(pid=32626): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32626)] 00:15:08.397692 run osmo-stp_10.42.42.5(pid=32626): stdout: | (launched: 2022-12-09_00:15:06.935980) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:08.536214 run osmo-stp_10.42.42.5(pid=32626): stderr: | [0;m[38;5;43m20221209001507128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001507128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001507129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001507129 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001507130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001507130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001507130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:08.674767 run osmo-stp_10.42.42.5(pid=32626): stdout: | (launched: 2022-12-09_00:15:06.935980) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:08.807607 run osmo-stp_10.42.42.5(pid=32626): stderr: | [0;m[38;5;43m20221209001507128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001507128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001507129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001507129 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001507130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001507130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001507130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:08.965150 run patchelf(pid=32629): Terminating (SIGINT) 00:15:09.146926 run patchelf(pid=32629): Terminated: ok {rc=0} 00:15:09.277945 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32626): Process ended prematurely: osmo-stp_10.42.42.5(pid=32626) [trial-2351↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32626)] [trial-2351↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 00:15:09.288053 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 00:15:09.316627 run osmo-hlr_10.42.42.2(pid=32623): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32623)] 00:15:09.366355 run osmo-hlr_10.42.42.2(pid=32623): stdout: | (launched: 2022-12-09_00:15:05.927706) 00:15:09.417558 run osmo-hlr_10.42.42.2(pid=32623): stderr: | [0;m[1;31m20221209001506124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001506124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001506124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001506124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001506124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001506124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001506136 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001506144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001506145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001506145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:15:09.469768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32616): Terminating (SIGTERM) 00:15:09.511383 run iperf3-srv_10.42.42.10(pid=32617): Terminating (SIGTERM) 00:15:09.552901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32618): Terminating (SIGTERM) 00:15:09.595016 run iperf3-srv_10.42.42.10(pid=32619): Terminating (SIGTERM) 00:15:09.636493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32622): Terminating (SIGTERM) 00:15:09.678355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32625): Terminating (SIGTERM) 00:15:09.719913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32628): Terminating (SIGTERM) 00:15:09.761729 --- ParallelTerminationStrategy: PID 32616 died... 00:15:09.781506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32616): Terminated: ok {rc=0} 00:15:09.827935 --- ParallelTerminationStrategy: PID 32617 died... 00:15:09.847174 run iperf3-srv_10.42.42.10(pid=32617): Terminated {rc=256} 00:15:09.892740 --- ParallelTerminationStrategy: PID 32618 died... 00:15:09.911977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32618): Terminated: ok {rc=0} 00:15:09.957708 --- ParallelTerminationStrategy: PID 32619 died... 00:15:09.976863 run iperf3-srv_10.42.42.10(pid=32619): Terminated {rc=256} 00:15:10.022627 --- ParallelTerminationStrategy: PID 32622 died... 00:15:10.041931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32622): Terminated: ok {rc=0} 00:15:10.087311 --- ParallelTerminationStrategy: PID 32625 died... 00:15:10.107076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32625): Terminated: ok {rc=0} 00:15:10.152124 --- ParallelTerminationStrategy: PID 32628 died... 00:15:10.171867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32628): Terminated: ok {rc=0} 00:15:10.258494 bus /gobi_0: Setting Powered False 00:15:11.353884 bus /gobi_0: Setting Powered False 00:15:12.463530 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 00:15:13.604358 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:13.615470 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:15:13.653540 tst iperf3.py: using LAC 17742 00:15:13.772043 tst iperf3.py: using RAC 147 00:15:13.892330 tst iperf3.py: using CellId 17742 00:15:14.012802 tst iperf3.py: using BVCI 17743 00:15:14.124532 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:14.135192 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:14.145771 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:14.156342 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:14.166870 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:14.177509 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:14.188023 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:14.198559 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:14.209074 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:15:14.327882 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:15:14.546774 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:14.870826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32630): Launched 00:15:15.151799 run iperf3-srv_10.42.42.10(pid=32631): Launched 00:15:15.273329 tst iperf3.py:8: start network... 00:15:15.491903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:15:16.012411 run create_hlr_db(pid=32632): Launched 00:15:16.165363 bus /gobi_6: Setting Powered False 00:15:17.238430 run create_hlr_db(pid=32632): Terminated: ok {rc=0} 00:15:17.690583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32634): Launched 00:15:18.013753 run osmo-hlr_10.42.42.2(pid=32635): Launched 00:15:18.137616 run osmo-stp_10.42.42.5: Starting osmo-stp 00:15:18.692809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32637): Launched 00:15:19.014513 run osmo-stp_10.42.42.5(pid=32638): Launched 00:15:19.137869 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:15:19.696435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32640): Launched 00:15:19.820832 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:15:20.094242 run patchelf(pid=32641): Launched 00:15:20.274918 run osmo-stp_10.42.42.5(pid=32638): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32638)] 00:15:20.412738 run osmo-stp_10.42.42.5(pid=32638): stdout: | (launched: 2022-12-09_00:15:18.955984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:20.551718 run osmo-stp_10.42.42.5(pid=32638): stderr: | [0;m[38;5;43m20221209001519147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001519147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001519147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001519148 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001519150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001519150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001519150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:20.690959 run osmo-stp_10.42.42.5(pid=32638): stdout: | (launched: 2022-12-09_00:15:18.955984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:20.824022 run osmo-stp_10.42.42.5(pid=32638): stderr: | [0;m[38;5;43m20221209001519147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001519147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001519147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001519148 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001519150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001519150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001519150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:20.981708 run patchelf(pid=32641): Terminating (SIGINT) 00:15:21.162976 run patchelf(pid=32641): Terminated: ok {rc=0} 00:15:21.293775 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32638): Process ended prematurely: osmo-stp_10.42.42.5(pid=32638) [trial-2351↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32638)] [trial-2351↪gprs:nanobts+band-1900↪iperf3.py:8] 00:15:21.303997 tst iperf3.py:8: Test FAILED (7.7 sec) 00:15:21.332706 run osmo-hlr_10.42.42.2(pid=32635): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32635)] 00:15:21.382472 run osmo-hlr_10.42.42.2(pid=32635): stdout: | (launched: 2022-12-09_00:15:17.954992) 00:15:21.434343 run osmo-hlr_10.42.42.2(pid=32635): stderr: | [0;m[1;31m20221209001518152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001518152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001518152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001518152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001518152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001518152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001518164 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001518172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001518172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001518172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:15:21.486092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32630): Terminating (SIGTERM) 00:15:21.527648 run iperf3-srv_10.42.42.10(pid=32631): Terminating (SIGTERM) 00:15:21.568856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32634): Terminating (SIGTERM) 00:15:21.610568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32637): Terminating (SIGTERM) 00:15:21.652375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32640): Terminating (SIGTERM) 00:15:21.694123 --- ParallelTerminationStrategy: PID 32630 died... 00:15:21.713953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32630): Terminated: ok {rc=0} 00:15:21.760064 --- ParallelTerminationStrategy: PID 32631 died... 00:15:21.779717 run iperf3-srv_10.42.42.10(pid=32631): Terminated {rc=256} 00:15:21.825183 --- ParallelTerminationStrategy: PID 32634 died... 00:15:21.844637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32634): Terminated: ok {rc=0} 00:15:21.890595 --- ParallelTerminationStrategy: PID 32637 died... 00:15:21.910102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32637): Terminated: ok {rc=0} 00:15:21.955968 --- ParallelTerminationStrategy: PID 32640 died... 00:15:21.975467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32640): Terminated: ok {rc=0} 00:15:22.061599 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 00:15:23.210712 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:23.222014 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:15:23.258554 tst iperf3m4.py: using LAC 17743 00:15:23.376719 tst iperf3m4.py: using RAC 148 00:15:23.495489 tst iperf3m4.py: using CellId 17743 00:15:23.622432 tst iperf3m4.py: using BVCI 17744 00:15:23.741833 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:23.753010 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:23.764088 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:23.774976 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:23.786638 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:23.797957 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:23.809200 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:23.820147 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:23.831486 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:15:23.947885 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:15:24.070052 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:15:24.191211 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:15:24.308211 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:15:24.513698 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:24.820232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32642): Launched 00:15:25.085443 run iperf3-srv_10.42.42.10(pid=32643): Launched 00:15:25.199483 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:15:25.402213 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:25.706276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32644): Launched 00:15:25.971148 run iperf3-srv_10.42.42.10(pid=32645): Launched 00:15:26.086457 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:15:26.289783 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:26.596189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32646): Launched 00:15:26.861112 run iperf3-srv_10.42.42.10(pid=32647): Launched 00:15:26.975226 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:15:27.178687 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:27.484823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32648): Launched 00:15:27.750228 run iperf3-srv_10.42.42.10(pid=32649): Launched 00:15:27.863988 tst iperf3m4.py:8: start network... 00:15:28.067726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:15:28.539822 run create_hlr_db(pid=32650): Launched 00:15:28.665739 bus /gobi_6: Setting Powered False 00:15:29.725913 run create_hlr_db(pid=32650): Terminated: ok {rc=0} 00:15:30.167817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32652): Launched 00:15:30.494537 run osmo-hlr_10.42.42.2(pid=32653): Launched 00:15:30.618969 run osmo-stp_10.42.42.5: Starting osmo-stp 00:15:31.194218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32655): Launched 00:15:31.528199 run osmo-stp_10.42.42.5(pid=32656): Launched 00:15:31.868451 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:15:32.578226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32658): Launched 00:15:32.694642 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:15:32.951434 run patchelf(pid=32659): Launched 00:15:33.122031 run osmo-stp_10.42.42.5(pid=32656): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32656)] 00:15:33.251098 run osmo-stp_10.42.42.5(pid=32656): stdout: | (launched: 2022-12-09_00:15:31.465701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:33.381937 run osmo-stp_10.42.42.5(pid=32656): stderr: | [0;m[38;5;43m20221209001531816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001531818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001531819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001531819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001531820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001531820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001531820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:33.512836 run osmo-stp_10.42.42.5(pid=32656): stdout: | (launched: 2022-12-09_00:15:31.465701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:33.637731 run osmo-stp_10.42.42.5(pid=32656): stderr: | [0;m[38;5;43m20221209001531816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001531818 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001531819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001531819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001531820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001531820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001531820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:33.785549 run patchelf(pid=32659): Terminating (SIGINT) 00:15:33.955926 run patchelf(pid=32659): Terminated: ok {rc=0} 00:15:34.078643 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32656): Process ended prematurely: osmo-stp_10.42.42.5(pid=32656) [trial-2351↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32656)] [trial-2351↪gprs:nanobts+band-1900↪iperf3m4.py:8] 00:15:34.088026 tst iperf3m4.py:8: Test FAILED (10.9 sec) 00:15:34.115062 run osmo-hlr_10.42.42.2(pid=32653): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32653)] 00:15:34.161860 run osmo-hlr_10.42.42.2(pid=32653): stdout: | (launched: 2022-12-09_00:15:30.435019) 00:15:34.210630 run osmo-hlr_10.42.42.2(pid=32653): stderr: | [0;m[1;31m20221209001530635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001530635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001530635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001530635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001530635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001530635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001530648 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001530656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001530656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001530656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:15:34.259492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32642): Terminating (SIGTERM) 00:15:34.298376 run iperf3-srv_10.42.42.10(pid=32643): Terminating (SIGTERM) 00:15:34.336882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32644): Terminating (SIGTERM) 00:15:34.375801 run iperf3-srv_10.42.42.10(pid=32645): Terminating (SIGTERM) 00:15:34.414504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32646): Terminating (SIGTERM) 00:15:34.453584 run iperf3-srv_10.42.42.10(pid=32647): Terminating (SIGTERM) 00:15:34.492802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32648): Terminating (SIGTERM) 00:15:34.531764 run iperf3-srv_10.42.42.10(pid=32649): Terminating (SIGTERM) 00:15:34.570471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32652): Terminating (SIGTERM) 00:15:34.609276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32655): Terminating (SIGTERM) 00:15:34.647928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32658): Terminating (SIGTERM) 00:15:34.686900 --- ParallelTerminationStrategy: PID 32642 died... 00:15:34.705800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32642): Terminated: ok {rc=0} 00:15:34.749215 --- ParallelTerminationStrategy: PID 32643 died... 00:15:34.767481 run iperf3-srv_10.42.42.10(pid=32643): Terminated {rc=256} 00:15:34.810601 --- ParallelTerminationStrategy: PID 32644 died... 00:15:34.829068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32644): Terminated: ok {rc=0} 00:15:34.872388 --- ParallelTerminationStrategy: PID 32645 died... 00:15:34.890691 run iperf3-srv_10.42.42.10(pid=32645): Terminated {rc=256} 00:15:34.933716 --- ParallelTerminationStrategy: PID 32646 died... 00:15:34.952043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32646): Terminated: ok {rc=0} 00:15:34.995133 --- ParallelTerminationStrategy: PID 32647 died... 00:15:35.013510 run iperf3-srv_10.42.42.10(pid=32647): Terminated {rc=256} 00:15:35.056480 --- ParallelTerminationStrategy: PID 32648 died... 00:15:35.074975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32648): Terminated: ok {rc=0} 00:15:35.118207 --- ParallelTerminationStrategy: PID 32649 died... 00:15:35.136656 run iperf3-srv_10.42.42.10(pid=32649): Terminated {rc=256} 00:15:35.179804 --- ParallelTerminationStrategy: PID 32652 died... 00:15:35.198219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32652): Terminated: ok {rc=0} 00:15:35.241835 --- ParallelTerminationStrategy: PID 32655 died... 00:15:35.260412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32655): Terminated: ok {rc=0} 00:15:35.303635 --- ParallelTerminationStrategy: PID 32658 died... 00:15:35.322132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32658): Terminated: ok {rc=0} 00:15:35.406894 bus /gobi_4: Setting Powered False 00:15:36.506316 bus /gobi_4: Setting Powered False 00:15:37.622064 bus /gobi_1: Setting Powered False 00:15:38.720098 bus /gobi_1: Setting Powered False 00:15:39.833977 bus /gobi_0: Setting Powered False 00:15:40.934775 bus /gobi_0: Setting Powered False 00:15:42.050670 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 00:15:43.155865 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:43.167689 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:15:43.209225 tst ping.py: using LAC 17744 00:15:43.335552 tst ping.py: using RAC 149 00:15:43.463589 tst ping.py: using CellId 17744 00:15:43.586333 tst ping.py: using BVCI 17745 00:15:43.701799 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:43.712908 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:43.724075 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:43.735229 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:43.746546 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:43.757650 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:43.769064 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:43.779945 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:15:43.893358 tst ping.py:19: start network... 00:15:44.093886 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:15:44.555196 run create_hlr_db(pid=32660): Launched 00:15:44.678717 bus /gobi_6: Setting Powered False 00:15:45.738792 run create_hlr_db(pid=32660): Terminated: ok {rc=0} 00:15:46.210002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32662): Launched 00:15:46.602545 run osmo-hlr_10.42.42.2(pid=32663): Launched 00:15:46.758908 run osmo-stp_10.42.42.5: Starting osmo-stp 00:15:47.441234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32665): Launched 00:15:47.767757 run osmo-stp_10.42.42.5(pid=32666): Launched 00:15:47.889057 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:15:48.437207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32668): Launched 00:15:48.559522 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:15:48.829169 run patchelf(pid=32669): Launched 00:15:49.006513 run osmo-stp_10.42.42.5(pid=32666): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32666)] 00:15:49.141942 run osmo-stp_10.42.42.5(pid=32666): stdout: | (launched: 2022-12-09_00:15:47.709936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:49.279105 run osmo-stp_10.42.42.5(pid=32666): stderr: | [0;m[38;5;43m20221209001547903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001547903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001547903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001547904 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001547904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001547904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001547904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:49.417228 run osmo-stp_10.42.42.5(pid=32666): stdout: | (launched: 2022-12-09_00:15:47.709936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:49.548364 run osmo-stp_10.42.42.5(pid=32666): stderr: | [0;m[38;5;43m20221209001547903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001547903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001547903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001547904 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001547904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001547904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001547904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:49.703149 run patchelf(pid=32669): Terminating (SIGINT) 00:15:49.881958 run patchelf(pid=32669): Terminated: ok {rc=0} 00:15:50.010956 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32666): Process ended prematurely: osmo-stp_10.42.42.5(pid=32666) [trial-2351↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32666)] [trial-2351↪gprs:nanobts+band-1900↪ping.py:22] 00:15:50.020518 tst ping.py:22: Test FAILED (6.9 sec) 00:15:50.048219 run osmo-hlr_10.42.42.2(pid=32663): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32663)] 00:15:50.099190 run osmo-hlr_10.42.42.2(pid=32663): stdout: | (launched: 2022-12-09_00:15:46.540228) 00:15:50.151103 run osmo-hlr_10.42.42.2(pid=32663): stderr: | [0;m[1;31m20221209001546899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001546899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001546899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001546899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001546900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001546900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001546918 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001546934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001546934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001546934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:15:50.202447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32662): Terminating (SIGTERM) 00:15:50.244531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32665): Terminating (SIGTERM) 00:15:50.287705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32668): Terminating (SIGTERM) 00:15:50.330258 --- ParallelTerminationStrategy: PID 32662 died... 00:15:50.350046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32662): Terminated: ok {rc=0} 00:15:50.396195 --- ParallelTerminationStrategy: PID 32665 died... 00:15:50.416648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32665): Terminated: ok {rc=0} 00:15:50.463567 --- ParallelTerminationStrategy: PID 32668 died... 00:15:50.483015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32668): Terminated: ok {rc=0} 00:15:50.570960 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 00:15:51.657582 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:51.669810 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:15:51.710567 tst ping_idle_ping.py: using LAC 17745 00:15:51.836196 tst ping_idle_ping.py: using RAC 150 00:15:51.960383 tst ping_idle_ping.py: using CellId 17745 00:15:52.084873 tst ping_idle_ping.py: using BVCI 17746 00:15:52.199959 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:52.211000 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:52.222007 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:52.233308 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:52.244351 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:52.255175 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:52.266443 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:52.278098 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:15:52.392603 tst ping_idle_ping.py:24: start network... 00:15:52.609636 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:15:53.106187 run create_hlr_db(pid=32671): Launched 00:15:53.227124 bus /gobi_6: Setting Powered False 00:15:54.290329 run create_hlr_db(pid=32671): Terminated: ok {rc=0} 00:15:54.735916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32673): Launched 00:15:55.055953 run osmo-hlr_10.42.42.2(pid=32674): Launched 00:15:55.177877 run osmo-stp_10.42.42.5: Starting osmo-stp 00:15:55.727388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32676): Launched 00:15:56.047666 run osmo-stp_10.42.42.5(pid=32677): Launched 00:15:56.170189 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:15:56.727782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32679): Launched 00:15:56.850582 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:15:57.120483 run patchelf(pid=32680): Launched 00:15:57.298726 run osmo-stp_10.42.42.5(pid=32677): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32677)] 00:15:57.435120 run osmo-stp_10.42.42.5(pid=32677): stdout: | (launched: 2022-12-09_00:15:55.989281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:57.572818 run osmo-stp_10.42.42.5(pid=32677): stderr: | [0;m[38;5;43m20221209001556179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001556179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001556179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001556179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001556182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001556182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001556182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:57.710355 run osmo-stp_10.42.42.5(pid=32677): stdout: | (launched: 2022-12-09_00:15:55.989281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:57.841483 run osmo-stp_10.42.42.5(pid=32677): stderr: | [0;m[38;5;43m20221209001556179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001556179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001556179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001556179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001556182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001556182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001556182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:57.997437 run patchelf(pid=32680): Terminating (SIGINT) 00:15:58.176622 run patchelf(pid=32680): Terminated: ok {rc=0} 00:15:58.305830 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32677): Process ended prematurely: osmo-stp_10.42.42.5(pid=32677) [trial-2351↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32677)] [trial-2351↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 00:15:58.315524 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 00:15:58.343617 run osmo-hlr_10.42.42.2(pid=32674): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32674)] 00:15:58.393757 run osmo-hlr_10.42.42.2(pid=32674): stdout: | (launched: 2022-12-09_00:15:54.997527) 00:15:58.445851 run osmo-hlr_10.42.42.2(pid=32674): stderr: | [0;m[1;31m20221209001555196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001555196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001555196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001555196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001555196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001555196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001555208 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001555216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001555216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001555216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:15:58.497666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32673): Terminating (SIGTERM) 00:15:58.539291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32676): Terminating (SIGTERM) 00:15:58.580852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32679): Terminating (SIGTERM) 00:15:58.623245 --- ParallelTerminationStrategy: PID 32673 died... 00:15:58.642971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32673): Terminated: ok {rc=0} 00:15:58.689169 --- ParallelTerminationStrategy: PID 32676 died... 00:15:58.708465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32676): Terminated: ok {rc=0} 00:15:58.754327 --- ParallelTerminationStrategy: PID 32679 died... 00:15:58.773677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32679): Terminated: ok {rc=0} 00:15:58.859430 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 00:16:00.151840 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:16:00.158392 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 00:16:00.182704 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 00:16:00.221506 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 00:16:00.306545 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 00:16:00.330015 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 00:16:00.368433 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 00:16:00.978358 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 00:16:01.030582 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:01.042061 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:16:01.083148 tst cs_paging_gprs_active.py: using LAC 17746 00:16:01.213784 tst cs_paging_gprs_active.py: using RAC 151 00:16:01.346173 tst cs_paging_gprs_active.py: using CellId 17746 00:16:01.491208 tst cs_paging_gprs_active.py: using BVCI 17747 00:16:01.646545 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:01.662819 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:01.679262 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:01.692098 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:01.708448 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:01.725116 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:01.740747 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:01.755749 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:01.771618 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:16:01.908021 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:16:02.028192 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:16:02.239840 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:02.547553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32684): Launched 00:16:02.814845 run iperf3-srv_10.42.42.10(pid=32685): Launched 00:16:02.929543 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:16:03.134855 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:03.440831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32686): Launched 00:16:03.705853 run iperf3-srv_10.42.42.10(pid=32687): Launched 00:16:03.820177 tst cs_paging_gprs_active.py:38: start network... 00:16:04.024718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:16:04.497501 run create_hlr_db(pid=32688): Launched 00:16:04.621629 bus /gobi_6: Setting Powered False 00:16:05.682038 run create_hlr_db(pid=32688): Terminated: ok {rc=0} 00:16:06.124010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32690): Launched 00:16:06.448490 run osmo-hlr_10.42.42.2(pid=32691): Launched 00:16:06.573642 run osmo-stp_10.42.42.5: Starting osmo-stp 00:16:07.130745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32693): Launched 00:16:07.465717 run osmo-stp_10.42.42.5(pid=32694): Launched 00:16:07.583907 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:16:08.110647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32696): Launched 00:16:08.227223 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:16:08.485266 run patchelf(pid=32697): Launched 00:16:08.654670 run osmo-stp_10.42.42.5(pid=32694): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32694)] 00:16:08.784163 run osmo-stp_10.42.42.5(pid=32694): stdout: | (launched: 2022-12-09_00:16:07.396460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:08.914269 run osmo-stp_10.42.42.5(pid=32694): stderr: | [0;m[38;5;43m20221209001607582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001607582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001607582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001607583 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001607583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001607583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001607583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:09.044546 run osmo-stp_10.42.42.5(pid=32694): stdout: | (launched: 2022-12-09_00:16:07.396460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:09.169235 run osmo-stp_10.42.42.5(pid=32694): stderr: | [0;m[38;5;43m20221209001607582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001607582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001607582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001607583 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001607583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001607583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001607583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:09.316602 run patchelf(pid=32697): Terminating (SIGINT) 00:16:09.487071 run patchelf(pid=32697): Terminated: ok {rc=0} 00:16:09.609967 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32694): Process ended prematurely: osmo-stp_10.42.42.5(pid=32694) [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32694)] [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 00:16:09.619414 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 00:16:09.646292 run osmo-hlr_10.42.42.2(pid=32691): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32691)] 00:16:09.692749 run osmo-hlr_10.42.42.2(pid=32691): stdout: | (launched: 2022-12-09_00:16:06.389271) 00:16:09.740934 run osmo-hlr_10.42.42.2(pid=32691): stderr: | [0;m[1;31m20221209001606591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001606591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001606591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001606591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001606591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001606591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001606603 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001606611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001606612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001606612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:16:09.789623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32684): Terminating (SIGTERM) 00:16:09.828343 run iperf3-srv_10.42.42.10(pid=32685): Terminating (SIGTERM) 00:16:09.866842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32686): Terminating (SIGTERM) 00:16:09.905516 run iperf3-srv_10.42.42.10(pid=32687): Terminating (SIGTERM) 00:16:09.943948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32690): Terminating (SIGTERM) 00:16:09.982572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32693): Terminating (SIGTERM) 00:16:10.021298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32696): Terminating (SIGTERM) 00:16:10.060147 --- ParallelTerminationStrategy: PID 32684 died... 00:16:10.078868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32684): Terminated: ok {rc=0} 00:16:10.122193 --- ParallelTerminationStrategy: PID 32685 died... 00:16:10.140460 run iperf3-srv_10.42.42.10(pid=32685): Terminated {rc=256} 00:16:10.183258 --- ParallelTerminationStrategy: PID 32686 died... 00:16:10.201558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32686): Terminated: ok {rc=0} 00:16:10.244333 --- ParallelTerminationStrategy: PID 32687 died... 00:16:10.262548 run iperf3-srv_10.42.42.10(pid=32687): Terminated {rc=256} 00:16:10.305339 --- ParallelTerminationStrategy: PID 32690 died... 00:16:10.323382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32690): Terminated: ok {rc=0} 00:16:10.366486 --- ParallelTerminationStrategy: PID 32693 died... 00:16:10.384688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32693): Terminated: ok {rc=0} 00:16:10.428234 --- ParallelTerminationStrategy: PID 32696 died... 00:16:10.446599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32696): Terminated: ok {rc=0} 00:16:10.530972 bus /gobi_0: Setting Powered False 00:16:11.627645 bus /gobi_0: Setting Powered False 00:16:12.741037 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 00:16:13.884835 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:13.896264 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:16:13.938389 tst iperf3.py: using LAC 17747 00:16:14.059563 tst iperf3.py: using RAC 152 00:16:14.180840 tst iperf3.py: using CellId 17747 00:16:14.301187 tst iperf3.py: using BVCI 17748 00:16:14.411128 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:14.422078 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:14.432760 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:14.443514 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:14.454114 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:14.464594 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:14.475313 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:14.485906 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:14.496582 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:16:14.610873 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:16:14.816148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:15.120647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32698): Launched 00:16:15.385987 run iperf3-srv_10.42.42.10(pid=32699): Launched 00:16:15.500053 tst iperf3.py:8: start network... 00:16:15.703291 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:16:16.196704 run create_hlr_db(pid=32700): Launched 00:16:16.351758 bus /gobi_6: Setting Powered False 00:16:17.412835 run create_hlr_db(pid=32700): Terminated: ok {rc=0} 00:16:17.856188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32702): Launched 00:16:18.181037 run osmo-hlr_10.42.42.2(pid=32703): Launched 00:16:18.305204 run osmo-stp_10.42.42.5: Starting osmo-stp 00:16:18.869723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32705): Launched 00:16:19.195202 run osmo-stp_10.42.42.5(pid=32706): Launched 00:16:19.319031 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:16:19.878671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32708): Launched 00:16:20.003700 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:16:20.277477 run patchelf(pid=32709): Launched 00:16:20.458293 run osmo-stp_10.42.42.5(pid=32706): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32706)] 00:16:20.595329 run osmo-stp_10.42.42.5(pid=32706): stdout: | (launched: 2022-12-09_00:16:19.135490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:20.734154 run osmo-stp_10.42.42.5(pid=32706): stderr: | [0;m[38;5;43m20221209001619329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001619329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001619329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001619330 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001619330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001619330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001619330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:20.873829 run osmo-stp_10.42.42.5(pid=32706): stdout: | (launched: 2022-12-09_00:16:19.135490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:21.006826 run osmo-stp_10.42.42.5(pid=32706): stderr: | [0;m[38;5;43m20221209001619329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001619329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001619329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001619330 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001619330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001619330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001619330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:21.164002 run patchelf(pid=32709): Terminating (SIGINT) 00:16:21.345644 run patchelf(pid=32709): Terminated: ok {rc=0} 00:16:21.476647 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32706): Process ended prematurely: osmo-stp_10.42.42.5(pid=32706) [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32706)] [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 00:16:21.487047 tst iperf3.py:8: Test FAILED (7.6 sec) 00:16:21.516011 run osmo-hlr_10.42.42.2(pid=32703): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32703)] 00:16:21.565769 run osmo-hlr_10.42.42.2(pid=32703): stdout: | (launched: 2022-12-09_00:16:18.122079) 00:16:21.617327 run osmo-hlr_10.42.42.2(pid=32703): stderr: | [0;m[1;31m20221209001618321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001618321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001618321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001618321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001618321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001618321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001618336 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001618346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001618346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001618346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:16:21.669420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32698): Terminating (SIGTERM) 00:16:21.710961 run iperf3-srv_10.42.42.10(pid=32699): Terminating (SIGTERM) 00:16:21.752549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32702): Terminating (SIGTERM) 00:16:21.794211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32705): Terminating (SIGTERM) 00:16:21.835709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32708): Terminating (SIGTERM) 00:16:21.877724 --- ParallelTerminationStrategy: PID 32698 died... 00:16:21.897710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32698): Terminated: ok {rc=0} 00:16:21.943831 --- ParallelTerminationStrategy: PID 32699 died... 00:16:21.962943 run iperf3-srv_10.42.42.10(pid=32699): Terminated {rc=256} 00:16:22.008665 --- ParallelTerminationStrategy: PID 32702 died... 00:16:22.027910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32702): Terminated: ok {rc=0} 00:16:22.073550 --- ParallelTerminationStrategy: PID 32705 died... 00:16:22.092794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32705): Terminated: ok {rc=0} 00:16:22.138600 --- ParallelTerminationStrategy: PID 32708 died... 00:16:22.157786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32708): Terminated: ok {rc=0} 00:16:22.243920 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 00:16:23.392691 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:23.404581 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:16:23.446568 tst iperf3m4.py: using LAC 17748 00:16:23.574915 tst iperf3m4.py: using RAC 153 00:16:23.701353 tst iperf3m4.py: using CellId 17748 00:16:23.828292 tst iperf3m4.py: using BVCI 17749 00:16:23.941633 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:23.952693 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:23.963534 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:23.974894 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:23.986283 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:23.997781 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:24.009947 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:24.020606 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:24.032091 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:16:24.151861 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:16:24.274372 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:16:24.390500 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:16:24.509794 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:16:24.727028 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:25.033055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32710): Launched 00:16:25.299423 run iperf3-srv_10.42.42.10(pid=32711): Launched 00:16:25.414736 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:16:25.619095 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:25.924643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32712): Launched 00:16:26.190020 run iperf3-srv_10.42.42.10(pid=32713): Launched 00:16:26.303878 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:16:26.507973 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:26.813384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32714): Launched 00:16:27.079361 run iperf3-srv_10.42.42.10(pid=32715): Launched 00:16:27.193657 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:16:27.397346 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:27.703183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32716): Launched 00:16:27.967827 run iperf3-srv_10.42.42.10(pid=32717): Launched 00:16:28.081894 tst iperf3m4.py:8: start network... 00:16:28.286049 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:16:28.757854 run create_hlr_db(pid=32718): Launched 00:16:28.881764 bus /gobi_6: Setting Powered False 00:16:29.942149 run create_hlr_db(pid=32718): Terminated: ok {rc=0} 00:16:30.384369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32720): Launched 00:16:30.710291 run osmo-hlr_10.42.42.2(pid=32721): Launched 00:16:30.864483 run osmo-stp_10.42.42.5: Starting osmo-stp 00:16:31.549710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32723): Launched 00:16:31.892110 run osmo-stp_10.42.42.5(pid=32724): Launched 00:16:32.088865 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:16:32.739625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32726): Launched 00:16:32.856591 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:16:33.114664 run patchelf(pid=32727): Launched 00:16:33.284038 run osmo-stp_10.42.42.5(pid=32724): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32724)] 00:16:33.412632 run osmo-stp_10.42.42.5(pid=32724): stdout: | (launched: 2022-12-09_00:16:31.828743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:33.543465 run osmo-stp_10.42.42.5(pid=32724): stderr: | [0;m[38;5;43m20221209001632140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001632141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001632141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001632141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001632142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001632142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001632142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:33.673817 run osmo-stp_10.42.42.5(pid=32724): stdout: | (launched: 2022-12-09_00:16:31.828743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:33.798518 run osmo-stp_10.42.42.5(pid=32724): stderr: | [0;m[38;5;43m20221209001632140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001632141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001632141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001632141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001632142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001632142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001632142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:33.945805 run patchelf(pid=32727): Terminating (SIGINT) 00:16:34.116053 run patchelf(pid=32727): Terminated: ok {rc=0} 00:16:34.239232 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32724): Process ended prematurely: osmo-stp_10.42.42.5(pid=32724) [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32724)] [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 00:16:34.248633 tst iperf3m4.py:8: Test FAILED (10.9 sec) 00:16:34.275605 run osmo-hlr_10.42.42.2(pid=32721): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32721)] 00:16:34.322770 run osmo-hlr_10.42.42.2(pid=32721): stdout: | (launched: 2022-12-09_00:16:30.651126) 00:16:34.370952 run osmo-hlr_10.42.42.2(pid=32721): stderr: | [0;m[1;31m20221209001630866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001630866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001630866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001630866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001630866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001630866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001630883 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001630902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001630902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001630902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:16:34.419597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32710): Terminating (SIGTERM) 00:16:34.458234 run iperf3-srv_10.42.42.10(pid=32711): Terminating (SIGTERM) 00:16:34.496640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32712): Terminating (SIGTERM) 00:16:34.535126 run iperf3-srv_10.42.42.10(pid=32713): Terminating (SIGTERM) 00:16:34.573640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32714): Terminating (SIGTERM) 00:16:34.612306 run iperf3-srv_10.42.42.10(pid=32715): Terminating (SIGTERM) 00:16:34.650700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32716): Terminating (SIGTERM) 00:16:34.689260 run iperf3-srv_10.42.42.10(pid=32717): Terminating (SIGTERM) 00:16:34.727583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32720): Terminating (SIGTERM) 00:16:34.766044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32723): Terminating (SIGTERM) 00:16:34.804503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32726): Terminating (SIGTERM) 00:16:34.843549 --- ParallelTerminationStrategy: PID 32710 died... 00:16:34.862299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32710): Terminated: ok {rc=0} 00:16:34.905047 --- ParallelTerminationStrategy: PID 32711 died... 00:16:34.923209 run iperf3-srv_10.42.42.10(pid=32711): Terminated {rc=256} 00:16:34.966107 --- ParallelTerminationStrategy: PID 32712 died... 00:16:34.984323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32712): Terminated: ok {rc=0} 00:16:35.027068 --- ParallelTerminationStrategy: PID 32713 died... 00:16:35.045298 run iperf3-srv_10.42.42.10(pid=32713): Terminated {rc=256} 00:16:35.087789 --- ParallelTerminationStrategy: PID 32714 died... 00:16:35.105986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32714): Terminated: ok {rc=0} 00:16:35.148832 --- ParallelTerminationStrategy: PID 32715 died... 00:16:35.167336 run iperf3-srv_10.42.42.10(pid=32715): Terminated {rc=256} 00:16:35.210007 --- ParallelTerminationStrategy: PID 32716 died... 00:16:35.228274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32716): Terminated: ok {rc=0} 00:16:35.271025 --- ParallelTerminationStrategy: PID 32717 died... 00:16:35.289168 run iperf3-srv_10.42.42.10(pid=32717): Terminated {rc=256} 00:16:35.331833 --- ParallelTerminationStrategy: PID 32720 died... 00:16:35.350046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32720): Terminated: ok {rc=0} 00:16:35.392678 --- ParallelTerminationStrategy: PID 32723 died... 00:16:35.410891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32723): Terminated: ok {rc=0} 00:16:35.453567 --- ParallelTerminationStrategy: PID 32726 died... 00:16:35.471753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32726): Terminated: ok {rc=0} 00:16:35.555643 bus /gobi_4: Setting Powered False 00:16:36.654761 bus /gobi_4: Setting Powered False 00:16:37.768269 bus /gobi_1: Setting Powered False 00:16:38.865422 bus /gobi_1: Setting Powered False 00:16:39.980331 bus /gobi_0: Setting Powered False 00:16:41.075678 bus /gobi_0: Setting Powered False 00:16:42.191361 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 00:16:43.292764 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:43.304131 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:16:43.346749 tst ping.py: using LAC 17749 00:16:43.463693 tst ping.py: using RAC 154 00:16:43.579035 tst ping.py: using CellId 17749 00:16:43.703005 tst ping.py: using BVCI 17750 00:16:43.817926 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:43.829419 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:43.840743 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:43.852677 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:43.863735 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:43.875406 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:43.887080 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:43.898209 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:16:44.014161 tst ping.py:19: start network... 00:16:44.213056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:16:44.673481 run create_hlr_db(pid=32728): Launched 00:16:44.794859 bus /gobi_6: Setting Powered False 00:16:45.855786 run create_hlr_db(pid=32728): Terminated: ok {rc=0} 00:16:46.290775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32730): Launched 00:16:46.611272 run osmo-hlr_10.42.42.2(pid=32731): Launched 00:16:46.913987 run osmo-stp_10.42.42.5: Starting osmo-stp 00:16:47.581660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32733): Launched 00:16:47.898743 run osmo-stp_10.42.42.5(pid=32734): Launched 00:16:48.020128 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:16:48.569760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32736): Launched 00:16:48.691606 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:16:48.960675 run patchelf(pid=32737): Launched 00:16:49.137883 run osmo-stp_10.42.42.5(pid=32734): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32734)] 00:16:49.272601 run osmo-stp_10.42.42.5(pid=32734): stdout: | (launched: 2022-12-09_00:16:47.840918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:49.408931 run osmo-stp_10.42.42.5(pid=32734): stderr: | [0;m[38;5;43m20221209001648033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001648033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001648034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001648034 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001648035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001648035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001648035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:49.546222 run osmo-stp_10.42.42.5(pid=32734): stdout: | (launched: 2022-12-09_00:16:47.840918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:49.676585 run osmo-stp_10.42.42.5(pid=32734): stderr: | [0;m[38;5;43m20221209001648033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001648033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001648034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001648034 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001648035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001648035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001648035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:49.830996 run patchelf(pid=32737): Terminating (SIGINT) 00:16:50.008711 run patchelf(pid=32737): Terminated: ok {rc=0} 00:16:50.137104 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32734): Process ended prematurely: osmo-stp_10.42.42.5(pid=32734) [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32734)] [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 00:16:50.146719 tst ping.py:22: Test FAILED (6.8 sec) 00:16:50.174579 run osmo-hlr_10.42.42.2(pid=32731): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32731)] 00:16:50.224568 run osmo-hlr_10.42.42.2(pid=32731): stdout: | (launched: 2022-12-09_00:16:46.549461) 00:16:50.275922 run osmo-hlr_10.42.42.2(pid=32731): stderr: | [0;m[1;31m20221209001646846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001646846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001646846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001646846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001646846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001646846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001646871 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001646894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001646894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001646894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:16:50.327930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32730): Terminating (SIGTERM) 00:16:50.369394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32733): Terminating (SIGTERM) 00:16:50.411590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32736): Terminating (SIGTERM) 00:16:50.454048 --- ParallelTerminationStrategy: PID 32730 died... 00:16:50.473974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32730): Terminated: ok {rc=0} 00:16:50.520883 --- ParallelTerminationStrategy: PID 32733 died... 00:16:50.540369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32733): Terminated: ok {rc=0} 00:16:50.586547 --- ParallelTerminationStrategy: PID 32736 died... 00:16:50.606064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32736): Terminated: ok {rc=0} 00:16:50.693108 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 00:16:51.779146 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:51.790595 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:16:51.832074 tst ping_idle_ping.py: using LAC 17750 00:16:51.950696 tst ping_idle_ping.py: using RAC 155 00:16:52.069457 tst ping_idle_ping.py: using CellId 17750 00:16:52.186770 tst ping_idle_ping.py: using BVCI 17751 00:16:52.297148 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:52.308012 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:52.318691 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:52.329383 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:52.339918 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:52.350555 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:52.361475 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:52.372413 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:16:52.489073 tst ping_idle_ping.py:24: start network... 00:16:52.703820 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:16:53.203932 run create_hlr_db(pid=32738): Launched 00:16:53.326678 bus /gobi_6: Setting Powered False 00:16:54.390235 run create_hlr_db(pid=32738): Terminated: ok {rc=0} 00:16:54.821766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32740): Launched 00:16:55.121342 run osmo-hlr_10.42.42.2(pid=32741): Launched 00:16:55.236477 run osmo-stp_10.42.42.5: Starting osmo-stp 00:16:55.757602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32743): Launched 00:16:56.057202 run osmo-stp_10.42.42.5(pid=32744): Launched 00:16:56.171280 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:16:56.689566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32746): Launched 00:16:56.804288 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:16:57.056822 run patchelf(pid=32747): Launched 00:16:57.224143 run osmo-stp_10.42.42.5(pid=32744): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32744)] 00:16:57.351410 run osmo-stp_10.42.42.5(pid=32744): stdout: | (launched: 2022-12-09_00:16:56.002056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:57.479879 run osmo-stp_10.42.42.5(pid=32744): stderr: | [0;m[38;5;43m20221209001656171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001656171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001656172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001656172 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001656172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001656173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001656173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:57.608753 run osmo-stp_10.42.42.5(pid=32744): stdout: | (launched: 2022-12-09_00:16:56.002056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:57.731522 run osmo-stp_10.42.42.5(pid=32744): stderr: | [0;m[38;5;43m20221209001656171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001656171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001656172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001656172 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001656172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001656173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001656173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:57.876609 run patchelf(pid=32747): Terminating (SIGINT) 00:16:58.043587 run patchelf(pid=32747): Terminated: ok {rc=0} 00:16:58.164357 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32744): Process ended prematurely: osmo-stp_10.42.42.5(pid=32744) [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32744)] [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 00:16:58.173249 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 00:16:58.199786 run osmo-hlr_10.42.42.2(pid=32741): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32741)] 00:16:58.246695 run osmo-hlr_10.42.42.2(pid=32741): stdout: | (launched: 2022-12-09_00:16:55.066213) 00:16:58.295106 run osmo-hlr_10.42.42.2(pid=32741): stderr: | [0;m[1;31m20221209001655242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001655242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001655242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001655242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001655243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001655243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001655255 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001655265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001655265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001655266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:16:58.343935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32740): Terminating (SIGTERM) 00:16:58.382707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32743): Terminating (SIGTERM) 00:16:58.421483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32746): Terminating (SIGTERM) 00:16:58.460418 --- ParallelTerminationStrategy: PID 32740 died... 00:16:58.478724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32740): Terminated: ok {rc=0} 00:16:58.521896 --- ParallelTerminationStrategy: PID 32743 died... 00:16:58.539962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32743): Terminated: ok {rc=0} 00:16:58.583104 --- ParallelTerminationStrategy: PID 32746 died... 00:16:58.601334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32746): Terminated: ok {rc=0} 00:16:58.683465 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 00:16:59.976740 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:16:59.984576 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 00:17:00.009205 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 00:17:00.050173 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 00:17:00.139205 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 00:17:00.162294 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 00:17:00.199903 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 00:17:00.799517 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 00:17:00.854979 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:00.866647 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:17:00.941308 tst cs_paging_gprs_active.py: using LAC 17751 00:17:01.078292 tst cs_paging_gprs_active.py: using RAC 156 00:17:01.218430 tst cs_paging_gprs_active.py: using CellId 17751 00:17:01.360900 tst cs_paging_gprs_active.py: using BVCI 17752 00:17:01.476354 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:01.487976 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:01.499682 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:01.511395 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:01.524008 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:01.537218 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:01.548864 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:01.560510 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:01.574139 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:17:01.714214 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:17:01.852145 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:17:02.085785 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:17:02.402298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32755): Launched 00:17:02.667293 run iperf3-srv_10.42.42.10(pid=32756): Launched 00:17:02.780733 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:17:02.984640 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:17:03.289511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32757): Launched 00:17:03.553093 run iperf3-srv_10.42.42.10(pid=32758): Launched 00:17:03.667161 tst cs_paging_gprs_active.py:38: start network... 00:17:03.871021 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:17:04.342987 run create_hlr_db(pid=32759): Launched 00:17:04.467121 bus /gobi_6: Setting Powered False 00:17:05.527059 run create_hlr_db(pid=32759): Terminated: ok {rc=0} 00:17:05.969386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32761): Launched 00:17:06.293535 run osmo-hlr_10.42.42.2(pid=32762): Launched 00:17:06.417730 run osmo-stp_10.42.42.5: Starting osmo-stp 00:17:06.978454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32764): Launched 00:17:07.302475 run osmo-stp_10.42.42.5(pid=32765): Launched 00:17:07.426556 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:17:07.987133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32767): Launched 00:17:08.111743 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:17:08.385227 run patchelf(pid=300): Launched 00:17:08.566670 run osmo-stp_10.42.42.5(pid=32765): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32765)] 00:17:08.703900 run osmo-stp_10.42.42.5(pid=32765): stdout: | (launched: 2022-12-09_00:17:07.243636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:08.842825 run osmo-stp_10.42.42.5(pid=32765): stderr: | [0;m[38;5;43m20221209001707436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001707436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001707437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001707437 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001707438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001707438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001707438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:08.981679 run osmo-stp_10.42.42.5(pid=32765): stdout: | (launched: 2022-12-09_00:17:07.243636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:09.114974 run osmo-stp_10.42.42.5(pid=32765): stderr: | [0;m[38;5;43m20221209001707436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001707436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001707437 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001707437 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001707438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001707438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001707438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:09.272198 run patchelf(pid=300): Terminating (SIGINT) 00:17:09.453303 run patchelf(pid=300): Terminated: ok {rc=0} 00:17:09.584805 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32765): Process ended prematurely: osmo-stp_10.42.42.5(pid=32765) [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32765)] [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 00:17:09.594990 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 00:17:09.624010 run osmo-hlr_10.42.42.2(pid=32762): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32762)] 00:17:09.673829 run osmo-hlr_10.42.42.2(pid=32762): stdout: | (launched: 2022-12-09_00:17:06.234818) 00:17:09.725359 run osmo-hlr_10.42.42.2(pid=32762): stderr: | [0;m[1;31m20221209001706434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001706434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001706434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001706434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001706434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001706434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001706446 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001706457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001706457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001706457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:17:09.777645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32755): Terminating (SIGTERM) 00:17:09.819620 run iperf3-srv_10.42.42.10(pid=32756): Terminating (SIGTERM) 00:17:09.861441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32757): Terminating (SIGTERM) 00:17:09.903311 run iperf3-srv_10.42.42.10(pid=32758): Terminating (SIGTERM) 00:17:09.945078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32761): Terminating (SIGTERM) 00:17:09.987102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32764): Terminating (SIGTERM) 00:17:10.029420 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32767): Terminating (SIGTERM) 00:17:10.071475 --- ParallelTerminationStrategy: PID 32755 died... 00:17:10.091486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32755): Terminated: ok {rc=0} 00:17:10.138250 --- ParallelTerminationStrategy: PID 32756 died... 00:17:10.157751 run iperf3-srv_10.42.42.10(pid=32756): Terminated {rc=256} 00:17:10.204067 --- ParallelTerminationStrategy: PID 32757 died... 00:17:10.223533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32757): Terminated: ok {rc=0} 00:17:10.269815 --- ParallelTerminationStrategy: PID 32758 died... 00:17:10.289266 run iperf3-srv_10.42.42.10(pid=32758): Terminated {rc=256} 00:17:10.335436 --- ParallelTerminationStrategy: PID 32761 died... 00:17:10.354937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32761): Terminated: ok {rc=0} 00:17:10.401275 --- ParallelTerminationStrategy: PID 32764 died... 00:17:10.420591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32764): Terminated: ok {rc=0} 00:17:10.467512 --- ParallelTerminationStrategy: PID 32767 died... 00:17:10.486978 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32767): Terminated: ok {rc=0} 00:17:10.573375 bus /gobi_0: Setting Powered False 00:17:11.672485 bus /gobi_0: Setting Powered False 00:17:12.787985 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 00:17:13.932773 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:13.944196 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:17:14.008834 tst iperf3.py: using LAC 17752 00:17:14.127550 tst iperf3.py: using RAC 157 00:17:14.245277 tst iperf3.py: using CellId 17752 00:17:14.363197 tst iperf3.py: using BVCI 17753 00:17:14.473482 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:14.484379 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:14.495111 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:14.505801 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:14.516451 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:14.527249 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:14.538071 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:14.548637 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:14.560072 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:17:14.679244 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:17:14.898121 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:17:15.222471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=301): Launched 00:17:15.505286 run iperf3-srv_10.42.42.10(pid=302): Launched 00:17:15.627107 tst iperf3.py:8: start network... 00:17:15.850701 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:17:16.371152 run create_hlr_db(pid=303): Launched 00:17:16.533547 bus /gobi_6: Setting Powered False 00:17:17.596299 run create_hlr_db(pid=303): Terminated: ok {rc=0} 00:17:18.028641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=305): Launched 00:17:18.333499 run osmo-hlr_10.42.42.2(pid=306): Launched 00:17:18.449617 run osmo-stp_10.42.42.5: Starting osmo-stp 00:17:18.978308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=308): Launched 00:17:19.282887 run osmo-stp_10.42.42.5(pid=309): Launched 00:17:19.398927 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:17:19.922383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=311): Launched 00:17:20.038468 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:17:20.295014 run patchelf(pid=312): Launched 00:17:20.463970 run osmo-stp_10.42.42.5(pid=309): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=309)] 00:17:20.592434 run osmo-stp_10.42.42.5(pid=309): stdout: | (launched: 2022-12-09_00:17:19.226641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:20.722788 run osmo-stp_10.42.42.5(pid=309): stderr: | [0;m[38;5;43m20221209001719399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001719399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001719399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001719400 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001719400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001719400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001719400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:20.853373 run osmo-stp_10.42.42.5(pid=309): stdout: | (launched: 2022-12-09_00:17:19.226641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:20.977626 run osmo-stp_10.42.42.5(pid=309): stderr: | [0;m[38;5;43m20221209001719399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001719399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001719399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001719400 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001719400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001719400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001719400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:21.125045 run patchelf(pid=312): Terminating (SIGINT) 00:17:21.296043 run patchelf(pid=312): Terminated: ok {rc=0} 00:17:21.419753 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=309): Process ended prematurely: osmo-stp_10.42.42.5(pid=309) [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=309)] [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 00:17:21.429312 tst iperf3.py:8: Test FAILED (7.5 sec) 00:17:21.456090 run osmo-hlr_10.42.42.2(pid=306): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=306)] 00:17:21.502774 run osmo-hlr_10.42.42.2(pid=306): stdout: | (launched: 2022-12-09_00:17:18.278171) 00:17:21.551128 run osmo-hlr_10.42.42.2(pid=306): stderr: | [0;m[1;31m20221209001718456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001718456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001718456 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001718457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001718457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001718457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001718469 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001718477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001718478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001718478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:17:21.600017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=301): Terminating (SIGTERM) 00:17:21.639213 run iperf3-srv_10.42.42.10(pid=302): Terminating (SIGTERM) 00:17:21.678248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=305): Terminating (SIGTERM) 00:17:21.717239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=308): Terminating (SIGTERM) 00:17:21.756110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=311): Terminating (SIGTERM) 00:17:21.795282 --- ParallelTerminationStrategy: PID 301 died... 00:17:21.814181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=301): Terminated: ok {rc=0} 00:17:21.857932 --- ParallelTerminationStrategy: PID 302 died... 00:17:21.876279 run iperf3-srv_10.42.42.10(pid=302): Terminated {rc=256} 00:17:21.920213 --- ParallelTerminationStrategy: PID 305 died... 00:17:21.939056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=305): Terminated: ok {rc=0} 00:17:21.982208 --- ParallelTerminationStrategy: PID 308 died... 00:17:22.000401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=308): Terminated: ok {rc=0} 00:17:22.043627 --- ParallelTerminationStrategy: PID 311 died... 00:17:22.062022 run pcap-recorder_any(filters='host 10.42.42.6')(pid=311): Terminated: ok {rc=0} 00:17:22.144473 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 00:17:23.293175 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:23.305133 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:17:23.366192 tst iperf3m4.py: using LAC 17753 00:17:23.485613 tst iperf3m4.py: using RAC 158 00:17:23.604594 tst iperf3m4.py: using CellId 17753 00:17:23.723378 tst iperf3m4.py: using BVCI 17754 00:17:23.835243 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:23.846211 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:23.856821 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:23.868052 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:23.878581 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:23.889742 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:23.901574 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:23.912019 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:23.923569 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:17:24.039178 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:17:24.159985 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:17:24.278725 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:17:24.399848 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:17:24.620196 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:17:24.945262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=313): Launched 00:17:25.228108 run iperf3-srv_10.42.42.10(pid=314): Launched 00:17:25.350648 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:17:25.570318 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:17:25.895212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=315): Launched 00:17:26.177971 run iperf3-srv_10.42.42.10(pid=316): Launched 00:17:26.299319 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:17:26.518345 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:17:26.843247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=317): Launched 00:17:27.126155 run iperf3-srv_10.42.42.10(pid=318): Launched 00:17:27.247392 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:17:27.466435 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:17:27.792400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=319): Launched 00:17:28.074379 run iperf3-srv_10.42.42.10(pid=320): Launched 00:17:28.195614 tst iperf3m4.py:8: start network... 00:17:28.413487 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:17:28.914179 run create_hlr_db(pid=321): Launched 00:17:29.037089 bus /gobi_6: Setting Powered False 00:17:30.101072 run create_hlr_db(pid=321): Terminated: ok {rc=0} 00:17:30.533773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=323): Launched 00:17:30.841094 run osmo-hlr_10.42.42.2(pid=324): Launched 00:17:31.056825 run osmo-stp_10.42.42.5: Starting osmo-stp 00:17:31.749500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=326): Launched 00:17:32.096404 run osmo-stp_10.42.42.5(pid=327): Launched 00:17:32.248991 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:17:32.827146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=329): Launched 00:17:32.951417 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:17:33.224510 run patchelf(pid=330): Launched 00:17:33.403871 run osmo-stp_10.42.42.5(pid=327): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=327)] 00:17:33.541629 run osmo-stp_10.42.42.5(pid=327): stdout: | (launched: 2022-12-09_00:17:32.033089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:33.680358 run osmo-stp_10.42.42.5(pid=327): stderr: | [0;m[38;5;43m20221209001732346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001732346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001732347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001732347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001732348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001732348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001732348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:33.819098 run osmo-stp_10.42.42.5(pid=327): stdout: | (launched: 2022-12-09_00:17:32.033089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:33.951550 run osmo-stp_10.42.42.5(pid=327): stderr: | [0;m[38;5;43m20221209001732346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001732346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001732347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001732347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001732348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001732348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001732348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:34.109005 run patchelf(pid=330): Terminating (SIGINT) 00:17:34.290210 run patchelf(pid=330): Terminated: ok {rc=0} 00:17:34.420908 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=327): Process ended prematurely: osmo-stp_10.42.42.5(pid=327) [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=327)] [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 00:17:34.431301 tst iperf3m4.py:8: Test FAILED (11.2 sec) 00:17:34.459766 run osmo-hlr_10.42.42.2(pid=324): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=324)] 00:17:34.510294 run osmo-hlr_10.42.42.2(pid=324): stdout: | (launched: 2022-12-09_00:17:30.782080) 00:17:34.561748 run osmo-hlr_10.42.42.2(pid=324): stderr: | [0;m[1;31m20221209001731136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001731136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001731137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001731137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001731137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001731137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001731167 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001731183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001731183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001731183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:17:34.613429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=313): Terminating (SIGTERM) 00:17:34.654525 run iperf3-srv_10.42.42.10(pid=314): Terminating (SIGTERM) 00:17:34.696376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=315): Terminating (SIGTERM) 00:17:34.737928 run iperf3-srv_10.42.42.10(pid=316): Terminating (SIGTERM) 00:17:34.779148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=317): Terminating (SIGTERM) 00:17:34.820528 run iperf3-srv_10.42.42.10(pid=318): Terminating (SIGTERM) 00:17:34.861822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=319): Terminating (SIGTERM) 00:17:34.903287 run iperf3-srv_10.42.42.10(pid=320): Terminating (SIGTERM) 00:17:34.944396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=323): Terminating (SIGTERM) 00:17:34.985808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=326): Terminating (SIGTERM) 00:17:35.026832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=329): Terminating (SIGTERM) 00:17:35.068753 --- ParallelTerminationStrategy: PID 313 died... 00:17:35.088166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=313): Terminated: ok {rc=0} 00:17:35.133989 --- ParallelTerminationStrategy: PID 314 died... 00:17:35.153307 run iperf3-srv_10.42.42.10(pid=314): Terminated {rc=256} 00:17:35.199237 --- ParallelTerminationStrategy: PID 315 died... 00:17:35.219002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=315): Terminated: ok {rc=0} 00:17:35.264848 --- ParallelTerminationStrategy: PID 316 died... 00:17:35.284420 run iperf3-srv_10.42.42.10(pid=316): Terminated {rc=256} 00:17:35.330072 --- ParallelTerminationStrategy: PID 317 died... 00:17:35.349261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=317): Terminated: ok {rc=0} 00:17:35.394957 --- ParallelTerminationStrategy: PID 318 died... 00:17:35.414130 run iperf3-srv_10.42.42.10(pid=318): Terminated {rc=256} 00:17:35.459628 --- ParallelTerminationStrategy: PID 319 died... 00:17:35.479182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=319): Terminated: ok {rc=0} 00:17:35.524712 --- ParallelTerminationStrategy: PID 320 died... 00:17:35.544194 run iperf3-srv_10.42.42.10(pid=320): Terminated {rc=256} 00:17:35.589747 --- ParallelTerminationStrategy: PID 323 died... 00:17:35.608815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=323): Terminated: ok {rc=0} 00:17:35.654313 --- ParallelTerminationStrategy: PID 326 died... 00:17:35.673543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=326): Terminated: ok {rc=0} 00:17:35.719489 --- ParallelTerminationStrategy: PID 329 died... 00:17:35.738837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=329): Terminated: ok {rc=0} 00:17:35.827480 bus /gobi_4: Setting Powered False 00:17:36.925365 bus /gobi_4: Setting Powered False 00:17:38.040112 bus /gobi_1: Setting Powered False 00:17:39.136776 bus /gobi_1: Setting Powered False 00:17:40.250575 bus /gobi_0: Setting Powered False 00:17:41.347364 bus /gobi_0: Setting Powered False 00:17:42.463055 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 00:17:43.564013 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:43.575948 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:17:43.639585 tst ping.py: using LAC 17754 00:17:43.764450 tst ping.py: using RAC 159 00:17:43.887936 tst ping.py: using CellId 17754 00:17:44.011776 tst ping.py: using BVCI 17755 00:17:44.126705 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:44.138163 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:44.149579 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:44.160683 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:44.172258 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:44.183398 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:44.195017 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:44.206441 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:17:44.322077 tst ping.py:19: start network... 00:17:44.523920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:17:44.985869 run create_hlr_db(pid=335): Launched 00:17:45.108437 bus /gobi_6: Setting Powered False 00:17:46.194725 run create_hlr_db(pid=335): Terminated: ok {rc=0} 00:17:46.656239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=337): Launched 00:17:46.996138 run osmo-hlr_10.42.42.2(pid=338): Launched 00:17:47.282709 run osmo-stp_10.42.42.5: Starting osmo-stp 00:17:47.833738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=340): Launched 00:17:48.150859 run osmo-stp_10.42.42.5(pid=341): Launched 00:17:48.272487 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:17:48.820802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=343): Launched 00:17:48.942555 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:17:49.210183 run patchelf(pid=344): Launched 00:17:49.386220 run osmo-stp_10.42.42.5(pid=341): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=341)] 00:17:49.520927 run osmo-stp_10.42.42.5(pid=341): stdout: | (launched: 2022-12-09_00:17:48.093214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:49.657980 run osmo-stp_10.42.42.5(pid=341): stderr: | [0;m[38;5;43m20221209001748285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001748285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001748286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001748286 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001748286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001748287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001748287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:49.794336 run osmo-stp_10.42.42.5(pid=341): stdout: | (launched: 2022-12-09_00:17:48.093214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:49.924367 run osmo-stp_10.42.42.5(pid=341): stderr: | [0;m[38;5;43m20221209001748285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001748285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001748286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001748286 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001748286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001748287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001748287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:50.078698 run patchelf(pid=344): Terminating (SIGINT) 00:17:50.256385 run patchelf(pid=344): Terminated: ok {rc=0} 00:17:50.384825 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=341): Process ended prematurely: osmo-stp_10.42.42.5(pid=341) [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=341)] [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 00:17:50.394428 tst ping.py:22: Test FAILED (6.8 sec) 00:17:50.422279 run osmo-hlr_10.42.42.2(pid=338): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=338)] 00:17:50.471762 run osmo-hlr_10.42.42.2(pid=338): stdout: | (launched: 2022-12-09_00:17:46.933085) 00:17:50.522953 run osmo-hlr_10.42.42.2(pid=338): stderr: | [0;m[1;31m20221209001747122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001747122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001747122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001747123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001747123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001747123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001747135 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001747143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001747144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001747144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:17:50.574856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=337): Terminating (SIGTERM) 00:17:50.616315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=340): Terminating (SIGTERM) 00:17:50.657848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=343): Terminating (SIGTERM) 00:17:50.699267 --- ParallelTerminationStrategy: PID 337 died... 00:17:50.719509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=337): Terminated: ok {rc=0} 00:17:50.765661 --- ParallelTerminationStrategy: PID 340 died... 00:17:50.784914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=340): Terminated: ok {rc=0} 00:17:50.830650 --- ParallelTerminationStrategy: PID 343 died... 00:17:50.849766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=343): Terminated: ok {rc=0} 00:17:50.935900 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 00:17:52.022266 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:52.033816 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:17:52.094611 tst ping_idle_ping.py: using LAC 17755 00:17:52.224926 tst ping_idle_ping.py: using RAC 160 00:17:52.349688 tst ping_idle_ping.py: using CellId 17755 00:17:52.466633 tst ping_idle_ping.py: using BVCI 17756 00:17:52.576278 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:52.587518 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:52.598476 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:52.609676 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:52.620477 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:52.631317 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:52.642071 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:52.652779 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:17:52.767243 tst ping_idle_ping.py:24: start network... 00:17:52.983063 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:17:53.480813 run create_hlr_db(pid=345): Launched 00:17:53.605464 bus /gobi_6: Setting Powered False 00:17:54.666003 run create_hlr_db(pid=345): Terminated: ok {rc=0} 00:17:55.084618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=349): Launched 00:17:55.386242 run osmo-hlr_10.42.42.2(pid=355): Launched 00:17:55.500417 run osmo-stp_10.42.42.5: Starting osmo-stp 00:17:56.014598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=358): Launched 00:17:56.314048 run osmo-stp_10.42.42.5(pid=359): Launched 00:17:56.427390 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:17:56.944182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=361): Launched 00:17:57.059610 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:17:57.312205 run patchelf(pid=362): Launched 00:17:57.478393 run osmo-stp_10.42.42.5(pid=359): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=359)] 00:17:57.605447 run osmo-stp_10.42.42.5(pid=359): stdout: | (launched: 2022-12-09_00:17:56.258937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:57.734825 run osmo-stp_10.42.42.5(pid=359): stderr: | [0;m[38;5;43m20221209001756430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001756430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001756431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001756431 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001756432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001756432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001756432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:57.863370 run osmo-stp_10.42.42.5(pid=359): stdout: | (launched: 2022-12-09_00:17:56.258937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:57.985518 run osmo-stp_10.42.42.5(pid=359): stderr: | [0;m[38;5;43m20221209001756430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001756430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001756431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001756431 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001756432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001756432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001756432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:58.130874 run patchelf(pid=362): Terminating (SIGINT) 00:17:58.298492 run patchelf(pid=362): Terminated: ok {rc=0} 00:17:58.419272 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=359): Process ended prematurely: osmo-stp_10.42.42.5(pid=359) [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=359)] [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 00:17:58.428073 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 00:17:58.454418 run osmo-hlr_10.42.42.2(pid=355): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=355)] 00:17:58.501207 run osmo-hlr_10.42.42.2(pid=355): stdout: | (launched: 2022-12-09_00:17:55.330888) 00:17:58.549523 run osmo-hlr_10.42.42.2(pid=355): stderr: | [0;m[1;31m20221209001755508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001755509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001755509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001755509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001755509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001755509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001755521 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001755530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001755530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001755530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:17:58.598353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=349): Terminating (SIGTERM) 00:17:58.637224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=358): Terminating (SIGTERM) 00:17:58.676182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=361): Terminating (SIGTERM) 00:17:58.715306 --- ParallelTerminationStrategy: PID 349 died... 00:17:58.733986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=349): Terminated: ok {rc=0} 00:17:58.777068 --- ParallelTerminationStrategy: PID 358 died... 00:17:58.795350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=358): Terminated: ok {rc=0} 00:17:58.838324 --- ParallelTerminationStrategy: PID 361 died... 00:17:58.856525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=361): Terminated: ok {rc=0} 00:17:58.940077 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 00:18:00.237653 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:18:00.245406 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:18:00.269474 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 00:18:00.303113 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:18:00.352805 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:18:00.376118 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 00:18:00.409737 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:18:00.989942 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2351 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 00:18:00.997913 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:18:01.010849 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:18:01.074475 tst switch_tch_pdch.py: using LAC 17756 00:18:01.200340 tst switch_tch_pdch.py: using RAC 161 00:18:01.326482 tst switch_tch_pdch.py: using CellId 17756 00:18:01.453480 tst switch_tch_pdch.py: using BVCI 17757 00:18:01.607353 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:18:01.619429 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:18:01.631275 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:18:01.643768 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:18:01.656357 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:18:01.668464 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:18:01.681279 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:18:01.693133 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:18:01.811779 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:18:01.933382 tst switch_tch_pdch.py:51: start network... 00:18:02.193901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:18:02.661232 run create_hlr_db(pid=371): Launched 00:18:02.782636 bus /gobi_6: Setting Powered False 00:18:03.842603 run create_hlr_db(pid=371): Terminated: ok {rc=0} 00:18:04.259171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=373): Launched 00:18:04.558173 run osmo-hlr_10.42.42.2(pid=374): Launched 00:18:04.671407 run osmo-stp_10.42.42.5: Starting osmo-stp 00:18:05.184148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=376): Launched 00:18:05.481657 run osmo-stp_10.42.42.5(pid=377): Launched 00:18:05.594735 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:18:06.110816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=379): Launched 00:18:06.224899 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:18:06.476447 run patchelf(pid=380): Launched 00:18:06.642421 run osmo-stp_10.42.42.5(pid=377): ERR: Terminated: ERROR {rc=1} [trial-2351↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=377)] 00:18:06.768676 run osmo-stp_10.42.42.5(pid=377): stdout: | (launched: 2022-12-09_00:18:05.427014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:06.896546 run osmo-stp_10.42.42.5(pid=377): stderr: | [0;m[38;5;43m20221209001805600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001805600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001805600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001805601 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001805601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001805601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001805601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:07.024766 run osmo-stp_10.42.42.5(pid=377): stdout: | (launched: 2022-12-09_00:18:05.427014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:07.147349 run osmo-stp_10.42.42.5(pid=377): stderr: | [0;m[38;5;43m20221209001805600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001805600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001805600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001805601 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001805601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001805601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001805601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:07.292566 run patchelf(pid=380): Terminating (SIGINT) 00:18:07.459498 run patchelf(pid=380): Terminated: ok {rc=0} 00:18:07.580089 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=377): Process ended prematurely: osmo-stp_10.42.42.5(pid=377) [trial-2351↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=377)] [trial-2351↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 00:18:07.589594 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 00:18:07.615947 run osmo-hlr_10.42.42.2(pid=374): ERR: Terminated: ERROR {rc=237} [trial-2351↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=374)] 00:18:07.662766 run osmo-hlr_10.42.42.2(pid=374): stdout: | (launched: 2022-12-09_00:18:04.503143) 00:18:07.712233 run osmo-hlr_10.42.42.2(pid=374): stderr: | [0;m[1;31m20221209001804682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001804682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001804683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001804683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001804683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001804683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001804695 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001804703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001804703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001804703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:18:07.761535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=373): Terminating (SIGTERM) 00:18:07.800908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=376): Terminating (SIGTERM) 00:18:07.840184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=379): Terminating (SIGTERM) 00:18:07.879588 --- ParallelTerminationStrategy: PID 373 died... 00:18:07.898509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=373): Terminated: ok {rc=0} 00:18:07.941819 --- ParallelTerminationStrategy: PID 376 died... 00:18:07.960354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=376): Terminated: ok {rc=0} 00:18:08.003615 --- ParallelTerminationStrategy: PID 379 died... 00:18:08.022234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=379): Terminated: ok {rc=0} 00:18:08.106942 bus /gobi_0: Setting Powered False 00:18:09.205016 bus /gobi_0: Setting Powered False 00:18:10.319135 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 sms:nanobts+band-900 --------------------------------------------------------------------- 00:18:11.562153 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:18:11.566914 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 00:18:11.598575 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 00:18:11.624907 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 00:18:11.678083 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 00:18:11.712701 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 00:18:11.740171 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 00:18:12.284789 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 00:18:12.290549 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:18:12.303116 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 00:18:12.349294 tst mo_mt_sms.py: using LAC 17757 00:18:12.469227 tst mo_mt_sms.py: using RAC 162 00:18:12.585765 tst mo_mt_sms.py: using CellId 17757 00:18:12.710162 tst mo_mt_sms.py: using BVCI 17758 00:18:12.825570 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:18:12.836668 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:18:12.847824 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:18:12.858850 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:18:12.870387 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:18:12.882102 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 00:18:12.999080 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 00:18:13.118687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:18:13.610259 run create_hlr_db(pid=384): Launched 00:18:13.731121 bus /gobi_6: Setting Powered False 00:18:14.794334 run create_hlr_db(pid=384): Terminated: ok {rc=0} 00:18:15.221217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=386): Launched 00:18:15.519029 run osmo-hlr_10.42.42.2(pid=387): Launched 00:18:15.634804 run osmo-stp_10.42.42.5: Starting osmo-stp 00:18:16.184319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=389): Launched 00:18:16.505733 run osmo-stp_10.42.42.5(pid=390): Launched 00:18:16.737450 run osmo-msc_10.42.42.6: Starting osmo-msc 00:18:17.412732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=392): Launched 00:18:17.731996 run osmo-msc_10.42.42.6(pid=393): Launched 00:18:17.909770 run osmo-stp_10.42.42.5(pid=390): ERR: Terminated: ERROR {rc=1} [trial-2351↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=390)] 00:18:18.044590 run osmo-stp_10.42.42.5(pid=390): stdout: | (launched: 2022-12-09_00:18:16.435394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:18.179980 run osmo-stp_10.42.42.5(pid=390): stderr: | [0;m[38;5;43m20221209001816757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001816757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001816758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001816758 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001816759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001816759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001816759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:18.314703 run osmo-stp_10.42.42.5(pid=390): stdout: | (launched: 2022-12-09_00:18:16.435394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:18.441891 run osmo-stp_10.42.42.5(pid=390): stderr: | [0;m[38;5;43m20221209001816757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001816757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001816758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001816758 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001816759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001816759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001816759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:18.594205 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=390): Process ended prematurely: osmo-stp_10.42.42.5(pid=390) [trial-2351↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=390)] [trial-2351↪sms:nanobts+band-900↪mo_mt_sms.py:16] 00:18:18.603109 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 00:18:18.630812 run osmo-hlr_10.42.42.2(pid=387): ERR: Terminated: ERROR {rc=237} [trial-2351↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=387)] 00:18:18.680536 run osmo-hlr_10.42.42.2(pid=387): stdout: | (launched: 2022-12-09_00:18:15.464207) 00:18:18.731859 run osmo-hlr_10.42.42.2(pid=387): stderr: | [0;m[1;31m20221209001815643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001815643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001815643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001815643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001815643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001815643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001815655 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001815666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001815666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001815666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:18:18.803506 run osmo-msc_10.42.42.6(pid=393): ERR: Terminated: ERROR {rc=2} [trial-2351↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=393)] 00:18:18.853176 run osmo-msc_10.42.42.6(pid=393): stdout: | (launched: 2022-12-09_00:18:17.674140) 00:18:18.904422 run osmo-msc_10.42.42.6(pid=393): stderr: | [0;m[38;5;43m20221209001817995 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001817995 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa03c05fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001817995 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001817995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001817995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001817996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001817997 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001817998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001817998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001817998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:18:18.956072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=386): Terminating (SIGTERM) 00:18:18.997735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=389): Terminating (SIGTERM) 00:18:19.039276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=392): Terminating (SIGTERM) 00:18:19.081195 --- ParallelTerminationStrategy: PID 386 died... 00:18:19.100912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=386): Terminated: ok {rc=0} 00:18:19.147213 --- ParallelTerminationStrategy: PID 389 died... 00:18:19.166571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=389): Terminated: ok {rc=0} 00:18:19.212629 --- ParallelTerminationStrategy: PID 392 died... 00:18:19.231925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=392): Terminated: ok {rc=0} 00:18:19.318829 bus /sierra_3: Setting Powered False 00:18:20.417382 bus /sierra_3: Setting Powered False 00:18:21.531967 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 00:18:22.768517 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:18:22.773817 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 00:18:22.807303 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 00:18:22.814235 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 00:18:22.849748 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 00:18:22.882149 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 00:18:22.888915 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 00:18:23.409588 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2351 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 00:18:23.415506 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 00:18:23.426510 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 00:18:23.476623 tst assert_extension.py: using LAC 17758 00:18:23.594199 tst assert_extension.py: using RAC 163 00:18:23.710546 tst assert_extension.py: using CellId 17758 00:18:23.827395 tst assert_extension.py: using BVCI 17759 00:18:23.935500 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 00:18:24.052833 tst assert_extension.py:10: start nitb and bts... 00:18:24.267879 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:18:24.916185 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=399): Launched 00:18:25.234183 run osmo-nitb_10.42.42.2(pid=400): Launched 00:18:25.410026 run osmo-nitb_10.42.42.2(pid=400): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=400)] 00:18:25.553602 run osmo-nitb_10.42.42.2(pid=400): stdout: | (launched: 2022-12-09_00:18:25.176465) 00:18:25.698534 run osmo-nitb_10.42.42.2(pid=400): stderr: | (launched: 2022-12-09_00:18:25.223820) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:18:25.843364 run osmo-nitb_10.42.42.2(pid=400): stdout: | (launched: 2022-12-09_00:18:25.176465) 00:18:25.982567 run osmo-nitb_10.42.42.2(pid=400): stderr: | (launched: 2022-12-09_00:18:25.223820) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6f22fc268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=400): Process ended prematurely: osmo-nitb_10.42.42.2(pid=400) [trial-2351↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=400)] 00:18:26.353988 tst osmo-nitb_10.42.42.2(pid=400): stdout: | (launched: 2022-12-09_00:18:25.176465) 00:18:26.482743 tst osmo-nitb_10.42.42.2(pid=400): stderr: | (launched: 2022-12-09_00:18:25.223820) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:18:26.634525 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=400): Process ended prematurely: osmo-nitb_10.42.42.2(pid=400) [trial-2351↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=400)] [trial-2351↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 00:18:26.643421 tst assert_extension.py:12: Test FAILED (3.2 sec) 00:18:26.650402 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=399): Terminating (SIGTERM) 00:18:26.861324 --- ParallelTerminationStrategy: PID 399 died... 00:18:26.881522 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=399): Terminated: ok {rc=0} 00:18:26.963923 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 ussd:nanobts+band-900 --------------------------------------------------------------------- 00:18:28.133580 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:18:28.138378 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 00:18:28.170133 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 00:18:28.196277 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 00:18:28.231027 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 00:18:28.264531 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 00:18:28.292317 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 00:18:28.822010 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2351 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 00:18:28.827416 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:18:28.838719 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 00:18:28.887157 tst assert_extension.py: using LAC 17759 00:18:29.011566 tst assert_extension.py: using RAC 164 00:18:29.138789 tst assert_extension.py: using CellId 17759 00:18:29.261865 tst assert_extension.py: using BVCI 17760 00:18:29.377413 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:18:29.388412 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:18:29.399433 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:18:29.411275 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:18:29.422822 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:18:29.434413 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 00:18:29.548074 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:18:30.012309 run create_hlr_db(pid=404): Launched 00:18:30.135097 bus /sierra_2: Setting Powered False 00:18:31.198204 run create_hlr_db(pid=404): Terminated: ok {rc=0} 00:18:31.623084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=406): Launched 00:18:31.947404 run osmo-hlr_10.42.42.2(pid=407): Launched 00:18:32.176422 run osmo-stp_10.42.42.5: Starting osmo-stp 00:18:32.742807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=409): Launched 00:18:33.061882 run osmo-stp_10.42.42.5(pid=410): Launched 00:18:33.183018 run osmo-msc_10.42.42.6: Starting osmo-msc 00:18:33.757066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=412): Launched 00:18:34.076054 run osmo-msc_10.42.42.6(pid=413): Launched 00:18:34.253638 run osmo-stp_10.42.42.5(pid=410): ERR: Terminated: ERROR {rc=1} [trial-2351↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=410)] 00:18:34.388834 run osmo-stp_10.42.42.5(pid=410): stdout: | (launched: 2022-12-09_00:18:33.004002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:34.524829 run osmo-stp_10.42.42.5(pid=410): stderr: | [0;m[38;5;43m20221209001833195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001833195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001833195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001833196 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001833196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001833196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001833196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:34.659387 run osmo-stp_10.42.42.5(pid=410): stdout: | (launched: 2022-12-09_00:18:33.004002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:34.787045 run osmo-stp_10.42.42.5(pid=410): stderr: | [0;m[38;5;43m20221209001833195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001833195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001833195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001833196 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001833196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001833196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001833196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:34.938740 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=410): Process ended prematurely: osmo-stp_10.42.42.5(pid=410) [trial-2351↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=410)] [trial-2351↪ussd:nanobts+band-900↪assert_extension.py:17] 00:18:34.947889 tst assert_extension.py:17: Test FAILED (6.1 sec) 00:18:34.976047 run osmo-hlr_10.42.42.2(pid=407): ERR: Terminated: ERROR {rc=237} [trial-2351↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=407)] 00:18:35.026031 run osmo-hlr_10.42.42.2(pid=407): stdout: | (launched: 2022-12-09_00:18:31.883611) 00:18:35.078080 run osmo-hlr_10.42.42.2(pid=407): stderr: | [0;m[1;31m20221209001832216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001832216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001832216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001832216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001832216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001832216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001832228 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001832236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001832237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001832237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:18:35.149915 run osmo-msc_10.42.42.6(pid=413): ERR: Terminated: ERROR {rc=2} [trial-2351↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=413)] 00:18:35.199354 run osmo-msc_10.42.42.6(pid=413): stdout: | (launched: 2022-12-09_00:18:34.018038) 00:18:35.251503 run osmo-msc_10.42.42.6(pid=413): stderr: | [0;m[38;5;43m20221209001834340 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001834340 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7388abdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001834340 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001834340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001834340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001834340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001834342 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001834343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001834343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001834343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:18:35.303584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=406): Terminating (SIGTERM) 00:18:35.345392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=409): Terminating (SIGTERM) 00:18:35.387153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=412): Terminating (SIGTERM) 00:18:35.429390 --- ParallelTerminationStrategy: PID 406 died... 00:18:35.449152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=406): Terminated: ok {rc=0} 00:18:35.495485 --- ParallelTerminationStrategy: PID 409 died... 00:18:35.515264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=409): Terminated: ok {rc=0} 00:18:35.561910 --- ParallelTerminationStrategy: PID 412 died... 00:18:35.581347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=412): Terminated: ok {rc=0} 00:18:35.668633 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 00:18:36.879812 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:18:36.887396 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 00:18:36.919009 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 00:18:36.946660 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 00:18:36.996180 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 00:18:37.027729 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 00:18:37.054266 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 00:18:37.606653 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 00:18:37.656544 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:37.667752 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:18:37.732599 tst mo_mt_call.py: using LAC 17760 00:18:37.850183 tst mo_mt_call.py: using RAC 165 00:18:37.968663 tst mo_mt_call.py: using CellId 17760 00:18:38.086929 tst mo_mt_call.py: using BVCI 17761 00:18:38.196436 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:38.207617 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:38.218499 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:38.229415 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:38.240638 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:38.251541 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:18:38.367511 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:18:38.481510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:18:38.950904 run create_hlr_db(pid=418): Launched 00:18:39.074680 bus /sierra_2: Setting Powered False 00:18:40.135436 run create_hlr_db(pid=418): Terminated: ok {rc=0} 00:18:40.577371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=420): Launched 00:18:40.900682 run osmo-hlr_10.42.42.2(pid=421): Launched 00:18:41.023420 run osmo-stp_10.42.42.5: Starting osmo-stp 00:18:41.578323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=423): Launched 00:18:41.902285 run osmo-stp_10.42.42.5(pid=424): Launched 00:18:42.025908 run osmo-msc_10.42.42.6: Starting osmo-msc 00:18:42.610265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=426): Launched 00:18:42.934012 run osmo-msc_10.42.42.6(pid=427): Launched 00:18:43.115482 run osmo-stp_10.42.42.5(pid=424): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=424)] 00:18:43.252460 run osmo-stp_10.42.42.5(pid=424): stdout: | (launched: 2022-12-09_00:18:41.843214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:43.390114 run osmo-stp_10.42.42.5(pid=424): stderr: | [0;m[38;5;43m20221209001842034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001842034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001842034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001842035 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001842035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001842035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001842035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:43.527126 run osmo-stp_10.42.42.5(pid=424): stdout: | (launched: 2022-12-09_00:18:41.843214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:43.655888 run osmo-stp_10.42.42.5(pid=424): stderr: | [0;m[38;5;43m20221209001842034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001842034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001842034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001842035 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001842035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001842035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001842035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:43.809988 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=424): Process ended prematurely: osmo-stp_10.42.42.5(pid=424) [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=424)] [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 00:18:43.819579 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:18:43.847826 run osmo-hlr_10.42.42.2(pid=421): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=421)] 00:18:43.897521 run osmo-hlr_10.42.42.2(pid=421): stdout: | (launched: 2022-12-09_00:18:40.841928) 00:18:43.949086 run osmo-hlr_10.42.42.2(pid=421): stderr: | [0;m[1;31m20221209001841041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001841041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001841041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001841041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001841041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001841041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001841069 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001841078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001841078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001841078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:18:44.020784 run osmo-msc_10.42.42.6(pid=427): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=427)] 00:18:44.070424 run osmo-msc_10.42.42.6(pid=427): stdout: | (launched: 2022-12-09_00:18:42.875333) 00:18:44.122026 run osmo-msc_10.42.42.6(pid=427): stderr: | [0;m[38;5;43m20221209001843197 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001843197 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe28390dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001843197 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001843197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001843198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001843198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001843200 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001843201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001843201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001843201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:18:44.173852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=420): Terminating (SIGTERM) 00:18:44.215190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=423): Terminating (SIGTERM) 00:18:44.256769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=426): Terminating (SIGTERM) 00:18:44.299042 --- ParallelTerminationStrategy: PID 420 died... 00:18:44.318748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=420): Terminated: ok {rc=0} 00:18:44.365064 --- ParallelTerminationStrategy: PID 423 died... 00:18:44.384286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=423): Terminated: ok {rc=0} 00:18:44.430329 --- ParallelTerminationStrategy: PID 426 died... 00:18:44.449658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=426): Terminated: ok {rc=0} 00:18:44.536268 bus /sierra_3: Setting Powered False 00:18:45.635445 bus /sierra_3: Setting Powered False 00:18:46.747827 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 00:18:47.893065 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:47.904744 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:18:47.971297 tst mo_mt_call_osmux.py: using LAC 17761 00:18:48.092873 tst mo_mt_call_osmux.py: using RAC 166 00:18:48.212600 tst mo_mt_call_osmux.py: using CellId 17761 00:18:48.333624 tst mo_mt_call_osmux.py: using BVCI 17762 00:18:48.445696 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:48.456660 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:48.467547 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:48.478401 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:48.489323 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:48.500125 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:18:48.619305 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:18:48.742158 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:18:49.244911 run create_hlr_db(pid=429): Launched 00:18:49.368263 bus /sierra_2: Setting Powered False 00:18:50.432673 run create_hlr_db(pid=429): Terminated: ok {rc=0} 00:18:50.865929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=431): Launched 00:18:51.170675 run osmo-hlr_10.42.42.2(pid=432): Launched 00:18:51.286471 run osmo-stp_10.42.42.5: Starting osmo-stp 00:18:51.809669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=434): Launched 00:18:52.115465 run osmo-stp_10.42.42.5(pid=435): Launched 00:18:52.231988 run osmo-msc_10.42.42.6: Starting osmo-msc 00:18:52.781148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=437): Launched 00:18:53.085548 run osmo-msc_10.42.42.6(pid=438): Launched 00:18:53.255653 run osmo-stp_10.42.42.5(pid=435): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=435)] 00:18:53.385105 run osmo-stp_10.42.42.5(pid=435): stdout: | (launched: 2022-12-09_00:18:52.059285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:53.514187 run osmo-stp_10.42.42.5(pid=435): stderr: | [0;m[38;5;43m20221209001852231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001852231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001852231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001852232 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001852232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001852232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001852233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:53.640749 run osmo-stp_10.42.42.5(pid=435): stdout: | (launched: 2022-12-09_00:18:52.059285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:53.761394 run osmo-stp_10.42.42.5(pid=435): stderr: | [0;m[38;5;43m20221209001852231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001852231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001852231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001852232 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001852232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001852232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001852233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:53.905802 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=435): Process ended prematurely: osmo-stp_10.42.42.5(pid=435) [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=435)] [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 00:18:53.914829 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 00:18:53.940987 run osmo-hlr_10.42.42.2(pid=432): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=432)] 00:18:53.987348 run osmo-hlr_10.42.42.2(pid=432): stdout: | (launched: 2022-12-09_00:18:51.114821) 00:18:54.035556 run osmo-hlr_10.42.42.2(pid=432): stderr: | [0;m[1;31m20221209001851292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001851292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001851292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001851292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001851292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001851292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001851305 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001851314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001851314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001851314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:18:54.103960 run osmo-msc_10.42.42.6(pid=438): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=438)] 00:18:54.150323 run osmo-msc_10.42.42.6(pid=438): stdout: | (launched: 2022-12-09_00:18:53.029603) 00:18:54.198403 run osmo-msc_10.42.42.6(pid=438): stderr: | [0;m[38;5;43m20221209001853301 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001853302 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe5992aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001853302 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001853302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001853302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001853302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001853305 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001853307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001853307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001853307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:18:54.246745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=431): Terminating (SIGTERM) 00:18:54.285417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=434): Terminating (SIGTERM) 00:18:54.324163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=437): Terminating (SIGTERM) 00:18:54.363326 --- ParallelTerminationStrategy: PID 431 died... 00:18:54.382081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=431): Terminated: ok {rc=0} 00:18:54.425421 --- ParallelTerminationStrategy: PID 434 died... 00:18:54.443634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=434): Terminated: ok {rc=0} 00:18:54.487341 --- ParallelTerminationStrategy: PID 437 died... 00:18:54.505725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=437): Terminated: ok {rc=0} 00:18:54.587182 bus /sierra_3: Setting Powered False 00:18:55.681710 bus /sierra_3: Setting Powered False 00:18:56.795386 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 00:18:58.047672 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:18:58.054943 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 00:18:58.086563 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 00:18:58.113176 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 00:18:58.163001 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 00:18:58.194395 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 00:18:58.220167 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 00:18:58.773910 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 00:18:58.822331 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:58.833667 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:18:58.897758 tst mo_mt_call.py: using LAC 17762 00:18:59.017834 tst mo_mt_call.py: using RAC 167 00:18:59.136350 tst mo_mt_call.py: using CellId 17762 00:18:59.253826 tst mo_mt_call.py: using BVCI 17763 00:18:59.363256 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:59.374276 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:59.385130 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:59.395858 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:59.406757 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:59.417570 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:18:59.535109 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:18:59.650312 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:19:00.120799 run create_hlr_db(pid=443): Launched 00:19:00.244282 bus /sierra_2: Setting Powered False 00:19:01.321547 run create_hlr_db(pid=443): Terminated: ok {rc=0} 00:19:01.824467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=445): Launched 00:19:02.148427 run osmo-hlr_10.42.42.2(pid=446): Launched 00:19:02.324167 run osmo-stp_10.42.42.5: Starting osmo-stp 00:19:02.887923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=448): Launched 00:19:03.211189 run osmo-stp_10.42.42.5(pid=449): Launched 00:19:03.334315 run osmo-msc_10.42.42.6: Starting osmo-msc 00:19:03.921165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=451): Launched 00:19:04.245810 run osmo-msc_10.42.42.6(pid=452): Launched 00:19:04.426560 run osmo-stp_10.42.42.5(pid=449): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=449)] 00:19:04.564131 run osmo-stp_10.42.42.5(pid=449): stdout: | (launched: 2022-12-09_00:19:03.152270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:04.702354 run osmo-stp_10.42.42.5(pid=449): stderr: | [0;m[38;5;43m20221209001903344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001903344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001903344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001903345 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001903345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001903345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001903345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:04.839098 run osmo-stp_10.42.42.5(pid=449): stdout: | (launched: 2022-12-09_00:19:03.152270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:04.968334 run osmo-stp_10.42.42.5(pid=449): stderr: | [0;m[38;5;43m20221209001903344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001903344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001903344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001903345 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001903345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001903345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001903345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:05.123130 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=449): Process ended prematurely: osmo-stp_10.42.42.5(pid=449) [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=449)] [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 00:19:05.132718 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 00:19:05.160870 run osmo-hlr_10.42.42.2(pid=446): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=446)] 00:19:05.210761 run osmo-hlr_10.42.42.2(pid=446): stdout: | (launched: 2022-12-09_00:19:02.089510) 00:19:05.262178 run osmo-hlr_10.42.42.2(pid=446): stderr: | [0;m[1;31m20221209001902310 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001902310 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001902310 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001902310 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001902310 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001902310 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001902323 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001902332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001902333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001902333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:19:05.334346 run osmo-msc_10.42.42.6(pid=452): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=452)] 00:19:05.383813 run osmo-msc_10.42.42.6(pid=452): stdout: | (launched: 2022-12-09_00:19:04.186912) 00:19:05.435443 run osmo-msc_10.42.42.6(pid=452): stderr: | [0;m[38;5;43m20221209001904511 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001904511 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1c2cf55c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001904511 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001904511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001904511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001904511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001904513 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001904514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001904514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001904514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:19:05.487025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=445): Terminating (SIGTERM) 00:19:05.528919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=448): Terminating (SIGTERM) 00:19:05.571367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=451): Terminating (SIGTERM) 00:19:05.613050 --- ParallelTerminationStrategy: PID 445 died... 00:19:05.633256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=445): Terminated: ok {rc=0} 00:19:05.679372 --- ParallelTerminationStrategy: PID 448 died... 00:19:05.698965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=448): Terminated: ok {rc=0} 00:19:05.745224 --- ParallelTerminationStrategy: PID 451 died... 00:19:05.764557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=451): Terminated: ok {rc=0} 00:19:05.851897 bus /sierra_3: Setting Powered False 00:19:06.950513 bus /sierra_3: Setting Powered False 00:19:08.065414 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 00:19:09.212419 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:19:09.224598 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:19:09.293796 tst mo_mt_call_osmux.py: using LAC 17763 00:19:09.421507 tst mo_mt_call_osmux.py: using RAC 168 00:19:09.541134 tst mo_mt_call_osmux.py: using CellId 17763 00:19:09.660348 tst mo_mt_call_osmux.py: using BVCI 17764 00:19:09.770522 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:19:09.781786 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:19:09.792754 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:19:09.803971 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:19:09.815264 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:19:09.826496 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:19:09.944775 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:19:10.060835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:19:10.532285 run create_hlr_db(pid=454): Launched 00:19:10.656848 bus /sierra_2: Setting Powered False 00:19:11.717863 run create_hlr_db(pid=454): Terminated: ok {rc=0} 00:19:12.160254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=456): Launched 00:19:12.485218 run osmo-hlr_10.42.42.2(pid=457): Launched 00:19:12.610670 run osmo-stp_10.42.42.5: Starting osmo-stp 00:19:13.170635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=459): Launched 00:19:13.494583 run osmo-stp_10.42.42.5(pid=460): Launched 00:19:13.619536 run osmo-msc_10.42.42.6: Starting osmo-msc 00:19:14.206216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=462): Launched 00:19:14.531421 run osmo-msc_10.42.42.6(pid=463): Launched 00:19:14.712439 run osmo-stp_10.42.42.5(pid=460): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=460)] 00:19:14.849901 run osmo-stp_10.42.42.5(pid=460): stdout: | (launched: 2022-12-09_00:19:13.435886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:14.988006 run osmo-stp_10.42.42.5(pid=460): stderr: | [0;m[38;5;43m20221209001913627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001913627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001913627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001913628 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001913628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001913628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001913628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:15.125423 run osmo-stp_10.42.42.5(pid=460): stdout: | (launched: 2022-12-09_00:19:13.435886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:15.254511 run osmo-stp_10.42.42.5(pid=460): stderr: | [0;m[38;5;43m20221209001913627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001913627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001913627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001913628 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001913628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001913628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001913628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:15.409283 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=460): Process ended prematurely: osmo-stp_10.42.42.5(pid=460) [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=460)] [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 00:19:15.418789 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:19:15.446569 run osmo-hlr_10.42.42.2(pid=457): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=457)] 00:19:15.496303 run osmo-hlr_10.42.42.2(pid=457): stdout: | (launched: 2022-12-09_00:19:12.426072) 00:19:15.547885 run osmo-hlr_10.42.42.2(pid=457): stderr: | [0;m[1;31m20221209001912627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001912627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001912627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001912627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001912627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001912627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001912639 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001912647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001912647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001912647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:19:15.619632 run osmo-msc_10.42.42.6(pid=463): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=463)] 00:19:15.668872 run osmo-msc_10.42.42.6(pid=463): stdout: | (launched: 2022-12-09_00:19:14.471720) 00:19:15.720221 run osmo-msc_10.42.42.6(pid=463): stderr: | [0;m[38;5;43m20221209001914794 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001914795 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6eacab0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001914795 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001914795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001914795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001914795 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001914797 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001914797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001914798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001914798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:19:15.771817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=456): Terminating (SIGTERM) 00:19:15.813255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=459): Terminating (SIGTERM) 00:19:15.875751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=462): Terminating (SIGTERM) 00:19:15.928796 --- ParallelTerminationStrategy: PID 456 died... 00:19:15.948994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=456): Terminated: ok {rc=0} 00:19:15.996906 --- ParallelTerminationStrategy: PID 459 died... 00:19:16.017104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=459): Terminated: ok {rc=0} 00:19:16.072219 --- ParallelTerminationStrategy: PID 462 died... 00:19:16.099975 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=462): Terminated: ok {rc=0} 00:19:16.211966 bus /sierra_3: Setting Powered False 00:19:17.325566 bus /sierra_3: Setting Powered False 00:19:18.440199 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 00:19:19.693078 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:19:19.701204 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 00:19:19.735053 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 00:19:19.762359 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 00:19:19.814799 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 00:19:19.847728 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 00:19:19.874999 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 00:19:20.426739 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 00:19:20.478896 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:20.490631 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:19:20.559232 tst mo_mt_call.py: using LAC 17764 00:19:20.686871 tst mo_mt_call.py: using RAC 169 00:19:20.814192 tst mo_mt_call.py: using CellId 17764 00:19:20.941723 tst mo_mt_call.py: using BVCI 17765 00:19:21.052657 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:21.063984 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:21.075088 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:21.086205 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:21.098316 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:21.109817 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:19:21.229586 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:19:21.346375 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:19:21.820083 run create_hlr_db(pid=468): Launched 00:19:21.944129 bus /sierra_2: Setting Powered False 00:19:23.005447 run create_hlr_db(pid=468): Terminated: ok {rc=0} 00:19:23.447184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=470): Launched 00:19:23.772312 run osmo-hlr_10.42.42.2(pid=471): Launched 00:19:23.896668 run osmo-stp_10.42.42.5: Starting osmo-stp 00:19:24.460217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=473): Launched 00:19:24.785556 run osmo-stp_10.42.42.5(pid=474): Launched 00:19:24.908859 run osmo-msc_10.42.42.6: Starting osmo-msc 00:19:25.492857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=476): Launched 00:19:25.817685 run osmo-msc_10.42.42.6(pid=477): Launched 00:19:25.999022 run osmo-stp_10.42.42.5(pid=474): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=474)] 00:19:26.136408 run osmo-stp_10.42.42.5(pid=474): stdout: | (launched: 2022-12-09_00:19:24.726071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:26.273966 run osmo-stp_10.42.42.5(pid=474): stderr: | [0;m[38;5;43m20221209001924919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001924919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001924920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001924920 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001924920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001924921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001924921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:26.411131 run osmo-stp_10.42.42.5(pid=474): stdout: | (launched: 2022-12-09_00:19:24.726071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:26.540915 run osmo-stp_10.42.42.5(pid=474): stderr: | [0;m[38;5;43m20221209001924919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001924919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001924920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001924920 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001924920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001924921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001924921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:26.696002 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=474): Process ended prematurely: osmo-stp_10.42.42.5(pid=474) [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=474)] [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 00:19:26.705757 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 00:19:26.733245 run osmo-hlr_10.42.42.2(pid=471): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=471)] 00:19:26.783367 run osmo-hlr_10.42.42.2(pid=471): stdout: | (launched: 2022-12-09_00:19:23.713687) 00:19:26.834921 run osmo-hlr_10.42.42.2(pid=471): stderr: | [0;m[1;31m20221209001923913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001923913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001923913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001923913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001923913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001923913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001923930 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001923939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001923939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001923939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:19:26.906943 run osmo-msc_10.42.42.6(pid=477): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=477)] 00:19:26.956484 run osmo-msc_10.42.42.6(pid=477): stdout: | (launched: 2022-12-09_00:19:25.758788) 00:19:27.008010 run osmo-msc_10.42.42.6(pid=477): stderr: | [0;m[38;5;43m20221209001926079 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001926079 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faba4865c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001926079 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001926079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001926079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001926079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001926081 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001926082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001926082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001926082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:19:27.059646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=470): Terminating (SIGTERM) 00:19:27.101369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=473): Terminating (SIGTERM) 00:19:27.143006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=476): Terminating (SIGTERM) 00:19:27.184775 --- ParallelTerminationStrategy: PID 470 died... 00:19:27.204704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=470): Terminated: ok {rc=0} 00:19:27.251022 --- ParallelTerminationStrategy: PID 473 died... 00:19:27.270467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=473): Terminated: ok {rc=0} 00:19:27.316629 --- ParallelTerminationStrategy: PID 476 died... 00:19:27.336129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=476): Terminated: ok {rc=0} 00:19:27.421791 bus /sierra_3: Setting Powered False 00:19:28.519065 bus /sierra_3: Setting Powered False 00:19:29.631578 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 00:19:30.773608 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:30.785404 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:19:30.863596 tst mo_mt_call_osmux.py: using LAC 17765 00:19:31.002940 tst mo_mt_call_osmux.py: using RAC 170 00:19:31.127637 tst mo_mt_call_osmux.py: using CellId 17765 00:19:31.273922 tst mo_mt_call_osmux.py: using BVCI 17766 00:19:31.431894 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:31.445337 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:31.458262 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:31.472046 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:31.485138 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:31.499812 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:19:31.627636 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:19:31.774541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:19:32.270622 run create_hlr_db(pid=479): Launched 00:19:32.425962 bus /sierra_2: Setting Powered False 00:19:33.487180 run create_hlr_db(pid=479): Terminated: ok {rc=0} 00:19:33.930317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=481): Launched 00:19:34.256146 run osmo-hlr_10.42.42.2(pid=482): Launched 00:19:34.381446 run osmo-stp_10.42.42.5: Starting osmo-stp 00:19:34.942236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=484): Launched 00:19:35.267260 run osmo-stp_10.42.42.5(pid=485): Launched 00:19:35.391240 run osmo-msc_10.42.42.6: Starting osmo-msc 00:19:35.977418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=487): Launched 00:19:36.302774 run osmo-msc_10.42.42.6(pid=488): Launched 00:19:36.483579 run osmo-stp_10.42.42.5(pid=485): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=485)] 00:19:36.621423 run osmo-stp_10.42.42.5(pid=485): stdout: | (launched: 2022-12-09_00:19:35.208228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:36.758575 run osmo-stp_10.42.42.5(pid=485): stderr: | [0;m[38;5;43m20221209001935400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001935401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001935401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001935402 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001935403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001935403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001935403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:36.895433 run osmo-stp_10.42.42.5(pid=485): stdout: | (launched: 2022-12-09_00:19:35.208228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:37.024761 run osmo-stp_10.42.42.5(pid=485): stderr: | [0;m[38;5;43m20221209001935400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001935401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001935401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001935402 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001935403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001935403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001935403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:37.179702 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=485): Process ended prematurely: osmo-stp_10.42.42.5(pid=485) [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=485)] [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 00:19:37.189506 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 00:19:37.217438 run osmo-hlr_10.42.42.2(pid=482): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=482)] 00:19:37.267135 run osmo-hlr_10.42.42.2(pid=482): stdout: | (launched: 2022-12-09_00:19:34.197346) 00:19:37.318543 run osmo-hlr_10.42.42.2(pid=482): stderr: | [0;m[1;31m20221209001934399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001934399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001934399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001934399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001934399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001934399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001934412 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001934420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001934421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001934421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:19:37.389996 run osmo-msc_10.42.42.6(pid=488): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=488)] 00:19:37.439269 run osmo-msc_10.42.42.6(pid=488): stdout: | (launched: 2022-12-09_00:19:36.243642) 00:19:37.490304 run osmo-msc_10.42.42.6(pid=488): stderr: | [0;m[38;5;43m20221209001936567 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001936568 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe45307bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001936568 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001936568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001936568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001936568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001936570 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001936570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001936570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001936570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:19:37.542286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=481): Terminating (SIGTERM) 00:19:37.584019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=484): Terminating (SIGTERM) 00:19:37.625483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=487): Terminating (SIGTERM) 00:19:37.667299 --- ParallelTerminationStrategy: PID 481 died... 00:19:37.687024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=481): Terminated: ok {rc=0} 00:19:37.733526 --- ParallelTerminationStrategy: PID 484 died... 00:19:37.752658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=484): Terminated: ok {rc=0} 00:19:37.798751 --- ParallelTerminationStrategy: PID 487 died... 00:19:37.818232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=487): Terminated: ok {rc=0} 00:19:37.904604 bus /sierra_3: Setting Powered False 00:19:39.000085 bus /sierra_3: Setting Powered False 00:19:40.114678 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 00:19:41.364845 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:19:41.373295 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 00:19:41.407501 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 00:19:41.434804 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 00:19:41.487332 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 00:19:41.520255 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 00:19:41.548127 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 00:19:42.100315 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 00:19:42.153024 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:42.164787 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:19:42.232436 tst mo_mt_call.py: using LAC 17766 00:19:42.359029 tst mo_mt_call.py: using RAC 171 00:19:42.480468 tst mo_mt_call.py: using CellId 17766 00:19:42.599693 tst mo_mt_call.py: using BVCI 17767 00:19:42.709881 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:42.720887 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:42.731962 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:42.742859 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:42.753845 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:42.764630 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:19:42.883035 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:19:42.999551 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:19:43.470183 run create_hlr_db(pid=493): Launched 00:19:43.593941 bus /sierra_2: Setting Powered False 00:19:44.654171 run create_hlr_db(pid=493): Terminated: ok {rc=0} 00:19:45.094780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=495): Launched 00:19:45.419361 run osmo-hlr_10.42.42.2(pid=496): Launched 00:19:45.543674 run osmo-stp_10.42.42.5: Starting osmo-stp 00:19:46.146373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=498): Launched 00:19:46.482165 run osmo-stp_10.42.42.5(pid=499): Launched 00:19:46.615275 run osmo-msc_10.42.42.6: Starting osmo-msc 00:19:47.322445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=501): Launched 00:19:47.648156 run osmo-msc_10.42.42.6(pid=502): Launched 00:19:47.828633 run osmo-stp_10.42.42.5(pid=499): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=499)] 00:19:47.965706 run osmo-stp_10.42.42.5(pid=499): stdout: | (launched: 2022-12-09_00:19:46.418231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:48.103381 run osmo-stp_10.42.42.5(pid=499): stderr: | [0;m[38;5;43m20221209001946829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001946829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001946830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001946830 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001946830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001946831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001946831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:48.240362 run osmo-stp_10.42.42.5(pid=499): stdout: | (launched: 2022-12-09_00:19:46.418231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:48.369801 run osmo-stp_10.42.42.5(pid=499): stderr: | [0;m[38;5;43m20221209001946829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001946829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001946830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001946830 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001946830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001946831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001946831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:48.524782 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=499): Process ended prematurely: osmo-stp_10.42.42.5(pid=499) [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=499)] [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 00:19:48.534629 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 00:19:48.563878 run osmo-hlr_10.42.42.2(pid=496): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=496)] 00:19:48.614280 run osmo-hlr_10.42.42.2(pid=496): stdout: | (launched: 2022-12-09_00:19:45.360503) 00:19:48.666119 run osmo-hlr_10.42.42.2(pid=496): stderr: | [0;m[1;31m20221209001945559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001945559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001945559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001945559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001945559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001945559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001945575 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001945584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001945584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001945584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:19:48.738077 run osmo-msc_10.42.42.6(pid=502): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=502)] 00:19:48.787456 run osmo-msc_10.42.42.6(pid=502): stdout: | (launched: 2022-12-09_00:19:47.589229) 00:19:48.839805 run osmo-msc_10.42.42.6(pid=502): stderr: | [0;m[38;5;43m20221209001947914 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001947915 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f86c54eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001947915 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001947915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001947915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001947915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001947917 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001947917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001947917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001947918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:19:48.891774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=495): Terminating (SIGTERM) 00:19:48.933501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=498): Terminating (SIGTERM) 00:19:48.975225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=501): Terminating (SIGTERM) 00:19:49.017294 --- ParallelTerminationStrategy: PID 495 died... 00:19:49.037276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=495): Terminated: ok {rc=0} 00:19:49.083906 --- ParallelTerminationStrategy: PID 498 died... 00:19:49.103439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=498): Terminated: ok {rc=0} 00:19:49.149937 --- ParallelTerminationStrategy: PID 501 died... 00:19:49.169436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=501): Terminated: ok {rc=0} 00:19:49.257127 bus /sierra_3: Setting Powered False 00:19:50.355875 bus /sierra_3: Setting Powered False 00:19:51.469823 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 00:19:52.611617 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:52.623213 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:19:52.689433 tst mo_mt_call_osmux.py: using LAC 17767 00:19:52.808385 tst mo_mt_call_osmux.py: using RAC 172 00:19:52.927870 tst mo_mt_call_osmux.py: using CellId 17767 00:19:53.048628 tst mo_mt_call_osmux.py: using BVCI 17768 00:19:53.158132 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:53.169320 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:53.180245 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:53.191201 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:53.202212 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:53.213565 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:19:53.331086 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:19:53.448257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:19:53.919674 run create_hlr_db(pid=504): Launched 00:19:54.044045 bus /sierra_2: Setting Powered False 00:19:55.103880 run create_hlr_db(pid=504): Terminated: ok {rc=0} 00:19:55.546032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=506): Launched 00:19:55.871667 run osmo-hlr_10.42.42.2(pid=507): Launched 00:19:55.995845 run osmo-stp_10.42.42.5: Starting osmo-stp 00:19:56.556621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=509): Launched 00:19:56.880869 run osmo-stp_10.42.42.5(pid=510): Launched 00:19:57.004933 run osmo-msc_10.42.42.6: Starting osmo-msc 00:19:57.591904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=512): Launched 00:19:57.917506 run osmo-msc_10.42.42.6(pid=513): Launched 00:19:58.099000 run osmo-stp_10.42.42.5(pid=510): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=510)] 00:19:58.236255 run osmo-stp_10.42.42.5(pid=510): stdout: | (launched: 2022-12-09_00:19:56.821956) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:58.374751 run osmo-stp_10.42.42.5(pid=510): stderr: | [0;m[38;5;43m20221209001957016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001957016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001957016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001957016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001957017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001957017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001957017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:58.512080 run osmo-stp_10.42.42.5(pid=510): stdout: | (launched: 2022-12-09_00:19:56.821956) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:58.642156 run osmo-stp_10.42.42.5(pid=510): stderr: | [0;m[38;5;43m20221209001957016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209001957016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209001957016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209001957016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209001957017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209001957017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209001957017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:58.796902 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=510): Process ended prematurely: osmo-stp_10.42.42.5(pid=510) [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=510)] [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 00:19:58.806823 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:19:58.835538 run osmo-hlr_10.42.42.2(pid=507): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=507)] 00:19:58.885293 run osmo-hlr_10.42.42.2(pid=507): stdout: | (launched: 2022-12-09_00:19:55.812724) 00:19:58.936869 run osmo-hlr_10.42.42.2(pid=507): stderr: | [0;m[1;31m20221209001956011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209001956011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209001956011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209001956011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209001956011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209001956011 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209001956023 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209001956032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209001956032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209001956032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:19:59.008550 run osmo-msc_10.42.42.6(pid=513): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=513)] 00:19:59.058360 run osmo-msc_10.42.42.6(pid=513): stdout: | (launched: 2022-12-09_00:19:57.858290) 00:19:59.109677 run osmo-msc_10.42.42.6(pid=513): stderr: | [0;m[38;5;43m20221209001958181 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209001958181 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6e510ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209001958181 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209001958181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209001958181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209001958182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209001958183 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209001958184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209001958184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209001958184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:19:59.161451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=506): Terminating (SIGTERM) 00:19:59.203185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=509): Terminating (SIGTERM) 00:19:59.245028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=512): Terminating (SIGTERM) 00:19:59.287471 --- ParallelTerminationStrategy: PID 506 died... 00:19:59.307207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=506): Terminated: ok {rc=0} 00:19:59.353636 --- ParallelTerminationStrategy: PID 509 died... 00:19:59.372632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=509): Terminated: ok {rc=0} 00:19:59.418637 --- ParallelTerminationStrategy: PID 512 died... 00:19:59.437872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=512): Terminated: ok {rc=0} 00:19:59.524507 bus /sierra_3: Setting Powered False 00:20:00.621743 bus /sierra_3: Setting Powered False 00:20:01.734380 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:20:02.980112 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:20:02.989617 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:20:03.023294 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 00:20:03.050670 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:20:03.101633 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:20:03.134899 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 00:20:03.162134 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:20:03.713902 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 00:20:03.762629 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:20:03.774059 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:20:03.841857 tst mo_mt_call.py: using LAC 17768 00:20:03.961361 tst mo_mt_call.py: using RAC 173 00:20:04.081388 tst mo_mt_call.py: using CellId 17768 00:20:04.201263 tst mo_mt_call.py: using BVCI 17769 00:20:04.321091 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:20:04.333598 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:20:04.345142 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:20:04.357454 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:20:04.369252 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:20:04.381084 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:20:04.497693 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:20:04.615554 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:20:05.087858 run create_hlr_db(pid=521): Launched 00:20:05.213554 bus /sierra_2: Setting Powered False 00:20:06.274785 run create_hlr_db(pid=521): Terminated: ok {rc=0} 00:20:06.719783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=523): Launched 00:20:07.044157 run osmo-hlr_10.42.42.2(pid=524): Launched 00:20:07.167216 run osmo-stp_10.42.42.5: Starting osmo-stp 00:20:07.728733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=526): Launched 00:20:08.051811 run osmo-stp_10.42.42.5(pid=527): Launched 00:20:08.174791 run osmo-msc_10.42.42.6: Starting osmo-msc 00:20:08.760359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=529): Launched 00:20:09.083627 run osmo-msc_10.42.42.6(pid=530): Launched 00:20:09.263988 run osmo-stp_10.42.42.5(pid=527): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=527)] 00:20:09.400332 run osmo-stp_10.42.42.5(pid=527): stdout: | (launched: 2022-12-09_00:20:07.992815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:09.537855 run osmo-stp_10.42.42.5(pid=527): stderr: | [0;m[38;5;43m20221209002008184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002008184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002008184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002008185 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002008187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002008187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002008187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:09.674474 run osmo-stp_10.42.42.5(pid=527): stdout: | (launched: 2022-12-09_00:20:07.992815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:09.803338 run osmo-stp_10.42.42.5(pid=527): stderr: | [0;m[38;5;43m20221209002008184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002008184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002008184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002008185 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002008187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002008187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002008187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:09.957514 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=527): Process ended prematurely: osmo-stp_10.42.42.5(pid=527) [trial-2351↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=527)] [trial-2351↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 00:20:09.967148 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:20:09.995432 run osmo-hlr_10.42.42.2(pid=524): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=524)] 00:20:10.045175 run osmo-hlr_10.42.42.2(pid=524): stdout: | (launched: 2022-12-09_00:20:06.985457) 00:20:10.096583 run osmo-hlr_10.42.42.2(pid=524): stderr: | [0;m[1;31m20221209002007184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002007184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002007184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002007184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002007184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002007184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002007196 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002007205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002007206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002007206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:20:10.168301 run osmo-msc_10.42.42.6(pid=530): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=530)] 00:20:10.217646 run osmo-msc_10.42.42.6(pid=530): stdout: | (launched: 2022-12-09_00:20:09.024535) 00:20:10.268591 run osmo-msc_10.42.42.6(pid=530): stderr: | [0;m[38;5;43m20221209002009346 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209002009346 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8fe13ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209002009346 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209002009346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209002009346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209002009347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209002009348 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209002009349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209002009349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209002009349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:20:10.320148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=523): Terminating (SIGTERM) 00:20:10.361520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=526): Terminating (SIGTERM) 00:20:10.403130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=529): Terminating (SIGTERM) 00:20:10.445026 --- ParallelTerminationStrategy: PID 523 died... 00:20:10.464705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=523): Terminated: ok {rc=0} 00:20:10.510706 --- ParallelTerminationStrategy: PID 526 died... 00:20:10.529964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=526): Terminated: ok {rc=0} 00:20:10.576123 --- ParallelTerminationStrategy: PID 529 died... 00:20:10.595434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=529): Terminated: ok {rc=0} 00:20:10.682798 bus /sierra_3: Setting Powered False 00:20:11.781483 bus /sierra_3: Setting Powered False 00:20:12.899196 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 00:20:14.044281 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:20:14.056191 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:20:14.122668 tst mo_mt_call_osmux.py: using LAC 17769 00:20:14.241913 tst mo_mt_call_osmux.py: using RAC 174 00:20:14.363131 tst mo_mt_call_osmux.py: using CellId 17769 00:20:14.485057 tst mo_mt_call_osmux.py: using BVCI 17770 00:20:14.595768 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:20:14.606929 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:20:14.617861 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:20:14.628896 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:20:14.640040 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:20:14.651115 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:20:14.766968 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:20:14.885860 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:20:15.389225 run create_hlr_db(pid=532): Launched 00:20:15.513817 bus /sierra_2: Setting Powered False 00:20:16.589152 run create_hlr_db(pid=532): Terminated: ok {rc=0} 00:20:17.083238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=534): Launched 00:20:17.423422 run osmo-hlr_10.42.42.2(pid=535): Launched 00:20:17.547882 run osmo-stp_10.42.42.5: Starting osmo-stp 00:20:18.105577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=537): Launched 00:20:18.429400 run osmo-stp_10.42.42.5(pid=538): Launched 00:20:18.553412 run osmo-msc_10.42.42.6: Starting osmo-msc 00:20:19.139850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=540): Launched 00:20:19.464463 run osmo-msc_10.42.42.6(pid=541): Launched 00:20:19.646106 run osmo-stp_10.42.42.5(pid=538): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=538)] 00:20:19.782993 run osmo-stp_10.42.42.5(pid=538): stdout: | (launched: 2022-12-09_00:20:18.370734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:19.920664 run osmo-stp_10.42.42.5(pid=538): stderr: | [0;m[38;5;43m20221209002018565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002018565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002018565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002018566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002018566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002018566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002018566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:20.057539 run osmo-stp_10.42.42.5(pid=538): stdout: | (launched: 2022-12-09_00:20:18.370734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:20.186712 run osmo-stp_10.42.42.5(pid=538): stderr: | [0;m[38;5;43m20221209002018565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002018565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002018565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002018566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002018566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002018566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002018566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:20.341610 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=538): Process ended prematurely: osmo-stp_10.42.42.5(pid=538) [trial-2351↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=538)] [trial-2351↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 00:20:20.351331 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 00:20:20.379257 run osmo-hlr_10.42.42.2(pid=535): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=535)] 00:20:20.429946 run osmo-hlr_10.42.42.2(pid=535): stdout: | (launched: 2022-12-09_00:20:17.364381) 00:20:20.481495 run osmo-hlr_10.42.42.2(pid=535): stderr: | [0;m[1;31m20221209002017563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002017563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002017563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002017563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002017563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002017563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002017575 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002017583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002017584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002017584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:20:20.553275 run osmo-msc_10.42.42.6(pid=541): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=541)] 00:20:20.602923 run osmo-msc_10.42.42.6(pid=541): stdout: | (launched: 2022-12-09_00:20:19.405411) 00:20:20.654148 run osmo-msc_10.42.42.6(pid=541): stderr: | [0;m[38;5;43m20221209002019731 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209002019731 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc8e08eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209002019731 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209002019731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209002019731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209002019731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209002019733 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209002019733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209002019734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209002019734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:20:20.706014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=534): Terminating (SIGTERM) 00:20:20.747408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=537): Terminating (SIGTERM) 00:20:20.789483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=540): Terminating (SIGTERM) 00:20:20.831452 --- ParallelTerminationStrategy: PID 534 died... 00:20:20.851729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=534): Terminated: ok {rc=0} 00:20:20.897825 --- ParallelTerminationStrategy: PID 537 died... 00:20:20.917194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=537): Terminated: ok {rc=0} 00:20:20.963141 --- ParallelTerminationStrategy: PID 540 died... 00:20:20.982623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=540): Terminated: ok {rc=0} 00:20:21.070035 bus /sierra_3: Setting Powered False 00:20:22.167016 bus /sierra_3: Setting Powered False 00:20:23.281306 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 00:20:24.531158 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:20:24.538941 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 00:20:24.573333 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 00:20:24.600605 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 00:20:24.654657 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 00:20:24.688011 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 00:20:24.715020 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 00:20:25.266851 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 00:20:25.318827 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:25.330655 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:20:25.384017 tst mo_mt_call.py: using LAC 17770 00:20:25.509737 tst mo_mt_call.py: using RAC 175 00:20:25.635750 tst mo_mt_call.py: using CellId 17770 00:20:25.760593 tst mo_mt_call.py: using BVCI 17771 00:20:25.877694 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:25.889407 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:25.900844 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:25.913199 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:25.925742 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:25.937727 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 00:20:26.056333 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 00:20:26.173492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:20:26.645563 run create_hlr_db(pid=547): Launched 00:20:26.771238 bus /sierra_2: Setting Powered False 00:20:27.832037 run create_hlr_db(pid=547): Terminated: ok {rc=0} 00:20:28.275652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=549): Launched 00:20:28.600899 run osmo-hlr_10.42.42.2(pid=550): Launched 00:20:28.727043 run osmo-stp_10.42.42.5: Starting osmo-stp 00:20:29.284625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=552): Launched 00:20:29.609909 run osmo-stp_10.42.42.5(pid=553): Launched 00:20:29.734330 run osmo-msc_10.42.42.6: Starting osmo-msc 00:20:30.319566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=555): Launched 00:20:30.644649 run osmo-msc_10.42.42.6(pid=556): Launched 00:20:30.828235 run osmo-stp_10.42.42.5(pid=553): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=553)] 00:20:31.120431 run osmo-stp_10.42.42.5(pid=553): stdout: | (launched: 2022-12-09_00:20:29.549372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:31.335144 run osmo-stp_10.42.42.5(pid=553): stderr: | [0;m[38;5;43m20221209002029742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002029742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002029743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002029743 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002029743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002029743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002029744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:31.468580 run osmo-stp_10.42.42.5(pid=553): stdout: | (launched: 2022-12-09_00:20:29.549372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:31.594808 run osmo-stp_10.42.42.5(pid=553): stderr: | [0;m[38;5;43m20221209002029742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002029742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002029743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002029743 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002029743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002029743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002029744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:31.746017 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=553): Process ended prematurely: osmo-stp_10.42.42.5(pid=553) [trial-2351↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=553)] [trial-2351↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 00:20:31.755520 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 00:20:31.783463 run osmo-hlr_10.42.42.2(pid=550): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=550)] 00:20:31.833634 run osmo-hlr_10.42.42.2(pid=550): stdout: | (launched: 2022-12-09_00:20:28.541256) 00:20:31.884268 run osmo-hlr_10.42.42.2(pid=550): stderr: | [0;m[1;31m20221209002028741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002028741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002028741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002028741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002028741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002028741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002028754 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002028762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002028762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002028762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:20:31.955078 run osmo-msc_10.42.42.6(pid=556): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=556)] 00:20:32.005331 run osmo-msc_10.42.42.6(pid=556): stdout: | (launched: 2022-12-09_00:20:30.585299) 00:20:32.055841 run osmo-msc_10.42.42.6(pid=556): stderr: | [0;m[38;5;43m20221209002030971 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209002030971 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fabdf6fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209002030971 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209002030971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209002030971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209002030971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209002030973 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209002030974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209002030974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209002030974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:20:32.107174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=549): Terminating (SIGTERM) 00:20:32.148379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=552): Terminating (SIGTERM) 00:20:32.191362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=555): Terminating (SIGTERM) 00:20:32.235843 --- ParallelTerminationStrategy: PID 549 died... 00:20:32.255298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=549): Terminated: ok {rc=0} 00:20:32.301389 --- ParallelTerminationStrategy: PID 552 died... 00:20:32.320007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=552): Terminated: ok {rc=0} 00:20:32.363312 --- ParallelTerminationStrategy: PID 555 died... 00:20:32.381752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=555): Terminated: ok {rc=0} 00:20:32.464275 bus /sierra_3: Setting Powered False 00:20:33.561245 bus /sierra_3: Setting Powered False 00:20:34.678465 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 00:20:35.829750 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:35.842027 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:20:35.893373 tst mo_mt_call_osmux.py: using LAC 17771 00:20:36.021335 tst mo_mt_call_osmux.py: using RAC 176 00:20:36.151738 tst mo_mt_call_osmux.py: using CellId 17771 00:20:36.278628 tst mo_mt_call_osmux.py: using BVCI 17772 00:20:36.396531 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:36.408557 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:36.420223 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:36.432100 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:36.444364 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:36.456363 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 00:20:36.573567 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 00:20:36.692791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:20:37.194859 run create_hlr_db(pid=558): Launched 00:20:37.318835 bus /sierra_2: Setting Powered False 00:20:38.383562 run create_hlr_db(pid=558): Terminated: ok {rc=0} 00:20:38.816942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=560): Launched 00:20:39.122598 run osmo-hlr_10.42.42.2(pid=561): Launched 00:20:39.237722 run osmo-stp_10.42.42.5: Starting osmo-stp 00:20:39.761241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=563): Launched 00:20:40.066636 run osmo-stp_10.42.42.5(pid=564): Launched 00:20:40.183317 run osmo-msc_10.42.42.6: Starting osmo-msc 00:20:40.734315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=566): Launched 00:20:41.041354 run osmo-msc_10.42.42.6(pid=567): Launched 00:20:41.212228 run osmo-stp_10.42.42.5(pid=564): ERR: Terminated: ERROR {rc=1} [trial-2351↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=564)] 00:20:41.341430 run osmo-stp_10.42.42.5(pid=564): stdout: | (launched: 2022-12-09_00:20:40.010760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:41.470365 run osmo-stp_10.42.42.5(pid=564): stderr: | [0;m[38;5;43m20221209002040179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002040180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002040180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002040180 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002040182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002040183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002040183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:41.597304 run osmo-stp_10.42.42.5(pid=564): stdout: | (launched: 2022-12-09_00:20:40.010760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:41.718511 run osmo-stp_10.42.42.5(pid=564): stderr: | [0;m[38;5;43m20221209002040179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002040180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002040180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002040180 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002040182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002040183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002040183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:41.863645 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=564): Process ended prematurely: osmo-stp_10.42.42.5(pid=564) [trial-2351↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=564)] [trial-2351↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 00:20:41.872676 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 00:20:41.899259 run osmo-hlr_10.42.42.2(pid=561): ERR: Terminated: ERROR {rc=237} [trial-2351↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=561)] 00:20:41.945968 run osmo-hlr_10.42.42.2(pid=561): stdout: | (launched: 2022-12-09_00:20:39.066990) 00:20:41.994720 run osmo-hlr_10.42.42.2(pid=561): stderr: | [0;m[1;31m20221209002039242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002039242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002039242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002039242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002039243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002039243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002039255 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002039264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002039264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002039264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:20:42.062765 run osmo-msc_10.42.42.6(pid=567): ERR: Terminated: ERROR {rc=2} [trial-2351↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=567)] 00:20:42.109791 run osmo-msc_10.42.42.6(pid=567): stdout: | (launched: 2022-12-09_00:20:40.985265) 00:20:42.158150 run osmo-msc_10.42.42.6(pid=567): stderr: | [0;m[38;5;43m20221209002041259 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209002041259 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f041f333c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209002041259 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209002041259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209002041260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209002041260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209002041262 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209002041262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209002041262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209002041262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:20:42.207021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=560): Terminating (SIGTERM) 00:20:42.245697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=563): Terminating (SIGTERM) 00:20:42.284607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=566): Terminating (SIGTERM) 00:20:42.324008 --- ParallelTerminationStrategy: PID 560 died... 00:20:42.342874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=560): Terminated: ok {rc=0} 00:20:42.386801 --- ParallelTerminationStrategy: PID 563 died... 00:20:42.405388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=563): Terminated: ok {rc=0} 00:20:42.448539 --- ParallelTerminationStrategy: PID 566 died... 00:20:42.466909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=566): Terminated: ok {rc=0} 00:20:42.550205 bus /sierra_3: Setting Powered False 00:20:43.648028 bus /sierra_3: Setting Powered False 00:20:44.762821 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 emergency:nanobts+band-900 --------------------------------------------------------------------- 00:20:46.055060 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:20:46.067084 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 00:20:46.105893 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 00:20:46.134516 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 00:20:46.220203 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 00:20:46.269128 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 00:20:46.312733 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 00:20:46.874470 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2351 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 00:20:46.881670 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:46.893646 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 00:20:46.945794 tst emergency_mo_mt_call.py: using LAC 17772 00:20:47.073996 tst emergency_mo_mt_call.py: using RAC 177 00:20:47.237619 tst emergency_mo_mt_call.py: using CellId 17772 00:20:47.362979 tst emergency_mo_mt_call.py: using BVCI 17773 00:20:47.478575 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:47.489863 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:47.500702 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:47.511819 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:47.523080 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:47.534273 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:47.651633 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:47.767058 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:20:48.231134 run create_hlr_db(pid=572): Launched 00:20:48.353276 bus /sierra_2: Setting Powered False 00:20:49.412897 run create_hlr_db(pid=572): Terminated: ok {rc=0} 00:20:49.831227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=574): Launched 00:20:50.129905 run osmo-hlr_10.42.42.2(pid=575): Launched 00:20:50.242953 run osmo-stp_10.42.42.5: Starting osmo-stp 00:20:50.769481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=577): Launched 00:20:51.068123 run osmo-stp_10.42.42.5(pid=578): Launched 00:20:51.192627 tst emergency_mo_mt_call.py: using MSISDN 6923 00:20:51.344550 run osmo-msc_10.42.42.6: Starting osmo-msc 00:20:51.881111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=580): Launched 00:20:52.179651 run osmo-msc_10.42.42.6(pid=581): Launched 00:20:52.347103 run osmo-stp_10.42.42.5(pid=578): ERR: Terminated: ERROR {rc=1} [trial-2351↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=578)] 00:20:52.473882 run osmo-stp_10.42.42.5(pid=578): stdout: | (launched: 2022-12-09_00:20:51.013541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:52.600809 run osmo-stp_10.42.42.5(pid=578): stderr: | [0;m[38;5;43m20221209002051183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002051183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002051183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002051183 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002051184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002051184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002051184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:52.725280 run osmo-stp_10.42.42.5(pid=578): stdout: | (launched: 2022-12-09_00:20:51.013541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:52.843935 run osmo-stp_10.42.42.5(pid=578): stderr: | [0;m[38;5;43m20221209002051183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002051183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002051183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002051183 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002051184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002051184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002051184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:52.986247 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=578): Process ended prematurely: osmo-stp_10.42.42.5(pid=578) [trial-2351↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=578)] [trial-2351↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 00:20:52.994624 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 00:20:53.020917 run osmo-hlr_10.42.42.2(pid=575): ERR: Terminated: ERROR {rc=237} [trial-2351↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=575)] 00:20:53.067978 run osmo-hlr_10.42.42.2(pid=575): stdout: | (launched: 2022-12-09_00:20:50.075115) 00:20:53.116673 run osmo-hlr_10.42.42.2(pid=575): stderr: | [0;m[1;31m20221209002050251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002050251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002050251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002050251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002050251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002050251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002050263 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002050273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002050273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002050273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:20:53.184299 run osmo-msc_10.42.42.6(pid=581): ERR: Terminated: ERROR {rc=2} [trial-2351↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=581)] 00:20:53.231112 run osmo-msc_10.42.42.6(pid=581): stdout: | (launched: 2022-12-09_00:20:52.124715) 00:20:53.279315 run osmo-msc_10.42.42.6(pid=581): stderr: | [0;m[38;5;43m20221209002052394 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209002052395 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa7949e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209002052395 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209002052395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209002052395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209002052395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209002052397 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209002052397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209002052398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209002052398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:20:53.327957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=574): Terminating (SIGTERM) 00:20:53.366768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=577): Terminating (SIGTERM) 00:20:53.405562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=580): Terminating (SIGTERM) 00:20:53.445103 --- ParallelTerminationStrategy: PID 574 died... 00:20:53.463789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=574): Terminated: ok {rc=0} 00:20:53.506778 --- ParallelTerminationStrategy: PID 577 died... 00:20:53.525141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=577): Terminated: ok {rc=0} 00:20:53.568161 --- ParallelTerminationStrategy: PID 580 died... 00:20:53.586650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=580): Terminated: ok {rc=0} 00:20:53.670615 bus /sierra_3: Setting Powered False 00:20:54.770563 bus /sierra_3: Setting Powered False 00:20:55.885847 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 00:20:56.972595 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:56.984024 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 00:20:57.033411 tst emergency_preemptive_call.py: using LAC 17773 00:20:57.161125 tst emergency_preemptive_call.py: using RAC 178 00:20:57.286813 tst emergency_preemptive_call.py: using CellId 17773 00:20:57.412895 tst emergency_preemptive_call.py: using BVCI 17774 00:20:57.529840 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:57.541372 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:57.552389 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:57.563946 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:57.575296 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:57.586921 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:57.703331 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:57.818669 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:57.936381 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:58.053481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:20:58.519179 run create_hlr_db(pid=583): Launched 00:20:58.642366 bus /sierra_2: Setting Powered False 00:20:59.702251 run create_hlr_db(pid=583): Terminated: ok {rc=0} 00:21:00.138812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=585): Launched 00:21:00.459548 run osmo-hlr_10.42.42.2(pid=586): Launched 00:21:00.582441 run osmo-stp_10.42.42.5: Starting osmo-stp 00:21:01.157670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=588): Launched 00:21:01.503825 run osmo-stp_10.42.42.5(pid=589): Launched 00:21:01.675537 tst emergency_preemptive_call.py: using MSISDN 6924 00:21:01.917238 run osmo-msc_10.42.42.6: Starting osmo-msc 00:21:02.525644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=591): Launched 00:21:02.825677 run osmo-msc_10.42.42.6(pid=592): Launched 00:21:02.992148 run osmo-stp_10.42.42.5(pid=589): ERR: Terminated: ERROR {rc=1} [trial-2351↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=589)] 00:21:03.119316 run osmo-stp_10.42.42.5(pid=589): stdout: | (launched: 2022-12-09_00:21:01.432227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:03.245731 run osmo-stp_10.42.42.5(pid=589): stderr: | [0;m[38;5;43m20221209002101781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002101781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002101782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002101782 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002101782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002101783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002101783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:03.369985 run osmo-stp_10.42.42.5(pid=589): stdout: | (launched: 2022-12-09_00:21:01.432227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:03.489323 run osmo-stp_10.42.42.5(pid=589): stderr: | [0;m[38;5;43m20221209002101781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002101781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002101782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002101782 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002101782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002101783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002101783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:03.631976 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=589): Process ended prematurely: osmo-stp_10.42.42.5(pid=589) [trial-2351↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=589)] [trial-2351↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 00:21:03.640514 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 00:21:03.666547 run osmo-hlr_10.42.42.2(pid=586): ERR: Terminated: ERROR {rc=237} [trial-2351↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=586)] 00:21:03.713544 run osmo-hlr_10.42.42.2(pid=586): stdout: | (launched: 2022-12-09_00:21:00.401355) 00:21:03.762236 run osmo-hlr_10.42.42.2(pid=586): stderr: | [0;m[1;31m20221209002100598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002100598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002100598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002100598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002100598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002100598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002100610 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002100618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002100619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002100619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:21:03.830305 run osmo-msc_10.42.42.6(pid=592): ERR: Terminated: ERROR {rc=2} [trial-2351↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=592)] 00:21:03.877042 run osmo-msc_10.42.42.6(pid=592): stdout: | (launched: 2022-12-09_00:21:02.770501) 00:21:03.925478 run osmo-msc_10.42.42.6(pid=592): stderr: | [0;m[38;5;43m20221209002103043 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209002103043 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f86fc662c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209002103043 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209002103043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209002103044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209002103044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209002103046 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209002103046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209002103046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209002103046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:21:03.974066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=585): Terminating (SIGTERM) 00:21:04.012813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=588): Terminating (SIGTERM) 00:21:04.051748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=591): Terminating (SIGTERM) 00:21:04.090815 --- ParallelTerminationStrategy: PID 585 died... 00:21:04.109750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=585): Terminated: ok {rc=0} 00:21:04.153112 --- ParallelTerminationStrategy: PID 588 died... 00:21:04.171616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=588): Terminated: ok {rc=0} 00:21:04.214948 --- ParallelTerminationStrategy: PID 591 died... 00:21:04.233403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=591): Terminated: ok {rc=0} 00:21:04.314866 bus /sierra_9: Setting Powered False 00:21:05.411662 bus /sierra_9: Setting Powered False 00:21:06.529123 bus /sierra_8: Setting Powered False 00:21:07.626409 bus /sierra_8: Setting Powered False 00:21:08.740429 bus /sierra_3: Setting Powered False 00:21:09.837059 bus /sierra_3: Setting Powered False 00:21:10.951724 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:nanobts+band-900 --------------------------------------------------------------------- 00:21:12.229566 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:21:12.235213 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 00:21:12.268832 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 00:21:12.307804 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 00:21:12.397984 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 00:21:12.429782 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 00:21:12.467980 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 00:21:13.060610 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 00:21:13.113935 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:13.124871 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 00:21:13.174003 tst cs_paging_gprs_active.py: using LAC 17774 00:21:13.302875 tst cs_paging_gprs_active.py: using RAC 179 00:21:13.429841 tst cs_paging_gprs_active.py: using CellId 17774 00:21:13.557249 tst cs_paging_gprs_active.py: using BVCI 17775 00:21:13.677894 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:13.689042 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:13.699925 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:13.710897 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:13.722378 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:13.733469 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:13.745327 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:13.756331 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:13.767368 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:13.888764 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:14.007524 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:21:14.213249 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:14.521205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=597): Launched 00:21:14.788498 run iperf3-srv_10.42.42.10(pid=598): Launched 00:21:14.903659 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:21:15.109407 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:15.417409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=599): Launched 00:21:15.683253 run iperf3-srv_10.42.42.10(pid=600): Launched 00:21:15.797601 tst cs_paging_gprs_active.py:38: start network... 00:21:16.013163 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:21:16.504189 run create_hlr_db(pid=601): Launched 00:21:16.671976 bus /sierra_2: Setting Powered False 00:21:17.735449 run create_hlr_db(pid=601): Terminated: ok {rc=0} 00:21:18.194573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=603): Launched 00:21:18.520639 run osmo-hlr_10.42.42.2(pid=604): Launched 00:21:18.646249 run osmo-stp_10.42.42.5: Starting osmo-stp 00:21:19.211012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=606): Launched 00:21:19.536382 run osmo-stp_10.42.42.5(pid=607): Launched 00:21:19.661118 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:21:20.225517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=609): Launched 00:21:20.350718 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:21:20.626119 run patchelf(pid=610): Launched 00:21:20.807531 run osmo-stp_10.42.42.5(pid=607): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=607)] 00:21:20.945242 run osmo-stp_10.42.42.5(pid=607): stdout: | (launched: 2022-12-09_00:21:19.477182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:21.083834 run osmo-stp_10.42.42.5(pid=607): stderr: | [0;m[38;5;43m20221209002119670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002119670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002119670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002119671 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002119673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002119673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002119673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:21.223141 run osmo-stp_10.42.42.5(pid=607): stdout: | (launched: 2022-12-09_00:21:19.477182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:21.357029 run osmo-stp_10.42.42.5(pid=607): stderr: | [0;m[38;5;43m20221209002119670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002119670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002119670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002119671 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002119673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002119673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002119673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:21.514768 run patchelf(pid=610): Terminating (SIGINT) 00:21:21.697180 run patchelf(pid=610): Terminated: ok {rc=0} 00:21:21.828124 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=607): Process ended prematurely: osmo-stp_10.42.42.5(pid=607) [trial-2351↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=607)] [trial-2351↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 00:21:21.838486 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 00:21:21.866763 run osmo-hlr_10.42.42.2(pid=604): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=604)] 00:21:21.916716 run osmo-hlr_10.42.42.2(pid=604): stdout: | (launched: 2022-12-09_00:21:18.461313) 00:21:21.967903 run osmo-hlr_10.42.42.2(pid=604): stderr: | [0;m[1;31m20221209002118660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002118660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002118660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002118660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002118660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002118660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002118673 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002118681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002118681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002118681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:21:22.019534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=597): Terminating (SIGTERM) 00:21:22.061460 run iperf3-srv_10.42.42.10(pid=598): Terminating (SIGTERM) 00:21:22.103038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=599): Terminating (SIGTERM) 00:21:22.144423 run iperf3-srv_10.42.42.10(pid=600): Terminating (SIGTERM) 00:21:22.185724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=603): Terminating (SIGTERM) 00:21:22.227232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=606): Terminating (SIGTERM) 00:21:22.268495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=609): Terminating (SIGTERM) 00:21:22.310350 --- ParallelTerminationStrategy: PID 597 died... 00:21:22.330024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=597): Terminated: ok {rc=0} 00:21:22.376230 --- ParallelTerminationStrategy: PID 598 died... 00:21:22.395522 run iperf3-srv_10.42.42.10(pid=598): Terminated {rc=256} 00:21:22.441500 --- ParallelTerminationStrategy: PID 599 died... 00:21:22.460789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=599): Terminated: ok {rc=0} 00:21:22.506717 --- ParallelTerminationStrategy: PID 600 died... 00:21:22.526187 run iperf3-srv_10.42.42.10(pid=600): Terminated {rc=256} 00:21:22.572056 --- ParallelTerminationStrategy: PID 603 died... 00:21:22.591698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=603): Terminated: ok {rc=0} 00:21:22.637877 --- ParallelTerminationStrategy: PID 606 died... 00:21:22.657293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=606): Terminated: ok {rc=0} 00:21:22.703341 --- ParallelTerminationStrategy: PID 609 died... 00:21:22.722653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=609): Terminated: ok {rc=0} 00:21:22.809552 bus /gobi_0: Setting Powered False 00:21:23.907846 bus /gobi_0: Setting Powered False 00:21:25.020130 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 00:21:26.168479 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:26.180105 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 00:21:26.231211 tst iperf3.py: using LAC 17775 00:21:26.357367 tst iperf3.py: using RAC 180 00:21:26.485783 tst iperf3.py: using CellId 17775 00:21:26.612910 tst iperf3.py: using BVCI 17776 00:21:26.731039 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:26.742214 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:26.753067 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:26.763890 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:26.775125 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:26.786817 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:26.798202 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:26.809310 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:26.820527 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:26.936267 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:21:27.142356 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:27.449999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=611): Launched 00:21:27.716568 run iperf3-srv_10.42.42.10(pid=612): Launched 00:21:27.831837 tst iperf3.py:8: start network... 00:21:28.037585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:21:28.512080 run create_hlr_db(pid=613): Launched 00:21:28.638100 bus /gobi_6: Setting Powered False 00:21:29.699948 run create_hlr_db(pid=613): Terminated: ok {rc=0} 00:21:30.144827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=615): Launched 00:21:30.471021 run osmo-hlr_10.42.42.2(pid=616): Launched 00:21:30.596143 run osmo-stp_10.42.42.5: Starting osmo-stp 00:21:31.174674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=618): Launched 00:21:31.502184 run osmo-stp_10.42.42.5(pid=619): Launched 00:21:31.742791 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:21:32.379286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=621): Launched 00:21:32.496921 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:21:32.756342 run patchelf(pid=622): Launched 00:21:32.926615 run osmo-stp_10.42.42.5(pid=619): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=619)] 00:21:33.056222 run osmo-stp_10.42.42.5(pid=619): stdout: | (launched: 2022-12-09_00:21:31.436726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:33.188080 run osmo-stp_10.42.42.5(pid=619): stderr: | [0;m[38;5;43m20221209002131774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002131774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002131774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002131775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002131775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002131775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002131775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:33.320336 run osmo-stp_10.42.42.5(pid=619): stdout: | (launched: 2022-12-09_00:21:31.436726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:33.446567 run osmo-stp_10.42.42.5(pid=619): stderr: | [0;m[38;5;43m20221209002131774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002131774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002131774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002131775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002131775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002131775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002131775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:33.594958 run patchelf(pid=622): Terminating (SIGINT) 00:21:33.766319 run patchelf(pid=622): Terminated: ok {rc=0} 00:21:33.889915 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=619): Process ended prematurely: osmo-stp_10.42.42.5(pid=619) [trial-2351↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=619)] [trial-2351↪gprs:nanobts+band-900↪iperf3.py:8] 00:21:33.899425 tst iperf3.py:8: Test FAILED (7.8 sec) 00:21:33.926633 run osmo-hlr_10.42.42.2(pid=616): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=616)] 00:21:33.973641 run osmo-hlr_10.42.42.2(pid=616): stdout: | (launched: 2022-12-09_00:21:30.411817) 00:21:34.022292 run osmo-hlr_10.42.42.2(pid=616): stderr: | [0;m[1;31m20221209002130612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002130612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002130612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002130612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002130612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002130612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002130634 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002130643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002130643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002130643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:21:34.071566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=611): Terminating (SIGTERM) 00:21:34.111346 run iperf3-srv_10.42.42.10(pid=612): Terminating (SIGTERM) 00:21:34.150914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=615): Terminating (SIGTERM) 00:21:34.190396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=618): Terminating (SIGTERM) 00:21:34.230020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=621): Terminating (SIGTERM) 00:21:34.269969 --- ParallelTerminationStrategy: PID 611 died... 00:21:34.289050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=611): Terminated: ok {rc=0} 00:21:34.333118 --- ParallelTerminationStrategy: PID 612 died... 00:21:34.351768 run iperf3-srv_10.42.42.10(pid=612): Terminated {rc=256} 00:21:34.395639 --- ParallelTerminationStrategy: PID 615 died... 00:21:34.414325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=615): Terminated: ok {rc=0} 00:21:34.457972 --- ParallelTerminationStrategy: PID 618 died... 00:21:34.476462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=618): Terminated: ok {rc=0} 00:21:34.520087 --- ParallelTerminationStrategy: PID 621 died... 00:21:34.538781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=621): Terminated: ok {rc=0} 00:21:34.623724 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 00:21:35.775620 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:35.787262 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 00:21:35.835841 tst iperf3m4.py: using LAC 17776 00:21:35.964168 tst iperf3m4.py: using RAC 181 00:21:36.091382 tst iperf3m4.py: using CellId 17776 00:21:36.218843 tst iperf3m4.py: using BVCI 17777 00:21:36.338462 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:36.349716 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:36.360554 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:36.371561 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:36.382692 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:36.394044 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:36.405017 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:36.415713 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:36.427260 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:36.547552 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:36.666054 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:36.784208 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:36.902925 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:21:37.108173 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:37.416463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=623): Launched 00:21:37.683864 run iperf3-srv_10.42.42.10(pid=624): Launched 00:21:37.798952 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:21:38.003366 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:38.309835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=625): Launched 00:21:38.576229 run iperf3-srv_10.42.42.10(pid=626): Launched 00:21:38.691230 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:21:38.896205 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:39.203357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=627): Launched 00:21:39.470278 run iperf3-srv_10.42.42.10(pid=628): Launched 00:21:39.585173 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:21:39.790270 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:40.097993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=629): Launched 00:21:40.364332 run iperf3-srv_10.42.42.10(pid=630): Launched 00:21:40.479375 tst iperf3m4.py:8: start network... 00:21:40.684701 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:21:41.159636 run create_hlr_db(pid=631): Launched 00:21:41.285396 bus /gobi_6: Setting Powered False 00:21:42.346497 run create_hlr_db(pid=631): Terminated: ok {rc=0} 00:21:42.791877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=633): Launched 00:21:43.119961 run osmo-hlr_10.42.42.2(pid=634): Launched 00:21:43.244284 run osmo-stp_10.42.42.5: Starting osmo-stp 00:21:43.810902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=636): Launched 00:21:44.138874 run osmo-stp_10.42.42.5(pid=637): Launched 00:21:44.263680 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:21:44.828200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=639): Launched 00:21:44.953990 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:21:45.230139 run patchelf(pid=640): Launched 00:21:45.412116 run osmo-stp_10.42.42.5(pid=637): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=637)] 00:21:45.550065 run osmo-stp_10.42.42.5(pid=637): stdout: | (launched: 2022-12-09_00:21:44.078930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:45.690614 run osmo-stp_10.42.42.5(pid=637): stderr: | [0;m[38;5;43m20221209002144271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002144271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002144271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002144272 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002144272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002144272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002144272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:45.840633 run osmo-stp_10.42.42.5(pid=637): stdout: | (launched: 2022-12-09_00:21:44.078930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:45.999690 run osmo-stp_10.42.42.5(pid=637): stderr: | [0;m[38;5;43m20221209002144271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002144271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002144271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002144272 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002144272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002144272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002144272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:46.166639 run patchelf(pid=640): Terminating (SIGINT) 00:21:46.352461 run patchelf(pid=640): Terminated: ok {rc=0} 00:21:46.486615 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=637): Process ended prematurely: osmo-stp_10.42.42.5(pid=637) [trial-2351↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=637)] [trial-2351↪gprs:nanobts+band-900↪iperf3m4.py:8] 00:21:46.497288 tst iperf3m4.py:8: Test FAILED (10.8 sec) 00:21:46.527613 run osmo-hlr_10.42.42.2(pid=634): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=634)] 00:21:46.579113 run osmo-hlr_10.42.42.2(pid=634): stdout: | (launched: 2022-12-09_00:21:43.059871) 00:21:46.632252 run osmo-hlr_10.42.42.2(pid=634): stderr: | [0;m[1;31m20221209002143258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002143258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002143258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002143258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002143258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002143259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002143271 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002143279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002143280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002143280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:21:46.685966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=623): Terminating (SIGTERM) 00:21:46.729125 run iperf3-srv_10.42.42.10(pid=624): Terminating (SIGTERM) 00:21:46.774749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=625): Terminating (SIGTERM) 00:21:46.818508 run iperf3-srv_10.42.42.10(pid=626): Terminating (SIGTERM) 00:21:46.863830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=627): Terminating (SIGTERM) 00:21:46.907364 run iperf3-srv_10.42.42.10(pid=628): Terminating (SIGTERM) 00:21:46.950527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=629): Terminating (SIGTERM) 00:21:46.993213 run iperf3-srv_10.42.42.10(pid=630): Terminating (SIGTERM) 00:21:47.036249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=633): Terminating (SIGTERM) 00:21:47.079123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=636): Terminating (SIGTERM) 00:21:47.123538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=639): Terminating (SIGTERM) 00:21:47.167655 --- ParallelTerminationStrategy: PID 623 died... 00:21:47.186862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=623): Terminated: ok {rc=0} 00:21:47.231935 --- ParallelTerminationStrategy: PID 624 died... 00:21:47.250563 run iperf3-srv_10.42.42.10(pid=624): Terminated {rc=256} 00:21:47.295507 --- ParallelTerminationStrategy: PID 625 died... 00:21:47.314187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=625): Terminated: ok {rc=0} 00:21:47.358778 --- ParallelTerminationStrategy: PID 626 died... 00:21:47.377305 run iperf3-srv_10.42.42.10(pid=626): Terminated {rc=256} 00:21:47.422301 --- ParallelTerminationStrategy: PID 627 died... 00:21:47.441323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=627): Terminated: ok {rc=0} 00:21:47.486231 --- ParallelTerminationStrategy: PID 628 died... 00:21:47.504531 run iperf3-srv_10.42.42.10(pid=628): Terminated {rc=256} 00:21:47.549461 --- ParallelTerminationStrategy: PID 629 died... 00:21:47.567992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=629): Terminated: ok {rc=0} 00:21:47.613053 --- ParallelTerminationStrategy: PID 630 died... 00:21:47.631592 run iperf3-srv_10.42.42.10(pid=630): Terminated {rc=256} 00:21:47.676276 --- ParallelTerminationStrategy: PID 633 died... 00:21:47.694796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=633): Terminated: ok {rc=0} 00:21:47.739413 --- ParallelTerminationStrategy: PID 636 died... 00:21:47.757920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=636): Terminated: ok {rc=0} 00:21:47.802545 --- ParallelTerminationStrategy: PID 639 died... 00:21:47.821231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=639): Terminated: ok {rc=0} 00:21:47.906547 bus /gobi_4: Setting Powered False 00:21:49.007651 bus /gobi_4: Setting Powered False 00:21:50.122950 bus /gobi_1: Setting Powered False 00:21:51.221856 bus /gobi_1: Setting Powered False 00:21:52.336050 bus /gobi_0: Setting Powered False 00:21:53.433880 bus /gobi_0: Setting Powered False 00:21:54.549614 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-900 ping.py ---------------------------------------------- 00:21:55.652038 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:55.663209 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 00:21:55.711073 tst ping.py: using LAC 17777 00:21:55.831044 tst ping.py: using RAC 182 00:21:55.950363 tst ping.py: using CellId 17777 00:21:56.068220 tst ping.py: using BVCI 17778 00:21:56.176587 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:56.187209 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:56.197699 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:56.208063 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:56.218494 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:56.228778 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:56.239224 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:56.249613 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:56.362099 tst ping.py:19: start network... 00:21:56.562244 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:21:57.025574 run create_hlr_db(pid=641): Launched 00:21:57.146853 bus /gobi_6: Setting Powered False 00:21:58.206377 run create_hlr_db(pid=641): Terminated: ok {rc=0} 00:21:58.643244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=643): Launched 00:21:58.946997 run osmo-hlr_10.42.42.2(pid=644): Launched 00:21:59.059986 run osmo-stp_10.42.42.5: Starting osmo-stp 00:21:59.578091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=646): Launched 00:21:59.878014 run osmo-stp_10.42.42.5(pid=647): Launched 00:21:59.990919 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:22:00.507675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=649): Launched 00:22:00.622317 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:22:00.888146 run patchelf(pid=650): Launched 00:22:01.074726 run osmo-stp_10.42.42.5(pid=647): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=647)] 00:22:01.203859 run osmo-stp_10.42.42.5(pid=647): stdout: | (launched: 2022-12-09_00:21:59.822939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:01.335119 run osmo-stp_10.42.42.5(pid=647): stderr: | [0;m[38;5;43m20221209002159993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002159993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002159994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002159994 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002159995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002159995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002159995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:01.466592 run osmo-stp_10.42.42.5(pid=647): stdout: | (launched: 2022-12-09_00:21:59.822939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:01.593277 run osmo-stp_10.42.42.5(pid=647): stderr: | [0;m[38;5;43m20221209002159993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002159993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002159994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002159994 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002159995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002159995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002159995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:01.741760 run patchelf(pid=650): Terminating (SIGINT) 00:22:01.913402 run patchelf(pid=650): Terminated: ok {rc=0} 00:22:02.036337 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=647): Process ended prematurely: osmo-stp_10.42.42.5(pid=647) [trial-2351↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=647)] [trial-2351↪gprs:nanobts+band-900↪ping.py:22] 00:22:02.045801 tst ping.py:22: Test FAILED (6.4 sec) 00:22:02.073593 run osmo-hlr_10.42.42.2(pid=644): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=644)] 00:22:02.121153 run osmo-hlr_10.42.42.2(pid=644): stdout: | (launched: 2022-12-09_00:21:58.892328) 00:22:02.170178 run osmo-hlr_10.42.42.2(pid=644): stderr: | [0;m[1;31m20221209002159067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002159067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002159067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002159067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002159067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002159067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002159083 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002159092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002159093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002159093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:22:02.219650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=643): Terminating (SIGTERM) 00:22:02.258659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=646): Terminating (SIGTERM) 00:22:02.297652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=649): Terminating (SIGTERM) 00:22:02.337187 --- ParallelTerminationStrategy: PID 643 died... 00:22:02.356017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=643): Terminated: ok {rc=0} 00:22:02.399642 --- ParallelTerminationStrategy: PID 646 died... 00:22:02.418217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=646): Terminated: ok {rc=0} 00:22:02.461703 --- ParallelTerminationStrategy: PID 649 died... 00:22:02.480283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=649): Terminated: ok {rc=0} 00:22:02.563308 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 00:22:03.649973 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:22:03.662328 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 00:22:03.713640 tst ping_idle_ping.py: using LAC 17778 00:22:03.834081 tst ping_idle_ping.py: using RAC 183 00:22:03.953136 tst ping_idle_ping.py: using CellId 17778 00:22:04.078953 tst ping_idle_ping.py: using BVCI 17779 00:22:04.195802 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:22:04.207191 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:22:04.218452 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:22:04.230091 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:22:04.241629 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:22:04.252856 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:22:04.264461 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:22:04.276523 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:22:04.395008 tst ping_idle_ping.py:24: start network... 00:22:04.612050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:22:05.112400 run create_hlr_db(pid=651): Launched 00:22:05.234544 bus /gobi_6: Setting Powered False 00:22:06.298105 run create_hlr_db(pid=651): Terminated: ok {rc=0} 00:22:06.745617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=653): Launched 00:22:07.066096 run osmo-hlr_10.42.42.2(pid=654): Launched 00:22:07.188419 run osmo-stp_10.42.42.5: Starting osmo-stp 00:22:07.739416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=656): Launched 00:22:08.060317 run osmo-stp_10.42.42.5(pid=657): Launched 00:22:08.182553 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:22:08.738048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=659): Launched 00:22:08.860299 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:22:09.130277 run patchelf(pid=660): Launched 00:22:09.308154 run osmo-stp_10.42.42.5(pid=657): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=657)] 00:22:09.443623 run osmo-stp_10.42.42.5(pid=657): stdout: | (launched: 2022-12-09_00:22:08.001691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:09.581042 run osmo-stp_10.42.42.5(pid=657): stderr: | [0;m[38;5;43m20221209002208215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002208215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002208215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002208216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002208216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002208216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002208216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:09.719108 run osmo-stp_10.42.42.5(pid=657): stdout: | (launched: 2022-12-09_00:22:08.001691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:09.849991 run osmo-stp_10.42.42.5(pid=657): stderr: | [0;m[38;5;43m20221209002208215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002208215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002208215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002208216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002208216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002208216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002208216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:10.005422 run patchelf(pid=660): Terminating (SIGINT) 00:22:10.184339 run patchelf(pid=660): Terminated: ok {rc=0} 00:22:10.314015 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=657): Process ended prematurely: osmo-stp_10.42.42.5(pid=657) [trial-2351↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=657)] [trial-2351↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 00:22:10.323526 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 00:22:10.351836 run osmo-hlr_10.42.42.2(pid=654): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=654)] 00:22:10.401180 run osmo-hlr_10.42.42.2(pid=654): stdout: | (launched: 2022-12-09_00:22:07.007805) 00:22:10.452480 run osmo-hlr_10.42.42.2(pid=654): stderr: | [0;m[1;31m20221209002207206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002207206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002207206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002207206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002207206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002207206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002207261 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002207271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002207271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002207271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:22:10.504172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=653): Terminating (SIGTERM) 00:22:10.545883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=656): Terminating (SIGTERM) 00:22:10.587225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=659): Terminating (SIGTERM) 00:22:10.630177 --- ParallelTerminationStrategy: PID 653 died... 00:22:10.650032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=653): Terminated: ok {rc=0} 00:22:10.696525 --- ParallelTerminationStrategy: PID 656 died... 00:22:10.716006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=656): Terminated: ok {rc=0} 00:22:10.762611 --- ParallelTerminationStrategy: PID 659 died... 00:22:10.782131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=659): Terminated: ok {rc=0} 00:22:10.868987 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 00:22:12.167352 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:22:12.173386 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 00:22:12.205187 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 00:22:12.243016 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 00:22:12.328260 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 00:22:12.359722 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 00:22:12.397323 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 00:22:12.995264 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 00:22:13.044398 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:13.055156 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:22:13.107651 tst cs_paging_gprs_active.py: using LAC 17779 00:22:13.236025 tst cs_paging_gprs_active.py: using RAC 184 00:22:13.357490 tst cs_paging_gprs_active.py: using CellId 17779 00:22:13.485364 tst cs_paging_gprs_active.py: using BVCI 17780 00:22:13.603687 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:13.615595 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:13.626878 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:13.638609 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:13.650604 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:13.662360 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:13.674282 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:13.685908 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:13.697929 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:13.813829 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:13.932717 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:22:14.154560 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:14.481893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=664): Launched 00:22:14.765451 run iperf3-srv_10.42.42.10(pid=665): Launched 00:22:14.887388 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:22:15.107161 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:15.419449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=666): Launched 00:22:15.686056 run iperf3-srv_10.42.42.10(pid=667): Launched 00:22:15.800391 tst cs_paging_gprs_active.py:38: start network... 00:22:16.009499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:22:16.501214 run create_hlr_db(pid=668): Launched 00:22:16.662272 bus /gobi_6: Setting Powered False 00:22:17.722441 run create_hlr_db(pid=668): Terminated: ok {rc=0} 00:22:18.169244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=670): Launched 00:22:18.495474 run osmo-hlr_10.42.42.2(pid=671): Launched 00:22:18.621563 run osmo-stp_10.42.42.5: Starting osmo-stp 00:22:19.182498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=673): Launched 00:22:19.508293 run osmo-stp_10.42.42.5(pid=674): Launched 00:22:19.633934 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:22:20.197640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=676): Launched 00:22:20.321961 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:22:20.597259 run patchelf(pid=677): Launched 00:22:20.778976 run osmo-stp_10.42.42.5(pid=674): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=674)] 00:22:20.916522 run osmo-stp_10.42.42.5(pid=674): stdout: | (launched: 2022-12-09_00:22:19.448930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:21.055302 run osmo-stp_10.42.42.5(pid=674): stderr: | [0;m[38;5;43m20221209002219645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002219645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002219645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002219645 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002219646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002219646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002219646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:21.194214 run osmo-stp_10.42.42.5(pid=674): stdout: | (launched: 2022-12-09_00:22:19.448930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:21.327729 run osmo-stp_10.42.42.5(pid=674): stderr: | [0;m[38;5;43m20221209002219645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002219645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002219645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002219645 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002219646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002219646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002219646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:21.486021 run patchelf(pid=677): Terminating (SIGINT) 00:22:21.668864 run patchelf(pid=677): Terminated: ok {rc=0} 00:22:21.800783 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=674): Process ended prematurely: osmo-stp_10.42.42.5(pid=674) [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=674)] [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 00:22:21.811136 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 00:22:21.840016 run osmo-hlr_10.42.42.2(pid=671): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=671)] 00:22:21.889552 run osmo-hlr_10.42.42.2(pid=671): stdout: | (launched: 2022-12-09_00:22:18.436058) 00:22:21.940935 run osmo-hlr_10.42.42.2(pid=671): stderr: | [0;m[1;31m20221209002218636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002218636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002218636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002218636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002218637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002218637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002218650 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002218658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002218658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002218658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:22:21.992781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=664): Terminating (SIGTERM) 00:22:22.034497 run iperf3-srv_10.42.42.10(pid=665): Terminating (SIGTERM) 00:22:22.075993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=666): Terminating (SIGTERM) 00:22:22.117696 run iperf3-srv_10.42.42.10(pid=667): Terminating (SIGTERM) 00:22:22.159145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=670): Terminating (SIGTERM) 00:22:22.200504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=673): Terminating (SIGTERM) 00:22:22.242329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=676): Terminating (SIGTERM) 00:22:22.284421 --- ParallelTerminationStrategy: PID 664 died... 00:22:22.304224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=664): Terminated: ok {rc=0} 00:22:22.350276 --- ParallelTerminationStrategy: PID 665 died... 00:22:22.369439 run iperf3-srv_10.42.42.10(pid=665): Terminated {rc=256} 00:22:22.415061 --- ParallelTerminationStrategy: PID 666 died... 00:22:22.434433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=666): Terminated: ok {rc=0} 00:22:22.480221 --- ParallelTerminationStrategy: PID 667 died... 00:22:22.499340 run iperf3-srv_10.42.42.10(pid=667): Terminated {rc=256} 00:22:22.545158 --- ParallelTerminationStrategy: PID 670 died... 00:22:22.564384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=670): Terminated: ok {rc=0} 00:22:22.610091 --- ParallelTerminationStrategy: PID 673 died... 00:22:22.629692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=673): Terminated: ok {rc=0} 00:22:22.675754 --- ParallelTerminationStrategy: PID 676 died... 00:22:22.695186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=676): Terminated: ok {rc=0} 00:22:22.781705 bus /gobi_0: Setting Powered False 00:22:23.879549 bus /gobi_0: Setting Powered False 00:22:24.992941 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 00:22:26.138106 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:26.149669 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:22:26.201476 tst iperf3.py: using LAC 17780 00:22:26.323471 tst iperf3.py: using RAC 185 00:22:26.445075 tst iperf3.py: using CellId 17780 00:22:26.564383 tst iperf3.py: using BVCI 17781 00:22:26.684791 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:26.696192 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:26.707308 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:26.719180 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:26.730921 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:26.742643 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:26.754547 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:26.766409 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:26.778338 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:26.898423 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:22:27.119013 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:27.445601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=678): Launched 00:22:27.730597 run iperf3-srv_10.42.42.10(pid=679): Launched 00:22:27.854003 tst iperf3.py:8: start network... 00:22:28.074898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:22:28.581673 run create_hlr_db(pid=680): Launched 00:22:28.706356 bus /gobi_6: Setting Powered False 00:22:29.770697 run create_hlr_db(pid=680): Terminated: ok {rc=0} 00:22:30.206765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=682): Launched 00:22:30.533507 run osmo-hlr_10.42.42.2(pid=683): Launched 00:22:30.659392 run osmo-stp_10.42.42.5: Starting osmo-stp 00:22:31.251674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=685): Launched 00:22:31.589708 run osmo-stp_10.42.42.5(pid=686): Launched 00:22:31.807906 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:22:32.432375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=688): Launched 00:22:32.557758 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:22:32.833471 run patchelf(pid=689): Launched 00:22:33.014681 run osmo-stp_10.42.42.5(pid=686): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=686)] 00:22:33.152210 run osmo-stp_10.42.42.5(pid=686): stdout: | (launched: 2022-12-09_00:22:31.523919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:33.291388 run osmo-stp_10.42.42.5(pid=686): stderr: | [0;m[38;5;43m20221209002231727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002231727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002231727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002231728 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002231728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002231728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002231737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:33.431107 run osmo-stp_10.42.42.5(pid=686): stdout: | (launched: 2022-12-09_00:22:31.523919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:33.564127 run osmo-stp_10.42.42.5(pid=686): stderr: | [0;m[38;5;43m20221209002231727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002231727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002231727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002231728 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002231728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002231728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002231737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:33.722391 run patchelf(pid=689): Terminating (SIGINT) 00:22:33.904411 run patchelf(pid=689): Terminated: ok {rc=0} 00:22:34.035725 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=686): Process ended prematurely: osmo-stp_10.42.42.5(pid=686) [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=686)] [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 00:22:34.046038 tst iperf3.py:8: Test FAILED (7.9 sec) 00:22:34.075037 run osmo-hlr_10.42.42.2(pid=683): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=683)] 00:22:34.124633 run osmo-hlr_10.42.42.2(pid=683): stdout: | (launched: 2022-12-09_00:22:30.474022) 00:22:34.176085 run osmo-hlr_10.42.42.2(pid=683): stderr: | [0;m[1;31m20221209002230674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002230674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002230674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002230674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002230674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002230674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002230687 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002230696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002230696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002230696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:22:34.227944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=678): Terminating (SIGTERM) 00:22:34.269476 run iperf3-srv_10.42.42.10(pid=679): Terminating (SIGTERM) 00:22:34.310894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=682): Terminating (SIGTERM) 00:22:34.352506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=685): Terminating (SIGTERM) 00:22:34.393830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=688): Terminating (SIGTERM) 00:22:34.435724 --- ParallelTerminationStrategy: PID 678 died... 00:22:34.455471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=678): Terminated: ok {rc=0} 00:22:34.501548 --- ParallelTerminationStrategy: PID 679 died... 00:22:34.520592 run iperf3-srv_10.42.42.10(pid=679): Terminated {rc=256} 00:22:34.566416 --- ParallelTerminationStrategy: PID 682 died... 00:22:34.585641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=682): Terminated: ok {rc=0} 00:22:34.632193 --- ParallelTerminationStrategy: PID 685 died... 00:22:34.651471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=685): Terminated: ok {rc=0} 00:22:34.697414 --- ParallelTerminationStrategy: PID 688 died... 00:22:34.716585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=688): Terminated: ok {rc=0} 00:22:34.803123 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 00:22:35.953636 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:35.965661 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:22:36.020608 tst iperf3m4.py: using LAC 17781 00:22:36.147490 tst iperf3m4.py: using RAC 186 00:22:36.267696 tst iperf3m4.py: using CellId 17781 00:22:36.385716 tst iperf3m4.py: using BVCI 17782 00:22:36.501712 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:36.512449 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:36.523118 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:36.533711 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:36.544106 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:36.554614 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:36.565438 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:36.575845 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:36.586586 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:36.704310 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:36.822244 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:36.941834 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:37.060504 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:22:37.265781 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:37.571390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=692): Launched 00:22:37.837731 run iperf3-srv_10.42.42.10(pid=693): Launched 00:22:37.952653 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:22:38.157259 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:38.463397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=694): Launched 00:22:38.729686 run iperf3-srv_10.42.42.10(pid=695): Launched 00:22:38.844524 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:22:39.048923 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:39.355615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=696): Launched 00:22:39.622258 run iperf3-srv_10.42.42.10(pid=697): Launched 00:22:39.736831 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:22:39.942372 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:40.249603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=698): Launched 00:22:40.516217 run iperf3-srv_10.42.42.10(pid=699): Launched 00:22:40.631215 tst iperf3m4.py:8: start network... 00:22:40.836513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:22:41.310850 run create_hlr_db(pid=700): Launched 00:22:41.436432 bus /gobi_6: Setting Powered False 00:22:42.497523 run create_hlr_db(pid=700): Terminated: ok {rc=0} 00:22:42.941677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=702): Launched 00:22:43.266788 run osmo-hlr_10.42.42.2(pid=703): Launched 00:22:43.391004 run osmo-stp_10.42.42.5: Starting osmo-stp 00:22:43.954542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=705): Launched 00:22:44.281416 run osmo-stp_10.42.42.5(pid=706): Launched 00:22:44.406750 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:22:44.969730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=708): Launched 00:22:45.094633 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:22:45.369633 run patchelf(pid=709): Launched 00:22:45.550420 run osmo-stp_10.42.42.5(pid=706): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=706)] 00:22:45.688542 run osmo-stp_10.42.42.5(pid=706): stdout: | (launched: 2022-12-09_00:22:44.221994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:45.828091 run osmo-stp_10.42.42.5(pid=706): stderr: | [0;m[38;5;43m20221209002244416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002244416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002244417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002244417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002244418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002244418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002244418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:45.970196 run osmo-stp_10.42.42.5(pid=706): stdout: | (launched: 2022-12-09_00:22:44.221994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:46.105903 run osmo-stp_10.42.42.5(pid=706): stderr: | [0;m[38;5;43m20221209002244416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002244416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002244417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002244417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002244418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002244418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002244418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:46.265996 run patchelf(pid=709): Terminating (SIGINT) 00:22:46.451422 run patchelf(pid=709): Terminated: ok {rc=0} 00:22:46.585909 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=706): Process ended prematurely: osmo-stp_10.42.42.5(pid=706) [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=706)] [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 00:22:46.597038 tst iperf3m4.py:8: Test FAILED (10.7 sec) 00:22:46.629693 run osmo-hlr_10.42.42.2(pid=703): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=703)] 00:22:46.681831 run osmo-hlr_10.42.42.2(pid=703): stdout: | (launched: 2022-12-09_00:22:43.207558) 00:22:46.735678 run osmo-hlr_10.42.42.2(pid=703): stderr: | [0;m[1;31m20221209002243406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002243406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002243407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002243407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002243407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002243407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002243420 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002243428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002243428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002243429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:22:46.790359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=692): Terminating (SIGTERM) 00:22:46.834995 run iperf3-srv_10.42.42.10(pid=693): Terminating (SIGTERM) 00:22:46.881852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=694): Terminating (SIGTERM) 00:22:46.926558 run iperf3-srv_10.42.42.10(pid=695): Terminating (SIGTERM) 00:22:46.973509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=696): Terminating (SIGTERM) 00:22:47.018248 run iperf3-srv_10.42.42.10(pid=697): Terminating (SIGTERM) 00:22:47.065283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=698): Terminating (SIGTERM) 00:22:47.110234 run iperf3-srv_10.42.42.10(pid=699): Terminating (SIGTERM) 00:22:47.156912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=702): Terminating (SIGTERM) 00:22:47.201178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=705): Terminating (SIGTERM) 00:22:47.245658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=708): Terminating (SIGTERM) 00:22:47.289182 --- ParallelTerminationStrategy: PID 692 died... 00:22:47.311031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=692): Terminated: ok {rc=0} 00:22:47.354755 --- ParallelTerminationStrategy: PID 693 died... 00:22:47.373625 run iperf3-srv_10.42.42.10(pid=693): Terminated {rc=256} 00:22:47.418067 --- ParallelTerminationStrategy: PID 694 died... 00:22:47.436524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=694): Terminated: ok {rc=0} 00:22:47.479787 --- ParallelTerminationStrategy: PID 695 died... 00:22:47.498136 run iperf3-srv_10.42.42.10(pid=695): Terminated {rc=256} 00:22:47.541234 --- ParallelTerminationStrategy: PID 696 died... 00:22:47.559572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=696): Terminated: ok {rc=0} 00:22:47.603515 --- ParallelTerminationStrategy: PID 697 died... 00:22:47.622135 run iperf3-srv_10.42.42.10(pid=697): Terminated {rc=256} 00:22:47.665212 --- ParallelTerminationStrategy: PID 698 died... 00:22:47.683687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=698): Terminated: ok {rc=0} 00:22:47.727405 --- ParallelTerminationStrategy: PID 699 died... 00:22:47.746045 run iperf3-srv_10.42.42.10(pid=699): Terminated {rc=256} 00:22:47.789305 --- ParallelTerminationStrategy: PID 702 died... 00:22:47.807809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=702): Terminated: ok {rc=0} 00:22:47.851122 --- ParallelTerminationStrategy: PID 705 died... 00:22:47.869620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=705): Terminated: ok {rc=0} 00:22:47.912724 --- ParallelTerminationStrategy: PID 708 died... 00:22:47.931579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=708): Terminated: ok {rc=0} 00:22:48.015978 bus /gobi_4: Setting Powered False 00:22:49.115909 bus /gobi_4: Setting Powered False 00:22:50.230993 bus /gobi_1: Setting Powered False 00:22:51.329221 bus /gobi_1: Setting Powered False 00:22:52.443649 bus /gobi_0: Setting Powered False 00:22:53.541302 bus /gobi_0: Setting Powered False 00:22:54.655268 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 00:22:55.757731 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:55.769260 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:22:55.818604 tst ping.py: using LAC 17782 00:22:55.944269 tst ping.py: using RAC 187 00:22:56.070589 tst ping.py: using CellId 17782 00:22:56.195465 tst ping.py: using BVCI 17783 00:22:56.313247 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:56.324472 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:56.335738 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:56.347118 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:56.358427 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:56.369854 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:56.381537 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:56.392740 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:56.509145 tst ping.py:19: start network... 00:22:56.711599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:22:57.176656 run create_hlr_db(pid=710): Launched 00:22:57.299863 bus /gobi_6: Setting Powered False 00:22:58.359503 run create_hlr_db(pid=710): Terminated: ok {rc=0} 00:22:58.798585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=712): Launched 00:22:59.121090 run osmo-hlr_10.42.42.2(pid=713): Launched 00:22:59.243878 run osmo-stp_10.42.42.5: Starting osmo-stp 00:22:59.803127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=715): Launched 00:23:00.123731 run osmo-stp_10.42.42.5(pid=716): Launched 00:23:00.245930 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:23:00.801752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=718): Launched 00:23:00.934390 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:23:01.214754 run patchelf(pid=719): Launched 00:23:01.431642 run osmo-stp_10.42.42.5(pid=716): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=716)] 00:23:01.586755 run osmo-stp_10.42.42.5(pid=716): stdout: | (launched: 2022-12-09_00:23:00.065326) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:01.753330 run osmo-stp_10.42.42.5(pid=716): stderr: | [0;m[38;5;43m20221209002300257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002300257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002300257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002300257 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002300258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002300258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002300258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:01.899583 run osmo-stp_10.42.42.5(pid=716): stdout: | (launched: 2022-12-09_00:23:00.065326) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:02.034836 run osmo-stp_10.42.42.5(pid=716): stderr: | [0;m[38;5;43m20221209002300257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002300257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002300257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002300257 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002300258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002300258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002300258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:02.212660 run patchelf(pid=719): Terminating (SIGINT) 00:23:02.410214 run patchelf(pid=719): Terminated: ok {rc=0} 00:23:02.542796 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=716): Process ended prematurely: osmo-stp_10.42.42.5(pid=716) [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=716)] [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 00:23:02.553469 tst ping.py:22: Test FAILED (6.8 sec) 00:23:02.586684 run osmo-hlr_10.42.42.2(pid=713): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=713)] 00:23:02.641896 run osmo-hlr_10.42.42.2(pid=713): stdout: | (launched: 2022-12-09_00:22:59.061640) 00:23:02.702767 run osmo-hlr_10.42.42.2(pid=713): stderr: | [0;m[1;31m20221209002259261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002259261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002259261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002259261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002259261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002259261 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002259273 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002259281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002259281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002259281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:23:02.761926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=712): Terminating (SIGTERM) 00:23:02.814374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=715): Terminating (SIGTERM) 00:23:02.859544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=718): Terminating (SIGTERM) 00:23:02.910052 --- ParallelTerminationStrategy: PID 712 died... 00:23:02.932157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=712): Terminated: ok {rc=0} 00:23:02.982171 --- ParallelTerminationStrategy: PID 715 died... 00:23:03.007364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=715): Terminated: ok {rc=0} 00:23:03.066077 --- ParallelTerminationStrategy: PID 718 died... 00:23:03.088739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=718): Terminated: ok {rc=0} 00:23:03.186800 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 00:23:04.286090 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:23:04.299308 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:23:04.351488 tst ping_idle_ping.py: using LAC 17783 00:23:04.478745 tst ping_idle_ping.py: using RAC 188 00:23:04.609054 tst ping_idle_ping.py: using CellId 17783 00:23:04.739104 tst ping_idle_ping.py: using BVCI 17784 00:23:04.862666 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:23:04.875329 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:23:04.887991 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:23:04.902509 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:23:04.915747 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:23:04.929278 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:23:04.942759 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:23:04.955115 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:23:05.083180 tst ping_idle_ping.py:24: start network... 00:23:05.306843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:23:05.827444 run create_hlr_db(pid=1018): Launched 00:23:05.990814 bus /gobi_6: Setting Powered False 00:23:07.055949 run create_hlr_db(pid=1018): Terminated: ok {rc=0} 00:23:07.517611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1022): Launched 00:23:07.864467 run osmo-hlr_10.42.42.2(pid=1023): Launched 00:23:08.097606 run osmo-stp_10.42.42.5: Starting osmo-stp 00:23:08.818064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1025): Launched 00:23:09.156608 run osmo-stp_10.42.42.5(pid=1026): Launched 00:23:09.403542 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:23:10.062372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1028): Launched 00:23:10.199028 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:23:10.482308 run patchelf(pid=1029): Launched 00:23:10.680319 run osmo-stp_10.42.42.5(pid=1026): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1026)] 00:23:10.823887 run osmo-stp_10.42.42.5(pid=1026): stdout: | (launched: 2022-12-09_00:23:09.092893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:10.966031 run osmo-stp_10.42.42.5(pid=1026): stderr: | [0;m[38;5;43m20221209002309394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002309394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002309395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002309395 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002309395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002309396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002309396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:11.109685 run osmo-stp_10.42.42.5(pid=1026): stdout: | (launched: 2022-12-09_00:23:09.092893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:11.246147 run osmo-stp_10.42.42.5(pid=1026): stderr: | [0;m[38;5;43m20221209002309394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002309394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002309395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002309395 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002309395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002309396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002309396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:11.406846 run patchelf(pid=1029): Terminating (SIGINT) 00:23:11.594148 run patchelf(pid=1029): Terminated: ok {rc=0} 00:23:11.731269 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1026): Process ended prematurely: osmo-stp_10.42.42.5(pid=1026) [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1026)] [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 00:23:11.741936 tst ping_idle_ping.py:27: Test FAILED (7.4 sec) 00:23:11.773244 run osmo-hlr_10.42.42.2(pid=1023): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1023)] 00:23:11.829353 run osmo-hlr_10.42.42.2(pid=1023): stdout: | (launched: 2022-12-09_00:23:07.799552) 00:23:11.883946 run osmo-hlr_10.42.42.2(pid=1023): stderr: | [0;m[1;31m20221209002308145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002308145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002308145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002308145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002308145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002308145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002308163 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002308179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002308180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002308180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:23:11.938998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1022): Terminating (SIGTERM) 00:23:11.984513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1025): Terminating (SIGTERM) 00:23:12.032622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1028): Terminating (SIGTERM) 00:23:12.079266 --- ParallelTerminationStrategy: PID 1022 died... 00:23:12.100418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1022): Terminated: ok {rc=0} 00:23:12.151778 --- ParallelTerminationStrategy: PID 1025 died... 00:23:12.172498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1025): Terminated: ok {rc=0} 00:23:12.223866 --- ParallelTerminationStrategy: PID 1028 died... 00:23:12.244569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1028): Terminated: ok {rc=0} 00:23:12.336745 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 00:23:13.652409 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:23:13.660896 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 00:23:13.699726 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 00:23:13.741875 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 00:23:13.834233 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 00:23:13.869572 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 00:23:13.911462 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 00:23:14.508651 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 00:23:14.565536 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:14.577924 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:23:14.649787 tst cs_paging_gprs_active.py: using LAC 17784 00:23:14.782352 tst cs_paging_gprs_active.py: using RAC 189 00:23:14.916690 tst cs_paging_gprs_active.py: using CellId 17784 00:23:15.050458 tst cs_paging_gprs_active.py: using BVCI 17785 00:23:15.173066 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:15.185413 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:15.197900 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:15.211724 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:15.225089 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:15.237216 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:15.249811 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:15.264295 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:15.277900 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:15.405286 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:15.541834 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:23:15.763445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:16.151799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1034): Launched 00:23:16.445678 run iperf3-srv_10.42.42.10(pid=1035): Launched 00:23:16.594947 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:23:16.805559 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:17.124027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1036): Launched 00:23:17.413124 run iperf3-srv_10.42.42.10(pid=1037): Launched 00:23:17.543571 tst cs_paging_gprs_active.py:38: start network... 00:23:17.752208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:23:18.241819 run create_hlr_db(pid=1038): Launched 00:23:18.399804 bus /gobi_6: Setting Powered False 00:23:19.462818 run create_hlr_db(pid=1038): Terminated: ok {rc=0} 00:23:19.912035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1040): Launched 00:23:20.253689 run osmo-hlr_10.42.42.2(pid=1041): Launched 00:23:20.499132 run osmo-stp_10.42.42.5: Starting osmo-stp 00:23:21.242513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1043): Launched 00:23:21.578815 run osmo-stp_10.42.42.5(pid=1044): Launched 00:23:21.837220 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:23:22.547863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1046): Launched 00:23:22.682605 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:23:22.969686 run patchelf(pid=1047): Launched 00:23:23.159383 run osmo-stp_10.42.42.5(pid=1044): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1044)] 00:23:23.295172 run osmo-stp_10.42.42.5(pid=1044): stdout: | (launched: 2022-12-09_00:23:21.513281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:23.432462 run osmo-stp_10.42.42.5(pid=1044): stderr: | [0;m[38;5;43m20221209002321855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002321856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002321856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002321856 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002321865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002321865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002321865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:23.568060 run osmo-stp_10.42.42.5(pid=1044): stdout: | (launched: 2022-12-09_00:23:21.513281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:23.700941 run osmo-stp_10.42.42.5(pid=1044): stderr: | [0;m[38;5;43m20221209002321855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002321856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002321856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002321856 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002321865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002321865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002321865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:23.859319 run patchelf(pid=1047): Terminating (SIGINT) 00:23:24.038174 run patchelf(pid=1047): Terminated: ok {rc=0} 00:23:24.166607 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1044): Process ended prematurely: osmo-stp_10.42.42.5(pid=1044) [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1044)] [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 00:23:24.177325 tst cs_paging_gprs_active.py:38: Test FAILED (9.7 sec) 00:23:24.206565 run osmo-hlr_10.42.42.2(pid=1041): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1041)] 00:23:24.256863 run osmo-hlr_10.42.42.2(pid=1041): stdout: | (launched: 2022-12-09_00:23:20.182207) 00:23:24.308538 run osmo-hlr_10.42.42.2(pid=1041): stderr: | [0;m[1;31m20221209002320533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002320533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002320533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002320533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002320533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002320534 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002320552 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002320560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002320560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002320566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:23:24.361433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1034): Terminating (SIGTERM) 00:23:24.403209 run iperf3-srv_10.42.42.10(pid=1035): Terminating (SIGTERM) 00:23:24.448665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1036): Terminating (SIGTERM) 00:23:24.490836 run iperf3-srv_10.42.42.10(pid=1037): Terminating (SIGTERM) 00:23:24.535392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1040): Terminating (SIGTERM) 00:23:24.577586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1043): Terminating (SIGTERM) 00:23:24.622801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1046): Terminating (SIGTERM) 00:23:24.666877 --- ParallelTerminationStrategy: PID 1034 died... 00:23:24.687075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1034): Terminated: ok {rc=0} 00:23:24.734474 --- ParallelTerminationStrategy: PID 1035 died... 00:23:24.754246 run iperf3-srv_10.42.42.10(pid=1035): Terminated {rc=256} 00:23:24.799345 --- ParallelTerminationStrategy: PID 1036 died... 00:23:24.821098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1036): Terminated: ok {rc=0} 00:23:24.868085 --- ParallelTerminationStrategy: PID 1037 died... 00:23:24.887798 run iperf3-srv_10.42.42.10(pid=1037): Terminated {rc=256} 00:23:24.933291 --- ParallelTerminationStrategy: PID 1040 died... 00:23:24.953289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1040): Terminated: ok {rc=0} 00:23:24.998662 --- ParallelTerminationStrategy: PID 1043 died... 00:23:25.020218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1043): Terminated: ok {rc=0} 00:23:25.065288 --- ParallelTerminationStrategy: PID 1046 died... 00:23:25.084644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1046): Terminated: ok {rc=0} 00:23:25.173002 bus /gobi_0: Setting Powered False 00:23:26.270991 bus /gobi_0: Setting Powered False 00:23:27.383894 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 00:23:28.529511 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:28.540871 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:23:28.608627 tst iperf3.py: using LAC 17785 00:23:28.731913 tst iperf3.py: using RAC 190 00:23:28.873127 tst iperf3.py: using CellId 17785 00:23:29.001971 tst iperf3.py: using BVCI 17786 00:23:29.120161 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:29.131859 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:29.143223 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:29.155125 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:29.167174 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:29.178964 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:29.190848 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:29.202655 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:29.214572 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:29.330645 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:23:29.535685 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:29.843438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1049): Launched 00:23:30.111559 run iperf3-srv_10.42.42.10(pid=1050): Launched 00:23:30.226561 tst iperf3.py:8: start network... 00:23:30.432357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:23:30.915976 run create_hlr_db(pid=1051): Launched 00:23:31.056565 bus /gobi_6: Setting Powered False 00:23:32.128686 run create_hlr_db(pid=1051): Terminated: ok {rc=0} 00:23:32.595670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1053): Launched 00:23:32.902167 run osmo-hlr_10.42.42.2(pid=1054): Launched 00:23:33.018007 run osmo-stp_10.42.42.5: Starting osmo-stp 00:23:33.548677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1056): Launched 00:23:33.853560 run osmo-stp_10.42.42.5(pid=1057): Launched 00:23:33.969330 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:23:34.495531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1059): Launched 00:23:34.612394 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:23:34.869639 run patchelf(pid=1060): Launched 00:23:35.039358 run osmo-stp_10.42.42.5(pid=1057): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1057)] 00:23:35.167982 run osmo-stp_10.42.42.5(pid=1057): stdout: | (launched: 2022-12-09_00:23:33.797441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:35.298890 run osmo-stp_10.42.42.5(pid=1057): stderr: | [0;m[38;5;43m20221209002333967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002333967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002333968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002333968 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002333970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002333970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002333970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:35.429685 run osmo-stp_10.42.42.5(pid=1057): stdout: | (launched: 2022-12-09_00:23:33.797441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:35.554335 run osmo-stp_10.42.42.5(pid=1057): stderr: | [0;m[38;5;43m20221209002333967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002333967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002333968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002333968 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002333970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002333970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002333970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:35.701833 run patchelf(pid=1060): Terminating (SIGINT) 00:23:35.872181 run patchelf(pid=1060): Terminated: ok {rc=0} 00:23:35.995226 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1057): Process ended prematurely: osmo-stp_10.42.42.5(pid=1057) [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1057)] [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 00:23:36.004552 tst iperf3.py:8: Test FAILED (7.5 sec) 00:23:36.031458 run osmo-hlr_10.42.42.2(pid=1054): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1054)] 00:23:36.077925 run osmo-hlr_10.42.42.2(pid=1054): stdout: | (launched: 2022-12-09_00:23:32.845765) 00:23:36.126287 run osmo-hlr_10.42.42.2(pid=1054): stderr: | [0;m[1;31m20221209002333025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002333025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002333025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002333025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002333025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002333025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002333037 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002333046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002333046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002333046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:23:36.175132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1049): Terminating (SIGTERM) 00:23:36.214292 run iperf3-srv_10.42.42.10(pid=1050): Terminating (SIGTERM) 00:23:36.252927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1053): Terminating (SIGTERM) 00:23:36.291762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1056): Terminating (SIGTERM) 00:23:36.331014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1059): Terminating (SIGTERM) 00:23:36.369905 --- ParallelTerminationStrategy: PID 1049 died... 00:23:36.388458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1049): Terminated: ok {rc=0} 00:23:36.432053 --- ParallelTerminationStrategy: PID 1050 died... 00:23:36.450479 run iperf3-srv_10.42.42.10(pid=1050): Terminated {rc=256} 00:23:36.493467 --- ParallelTerminationStrategy: PID 1053 died... 00:23:36.511583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1053): Terminated: ok {rc=0} 00:23:36.554500 --- ParallelTerminationStrategy: PID 1056 died... 00:23:36.572697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1056): Terminated: ok {rc=0} 00:23:36.615338 --- ParallelTerminationStrategy: PID 1059 died... 00:23:36.633696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1059): Terminated: ok {rc=0} 00:23:36.717435 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 00:23:37.864097 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:37.875783 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:23:37.943329 tst iperf3m4.py: using LAC 17786 00:23:38.064289 tst iperf3m4.py: using RAC 191 00:23:38.184310 tst iperf3m4.py: using CellId 17786 00:23:38.304886 tst iperf3m4.py: using BVCI 17787 00:23:38.418022 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:38.428841 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:38.439655 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:38.450489 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:38.461219 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:38.471896 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:38.482768 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:38.493467 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:38.504199 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:38.624523 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:38.744777 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:38.865590 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:38.985978 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:23:39.206436 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:39.533909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1061): Launched 00:23:39.819228 run iperf3-srv_10.42.42.10(pid=1062): Launched 00:23:39.941993 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:23:40.162802 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:40.490277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1063): Launched 00:23:40.774254 run iperf3-srv_10.42.42.10(pid=1064): Launched 00:23:40.897195 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:23:41.117099 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:41.444774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1065): Launched 00:23:41.729637 run iperf3-srv_10.42.42.10(pid=1066): Launched 00:23:41.851846 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:23:42.071949 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:42.399401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1067): Launched 00:23:42.684194 run iperf3-srv_10.42.42.10(pid=1068): Launched 00:23:42.806916 tst iperf3m4.py:8: start network... 00:23:43.026763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:23:43.533259 run create_hlr_db(pid=1069): Launched 00:23:43.656930 bus /gobi_6: Setting Powered False 00:23:44.721126 run create_hlr_db(pid=1069): Terminated: ok {rc=0} 00:23:45.156778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1071): Launched 00:23:45.465203 run osmo-hlr_10.42.42.2(pid=1072): Launched 00:23:45.583063 run osmo-stp_10.42.42.5: Starting osmo-stp 00:23:46.125424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1074): Launched 00:23:46.456786 run osmo-stp_10.42.42.5(pid=1075): Launched 00:23:46.702015 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:23:47.394904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1077): Launched 00:23:47.511860 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:23:47.771172 run patchelf(pid=1078): Launched 00:23:47.941879 run osmo-stp_10.42.42.5(pid=1075): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1075)] 00:23:48.071366 run osmo-stp_10.42.42.5(pid=1075): stdout: | (launched: 2022-12-09_00:23:46.391305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:48.202704 run osmo-stp_10.42.42.5(pid=1075): stderr: | [0;m[38;5;43m20221209002346729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002346729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002346729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002346730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002346730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002346730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002346730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:48.333982 run osmo-stp_10.42.42.5(pid=1075): stdout: | (launched: 2022-12-09_00:23:46.391305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:48.460157 run osmo-stp_10.42.42.5(pid=1075): stderr: | [0;m[38;5;43m20221209002346729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002346729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002346729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002346730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002346730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002346730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002346730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:48.607936 run patchelf(pid=1078): Terminating (SIGINT) 00:23:48.779657 run patchelf(pid=1078): Terminated: ok {rc=0} 00:23:48.903145 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1075): Process ended prematurely: osmo-stp_10.42.42.5(pid=1075) [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1075)] [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 00:23:48.912847 tst iperf3m4.py:8: Test FAILED (11.1 sec) 00:23:48.942180 run osmo-hlr_10.42.42.2(pid=1072): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1072)] 00:23:48.992698 run osmo-hlr_10.42.42.2(pid=1072): stdout: | (launched: 2022-12-09_00:23:45.408392) 00:23:49.045172 run osmo-hlr_10.42.42.2(pid=1072): stderr: | [0;m[1;31m20221209002345586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002345586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002345586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002345586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002345586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002345586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002345598 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002345607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002345607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002345607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:23:49.097728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1061): Terminating (SIGTERM) 00:23:49.140094 run iperf3-srv_10.42.42.10(pid=1062): Terminating (SIGTERM) 00:23:49.182726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1063): Terminating (SIGTERM) 00:23:49.225371 run iperf3-srv_10.42.42.10(pid=1064): Terminating (SIGTERM) 00:23:49.267724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1065): Terminating (SIGTERM) 00:23:49.310121 run iperf3-srv_10.42.42.10(pid=1066): Terminating (SIGTERM) 00:23:49.352422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1067): Terminating (SIGTERM) 00:23:49.395120 run iperf3-srv_10.42.42.10(pid=1068): Terminating (SIGTERM) 00:23:49.437505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1071): Terminating (SIGTERM) 00:23:49.479985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1074): Terminating (SIGTERM) 00:23:49.522460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1077): Terminating (SIGTERM) 00:23:49.565602 --- ParallelTerminationStrategy: PID 1061 died... 00:23:49.585234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1061): Terminated: ok {rc=0} 00:23:49.632752 --- ParallelTerminationStrategy: PID 1062 died... 00:23:49.652181 run iperf3-srv_10.42.42.10(pid=1062): Terminated {rc=256} 00:23:49.699841 --- ParallelTerminationStrategy: PID 1063 died... 00:23:49.719450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1063): Terminated: ok {rc=0} 00:23:49.766922 --- ParallelTerminationStrategy: PID 1064 died... 00:23:49.786364 run iperf3-srv_10.42.42.10(pid=1064): Terminated {rc=256} 00:23:49.833587 --- ParallelTerminationStrategy: PID 1065 died... 00:23:49.852862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1065): Terminated: ok {rc=0} 00:23:49.900228 --- ParallelTerminationStrategy: PID 1066 died... 00:23:49.919704 run iperf3-srv_10.42.42.10(pid=1066): Terminated {rc=256} 00:23:49.966862 --- ParallelTerminationStrategy: PID 1067 died... 00:23:49.986337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1067): Terminated: ok {rc=0} 00:23:50.033554 --- ParallelTerminationStrategy: PID 1068 died... 00:23:50.052811 run iperf3-srv_10.42.42.10(pid=1068): Terminated {rc=256} 00:23:50.099848 --- ParallelTerminationStrategy: PID 1071 died... 00:23:50.119210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1071): Terminated: ok {rc=0} 00:23:50.166152 --- ParallelTerminationStrategy: PID 1074 died... 00:23:50.185446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1074): Terminated: ok {rc=0} 00:23:50.232518 --- ParallelTerminationStrategy: PID 1077 died... 00:23:50.251977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1077): Terminated: ok {rc=0} 00:23:50.339922 bus /gobi_4: Setting Powered False 00:23:51.437518 bus /gobi_4: Setting Powered False 00:23:52.554055 bus /gobi_1: Setting Powered False 00:23:53.651713 bus /gobi_1: Setting Powered False 00:23:54.767720 bus /gobi_0: Setting Powered False 00:23:55.864197 bus /gobi_0: Setting Powered False 00:23:56.979023 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 00:23:58.079122 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:58.091078 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:23:58.160229 tst ping.py: using LAC 17787 00:23:58.285189 tst ping.py: using RAC 192 00:23:58.409732 tst ping.py: using CellId 17787 00:23:58.534515 tst ping.py: using BVCI 17788 00:23:58.650215 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:58.662083 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:58.673377 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:58.684700 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:58.696115 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:58.707708 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:58.719397 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:58.730936 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:58.849172 tst ping.py:19: start network... 00:23:59.063592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:23:59.557281 run create_hlr_db(pid=1079): Launched 00:23:59.679305 bus /gobi_6: Setting Powered False 00:24:00.742452 run create_hlr_db(pid=1079): Terminated: ok {rc=0} 00:24:01.204716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1081): Launched 00:24:01.536502 run osmo-hlr_10.42.42.2(pid=1082): Launched 00:24:01.748539 run osmo-stp_10.42.42.5: Starting osmo-stp 00:24:02.430101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1084): Launched 00:24:02.732369 run osmo-stp_10.42.42.5(pid=1085): Launched 00:24:02.847350 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:24:03.365563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1087): Launched 00:24:03.480849 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:24:03.734847 run patchelf(pid=1088): Launched 00:24:03.902412 run osmo-stp_10.42.42.5(pid=1085): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1085)] 00:24:04.029490 run osmo-stp_10.42.42.5(pid=1085): stdout: | (launched: 2022-12-09_00:24:02.676921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:04.158576 run osmo-stp_10.42.42.5(pid=1085): stderr: | [0;m[38;5;43m20221209002402849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002402849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002402851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002402851 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002402851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002402852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002402852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:04.287362 run osmo-stp_10.42.42.5(pid=1085): stdout: | (launched: 2022-12-09_00:24:02.676921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:04.410107 run osmo-stp_10.42.42.5(pid=1085): stderr: | [0;m[38;5;43m20221209002402849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002402849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002402851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002402851 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002402851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002402852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002402852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:04.556341 run patchelf(pid=1088): Terminating (SIGINT) 00:24:04.725458 run patchelf(pid=1088): Terminated: ok {rc=0} 00:24:04.846912 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1085): Process ended prematurely: osmo-stp_10.42.42.5(pid=1085) [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1085)] [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 00:24:04.855658 tst ping.py:22: Test FAILED (6.8 sec) 00:24:04.882626 run osmo-hlr_10.42.42.2(pid=1082): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1082)] 00:24:04.929340 run osmo-hlr_10.42.42.2(pid=1082): stdout: | (launched: 2022-12-09_00:24:01.471609) 00:24:04.977905 run osmo-hlr_10.42.42.2(pid=1082): stderr: | [0;m[1;31m20221209002401738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002401738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002401738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002401738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002401739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002401739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002401762 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002401779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002401779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002401779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:24:05.026674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1081): Terminating (SIGTERM) 00:24:05.066059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1084): Terminating (SIGTERM) 00:24:05.105320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1087): Terminating (SIGTERM) 00:24:05.144902 --- ParallelTerminationStrategy: PID 1081 died... 00:24:05.163611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1081): Terminated: ok {rc=0} 00:24:05.207672 --- ParallelTerminationStrategy: PID 1084 died... 00:24:05.226244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1084): Terminated: ok {rc=0} 00:24:05.269784 --- ParallelTerminationStrategy: PID 1087 died... 00:24:05.288645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1087): Terminated: ok {rc=0} 00:24:05.371243 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 00:24:06.456366 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:24:06.468926 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:24:06.545406 tst ping_idle_ping.py: using LAC 17788 00:24:06.673463 tst ping_idle_ping.py: using RAC 193 00:24:06.800239 tst ping_idle_ping.py: using CellId 17788 00:24:06.924381 tst ping_idle_ping.py: using BVCI 17789 00:24:07.041270 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:24:07.052780 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:24:07.064161 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:24:07.076293 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:24:07.088576 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:24:07.100604 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:24:07.112708 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:24:07.125060 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:24:07.242364 tst ping_idle_ping.py:24: start network... 00:24:07.444625 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:24:07.915802 run create_hlr_db(pid=1089): Launched 00:24:08.039526 bus /gobi_6: Setting Powered False 00:24:09.100858 run create_hlr_db(pid=1089): Terminated: ok {rc=0} 00:24:09.522784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1091): Launched 00:24:09.826405 run osmo-hlr_10.42.42.2(pid=1092): Launched 00:24:09.940288 run osmo-stp_10.42.42.5: Starting osmo-stp 00:24:10.474311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1094): Launched 00:24:10.776674 run osmo-stp_10.42.42.5(pid=1095): Launched 00:24:10.895124 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:24:11.416351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1097): Launched 00:24:11.532093 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:24:11.787611 run patchelf(pid=1098): Launched 00:24:11.956085 run osmo-stp_10.42.42.5(pid=1095): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1095)] 00:24:12.083844 run osmo-stp_10.42.42.5(pid=1095): stdout: | (launched: 2022-12-09_00:24:10.720935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:12.213099 run osmo-stp_10.42.42.5(pid=1095): stderr: | [0;m[38;5;43m20221209002410895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002410895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002410895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002410896 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002410896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002410896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002410896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:12.342617 run osmo-stp_10.42.42.5(pid=1095): stdout: | (launched: 2022-12-09_00:24:10.720935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:12.466141 run osmo-stp_10.42.42.5(pid=1095): stderr: | [0;m[38;5;43m20221209002410895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002410895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002410895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002410896 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002410896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002410896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002410896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:12.613133 run patchelf(pid=1098): Terminating (SIGINT) 00:24:12.782250 run patchelf(pid=1098): Terminated: ok {rc=0} 00:24:12.904171 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1095): Process ended prematurely: osmo-stp_10.42.42.5(pid=1095) [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1095)] [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 00:24:12.913178 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 00:24:12.939789 run osmo-hlr_10.42.42.2(pid=1092): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1092)] 00:24:12.986622 run osmo-hlr_10.42.42.2(pid=1092): stdout: | (launched: 2022-12-09_00:24:09.769095) 00:24:13.035518 run osmo-hlr_10.42.42.2(pid=1092): stderr: | [0;m[1;31m20221209002409947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002409947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002409947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002409947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002409947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002409947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002409960 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002409970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002409970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002409970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:24:13.084433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1091): Terminating (SIGTERM) 00:24:13.123885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1094): Terminating (SIGTERM) 00:24:13.163278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1097): Terminating (SIGTERM) 00:24:13.202916 --- ParallelTerminationStrategy: PID 1091 died... 00:24:13.221867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1091): Terminated: ok {rc=0} 00:24:13.265278 --- ParallelTerminationStrategy: PID 1094 died... 00:24:13.283743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1094): Terminated: ok {rc=0} 00:24:13.326654 --- ParallelTerminationStrategy: PID 1097 died... 00:24:13.344671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1097): Terminated: ok {rc=0} 00:24:13.426224 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 00:24:14.726215 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:24:14.733139 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 00:24:14.764609 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 00:24:14.802165 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 00:24:14.891540 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 00:24:14.924653 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 00:24:14.961940 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 00:24:15.555310 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 00:24:15.603245 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:15.614397 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:24:15.661630 tst cs_paging_gprs_active.py: using LAC 17789 00:24:15.788764 tst cs_paging_gprs_active.py: using RAC 194 00:24:15.926914 tst cs_paging_gprs_active.py: using CellId 17789 00:24:16.061876 tst cs_paging_gprs_active.py: using BVCI 17790 00:24:16.195608 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:16.210909 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:16.227077 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:16.242766 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:16.259081 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:16.274227 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:16.288017 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:16.300555 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:16.314311 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:16.439795 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:16.559534 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:24:16.784267 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:24:17.112698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1102): Launched 00:24:17.382515 run iperf3-srv_10.42.42.10(pid=1103): Launched 00:24:17.496114 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:24:17.699070 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:24:18.001310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1104): Launched 00:24:18.263264 run iperf3-srv_10.42.42.10(pid=1105): Launched 00:24:18.376154 tst cs_paging_gprs_active.py:38: start network... 00:24:18.579402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:24:19.051210 run create_hlr_db(pid=1106): Launched 00:24:19.175030 bus /gobi_6: Setting Powered False 00:24:20.236199 run create_hlr_db(pid=1106): Terminated: ok {rc=0} 00:24:20.675865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1108): Launched 00:24:20.996683 run osmo-hlr_10.42.42.2(pid=1109): Launched 00:24:21.119717 run osmo-stp_10.42.42.5: Starting osmo-stp 00:24:21.672847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1111): Launched 00:24:21.993670 run osmo-stp_10.42.42.5(pid=1112): Launched 00:24:22.116698 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:24:22.670561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1115): Launched 00:24:22.794431 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:24:23.066021 run patchelf(pid=1116): Launched 00:24:23.244590 run osmo-stp_10.42.42.5(pid=1112): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1112)] 00:24:23.380833 run osmo-stp_10.42.42.5(pid=1112): stdout: | (launched: 2022-12-09_00:24:21.935694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:23.518174 run osmo-stp_10.42.42.5(pid=1112): stderr: | [0;m[38;5;43m20221209002422127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002422127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002422127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002422128 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002422128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002422128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002422128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:23.655636 run osmo-stp_10.42.42.5(pid=1112): stdout: | (launched: 2022-12-09_00:24:21.935694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:23.788186 run osmo-stp_10.42.42.5(pid=1112): stderr: | [0;m[38;5;43m20221209002422127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002422127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002422127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002422128 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002422128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002422128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002422128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:23.944330 run patchelf(pid=1116): Terminating (SIGINT) 00:24:24.124178 run patchelf(pid=1116): Terminated: ok {rc=0} 00:24:24.254157 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1112): Process ended prematurely: osmo-stp_10.42.42.5(pid=1112) [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1112)] [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 00:24:24.264397 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 00:24:24.293169 run osmo-hlr_10.42.42.2(pid=1109): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1109)] 00:24:24.343408 run osmo-hlr_10.42.42.2(pid=1109): stdout: | (launched: 2022-12-09_00:24:20.938643) 00:24:24.394990 run osmo-hlr_10.42.42.2(pid=1109): stderr: | [0;m[1;31m20221209002421138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002421138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002421138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002421138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002421138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002421138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002421150 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002421158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002421158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002421158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:24:24.446884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1102): Terminating (SIGTERM) 00:24:24.488639 run iperf3-srv_10.42.42.10(pid=1103): Terminating (SIGTERM) 00:24:24.530388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1104): Terminating (SIGTERM) 00:24:24.572168 run iperf3-srv_10.42.42.10(pid=1105): Terminating (SIGTERM) 00:24:24.613915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1108): Terminating (SIGTERM) 00:24:24.655813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1111): Terminating (SIGTERM) 00:24:24.698102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1115): Terminating (SIGTERM) 00:24:24.740148 --- ParallelTerminationStrategy: PID 1102 died... 00:24:24.759884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1102): Terminated: ok {rc=0} 00:24:24.805947 --- ParallelTerminationStrategy: PID 1103 died... 00:24:24.825125 run iperf3-srv_10.42.42.10(pid=1103): Terminated {rc=256} 00:24:24.871083 --- ParallelTerminationStrategy: PID 1104 died... 00:24:24.890265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1104): Terminated: ok {rc=0} 00:24:24.935871 --- ParallelTerminationStrategy: PID 1105 died... 00:24:24.954995 run iperf3-srv_10.42.42.10(pid=1105): Terminated {rc=256} 00:24:25.000669 --- ParallelTerminationStrategy: PID 1108 died... 00:24:25.019998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1108): Terminated: ok {rc=0} 00:24:25.065545 --- ParallelTerminationStrategy: PID 1111 died... 00:24:25.084662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1111): Terminated: ok {rc=0} 00:24:25.130887 --- ParallelTerminationStrategy: PID 1115 died... 00:24:25.150140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1115): Terminated: ok {rc=0} 00:24:25.237487 bus /gobi_0: Setting Powered False 00:24:26.334104 bus /gobi_0: Setting Powered False 00:24:27.447402 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 00:24:28.594264 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:28.606828 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:24:28.658794 tst iperf3.py: using LAC 17790 00:24:28.786303 tst iperf3.py: using RAC 195 00:24:28.909563 tst iperf3.py: using CellId 17790 00:24:29.035878 tst iperf3.py: using BVCI 17791 00:24:29.153943 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:29.165947 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:29.177614 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:29.189634 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:29.201581 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:29.213551 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:29.226071 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:29.237759 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:29.249761 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:29.370478 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:24:29.585773 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:24:29.905881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1117): Launched 00:24:30.183522 run iperf3-srv_10.42.42.10(pid=1118): Launched 00:24:30.303394 tst iperf3.py:8: start network... 00:24:30.519253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:24:31.036004 run create_hlr_db(pid=1120): Launched 00:24:31.211170 bus /gobi_6: Setting Powered False 00:24:32.269663 run create_hlr_db(pid=1120): Terminated: ok {rc=0} 00:24:32.750564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1122): Launched 00:24:33.070468 run osmo-hlr_10.42.42.2(pid=1123): Launched 00:24:33.192724 run osmo-stp_10.42.42.5: Starting osmo-stp 00:24:33.747846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1129): Launched 00:24:34.068596 run osmo-stp_10.42.42.5(pid=1130): Launched 00:24:34.191297 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:24:34.744599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1132): Launched 00:24:34.867332 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:24:35.137651 run patchelf(pid=1133): Launched 00:24:35.315359 run osmo-stp_10.42.42.5(pid=1130): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1130)] 00:24:35.451357 run osmo-stp_10.42.42.5(pid=1130): stdout: | (launched: 2022-12-09_00:24:34.010414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:35.588863 run osmo-stp_10.42.42.5(pid=1130): stderr: | [0;m[38;5;43m20221209002434204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002434204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002434204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002434205 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002434205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002434205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002434205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:35.727084 run osmo-stp_10.42.42.5(pid=1130): stdout: | (launched: 2022-12-09_00:24:34.010414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:35.858521 run osmo-stp_10.42.42.5(pid=1130): stderr: | [0;m[38;5;43m20221209002434204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002434204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002434204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002434205 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002434205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002434205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002434205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:36.014781 run patchelf(pid=1133): Terminating (SIGINT) 00:24:36.194141 run patchelf(pid=1133): Terminated: ok {rc=0} 00:24:36.323660 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1130): Process ended prematurely: osmo-stp_10.42.42.5(pid=1130) [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1130)] [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 00:24:36.333922 tst iperf3.py:8: Test FAILED (7.8 sec) 00:24:36.362250 run osmo-hlr_10.42.42.2(pid=1123): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1123)] 00:24:36.412268 run osmo-hlr_10.42.42.2(pid=1123): stdout: | (launched: 2022-12-09_00:24:33.012347) 00:24:36.463507 run osmo-hlr_10.42.42.2(pid=1123): stderr: | [0;m[1;31m20221209002433208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002433208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002433208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002433208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002433209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002433209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002433222 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002433230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002433230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002433230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:24:36.515472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1117): Terminating (SIGTERM) 00:24:36.556811 run iperf3-srv_10.42.42.10(pid=1118): Terminating (SIGTERM) 00:24:36.598004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1122): Terminating (SIGTERM) 00:24:36.639561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1129): Terminating (SIGTERM) 00:24:36.681282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1132): Terminating (SIGTERM) 00:24:36.722899 --- ParallelTerminationStrategy: PID 1117 died... 00:24:36.742571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1117): Terminated: ok {rc=0} 00:24:36.788226 --- ParallelTerminationStrategy: PID 1118 died... 00:24:36.807484 run iperf3-srv_10.42.42.10(pid=1118): Terminated {rc=256} 00:24:36.853583 --- ParallelTerminationStrategy: PID 1122 died... 00:24:36.872602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1122): Terminated: ok {rc=0} 00:24:36.918343 --- ParallelTerminationStrategy: PID 1129 died... 00:24:36.937526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1129): Terminated: ok {rc=0} 00:24:36.983094 --- ParallelTerminationStrategy: PID 1132 died... 00:24:37.002181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1132): Terminated: ok {rc=0} 00:24:37.087519 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 00:24:38.234678 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:38.246644 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:24:38.296055 tst iperf3m4.py: using LAC 17791 00:24:38.416104 tst iperf3m4.py: using RAC 196 00:24:38.535669 tst iperf3m4.py: using CellId 17791 00:24:38.661818 tst iperf3m4.py: using BVCI 17792 00:24:38.778637 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:38.790838 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:38.802742 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:38.814691 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:38.827182 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:38.838933 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:38.850865 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:38.862649 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:38.875000 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:38.994572 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:39.112495 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:39.227584 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:39.343409 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:24:39.562327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:24:39.885030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1139): Launched 00:24:40.164558 run iperf3-srv_10.42.42.10(pid=1140): Launched 00:24:40.285083 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:24:40.501514 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:24:40.826110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1141): Launched 00:24:41.105725 run iperf3-srv_10.42.42.10(pid=1142): Launched 00:24:41.226452 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:24:41.443168 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:24:41.766922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1144): Launched 00:24:42.046471 run iperf3-srv_10.42.42.10(pid=1145): Launched 00:24:42.167002 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:24:42.383589 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:24:42.706856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1146): Launched 00:24:42.986679 run iperf3-srv_10.42.42.10(pid=1147): Launched 00:24:43.107279 tst iperf3m4.py:8: start network... 00:24:43.323865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:24:43.825417 run create_hlr_db(pid=1148): Launched 00:24:43.947645 bus /gobi_6: Setting Powered False 00:24:45.010621 run create_hlr_db(pid=1148): Terminated: ok {rc=0} 00:24:45.456171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1150): Launched 00:24:45.777110 run osmo-hlr_10.42.42.2(pid=1151): Launched 00:24:46.028322 run osmo-stp_10.42.42.5: Starting osmo-stp 00:24:46.693515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1153): Launched 00:24:47.038785 run osmo-stp_10.42.42.5(pid=1154): Launched 00:24:47.259921 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:24:47.825644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1156): Launched 00:24:47.949175 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:24:48.220425 run patchelf(pid=1157): Launched 00:24:48.398383 run osmo-stp_10.42.42.5(pid=1154): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1154)] 00:24:48.534077 run osmo-stp_10.42.42.5(pid=1154): stdout: | (launched: 2022-12-09_00:24:46.973137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:48.671539 run osmo-stp_10.42.42.5(pid=1154): stderr: | [0;m[38;5;43m20221209002447282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002447283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002447283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002447283 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002447284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002447284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002447284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:48.809761 run osmo-stp_10.42.42.5(pid=1154): stdout: | (launched: 2022-12-09_00:24:46.973137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:48.941642 run osmo-stp_10.42.42.5(pid=1154): stderr: | [0;m[38;5;43m20221209002447282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002447283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002447283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002447283 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002447284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002447284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002447284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:49.097743 run patchelf(pid=1157): Terminating (SIGINT) 00:24:49.277168 run patchelf(pid=1157): Terminated: ok {rc=0} 00:24:49.406998 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1154): Process ended prematurely: osmo-stp_10.42.42.5(pid=1154) [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1154)] [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 00:24:49.417298 tst iperf3m4.py:8: Test FAILED (11.2 sec) 00:24:49.446007 run osmo-hlr_10.42.42.2(pid=1151): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1151)] 00:24:49.496078 run osmo-hlr_10.42.42.2(pid=1151): stdout: | (launched: 2022-12-09_00:24:45.718653) 00:24:49.547448 run osmo-hlr_10.42.42.2(pid=1151): stderr: | [0;m[1;31m20221209002445950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002445950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002445950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002445950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002445950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002445950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002445972 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002445985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002445989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002445989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:24:49.599214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1139): Terminating (SIGTERM) 00:24:49.640614 run iperf3-srv_10.42.42.10(pid=1140): Terminating (SIGTERM) 00:24:49.682005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1141): Terminating (SIGTERM) 00:24:49.723785 run iperf3-srv_10.42.42.10(pid=1142): Terminating (SIGTERM) 00:24:49.765139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1144): Terminating (SIGTERM) 00:24:49.806653 run iperf3-srv_10.42.42.10(pid=1145): Terminating (SIGTERM) 00:24:49.847939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1146): Terminating (SIGTERM) 00:24:49.889368 run iperf3-srv_10.42.42.10(pid=1147): Terminating (SIGTERM) 00:24:49.930526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1150): Terminating (SIGTERM) 00:24:49.971871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1153): Terminating (SIGTERM) 00:24:50.013718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1156): Terminating (SIGTERM) 00:24:50.055539 --- ParallelTerminationStrategy: PID 1139 died... 00:24:50.075287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1139): Terminated: ok {rc=0} 00:24:50.121266 --- ParallelTerminationStrategy: PID 1140 died... 00:24:50.140299 run iperf3-srv_10.42.42.10(pid=1140): Terminated {rc=256} 00:24:50.186037 --- ParallelTerminationStrategy: PID 1141 died... 00:24:50.205181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1141): Terminated: ok {rc=0} 00:24:50.250889 --- ParallelTerminationStrategy: PID 1142 died... 00:24:50.270132 run iperf3-srv_10.42.42.10(pid=1142): Terminated {rc=256} 00:24:50.315907 --- ParallelTerminationStrategy: PID 1144 died... 00:24:50.335115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1144): Terminated: ok {rc=0} 00:24:50.381065 --- ParallelTerminationStrategy: PID 1145 died... 00:24:50.400235 run iperf3-srv_10.42.42.10(pid=1145): Terminated {rc=256} 00:24:50.446025 --- ParallelTerminationStrategy: PID 1146 died... 00:24:50.465277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1146): Terminated: ok {rc=0} 00:24:50.511102 --- ParallelTerminationStrategy: PID 1147 died... 00:24:50.530338 run iperf3-srv_10.42.42.10(pid=1147): Terminated {rc=256} 00:24:50.576110 --- ParallelTerminationStrategy: PID 1150 died... 00:24:50.595435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1150): Terminated: ok {rc=0} 00:24:50.641375 --- ParallelTerminationStrategy: PID 1153 died... 00:24:50.660467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1153): Terminated: ok {rc=0} 00:24:50.706908 --- ParallelTerminationStrategy: PID 1156 died... 00:24:50.726258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1156): Terminated: ok {rc=0} 00:24:50.813587 bus /gobi_4: Setting Powered False 00:24:51.911430 bus /gobi_4: Setting Powered False 00:24:53.027290 bus /gobi_1: Setting Powered False 00:24:54.124359 bus /gobi_1: Setting Powered False 00:24:55.238369 bus /gobi_0: Setting Powered False 00:24:56.334383 bus /gobi_0: Setting Powered False 00:24:57.448903 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 00:24:58.551194 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:58.564031 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:24:58.615782 tst ping.py: using LAC 17792 00:24:58.741143 tst ping.py: using RAC 197 00:24:58.859536 tst ping.py: using CellId 17792 00:24:58.978489 tst ping.py: using BVCI 17793 00:24:59.086372 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:59.097995 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:59.109353 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:59.121181 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:59.132554 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:59.144370 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:59.156099 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:59.167689 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:59.285758 tst ping.py:19: start network... 00:24:59.485054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:24:59.945472 run create_hlr_db(pid=1158): Launched 00:25:00.066651 bus /gobi_6: Setting Powered False 00:25:01.128090 run create_hlr_db(pid=1158): Terminated: ok {rc=0} 00:25:01.598273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1163): Launched 00:25:01.955007 run osmo-hlr_10.42.42.2(pid=1164): Launched 00:25:02.215881 run osmo-stp_10.42.42.5: Starting osmo-stp 00:25:02.724875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1166): Launched 00:25:03.023010 run osmo-stp_10.42.42.5(pid=1167): Launched 00:25:03.135049 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:25:03.648349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1169): Launched 00:25:03.762718 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:25:04.013107 run patchelf(pid=1170): Launched 00:25:04.177580 run osmo-stp_10.42.42.5(pid=1167): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1167)] 00:25:04.303087 run osmo-stp_10.42.42.5(pid=1167): stdout: | (launched: 2022-12-09_00:25:02.967092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:04.430414 run osmo-stp_10.42.42.5(pid=1167): stderr: | [0;m[38;5;43m20221209002503139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002503139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002503139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002503140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002503140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002503140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002503140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:04.557695 run osmo-stp_10.42.42.5(pid=1167): stdout: | (launched: 2022-12-09_00:25:02.967092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:04.679010 run osmo-stp_10.42.42.5(pid=1167): stderr: | [0;m[38;5;43m20221209002503139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002503139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002503139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002503140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002503140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002503140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002503140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:04.822982 run patchelf(pid=1170): Terminating (SIGINT) 00:25:04.989222 run patchelf(pid=1170): Terminated: ok {rc=0} 00:25:05.110346 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1167): Process ended prematurely: osmo-stp_10.42.42.5(pid=1167) [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1167)] [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 00:25:05.119309 tst ping.py:22: Test FAILED (6.6 sec) 00:25:05.145916 run osmo-hlr_10.42.42.2(pid=1164): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1164)] 00:25:05.193115 run osmo-hlr_10.42.42.2(pid=1164): stdout: | (launched: 2022-12-09_00:25:01.889627) 00:25:05.241836 run osmo-hlr_10.42.42.2(pid=1164): stderr: | [0;m[1;31m20221209002502107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002502107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002502107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002502107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002502107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002502107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002502125 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002502133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002502134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002502134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:05.291186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1163): Terminating (SIGTERM) 00:25:05.330404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1166): Terminating (SIGTERM) 00:25:05.369518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1169): Terminating (SIGTERM) 00:25:05.408817 --- ParallelTerminationStrategy: PID 1163 died... 00:25:05.427802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1163): Terminated: ok {rc=0} 00:25:05.471355 --- ParallelTerminationStrategy: PID 1166 died... 00:25:05.489692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1166): Terminated: ok {rc=0} 00:25:05.533068 --- ParallelTerminationStrategy: PID 1169 died... 00:25:05.551409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1169): Terminated: ok {rc=0} 00:25:05.635509 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 00:25:06.724091 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:25:06.736440 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:25:06.787630 tst ping_idle_ping.py: using LAC 17793 00:25:06.905684 tst ping_idle_ping.py: using RAC 198 00:25:07.022431 tst ping_idle_ping.py: using CellId 17793 00:25:07.139726 tst ping_idle_ping.py: using BVCI 17794 00:25:07.247161 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:25:07.258572 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:25:07.269673 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:25:07.280745 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:25:07.292009 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:25:07.303094 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:25:07.314241 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:25:07.325395 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:25:07.442797 tst ping_idle_ping.py:24: start network... 00:25:07.656935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:25:08.149125 run create_hlr_db(pid=1171): Launched 00:25:08.270052 bus /gobi_6: Setting Powered False 00:25:09.333191 run create_hlr_db(pid=1171): Terminated: ok {rc=0} 00:25:09.761077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1174): Launched 00:25:10.059511 run osmo-hlr_10.42.42.2(pid=1176): Launched 00:25:10.173121 run osmo-stp_10.42.42.5: Starting osmo-stp 00:25:10.691096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1178): Launched 00:25:10.988177 run osmo-stp_10.42.42.5(pid=1179): Launched 00:25:11.101361 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:25:11.616028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1181): Launched 00:25:11.729929 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:25:11.980887 run patchelf(pid=1182): Launched 00:25:12.145825 run osmo-stp_10.42.42.5(pid=1179): ERR: Terminated: ERROR {rc=1} [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1179)] 00:25:12.271988 run osmo-stp_10.42.42.5(pid=1179): stdout: | (launched: 2022-12-09_00:25:10.933425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:12.399558 run osmo-stp_10.42.42.5(pid=1179): stderr: | [0;m[38;5;43m20221209002511104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002511105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002511105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002511105 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002511106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002511106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002511106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:12.527399 run osmo-stp_10.42.42.5(pid=1179): stdout: | (launched: 2022-12-09_00:25:10.933425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:12.648438 run osmo-stp_10.42.42.5(pid=1179): stderr: | [0;m[38;5;43m20221209002511104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002511105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002511105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002511105 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002511106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002511106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002511106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:12.792703 run patchelf(pid=1182): Terminating (SIGINT) 00:25:12.959023 run patchelf(pid=1182): Terminated: ok {rc=0} 00:25:13.079530 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1179): Process ended prematurely: osmo-stp_10.42.42.5(pid=1179) [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1179)] [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 00:25:13.088467 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 00:25:13.115080 run osmo-hlr_10.42.42.2(pid=1176): ERR: Terminated: ERROR {rc=237} [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1176)] 00:25:13.162307 run osmo-hlr_10.42.42.2(pid=1176): stdout: | (launched: 2022-12-09_00:25:10.005267) 00:25:13.211151 run osmo-hlr_10.42.42.2(pid=1176): stderr: | [0;m[1;31m20221209002510180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002510180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002510180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002510180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002510180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002510180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002510192 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002510201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002510202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002510202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:13.260432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1174): Terminating (SIGTERM) 00:25:13.299831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1178): Terminating (SIGTERM) 00:25:13.339232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1181): Terminating (SIGTERM) 00:25:13.378830 --- ParallelTerminationStrategy: PID 1174 died... 00:25:13.397825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1174): Terminated: ok {rc=0} 00:25:13.441459 --- ParallelTerminationStrategy: PID 1178 died... 00:25:13.459742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1178): Terminated: ok {rc=0} 00:25:13.503434 --- ParallelTerminationStrategy: PID 1181 died... 00:25:13.521917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1181): Terminated: ok {rc=0} 00:25:13.605122 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 00:25:14.912448 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:25:14.919707 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:25:14.951056 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 00:25:14.984519 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:25:15.038973 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:25:15.074041 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 00:25:15.110041 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:25:15.663180 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2351 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 00:25:15.669675 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:25:15.681586 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:25:15.750794 tst switch_tch_pdch.py: using LAC 17794 00:25:15.891272 tst switch_tch_pdch.py: using RAC 199 00:25:16.020618 tst switch_tch_pdch.py: using CellId 17794 00:25:16.148084 tst switch_tch_pdch.py: using BVCI 17795 00:25:16.307971 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:25:16.325037 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:25:16.344063 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:25:16.362679 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:25:16.380834 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:25:16.399766 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:25:16.417423 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:25:16.432299 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:25:16.576675 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:25:16.718280 tst switch_tch_pdch.py:51: start network... 00:25:16.935118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:25:17.407116 run create_hlr_db(pid=1187): Launched 00:25:17.530805 bus /gobi_6: Setting Powered False 00:25:18.589472 run create_hlr_db(pid=1187): Terminated: ok {rc=0} 00:25:19.003609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1189): Launched 00:25:19.300867 run osmo-hlr_10.42.42.2(pid=1190): Launched 00:25:19.413651 run osmo-stp_10.42.42.5: Starting osmo-stp 00:25:19.925258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1192): Launched 00:25:20.223718 run osmo-stp_10.42.42.5(pid=1193): Launched 00:25:20.336810 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:25:20.850747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1195): Launched 00:25:20.964407 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:25:21.215689 run patchelf(pid=1196): Launched 00:25:21.380831 run osmo-stp_10.42.42.5(pid=1193): ERR: Terminated: ERROR {rc=1} [trial-2351↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1193)] 00:25:21.506596 run osmo-stp_10.42.42.5(pid=1193): stdout: | (launched: 2022-12-09_00:25:20.168624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:21.634467 run osmo-stp_10.42.42.5(pid=1193): stderr: | [0;m[38;5;43m20221209002520339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002520339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002520339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002520340 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002520340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002520340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002520340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:21.762177 run osmo-stp_10.42.42.5(pid=1193): stdout: | (launched: 2022-12-09_00:25:20.168624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:21.884064 run osmo-stp_10.42.42.5(pid=1193): stderr: | [0;m[38;5;43m20221209002520339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002520339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002520339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002520340 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002520340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002520340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002520340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:22.027890 run patchelf(pid=1196): Terminating (SIGINT) 00:25:22.193652 run patchelf(pid=1196): Terminated: ok {rc=0} 00:25:22.313287 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1193): Process ended prematurely: osmo-stp_10.42.42.5(pid=1193) [trial-2351↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1193)] [trial-2351↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 00:25:22.322177 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 00:25:22.348111 run osmo-hlr_10.42.42.2(pid=1190): ERR: Terminated: ERROR {rc=237} [trial-2351↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1190)] 00:25:22.394882 run osmo-hlr_10.42.42.2(pid=1190): stdout: | (launched: 2022-12-09_00:25:19.246747) 00:25:22.443431 run osmo-hlr_10.42.42.2(pid=1190): stderr: | [0;m[1;31m20221209002519423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002519424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002519424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002519424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002519424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002519424 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002519436 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002519446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002519446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002519446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:22.493281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1189): Terminating (SIGTERM) 00:25:22.532573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1192): Terminating (SIGTERM) 00:25:22.571529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1195): Terminating (SIGTERM) 00:25:22.610762 --- ParallelTerminationStrategy: PID 1189 died... 00:25:22.629351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1189): Terminated: ok {rc=0} 00:25:22.672760 --- ParallelTerminationStrategy: PID 1192 died... 00:25:22.690952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1192): Terminated: ok {rc=0} 00:25:22.733823 --- ParallelTerminationStrategy: PID 1195 died... 00:25:22.751910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1195): Terminated: ok {rc=0} 00:25:22.836347 bus /gobi_0: Setting Powered False 00:25:23.935287 bus /gobi_0: Setting Powered False 00:25:25.049555 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2351 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 nitb_smpp --------------------------------------------------------------------- 00:25:26.300276 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:25:26.302665 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 00:25:26.322724 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 00:25:26.329307 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 00:25:26.366284 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 00:25:26.386933 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 00:25:26.393414 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 00:25:26.909783 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2351 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 00:25:26.914822 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 00:25:26.934258 tst esme_connect_policy_acceptall.py: using MSISDN 6925 00:25:27.067357 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:25:27.632528 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1200): Launched 00:25:27.935632 run osmo-nitb_10.42.42.2(pid=1201): Launched 00:25:28.102708 run osmo-nitb_10.42.42.2(pid=1201): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1201)] 00:25:28.238660 run osmo-nitb_10.42.42.2(pid=1201): stdout: | (launched: 2022-12-09_00:25:27.880693) 00:25:28.375861 run osmo-nitb_10.42.42.2(pid=1201): stderr: | (launched: 2022-12-09_00:25:27.925731) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:28.513158 run osmo-nitb_10.42.42.2(pid=1201): stdout: | (launched: 2022-12-09_00:25:27.880693) 00:25:28.644768 run osmo-nitb_10.42.42.2(pid=1201): stderr: | (launched: 2022-12-09_00:25:27.925731) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6f22fc268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1201): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1201) [trial-2351↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1201)] 00:25:29.049721 tst osmo-nitb_10.42.42.2(pid=1201): stdout: | (launched: 2022-12-09_00:25:27.880693) 00:25:29.171560 tst osmo-nitb_10.42.42.2(pid=1201): stderr: | (launched: 2022-12-09_00:25:27.925731) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:29.316244 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=1201): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1201) [trial-2351↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1201)] [trial-2351↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 00:25:29.324436 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 00:25:29.330838 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1200): Terminating (SIGTERM) 00:25:29.538747 --- ParallelTerminationStrategy: PID 1200 died... 00:25:29.559197 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1200): Terminated: ok {rc=0} ---------------------------------------------- trial-2351 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 00:25:29.606477 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 00:25:29.627385 tst esme_connect_policy_closed.py: using MSISDN 6926 00:25:29.748744 tst esme_connect_policy_closed.py: using MSISDN 6927 00:25:29.859314 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:25:30.423696 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1202): Launched 00:25:30.727752 run osmo-nitb_10.42.42.2(pid=1203): Launched 00:25:30.902325 run osmo-nitb_10.42.42.2(pid=1203): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1203)] 00:25:31.029580 run osmo-nitb_10.42.42.2(pid=1203): stdout: | (launched: 2022-12-09_00:25:30.672093) 00:25:31.158915 run osmo-nitb_10.42.42.2(pid=1203): stderr: | (launched: 2022-12-09_00:25:30.717660) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:31.289327 run osmo-nitb_10.42.42.2(pid=1203): stdout: | (launched: 2022-12-09_00:25:30.672093) 00:25:31.413309 run osmo-nitb_10.42.42.2(pid=1203): stderr: | (launched: 2022-12-09_00:25:30.717660) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:31.561517 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=1203): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1203) [trial-2351↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1203)] [trial-2351↪nitb_smpp↪esme_connect_policy_closed.py:24] 00:25:31.570342 tst esme_connect_policy_closed.py:24: Test FAILED (2.0 sec) 00:25:31.577293 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1202): Terminating (SIGTERM) 00:25:31.785706 --- ParallelTerminationStrategy: PID 1202 died... 00:25:31.815820 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1202): Terminated: ok {rc=0} ---------------------------------------------- trial-2351 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 00:25:31.890508 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 00:25:31.903840 tst nitb_smpp: Using 1 x bts (candidates: 1) 00:25:31.946805 tst esme_ms_sms_storeforward.py: using LAC 17795 00:25:32.105397 tst esme_ms_sms_storeforward.py: using RAC 200 00:25:32.240853 tst esme_ms_sms_storeforward.py: using CellId 17795 00:25:32.363292 tst esme_ms_sms_storeforward.py: using BVCI 17796 00:25:32.473717 tst nitb_smpp: Using 1 x modem (candidates: 1) 00:25:32.603472 tst esme_ms_sms_storeforward.py: using MSISDN 6928 00:25:32.719189 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 00:25:32.924703 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:25:33.547338 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1204): Launched 00:25:33.853887 run osmo-nitb_10.42.42.2(pid=1205): Launched 00:25:34.018271 run osmo-nitb_10.42.42.2(pid=1205): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1205)] 00:25:34.144313 run osmo-nitb_10.42.42.2(pid=1205): stdout: | (launched: 2022-12-09_00:25:33.798455) 00:25:34.271964 run osmo-nitb_10.42.42.2(pid=1205): stderr: | (launched: 2022-12-09_00:25:33.843992) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:34.399104 run osmo-nitb_10.42.42.2(pid=1205): stdout: | (launched: 2022-12-09_00:25:33.798455) 00:25:34.520486 run osmo-nitb_10.42.42.2(pid=1205): stderr: | (launched: 2022-12-09_00:25:33.843992) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:34.665939 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=1205): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1205) [trial-2351↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1205)] [trial-2351↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 00:25:34.674080 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.8 sec) 00:25:34.680458 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1204): Terminating (SIGTERM) 00:25:34.887973 --- ParallelTerminationStrategy: PID 1204 died... 00:25:34.907946 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1204): Terminated: ok {rc=0} 00:25:34.993841 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 00:25:36.080805 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 00:25:36.092042 tst nitb_smpp: Using 1 x bts (candidates: 1) 00:25:36.128613 tst esme_ms_sms_transaction.py: using LAC 17796 00:25:36.251252 tst esme_ms_sms_transaction.py: using RAC 201 00:25:36.373047 tst esme_ms_sms_transaction.py: using CellId 17796 00:25:36.492440 tst esme_ms_sms_transaction.py: using BVCI 17797 00:25:36.604362 tst nitb_smpp: Using 1 x modem (candidates: 1) 00:25:36.732548 tst esme_ms_sms_transaction.py: using MSISDN 6929 00:25:36.843317 tst esme_ms_sms_transaction.py:18: start nitb and bts... 00:25:37.048292 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:25:37.665267 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1206): Launched 00:25:37.969882 run osmo-nitb_10.42.42.2(pid=1207): Launched 00:25:38.137803 run osmo-nitb_10.42.42.2(pid=1207): ERR: Terminated: ERROR {rc=2} [trial-2351↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1207)] 00:25:38.274075 run osmo-nitb_10.42.42.2(pid=1207): stdout: | (launched: 2022-12-09_00:25:37.914650) 00:25:38.411696 run osmo-nitb_10.42.42.2(pid=1207): stderr: | (launched: 2022-12-09_00:25:37.959843) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:38.549778 run osmo-nitb_10.42.42.2(pid=1207): stdout: | (launched: 2022-12-09_00:25:37.914650) 00:25:38.681871 run osmo-nitb_10.42.42.2(pid=1207): stderr: | (launched: 2022-12-09_00:25:37.959843) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7ff6f22fc268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1207): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1207) [trial-2351↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1207)] 00:25:39.084708 tst osmo-nitb_10.42.42.2(pid=1207): stdout: | (launched: 2022-12-09_00:25:37.914650) 00:25:39.207044 tst osmo-nitb_10.42.42.2(pid=1207): stderr: | (launched: 2022-12-09_00:25:37.959843) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:39.351997 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=1207): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1207) [trial-2351↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1207)] [trial-2351↪nitb_smpp↪esme_ms_sms_transaction.py:21] 00:25:39.360324 tst esme_ms_sms_transaction.py:21: Test FAILED (3.3 sec) 00:25:39.366734 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1206): Terminating (SIGTERM) 00:25:39.574459 --- ParallelTerminationStrategy: PID 1206 died... 00:25:39.594891 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1206): Terminated: ok {rc=0} 00:25:39.678502 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 smpp --------------------------------------------------------------------- 00:25:40.840882 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:25:40.843521 tst smpp: Verifying 1 x bts (candidates: 11) 00:25:40.863576 tst smpp: Verifying 6 x ip_address (candidates: 9) 00:25:40.889749 tst smpp: Verifying 1 x modem (candidates: 12) 00:25:40.924083 tst smpp: Reserving 1 x bts (candidates: 11) 00:25:40.944399 tst smpp: Reserving 6 x ip_address (candidates: 9) 00:25:40.970406 tst smpp: Reserving 1 x modem (candidates: 12) 00:25:41.500283 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2351 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 00:25:41.505379 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:41.515664 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:41.525985 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:41.536214 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:41.565358 tst esme_connect_policy_acceptall.py: using MSISDN 6930 00:25:41.684703 run osmo-stp_10.42.42.4: Starting osmo-stp 00:25:42.235864 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=1212): Launched 00:25:42.559193 run osmo-stp_10.42.42.4(pid=1213): Launched 00:25:42.682867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:25:43.185306 run create_hlr_db(pid=1214): Launched 00:25:43.308868 bus /sierra_2: Setting Powered False 00:25:44.372637 run create_hlr_db(pid=1214): Terminated: ok {rc=0} 00:25:44.808551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1216): Launched 00:25:45.113965 run osmo-hlr_10.42.42.2(pid=1217): Launched 00:25:45.230421 run osmo-msc_10.42.42.5: Starting osmo-msc 00:25:45.794201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1219): Launched 00:25:46.150624 run osmo-msc_10.42.42.5(pid=1220): Launched 00:25:46.551564 run osmo-hlr_10.42.42.2(pid=1217): ERR: Terminated: ERROR {rc=237} [trial-2351↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1217)] 00:25:46.713355 run osmo-hlr_10.42.42.2(pid=1217): stdout: | (launched: 2022-12-09_00:25:45.058366) 00:25:46.870895 run osmo-hlr_10.42.42.2(pid=1217): stderr: | [0;m[1;31m20221209002545235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002545235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002545235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002545235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002545235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002545235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002545248 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002545257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002545257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002545257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:47.078485 run osmo-hlr_10.42.42.2(pid=1217): stdout: | (launched: 2022-12-09_00:25:45.058366) 00:25:47.211616 run osmo-hlr_10.42.42.2(pid=1217): stderr: | [0;m[1;31m20221209002545235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002545235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002545235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002545235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002545235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002545235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002545248 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002545257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002545257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002545257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:47.372128 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=1217): Process ended prematurely: osmo-hlr_10.42.42.2(pid=1217) [trial-2351↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1217)] [trial-2351↪smpp↪esme_connect_policy_acceptall.py:23] 00:25:47.382168 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.9 sec) 00:25:47.412606 run osmo-msc_10.42.42.5(pid=1220): ERR: Terminated: ERROR {rc=9} [trial-2351↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=1220)] 00:25:47.463258 run osmo-msc_10.42.42.5(pid=1220): stdout: | (launched: 2022-12-09_00:25:46.082733) 00:25:47.515487 run osmo-msc_10.42.42.5(pid=1220): stderr: | [0;m[38;5;43m20221209002546565 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221209002546565 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221209002546565 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221209002546565 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221209002546565 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221209002546565 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221209002546565 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221209002546566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209002546566 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 00:25:47.568132 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=1212): Terminating (SIGTERM) 00:25:47.610047 run osmo-stp_10.42.42.4(pid=1213): Terminating (SIGTERM) 00:25:47.652432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1216): Terminating (SIGTERM) 00:25:47.696678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1219): Terminating (SIGTERM) 00:25:47.742821 --- ParallelTerminationStrategy: PID 1212 died... 00:25:47.763372 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=1212): Terminated: ok {rc=0} 00:25:47.813477 --- ParallelTerminationStrategy: PID 1213 died... 00:25:47.833171 run osmo-stp_10.42.42.4(pid=1213): Terminated: ok {rc=0} 00:25:47.879334 --- ParallelTerminationStrategy: PID 1216 died... 00:25:47.898725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1216): Terminated: ok {rc=0} 00:25:47.945214 --- ParallelTerminationStrategy: PID 1219 died... 00:25:47.964531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1219): Terminated: ok {rc=0} ---------------------------------------------- trial-2351 smpp esme_connect_policy_closed.py ---------------------------------------------- 00:25:48.015811 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:48.027180 tst smpp: Using 1 x bts (candidates: 1) 00:25:48.063048 tst esme_connect_policy_closed.py: using LAC 17797 00:25:48.185382 tst esme_connect_policy_closed.py: using RAC 202 00:25:48.310412 tst esme_connect_policy_closed.py: using CellId 17797 00:25:48.430019 tst esme_connect_policy_closed.py: using BVCI 17798 00:25:48.547752 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:48.558748 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:48.569602 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:48.589244 tst esme_connect_policy_closed.py: using MSISDN 6931 00:25:48.714884 tst esme_connect_policy_closed.py: using MSISDN 6932 00:25:48.833962 run osmo-stp_10.42.42.4: Starting osmo-stp 00:25:49.384536 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=1223): Launched 00:25:49.708458 run osmo-stp_10.42.42.4(pid=1224): Launched 00:25:49.832903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:25:50.335728 run create_hlr_db(pid=1225): Launched 00:25:51.517380 run create_hlr_db(pid=1225): Terminated: ok {rc=0} 00:25:51.860068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1227): Launched 00:25:52.184711 run osmo-hlr_10.42.42.2(pid=1228): Launched 00:25:52.309672 run osmo-msc_10.42.42.5: Starting osmo-msc 00:25:52.902783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1230): Launched 00:25:53.227725 run osmo-msc_10.42.42.5(pid=1232): Launched 00:25:53.408248 run osmo-hlr_10.42.42.2(pid=1228): ERR: Terminated: ERROR {rc=237} [trial-2351↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1228)] 00:25:53.545096 run osmo-hlr_10.42.42.2(pid=1228): stdout: | (launched: 2022-12-09_00:25:52.125986) 00:25:53.687256 run osmo-hlr_10.42.42.2(pid=1228): stderr: | [0;m[1;31m20221209002552325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002552325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002552325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002552325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002552325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002552325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002552341 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002552351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002552351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002552351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:53.825901 run osmo-hlr_10.42.42.2(pid=1228): stdout: | (launched: 2022-12-09_00:25:52.125986) 00:25:53.955254 run osmo-hlr_10.42.42.2(pid=1228): stderr: | [0;m[1;31m20221209002552325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002552325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002552325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002552325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002552325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002552325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002552341 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002552351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002552351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002552351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:54.110903 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=1228): Process ended prematurely: osmo-hlr_10.42.42.2(pid=1228) [trial-2351↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1228)] [trial-2351↪smpp↪esme_connect_policy_closed.py:31] 00:25:54.119996 tst esme_connect_policy_closed.py:31: Test FAILED (6.1 sec) 00:25:54.147970 run osmo-msc_10.42.42.5(pid=1232): ERR: Terminated: ERROR {rc=9} [trial-2351↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=1232)] 00:25:54.198285 run osmo-msc_10.42.42.5(pid=1232): stdout: | (launched: 2022-12-09_00:25:53.168741) 00:25:54.249963 run osmo-msc_10.42.42.5(pid=1232): stderr: | [0;m[38;5;43m20221209002553536 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221209002553536 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221209002553536 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221209002553536 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221209002553536 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221209002553537 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221209002553537 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221209002553537 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209002553537 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 00:25:54.302200 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=1223): Terminating (SIGTERM) 00:25:54.344024 run osmo-stp_10.42.42.4(pid=1224): Terminating (SIGTERM) 00:25:54.385755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1227): Terminating (SIGTERM) 00:25:54.428674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1230): Terminating (SIGTERM) 00:25:54.471666 --- ParallelTerminationStrategy: PID 1223 died... 00:25:54.491639 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=1223): Terminated: ok {rc=0} 00:25:54.539136 --- ParallelTerminationStrategy: PID 1224 died... 00:25:54.558574 run osmo-stp_10.42.42.4(pid=1224): Terminated: ok {rc=0} 00:25:54.604773 --- ParallelTerminationStrategy: PID 1227 died... 00:25:54.624207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1227): Terminated: ok {rc=0} 00:25:54.670568 --- ParallelTerminationStrategy: PID 1230 died... 00:25:54.690142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1230): Terminated: ok {rc=0} ---------------------------------------------- trial-2351 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 00:25:54.741877 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:54.753232 tst smpp: Using 1 x bts (candidates: 1) 00:25:54.789596 tst esme_ms_sms_storeforward.py: using LAC 17798 00:25:54.918153 tst esme_ms_sms_storeforward.py: using RAC 203 00:25:55.046474 tst esme_ms_sms_storeforward.py: using CellId 17798 00:25:55.179405 tst esme_ms_sms_storeforward.py: using BVCI 17799 00:25:55.298454 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:55.309422 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:55.320114 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:55.331073 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:55.342207 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:55.353342 tst smpp: Using 1 x modem (candidates: 1) 00:25:55.479498 tst esme_ms_sms_storeforward.py: using MSISDN 6933 00:25:55.592449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:25:56.065882 run create_hlr_db(pid=1235): Launched 00:25:57.244812 run create_hlr_db(pid=1235): Terminated: ok {rc=0} 00:25:57.568501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1237): Launched 00:25:57.875466 run osmo-hlr_10.42.42.2(pid=1238): Launched 00:25:57.991861 run osmo-stp_10.42.42.5: Starting osmo-stp 00:25:58.520078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1240): Launched 00:25:58.827397 run osmo-stp_10.42.42.5(pid=1241): Launched 00:25:58.945776 run osmo-msc_10.42.42.6: Starting osmo-msc 00:25:59.498866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1243): Launched 00:25:59.805415 run osmo-msc_10.42.42.6(pid=1244): Launched 00:25:59.975858 run osmo-stp_10.42.42.5(pid=1241): ERR: Terminated: ERROR {rc=1} [trial-2351↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1241)] 00:26:00.104800 run osmo-stp_10.42.42.5(pid=1241): stdout: | (launched: 2022-12-09_00:25:58.771407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:00.234067 run osmo-stp_10.42.42.5(pid=1241): stderr: | [0;m[38;5;43m20221209002558944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002558944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002558945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002558945 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002558946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002558946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002558946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:00.360817 run osmo-stp_10.42.42.5(pid=1241): stdout: | (launched: 2022-12-09_00:25:58.771407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:00.482398 run osmo-stp_10.42.42.5(pid=1241): stderr: | [0;m[38;5;43m20221209002558944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002558944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002558945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002558945 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002558946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002558946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002558946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:00.627458 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=1241): Process ended prematurely: osmo-stp_10.42.42.5(pid=1241) [trial-2351↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1241)] [trial-2351↪smpp↪esme_ms_sms_storeforward.py:30] 00:26:00.635621 tst esme_ms_sms_storeforward.py:30: Test FAILED (5.9 sec) 00:26:00.661063 run osmo-hlr_10.42.42.2(pid=1238): ERR: Terminated: ERROR {rc=237} [trial-2351↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1238)] 00:26:00.707627 run osmo-hlr_10.42.42.2(pid=1238): stdout: | (launched: 2022-12-09_00:25:57.819442) 00:26:00.755898 run osmo-hlr_10.42.42.2(pid=1238): stderr: | [0;m[1;31m20221209002557997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002557997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002557997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002557997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002557997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002557997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002558009 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002558018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002558019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002558019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:26:00.828289 run osmo-msc_10.42.42.6(pid=1244): ERR: Terminated: ERROR {rc=2} [trial-2351↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1244)] 00:26:00.889666 run osmo-msc_10.42.42.6(pid=1244): stdout: | (launched: 2022-12-09_00:25:59.749552) 00:26:00.945309 run osmo-msc_10.42.42.6(pid=1244): stderr: | [0;m[38;5;43m20221209002600024 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209002600024 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe697432c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209002600024 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209002600024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209002600024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209002600025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209002600026 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209002600028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209002600028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209002600028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:26:00.999676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1237): Terminating (SIGTERM) 00:26:01.045395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1240): Terminating (SIGTERM) 00:26:01.091814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1243): Terminating (SIGTERM) 00:26:01.138148 --- ParallelTerminationStrategy: PID 1237 died... 00:26:01.159310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1237): Terminated: ok {rc=0} 00:26:01.209924 --- ParallelTerminationStrategy: PID 1240 died... 00:26:01.231375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1240): Terminated: ok {rc=0} 00:26:01.280432 --- ParallelTerminationStrategy: PID 1243 died... 00:26:01.300665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1243): Terminated: ok {rc=0} 00:26:01.391625 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 smpp esme_ms_sms_transaction.py ---------------------------------------------- 00:26:02.478814 tst smpp: Using 1 x ip_address (candidates: 6) 00:26:02.489740 tst smpp: Using 1 x bts (candidates: 1) 00:26:02.525666 tst esme_ms_sms_transaction.py: using LAC 17799 00:26:02.646956 tst esme_ms_sms_transaction.py: using RAC 204 00:26:02.767928 tst esme_ms_sms_transaction.py: using CellId 17799 00:26:02.888758 tst esme_ms_sms_transaction.py: using BVCI 17800 00:26:02.998176 tst smpp: Using 1 x ip_address (candidates: 6) 00:26:03.008344 tst smpp: Using 1 x ip_address (candidates: 6) 00:26:03.018547 tst smpp: Using 1 x ip_address (candidates: 6) 00:26:03.028648 tst smpp: Using 1 x ip_address (candidates: 6) 00:26:03.038876 tst smpp: Using 1 x ip_address (candidates: 6) 00:26:03.048917 tst smpp: Using 1 x modem (candidates: 1) 00:26:03.180241 tst esme_ms_sms_transaction.py: using MSISDN 6934 00:26:03.291662 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:26:03.763722 run create_hlr_db(pid=1246): Launched 00:26:03.888491 bus /sierra_2: Setting Powered False 00:26:04.948196 run create_hlr_db(pid=1246): Terminated: ok {rc=0} 00:26:05.392423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1248): Launched 00:26:05.718119 run osmo-hlr_10.42.42.2(pid=1249): Launched 00:26:05.842790 run osmo-stp_10.42.42.5: Starting osmo-stp 00:26:06.402900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1251): Launched 00:26:06.726972 run osmo-stp_10.42.42.5(pid=1252): Launched 00:26:06.851017 run osmo-msc_10.42.42.6: Starting osmo-msc 00:26:07.437900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1254): Launched 00:26:07.762222 run osmo-msc_10.42.42.6(pid=1255): Launched 00:26:07.943016 run osmo-stp_10.42.42.5(pid=1252): ERR: Terminated: ERROR {rc=1} [trial-2351↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1252)] 00:26:08.080754 run osmo-stp_10.42.42.5(pid=1252): stdout: | (launched: 2022-12-09_00:26:06.668229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:08.218747 run osmo-stp_10.42.42.5(pid=1252): stderr: | [0;m[38;5;43m20221209002606862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002606862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002606863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002606863 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002606863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002606864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002606864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:08.356090 run osmo-stp_10.42.42.5(pid=1252): stdout: | (launched: 2022-12-09_00:26:06.668229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:08.486033 run osmo-stp_10.42.42.5(pid=1252): stderr: | [0;m[38;5;43m20221209002606862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002606862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002606863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002606863 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002606863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002606864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002606864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:08.640930 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=1252): Process ended prematurely: osmo-stp_10.42.42.5(pid=1252) [trial-2351↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1252)] [trial-2351↪smpp↪esme_ms_sms_transaction.py:28] 00:26:08.650128 tst esme_ms_sms_transaction.py:28: Test FAILED (6.2 sec) 00:26:08.678380 run osmo-hlr_10.42.42.2(pid=1249): ERR: Terminated: ERROR {rc=237} [trial-2351↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1249)] 00:26:08.728777 run osmo-hlr_10.42.42.2(pid=1249): stdout: | (launched: 2022-12-09_00:26:05.659287) 00:26:08.780821 run osmo-hlr_10.42.42.2(pid=1249): stderr: | [0;m[1;31m20221209002605859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002605859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002605859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002605859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002605859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002605860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002605872 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002605880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002605880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002605880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:26:08.852714 run osmo-msc_10.42.42.6(pid=1255): ERR: Terminated: ERROR {rc=2} [trial-2351↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1255)] 00:26:08.902610 run osmo-msc_10.42.42.6(pid=1255): stdout: | (launched: 2022-12-09_00:26:07.703224) 00:26:08.954193 run osmo-msc_10.42.42.6(pid=1255): stderr: | [0;m[38;5;43m20221209002608028 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209002608028 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f153c14ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209002608028 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209002608028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209002608029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209002608029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209002608032 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209002608032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209002608032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209002608032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:26:09.006084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1248): Terminating (SIGTERM) 00:26:09.047380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1251): Terminating (SIGTERM) 00:26:09.088648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1254): Terminating (SIGTERM) 00:26:09.130471 --- ParallelTerminationStrategy: PID 1248 died... 00:26:09.150060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1248): Terminated: ok {rc=0} 00:26:09.196161 --- ParallelTerminationStrategy: PID 1251 died... 00:26:09.215286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1251): Terminated: ok {rc=0} 00:26:09.260816 --- ParallelTerminationStrategy: PID 1254 died... 00:26:09.280241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1254): Terminated: ok {rc=0} 00:26:09.366772 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 encryption --------------------------------------------------------------------- 00:26:10.560886 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:26:10.564267 tst encryption: Verifying 1 x bts (candidates: 11) 00:26:10.585835 tst encryption: Verifying 6 x ip_address (candidates: 9) 00:26:10.614112 tst encryption: Verifying 1 x modem (candidates: 12) 00:26:10.649697 tst encryption: Reserving 1 x bts (candidates: 11) 00:26:10.671392 tst encryption: Reserving 6 x ip_address (candidates: 9) 00:26:10.699383 tst encryption: Reserving 1 x modem (candidates: 12) 00:26:11.226863 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2351 encryption register_a5_0_authopt.py ---------------------------------------------- 00:26:11.282250 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:11.293180 tst encryption: Using 1 x bts (candidates: 1) 00:26:11.329920 tst register_a5_0_authopt.py: using LAC 17800 00:26:11.461051 tst register_a5_0_authopt.py: using RAC 205 00:26:11.590364 tst register_a5_0_authopt.py: using CellId 17800 00:26:11.718764 tst register_a5_0_authopt.py: using BVCI 17801 00:26:11.840516 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:11.851759 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:11.862465 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:11.874009 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:11.885514 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:11.896879 tst encryption: Using 1 x modem (candidates: 1) 00:26:12.012013 tst register_a5_0_authopt.py:8: start network... 00:26:12.221137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:26:12.699322 run create_hlr_db(pid=1260): Launched 00:26:12.826157 bus /sierra_2: Setting Powered False 00:26:13.886931 run create_hlr_db(pid=1260): Terminated: ok {rc=0} 00:26:14.316349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1262): Launched 00:26:14.625696 run osmo-hlr_10.42.42.2(pid=1263): Launched 00:26:14.743583 run osmo-stp_10.42.42.5: Starting osmo-stp 00:26:15.296034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1265): Launched 00:26:15.605317 run osmo-stp_10.42.42.5(pid=1266): Launched 00:26:15.723292 run osmo-msc_10.42.42.6: Starting osmo-msc 00:26:16.310170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1268): Launched 00:26:16.645663 run osmo-msc_10.42.42.6(pid=1269): Launched 00:26:16.916532 run osmo-stp_10.42.42.5(pid=1266): ERR: Terminated: ERROR {rc=1} [trial-2351↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1266)] 00:26:17.179379 run osmo-stp_10.42.42.5(pid=1266): stdout: | (launched: 2022-12-09_00:26:15.548365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:17.343164 run osmo-stp_10.42.42.5(pid=1266): stderr: | [0;m[38;5;43m20221209002615720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002615721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002615721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002615721 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002615722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002615722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002615722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:17.482307 run osmo-stp_10.42.42.5(pid=1266): stdout: | (launched: 2022-12-09_00:26:15.548365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:17.613394 run osmo-stp_10.42.42.5(pid=1266): stderr: | [0;m[38;5;43m20221209002615720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002615721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002615721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002615721 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002615722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002615722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002615722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:17.770392 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1266): Process ended prematurely: osmo-stp_10.42.42.5(pid=1266) [trial-2351↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1266)] [trial-2351↪encryption↪register_a5_0_authopt.py:8] 00:26:17.780016 tst register_a5_0_authopt.py:8: Test FAILED (6.5 sec) 00:26:17.807924 run osmo-hlr_10.42.42.2(pid=1263): ERR: Terminated: ERROR {rc=237} [trial-2351↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1263)] 00:26:17.858003 run osmo-hlr_10.42.42.2(pid=1263): stdout: | (launched: 2022-12-09_00:26:14.569707) 00:26:17.909556 run osmo-hlr_10.42.42.2(pid=1263): stderr: | [0;m[1;31m20221209002614749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002614749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002614749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002614749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002614749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002614749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002614762 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002614770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002614771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002614771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:26:17.981599 run osmo-msc_10.42.42.6(pid=1269): ERR: Terminated: ERROR {rc=2} [trial-2351↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1269)] 00:26:18.031596 run osmo-msc_10.42.42.6(pid=1269): stdout: | (launched: 2022-12-09_00:26:16.577761) 00:26:18.083025 run osmo-msc_10.42.42.6(pid=1269): stderr: | [0;m[38;5;43m20221209002617166 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209002617166 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f40a464dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209002617166 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209002617166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209002617166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209002617167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209002617168 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209002617173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209002617173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209002617173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:26:18.134872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1262): Terminating (SIGTERM) 00:26:18.176487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1265): Terminating (SIGTERM) 00:26:18.218499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1268): Terminating (SIGTERM) 00:26:18.260444 --- ParallelTerminationStrategy: PID 1262 died... 00:26:18.280144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1262): Terminated: ok {rc=0} 00:26:18.326593 --- ParallelTerminationStrategy: PID 1265 died... 00:26:18.345980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1265): Terminated: ok {rc=0} 00:26:18.392032 --- ParallelTerminationStrategy: PID 1268 died... 00:26:18.411407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1268): Terminated: ok {rc=0} 00:26:18.498930 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 encryption register_a5_0_authreq.py ---------------------------------------------- 00:26:19.648356 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:19.659921 tst encryption: Using 1 x bts (candidates: 1) 00:26:19.699759 tst register_a5_0_authreq.py: using LAC 17801 00:26:19.827455 tst register_a5_0_authreq.py: using RAC 206 00:26:19.954934 tst register_a5_0_authreq.py: using CellId 17801 00:26:20.074932 tst register_a5_0_authreq.py: using BVCI 17802 00:26:20.186556 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:20.196907 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:20.207407 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:20.217825 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:20.228025 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:20.238314 tst encryption: Using 1 x modem (candidates: 1) 00:26:20.354259 tst register_a5_0_authreq.py:8: start network... 00:26:20.563116 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:26:21.042528 run create_hlr_db(pid=1271): Launched 00:26:21.168272 bus /sierra_2: Setting Powered False 00:26:22.229805 run create_hlr_db(pid=1271): Terminated: ok {rc=0} 00:26:22.658965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1273): Launched 00:26:22.969368 run osmo-hlr_10.42.42.2(pid=1274): Launched 00:26:23.087168 run osmo-stp_10.42.42.5: Starting osmo-stp 00:26:23.618092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1276): Launched 00:26:23.928585 run osmo-stp_10.42.42.5(pid=1277): Launched 00:26:24.046722 run osmo-msc_10.42.42.6: Starting osmo-msc 00:26:24.619475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1279): Launched 00:26:24.930204 run osmo-msc_10.42.42.6(pid=1280): Launched 00:26:25.102747 run osmo-stp_10.42.42.5(pid=1277): ERR: Terminated: ERROR {rc=1} [trial-2351↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1277)] 00:26:25.233510 run osmo-stp_10.42.42.5(pid=1277): stdout: | (launched: 2022-12-09_00:26:23.872083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:25.363750 run osmo-stp_10.42.42.5(pid=1277): stderr: | [0;m[38;5;43m20221209002624047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002624047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002624048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002624048 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002624049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002624049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002624049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:25.492206 run osmo-stp_10.42.42.5(pid=1277): stdout: | (launched: 2022-12-09_00:26:23.872083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:25.615177 run osmo-stp_10.42.42.5(pid=1277): stderr: | [0;m[38;5;43m20221209002624047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002624047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002624048 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002624048 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002624049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002624049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002624049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:25.762770 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1277): Process ended prematurely: osmo-stp_10.42.42.5(pid=1277) [trial-2351↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1277)] [trial-2351↪encryption↪register_a5_0_authreq.py:8] 00:26:25.771679 tst register_a5_0_authreq.py:8: Test FAILED (6.2 sec) 00:26:25.797710 run osmo-hlr_10.42.42.2(pid=1274): ERR: Terminated: ERROR {rc=237} [trial-2351↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1274)] 00:26:25.844236 run osmo-hlr_10.42.42.2(pid=1274): stdout: | (launched: 2022-12-09_00:26:22.912452) 00:26:25.892476 run osmo-hlr_10.42.42.2(pid=1274): stderr: | [0;m[1;31m20221209002623091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002623091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002623091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002623091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002623091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002623091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002623103 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002623112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002623112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002623112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:26:25.959620 run osmo-msc_10.42.42.6(pid=1280): ERR: Terminated: ERROR {rc=2} [trial-2351↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1280)] 00:26:26.006061 run osmo-msc_10.42.42.6(pid=1280): stdout: | (launched: 2022-12-09_00:26:24.873929) 00:26:26.054387 run osmo-msc_10.42.42.6(pid=1280): stderr: | [0;m[38;5;43m20221209002625148 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209002625148 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f190a619c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209002625148 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209002625148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209002625148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209002625149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209002625150 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209002625151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209002625151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209002625151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:26:26.102905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1273): Terminating (SIGTERM) 00:26:26.141742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1276): Terminating (SIGTERM) 00:26:26.180429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1279): Terminating (SIGTERM) 00:26:26.219491 --- ParallelTerminationStrategy: PID 1273 died... 00:26:26.238171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1273): Terminated: ok {rc=0} 00:26:26.281559 --- ParallelTerminationStrategy: PID 1276 died... 00:26:26.299922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1276): Terminated: ok {rc=0} 00:26:26.343061 --- ParallelTerminationStrategy: PID 1279 died... 00:26:26.361474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1279): Terminated: ok {rc=0} 00:26:26.446204 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 encryption register_a5_1_authreq.py ---------------------------------------------- 00:26:27.595021 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:27.606236 tst encryption: Using 1 x bts (candidates: 1) 00:26:27.641760 tst register_a5_1_authreq.py: using LAC 17802 00:26:27.765280 tst register_a5_1_authreq.py: using RAC 207 00:26:27.887838 tst register_a5_1_authreq.py: using CellId 17802 00:26:28.010732 tst register_a5_1_authreq.py: using BVCI 17803 00:26:28.124258 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:28.134809 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:28.145055 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:28.155956 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:28.166278 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:28.176394 tst encryption: Using 1 x modem (candidates: 1) 00:26:28.294737 tst register_a5_1_authreq.py:8: start network... 00:26:28.518482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:26:29.029262 run create_hlr_db(pid=1282): Launched 00:26:29.157239 bus /sierra_2: Setting Powered False 00:26:30.222231 run create_hlr_db(pid=1282): Terminated: ok {rc=0} 00:26:30.663580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1284): Launched 00:26:31.016567 run osmo-hlr_10.42.42.2(pid=1285): Launched 00:26:31.258970 run osmo-stp_10.42.42.5: Starting osmo-stp 00:26:31.899916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1287): Launched 00:26:32.248630 run osmo-stp_10.42.42.5(pid=1288): Launched 00:26:32.375221 run osmo-msc_10.42.42.6: Starting osmo-msc 00:26:32.966782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1290): Launched 00:26:33.280423 run osmo-msc_10.42.42.6(pid=1291): Launched 00:26:33.454205 run osmo-stp_10.42.42.5(pid=1288): ERR: Terminated: ERROR {rc=1} [trial-2351↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1288)] 00:26:33.586681 run osmo-stp_10.42.42.5(pid=1288): stdout: | (launched: 2022-12-09_00:26:32.187055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:33.717238 run osmo-stp_10.42.42.5(pid=1288): stderr: | [0;m[38;5;43m20221209002632380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002632380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002632380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002632381 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002632381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002632381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002632382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:33.846397 run osmo-stp_10.42.42.5(pid=1288): stdout: | (launched: 2022-12-09_00:26:32.187055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:33.969323 run osmo-stp_10.42.42.5(pid=1288): stderr: | [0;m[38;5;43m20221209002632380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002632380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002632380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002632381 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002632381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002632381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002632382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:34.116245 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1288): Process ended prematurely: osmo-stp_10.42.42.5(pid=1288) [trial-2351↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1288)] [trial-2351↪encryption↪register_a5_1_authreq.py:8] 00:26:34.125114 tst register_a5_1_authreq.py:8: Test FAILED (6.6 sec) 00:26:34.150975 run osmo-hlr_10.42.42.2(pid=1285): ERR: Terminated: ERROR {rc=237} [trial-2351↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1285)] 00:26:34.198080 run osmo-hlr_10.42.42.2(pid=1285): stdout: | (launched: 2022-12-09_00:26:30.951464) 00:26:34.246637 run osmo-hlr_10.42.42.2(pid=1285): stderr: | [0;m[1;31m20221209002631164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002631164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002631164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002631164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002631164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002631164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002631183 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002631191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002631192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002631192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:26:34.314252 run osmo-msc_10.42.42.6(pid=1291): ERR: Terminated: ERROR {rc=2} [trial-2351↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1291)] 00:26:34.360924 run osmo-msc_10.42.42.6(pid=1291): stdout: | (launched: 2022-12-09_00:26:33.224177) 00:26:34.409324 run osmo-msc_10.42.42.6(pid=1291): stderr: | [0;m[38;5;43m20221209002633496 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209002633496 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7857f52c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209002633496 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209002633496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209002633496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209002633497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209002633498 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209002633499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209002633499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209002633499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:26:34.457820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1284): Terminating (SIGTERM) 00:26:34.496497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1287): Terminating (SIGTERM) 00:26:34.535371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1290): Terminating (SIGTERM) 00:26:34.574430 --- ParallelTerminationStrategy: PID 1284 died... 00:26:34.592920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1284): Terminated: ok {rc=0} 00:26:34.636277 --- ParallelTerminationStrategy: PID 1287 died... 00:26:34.654538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1287): Terminated: ok {rc=0} 00:26:34.697499 --- ParallelTerminationStrategy: PID 1290 died... 00:26:34.715750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1290): Terminated: ok {rc=0} 00:26:34.800290 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2351 encryption register_a5_3_authreq.py ---------------------------------------------- 00:26:35.949236 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:35.960275 tst encryption: Using 1 x bts (candidates: 1) 00:26:35.995746 tst register_a5_3_authreq.py: using LAC 17803 00:26:36.126295 tst register_a5_3_authreq.py: using RAC 208 00:26:36.255987 tst register_a5_3_authreq.py: using CellId 17803 00:26:36.385589 tst register_a5_3_authreq.py: using BVCI 17804 00:26:36.505364 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:36.516180 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:36.526989 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:36.538037 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:36.548917 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:36.559902 tst encryption: Using 1 x modem (candidates: 1) 00:26:36.684074 tst register_a5_3_authreq.py:8: start network... 00:26:36.893500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:26:37.371557 run create_hlr_db(pid=1293): Launched 00:26:37.498430 bus /sierra_2: Setting Powered False 00:26:38.559424 run create_hlr_db(pid=1293): Terminated: ok {rc=0} 00:26:39.006951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1295): Launched 00:26:39.336065 run osmo-hlr_10.42.42.2(pid=1296): Launched 00:26:39.462777 run osmo-stp_10.42.42.5: Starting osmo-stp 00:26:40.002993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1298): Launched 00:26:40.333600 run osmo-stp_10.42.42.5(pid=1299): Launched 00:26:40.459276 run osmo-msc_10.42.42.6: Starting osmo-msc 00:26:41.053169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1301): Launched 00:26:41.381770 run osmo-msc_10.42.42.6(pid=1302): Launched 00:26:41.564449 run osmo-stp_10.42.42.5(pid=1299): ERR: Terminated: ERROR {rc=1} [trial-2351↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1299)] 00:26:41.703181 run osmo-stp_10.42.42.5(pid=1299): stdout: | (launched: 2022-12-09_00:26:40.274057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:41.843649 run osmo-stp_10.42.42.5(pid=1299): stderr: | [0;m[38;5;43m20221209002640467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002640467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002640467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002640468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002640468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002640468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002640468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:41.982124 run osmo-stp_10.42.42.5(pid=1299): stdout: | (launched: 2022-12-09_00:26:40.274057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:42.113597 run osmo-stp_10.42.42.5(pid=1299): stderr: | [0;m[38;5;43m20221209002640467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002640467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002640467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002640468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002640468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002640468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002640468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:42.270218 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1299): Process ended prematurely: osmo-stp_10.42.42.5(pid=1299) [trial-2351↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1299)] [trial-2351↪encryption↪register_a5_3_authreq.py:8] 00:26:42.279746 tst register_a5_3_authreq.py:8: Test FAILED (6.4 sec) 00:26:42.307664 run osmo-hlr_10.42.42.2(pid=1296): ERR: Terminated: ERROR {rc=237} [trial-2351↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1296)] 00:26:42.357456 run osmo-hlr_10.42.42.2(pid=1296): stdout: | (launched: 2022-12-09_00:26:39.276546) 00:26:42.408792 run osmo-hlr_10.42.42.2(pid=1296): stderr: | [0;m[1;31m20221209002639478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002639478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002639478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002639478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002639478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002639478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002639492 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002639500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002639500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002639500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:26:42.480127 run osmo-msc_10.42.42.6(pid=1302): ERR: Terminated: ERROR {rc=2} [trial-2351↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1302)] 00:26:42.529771 run osmo-msc_10.42.42.6(pid=1302): stdout: | (launched: 2022-12-09_00:26:41.322405) 00:26:42.581419 run osmo-msc_10.42.42.6(pid=1302): stderr: | [0;m[38;5;43m20221209002641647 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209002641647 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff7d0191c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209002641647 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209002641647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209002641648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209002641648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209002641650 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209002641650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209002641650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209002641650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:26:42.632914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1295): Terminating (SIGTERM) 00:26:42.674484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1298): Terminating (SIGTERM) 00:26:42.716025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1301): Terminating (SIGTERM) 00:26:42.758087 --- ParallelTerminationStrategy: PID 1295 died... 00:26:42.777644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1295): Terminated: ok {rc=0} 00:26:42.823692 --- ParallelTerminationStrategy: PID 1298 died... 00:26:42.843125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1298): Terminated: ok {rc=0} 00:26:42.889053 --- ParallelTerminationStrategy: PID 1301 died... 00:26:42.908275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1301): Terminated: ok {rc=0} 00:26:42.995093 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 00:26:44.200433 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:26:44.205701 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 00:26:44.224312 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 00:26:44.252785 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 00:26:44.281155 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 00:26:44.300315 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 00:26:44.327602 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 00:26:44.838804 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2351 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 00:26:44.843540 tst handover.py:11: TEST_CONFIG: {} 00:26:45.064002 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:26:45.080118 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:26:45.103641 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:26:45.153371 tst handover.py: using MSISDN 6935 00:26:45.272677 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6935', subscriber_id=0} 00:26:45.387654 run srsepc_10.42.42.118: Starting srsepc 00:26:47.314557 run rm-remote-dir(pid=1308): Launched 00:26:47.444245 bus /sierra_2: Setting Powered False 00:26:48.509976 run rm-remote-dir(pid=1308): Terminated: ok {rc=0} 00:26:48.957358 run mk-remote-dir(pid=1309): Launched 00:26:50.138708 run mk-remote-dir(pid=1309): Terminated: ok {rc=0} 00:26:50.426466 run scp-inst-to-remote(pid=1310): Launched 00:26:52.606664 run scp-inst-to-remote(pid=1310): Terminated: ok {rc=0} 00:26:52.942483 run rm-remote-dir(pid=1312): Launched 00:26:54.123565 run rm-remote-dir(pid=1312): Terminated: ok {rc=0} 00:26:54.461152 run mk-remote-dir(pid=1313): Launched 00:26:55.642680 run mk-remote-dir(pid=1313): Terminated: ok {rc=0} 00:26:55.931202 run scp-cfg-to-remote(pid=1314): Launched 00:26:57.109969 run scp-cfg-to-remote(pid=1314): Terminated: ok {rc=0} 00:26:57.395134 run scp-db-to-remote(pid=1316): Launched 00:26:58.574883 run scp-db-to-remote(pid=1316): Terminated: ok {rc=0} 00:26:58.707055 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:26:59.017313 run patchelf(pid=1318): Launched 00:27:00.196095 run patchelf(pid=1318): Terminated: ok {rc=0} 00:27:00.328564 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:27:00.638469 run setcap-netadm(pid=1319): Launched 00:27:01.817374 run setcap-netadm(pid=1319): Terminated: ok {rc=0} 00:27:02.156395 run srsepc(pid=1320): Launched 00:27:02.285353 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:27:03.462472 run rm-remote-dir(pid=1321): Launched 00:27:03.649199 run srsepc(pid=1320): ERR: Terminated: ERROR {rc=127} [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1320)] 00:27:03.792817 run srsepc(pid=1320): stdout: | (launched: 2022-12-09_00:27:02.091192) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:27:03.936563 run srsepc(pid=1320): stderr: | (launched: 2022-12-09_00:27:02.137682) | Connection to 10.42.42.116 closed. 00:27:04.080627 run srsepc(pid=1320): stdout: | (launched: 2022-12-09_00:27:02.091192) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:27:04.218834 run srsepc(pid=1320): stderr: | (launched: 2022-12-09_00:27:02.137682) | Connection to 10.42.42.116 closed. 00:27:04.382774 run rm-remote-dir(pid=1321): Terminating (SIGINT) 00:27:04.571145 run rm-remote-dir(pid=1321): Terminated: ok {rc=0} 00:27:04.706958 tst handover.py:37: ERR: Error: srsepc(pid=1320): Process ended prematurely: srsepc(pid=1320) [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1320)] [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 00:27:04.717637 tst handover.py:37: Test FAILED (19.9 sec) 00:27:04.798129 run scp-back-log(pid=1322): Launched 00:27:05.878226 run scp-back-log(pid=1322): ERR: Terminated: ERROR {rc=1} [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1322)] 00:27:05.941604 run scp-back-log(pid=1322): stdout: | (launched: 2022-12-09_00:27:04.766742) 00:27:06.008611 run scp-back-log(pid=1322): stderr: | (launched: 2022-12-09_00:27:04.787222) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:27:06.078168 tst srsepc_10.42.42.118: Error('scp-back-log(pid=1322): launch_sync(): local process exited with status 1 [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1322)]') ---------------------------------------------- trial-2351 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 00:27:06.122689 tst iperf3_bidir.py:13: Number of physical ue: 1 00:27:06.329850 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:27:06.373648 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 00:27:06.594154 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:27:06.610394 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:27:06.643176 tst iperf3_bidir.py: using MSISDN 6936 00:27:06.755529 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6936', subscriber_id=0} 00:27:06.863376 run srsepc_10.42.42.118: Starting srsepc 00:27:07.494639 run rm-remote-dir(pid=1324): Launched 00:27:08.675708 run rm-remote-dir(pid=1324): Terminated: ok {rc=0} 00:27:09.011763 run mk-remote-dir(pid=1325): Launched 00:27:10.192212 run mk-remote-dir(pid=1325): Terminated: ok {rc=0} 00:27:10.479217 run scp-inst-to-remote(pid=1326): Launched 00:27:12.659673 run scp-inst-to-remote(pid=1326): Terminated: ok {rc=0} 00:27:12.994400 run rm-remote-dir(pid=1328): Launched 00:27:14.175145 run rm-remote-dir(pid=1328): Terminated: ok {rc=0} 00:27:14.511869 run mk-remote-dir(pid=1329): Launched 00:27:15.691820 run mk-remote-dir(pid=1329): Terminated: ok {rc=0} 00:27:16.021324 run scp-cfg-to-remote(pid=1330): Launched 00:27:17.266263 run scp-cfg-to-remote(pid=1330): Terminated: ok {rc=0} 00:27:17.569521 run scp-db-to-remote(pid=1332): Launched 00:27:18.757510 run scp-db-to-remote(pid=1332): Terminated: ok {rc=0} 00:27:18.898452 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:27:19.227401 run patchelf(pid=1334): Launched 00:27:20.414978 run patchelf(pid=1334): Terminated: ok {rc=0} 00:27:20.555429 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:27:20.885416 run setcap-netadm(pid=1335): Launched 00:27:22.072484 run setcap-netadm(pid=1335): Terminated: ok {rc=0} 00:27:22.417957 run srsepc(pid=1336): Launched 00:27:22.539259 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:27:23.720785 run rm-remote-dir(pid=1337): Launched 00:27:23.908105 run srsepc(pid=1336): ERR: Terminated: ERROR {rc=127} [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1336)] 00:27:24.051272 run srsepc(pid=1336): stdout: | (launched: 2022-12-09_00:27:22.358589) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:27:24.195293 run srsepc(pid=1336): stderr: | (launched: 2022-12-09_00:27:22.407450) | Connection to 10.42.42.116 closed. 00:27:24.338609 run srsepc(pid=1336): stdout: | (launched: 2022-12-09_00:27:22.358589) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:27:24.476327 run srsepc(pid=1336): stderr: | (launched: 2022-12-09_00:27:22.407450) | Connection to 10.42.42.116 closed. 00:27:24.639973 run rm-remote-dir(pid=1337): Terminating (SIGINT) 00:27:24.828780 run rm-remote-dir(pid=1337): Terminated: ok {rc=0} 00:27:24.965270 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=1336): Process ended prematurely: srsepc(pid=1336) [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1336)] [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 00:27:24.976012 tst iperf3_bidir.py:42: Test FAILED (18.8 sec) 00:27:25.056097 run scp-back-log(pid=1338): Launched 00:27:26.135496 run scp-back-log(pid=1338): ERR: Terminated: ERROR {rc=1} [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1338)] 00:27:26.199186 run scp-back-log(pid=1338): stdout: | (launched: 2022-12-09_00:27:25.024884) 00:27:26.264210 run scp-back-log(pid=1338): stderr: | (launched: 2022-12-09_00:27:25.045394) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:27:26.336885 tst srsepc_10.42.42.118: Error('scp-back-log(pid=1338): launch_sync(): local process exited with status 1 [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1338)]') ---------------------------------------------- trial-2351 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 00:27:26.383941 tst iperf3_dl.py:13: Number of physical ue: 1 00:27:26.604769 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:27:26.650011 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 00:27:26.870317 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:27:26.886367 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:27:26.918763 tst iperf3_dl.py: using MSISDN 6937 00:27:27.038879 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6937', subscriber_id=0} 00:27:27.153169 run srsepc_10.42.42.118: Starting srsepc 00:27:27.820562 run rm-remote-dir(pid=1340): Launched 00:27:29.010510 run rm-remote-dir(pid=1340): Terminated: ok {rc=0} 00:27:29.367351 run mk-remote-dir(pid=1341): Launched 00:27:30.556647 run mk-remote-dir(pid=1341): Terminated: ok {rc=0} 00:27:30.873760 run scp-inst-to-remote(pid=1342): Launched 00:27:33.150464 run scp-inst-to-remote(pid=1342): Terminated: ok {rc=0} 00:27:33.485284 run rm-remote-dir(pid=1344): Launched 00:27:34.665888 run rm-remote-dir(pid=1344): Terminated: ok {rc=0} 00:27:35.001584 run mk-remote-dir(pid=1345): Launched 00:27:36.182229 run mk-remote-dir(pid=1345): Terminated: ok {rc=0} 00:27:36.468722 run scp-cfg-to-remote(pid=1349): Launched 00:27:37.646760 run scp-cfg-to-remote(pid=1349): Terminated: ok {rc=0} 00:27:37.931543 run scp-db-to-remote(pid=1351): Launched 00:27:39.110403 run scp-db-to-remote(pid=1351): Terminated: ok {rc=0} 00:27:39.242307 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:27:39.550829 run patchelf(pid=1353): Launched 00:27:40.730107 run patchelf(pid=1353): Terminated: ok {rc=0} 00:27:40.862539 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:27:41.171131 run setcap-netadm(pid=1354): Launched 00:27:42.349490 run setcap-netadm(pid=1354): Terminated: ok {rc=0} 00:27:42.673161 run srsepc(pid=1355): Launched 00:27:42.789191 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:27:43.900527 run rm-remote-dir(pid=1356): Launched 00:27:44.079298 run srsepc(pid=1355): ERR: Terminated: ERROR {rc=127} [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1355)] 00:27:44.215437 run srsepc(pid=1355): stdout: | (launched: 2022-12-09_00:27:42.617165) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:27:44.351238 run srsepc(pid=1355): stderr: | (launched: 2022-12-09_00:27:42.662751) | Connection to 10.42.42.116 closed. 00:27:44.486223 run srsepc(pid=1355): stdout: | (launched: 2022-12-09_00:27:42.617165) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:27:44.616418 run srsepc(pid=1355): stderr: | (launched: 2022-12-09_00:27:42.662751) | Connection to 10.42.42.116 closed. 00:27:44.770176 run rm-remote-dir(pid=1356): Terminating (SIGINT) 00:27:44.947628 run rm-remote-dir(pid=1356): Terminated: ok {rc=0} 00:27:45.075363 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=1355): Process ended prematurely: srsepc(pid=1355) [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1355)] [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 00:27:45.085397 tst iperf3_dl.py:42: Test FAILED (18.7 sec) 00:27:45.161245 run scp-back-log(pid=1357): Launched 00:27:46.234878 run scp-back-log(pid=1357): ERR: Terminated: ERROR {rc=1} [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1357)] 00:27:46.298258 run scp-back-log(pid=1357): stdout: | (launched: 2022-12-09_00:27:45.131259) 00:27:46.361184 run scp-back-log(pid=1357): stderr: | (launched: 2022-12-09_00:27:45.150506) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:27:46.430785 tst srsepc_10.42.42.118: Error('scp-back-log(pid=1357): launch_sync(): local process exited with status 1 [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1357)]') ---------------------------------------------- trial-2351 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 00:27:46.477371 tst iperf3_ul.py:13: Number of physical ue: 1 00:27:46.688826 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:27:46.734401 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 00:27:46.959839 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:27:46.977341 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:27:47.013675 tst iperf3_ul.py: using MSISDN 6938 00:27:47.135741 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6938', subscriber_id=0} 00:27:47.252030 run srsepc_10.42.42.118: Starting srsepc 00:27:47.920872 run rm-remote-dir(pid=1359): Launched 00:27:49.111391 run rm-remote-dir(pid=1359): Terminated: ok {rc=0} 00:27:49.468698 run mk-remote-dir(pid=1360): Launched 00:27:50.658221 run mk-remote-dir(pid=1360): Terminated: ok {rc=0} 00:27:50.964241 run scp-inst-to-remote(pid=1361): Launched 00:27:53.153573 run scp-inst-to-remote(pid=1361): Terminated: ok {rc=0} 00:27:53.509454 run rm-remote-dir(pid=1363): Launched 00:27:54.699184 run rm-remote-dir(pid=1363): Terminated: ok {rc=0} 00:27:55.057622 run mk-remote-dir(pid=1364): Launched 00:27:56.247200 run mk-remote-dir(pid=1364): Terminated: ok {rc=0} 00:27:56.552396 run scp-cfg-to-remote(pid=1365): Launched 00:27:57.737248 run scp-cfg-to-remote(pid=1365): Terminated: ok {rc=0} 00:27:58.023244 run scp-db-to-remote(pid=1367): Launched 00:27:59.202967 run scp-db-to-remote(pid=1367): Terminated: ok {rc=0} 00:27:59.335973 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:27:59.645684 run patchelf(pid=1369): Launched 00:28:00.828709 run patchelf(pid=1369): Terminated: ok {rc=0} 00:28:00.987452 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:28:01.329496 run setcap-netadm(pid=1370): Launched 00:28:02.571706 run setcap-netadm(pid=1370): Terminated: ok {rc=0} 00:28:02.916761 run srsepc(pid=1371): Launched 00:28:03.038394 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:28:04.218336 run rm-remote-dir(pid=1372): Launched 00:28:04.405922 run srsepc(pid=1371): ERR: Terminated: ERROR {rc=127} [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1371)] 00:28:04.549284 run srsepc(pid=1371): stdout: | (launched: 2022-12-09_00:28:02.857662) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:28:04.693290 run srsepc(pid=1371): stderr: | (launched: 2022-12-09_00:28:02.906361) | Connection to 10.42.42.116 closed. 00:28:04.837860 run srsepc(pid=1371): stdout: | (launched: 2022-12-09_00:28:02.857662) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:28:04.976446 run srsepc(pid=1371): stderr: | (launched: 2022-12-09_00:28:02.906361) | Connection to 10.42.42.116 closed. 00:28:05.140773 run rm-remote-dir(pid=1372): Terminating (SIGINT) 00:28:05.330112 run rm-remote-dir(pid=1372): Terminated: ok {rc=0} 00:28:05.466652 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=1371): Process ended prematurely: srsepc(pid=1371) [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1371)] [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 00:28:05.477545 tst iperf3_ul.py:42: Test FAILED (19.0 sec) 00:28:05.556898 run scp-back-log(pid=1373): Launched 00:28:06.635389 run scp-back-log(pid=1373): ERR: Terminated: ERROR {rc=1} [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1373)] 00:28:06.698567 run scp-back-log(pid=1373): stdout: | (launched: 2022-12-09_00:28:05.526060) 00:28:06.763128 run scp-back-log(pid=1373): stderr: | (launched: 2022-12-09_00:28:05.546346) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:28:06.836036 tst srsepc_10.42.42.118: Error('scp-back-log(pid=1373): launch_sync(): local process exited with status 1 [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1373)]') ---------------------------------------------- trial-2351 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 00:28:06.883494 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:28:06.900365 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:28:06.924120 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:28:06.973982 tst ping.py: using MSISDN 6939 00:28:07.090053 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6939', subscriber_id=0} 00:28:07.198818 run srsepc_10.42.42.118: Starting srsepc 00:28:07.831533 run rm-remote-dir(pid=1375): Launched 00:28:09.011711 run rm-remote-dir(pid=1375): Terminated: ok {rc=0} 00:28:09.349125 run mk-remote-dir(pid=1376): Launched 00:28:10.530644 run mk-remote-dir(pid=1376): Terminated: ok {rc=0} 00:28:10.818326 run scp-inst-to-remote(pid=1377): Launched 00:28:12.999226 run scp-inst-to-remote(pid=1377): Terminated: ok {rc=0} 00:28:13.335095 run rm-remote-dir(pid=1379): Launched 00:28:14.517059 run rm-remote-dir(pid=1379): Terminated: ok {rc=0} 00:28:14.855080 run mk-remote-dir(pid=1380): Launched 00:28:16.050215 run mk-remote-dir(pid=1380): Terminated: ok {rc=0} 00:28:16.395576 run scp-cfg-to-remote(pid=1381): Launched 00:28:17.625857 run scp-cfg-to-remote(pid=1381): Terminated: ok {rc=0} 00:28:17.929163 run scp-db-to-remote(pid=1383): Launched 00:28:19.120155 run scp-db-to-remote(pid=1383): Terminated: ok {rc=0} 00:28:19.260194 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:28:19.589289 run patchelf(pid=1385): Launched 00:28:20.777478 run patchelf(pid=1385): Terminated: ok {rc=0} 00:28:20.918623 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:28:21.247279 run setcap-netadm(pid=1386): Launched 00:28:22.436525 run setcap-netadm(pid=1386): Terminated: ok {rc=0} 00:28:22.781451 run srsepc(pid=1387): Launched 00:28:22.903406 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:28:24.077956 run rm-remote-dir(pid=1388): Launched 00:28:24.265024 run srsepc(pid=1387): ERR: Terminated: ERROR {rc=127} [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1387)] 00:28:24.408802 run srsepc(pid=1387): stdout: | (launched: 2022-12-09_00:28:22.722108) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:28:24.552822 run srsepc(pid=1387): stderr: | (launched: 2022-12-09_00:28:22.770892) | Connection to 10.42.42.116 closed. 00:28:24.697454 run srsepc(pid=1387): stdout: | (launched: 2022-12-09_00:28:22.722108) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:28:24.836128 run srsepc(pid=1387): stderr: | (launched: 2022-12-09_00:28:22.770892) | Connection to 10.42.42.116 closed. 00:28:25.000552 run rm-remote-dir(pid=1388): Terminating (SIGINT) 00:28:25.190043 run rm-remote-dir(pid=1388): Terminated: ok {rc=0} 00:28:25.326286 tst ping.py:16: ERR: Error: srsepc(pid=1387): Process ended prematurely: srsepc(pid=1387) [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1387)] [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 00:28:25.336763 tst ping.py:16: Test FAILED (18.4 sec) 00:28:25.416812 run scp-back-log(pid=1389): Launched 00:28:26.495711 run scp-back-log(pid=1389): ERR: Terminated: ERROR {rc=1} [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1389)] 00:28:26.559253 run scp-back-log(pid=1389): stdout: | (launched: 2022-12-09_00:28:25.385736) 00:28:26.624692 run scp-back-log(pid=1389): stderr: | (launched: 2022-12-09_00:28:25.406153) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:28:26.698827 tst srsepc_10.42.42.118: Error('scp-back-log(pid=1389): launch_sync(): local process exited with status 1 [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1389)]') ---------------------------------------------- trial-2351 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 00:28:26.746330 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:28:26.763195 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:28:26.786940 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:28:26.842194 tst rrc_idle_mo_ping.py: using MSISDN 6940 00:28:26.962958 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6940', subscriber_id=0} 00:28:27.077556 run srsepc_10.42.42.118: Starting srsepc 00:28:27.744589 run rm-remote-dir(pid=1391): Launched 00:28:28.935118 run rm-remote-dir(pid=1391): Terminated: ok {rc=0} 00:28:29.292003 run mk-remote-dir(pid=1392): Launched 00:28:30.481699 run mk-remote-dir(pid=1392): Terminated: ok {rc=0} 00:28:30.786222 run scp-inst-to-remote(pid=1393): Launched 00:28:33.001537 run scp-inst-to-remote(pid=1393): Terminated: ok {rc=0} 00:28:33.356857 run rm-remote-dir(pid=1395): Launched 00:28:34.546469 run rm-remote-dir(pid=1395): Terminated: ok {rc=0} 00:28:34.904771 run mk-remote-dir(pid=1396): Launched 00:28:36.095309 run mk-remote-dir(pid=1396): Terminated: ok {rc=0} 00:28:36.399378 run scp-cfg-to-remote(pid=1397): Launched 00:28:37.586609 run scp-cfg-to-remote(pid=1397): Terminated: ok {rc=0} 00:28:37.889531 run scp-db-to-remote(pid=1399): Launched 00:28:39.077837 run scp-db-to-remote(pid=1399): Terminated: ok {rc=0} 00:28:39.218140 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:28:39.547574 run patchelf(pid=1402): Launched 00:28:40.735592 run patchelf(pid=1402): Terminated: ok {rc=0} 00:28:40.876043 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:28:41.204856 run setcap-netadm(pid=1403): Launched 00:28:42.393076 run setcap-netadm(pid=1403): Terminated: ok {rc=0} 00:28:42.737697 run srsepc(pid=1404): Launched 00:28:42.859664 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:28:44.034797 run rm-remote-dir(pid=1405): Launched 00:28:44.222043 run srsepc(pid=1404): ERR: Terminated: ERROR {rc=127} [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1404)] 00:28:44.365290 run srsepc(pid=1404): stdout: | (launched: 2022-12-09_00:28:42.678298) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:28:44.509025 run srsepc(pid=1404): stderr: | (launched: 2022-12-09_00:28:42.726984) | Connection to 10.42.42.116 closed. 00:28:44.652760 run srsepc(pid=1404): stdout: | (launched: 2022-12-09_00:28:42.678298) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:28:44.791813 run srsepc(pid=1404): stderr: | (launched: 2022-12-09_00:28:42.726984) | Connection to 10.42.42.116 closed. 00:28:44.956319 run rm-remote-dir(pid=1405): Terminating (SIGINT) 00:28:45.145565 run rm-remote-dir(pid=1405): Terminated: ok {rc=0} 00:28:45.281892 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=1404): Process ended prematurely: srsepc(pid=1404) [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1404)] [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 00:28:45.292637 tst rrc_idle_mo_ping.py:16: Test FAILED (18.5 sec) 00:28:45.372532 run scp-back-log(pid=1406): Launched 00:28:46.451251 run scp-back-log(pid=1406): ERR: Terminated: ERROR {rc=1} [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1406)] 00:28:46.516820 run scp-back-log(pid=1406): stdout: | (launched: 2022-12-09_00:28:45.341408) 00:28:46.584063 run scp-back-log(pid=1406): stderr: | (launched: 2022-12-09_00:28:45.361892) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:28:46.660689 tst srsepc_10.42.42.118: Error('scp-back-log(pid=1406): launch_sync(): local process exited with status 1 [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1406)]') ---------------------------------------------- trial-2351 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 00:28:46.711674 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:28:46.729762 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:28:46.757363 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:28:46.807729 tst rrc_idle_mt_ping.py: using MSISDN 6941 00:28:46.961516 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6941', subscriber_id=0} 00:28:47.106649 run srsepc_10.42.42.118: Starting srsepc 00:28:47.787636 run rm-remote-dir(pid=1408): Launched 00:28:48.978931 run rm-remote-dir(pid=1408): Terminated: ok {rc=0} 00:28:49.337369 run mk-remote-dir(pid=1409): Launched 00:28:50.527278 run mk-remote-dir(pid=1409): Terminated: ok {rc=0} 00:28:50.832118 run scp-inst-to-remote(pid=1410): Launched 00:28:53.022682 run scp-inst-to-remote(pid=1410): Terminated: ok {rc=0} 00:28:53.379610 run rm-remote-dir(pid=1412): Launched 00:28:54.570978 run rm-remote-dir(pid=1412): Terminated: ok {rc=0} 00:28:54.930053 run mk-remote-dir(pid=1413): Launched 00:28:56.121241 run mk-remote-dir(pid=1413): Terminated: ok {rc=0} 00:28:56.426538 run scp-cfg-to-remote(pid=1414): Launched 00:28:57.614352 run scp-cfg-to-remote(pid=1414): Terminated: ok {rc=0} 00:28:57.917944 run scp-db-to-remote(pid=1416): Launched 00:28:59.107503 run scp-db-to-remote(pid=1416): Terminated: ok {rc=0} 00:28:59.247956 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:28:59.577388 run patchelf(pid=1418): Launched 00:29:00.765596 run patchelf(pid=1418): Terminated: ok {rc=0} 00:29:00.910256 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:29:01.247403 run setcap-netadm(pid=1422): Launched 00:29:02.491362 run setcap-netadm(pid=1422): Terminated: ok {rc=0} 00:29:02.837480 run srsepc(pid=1423): Launched 00:29:02.959347 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:29:04.135106 run rm-remote-dir(pid=1424): Launched 00:29:04.322025 run srsepc(pid=1423): ERR: Terminated: ERROR {rc=127} [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1423)] 00:29:04.465232 run srsepc(pid=1423): stdout: | (launched: 2022-12-09_00:29:02.777521) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:29:04.608734 run srsepc(pid=1423): stderr: | (launched: 2022-12-09_00:29:02.826823) | Connection to 10.42.42.116 closed. 00:29:04.752263 run srsepc(pid=1423): stdout: | (launched: 2022-12-09_00:29:02.777521) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:29:04.891040 run srsepc(pid=1423): stderr: | (launched: 2022-12-09_00:29:02.826823) | Connection to 10.42.42.116 closed. 00:29:05.055256 run rm-remote-dir(pid=1424): Terminating (SIGINT) 00:29:05.244507 run rm-remote-dir(pid=1424): Terminated: ok {rc=0} 00:29:05.380491 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=1423): Process ended prematurely: srsepc(pid=1423) [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1423)] [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 00:29:05.391166 tst rrc_idle_mt_ping.py:16: Test FAILED (18.7 sec) 00:29:05.471239 run scp-back-log(pid=1425): Launched 00:29:06.549881 run scp-back-log(pid=1425): ERR: Terminated: ERROR {rc=1} [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1425)] 00:29:06.609837 run scp-back-log(pid=1425): stdout: | (launched: 2022-12-09_00:29:05.440333) 00:29:06.671521 run scp-back-log(pid=1425): stderr: | (launched: 2022-12-09_00:29:05.460851) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:29:06.740544 tst srsepc_10.42.42.118: Error('scp-back-log(pid=1425): launch_sync(): local process exited with status 1 [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=1425)]') --------------------------------------------------------------------- trial-2351 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 00:29:06.869301 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:29:06.874465 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 00:29:06.914604 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 00:29:06.940920 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 00:29:06.989532 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 00:29:07.030769 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 00:29:07.056647 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 00:29:07.612751 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 00:29:07.618782 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 00:29:07.630302 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 00:29:07.673076 tst handover.py: using LAC 17804 00:29:07.812261 tst handover.py: using RAC 209 00:29:07.939784 tst handover.py: using CellId 17804 00:29:08.065145 tst handover.py: using BVCI 17805 00:29:08.182470 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 00:29:08.216791 tst handover.py: using LAC 17805 00:29:08.342273 tst handover.py: using RAC 210 00:29:08.467064 tst handover.py: using CellId 17805 00:29:08.591995 tst handover.py: using BVCI 17806 00:29:08.709663 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 00:29:08.720869 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 00:29:08.731903 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 00:29:08.743225 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 00:29:08.754672 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 00:29:08.766057 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 00:29:08.881770 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 00:29:08.996916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:29:09.469306 run create_hlr_db(pid=1430): Launched 00:29:10.640519 run create_hlr_db(pid=1430): Terminated: ok {rc=0} 00:29:10.961252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1432): Launched 00:29:11.264534 run osmo-hlr_10.42.42.2(pid=1433): Launched 00:29:11.380369 run osmo-stp_10.42.42.5: Starting osmo-stp 00:29:11.915006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1435): Launched 00:29:12.219047 run osmo-stp_10.42.42.5(pid=1436): Launched 00:29:12.334136 run osmo-msc_10.42.42.6: Starting osmo-msc 00:29:12.883553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1438): Launched 00:29:13.188508 run osmo-msc_10.42.42.6(pid=1439): Launched 00:29:13.357361 run osmo-stp_10.42.42.5(pid=1436): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1436)] 00:29:13.486384 run osmo-stp_10.42.42.5(pid=1436): stdout: | (launched: 2022-12-09_00:29:12.163332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:13.615163 run osmo-stp_10.42.42.5(pid=1436): stderr: | [0;m[38;5;43m20221209002912333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002912334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002912334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002912334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002912336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002912337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002912337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:13.741568 run osmo-stp_10.42.42.5(pid=1436): stdout: | (launched: 2022-12-09_00:29:12.163332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:13.862266 run osmo-stp_10.42.42.5(pid=1436): stderr: | [0;m[38;5;43m20221209002912333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002912334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002912334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002912334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002912336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002912337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002912337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:14.007122 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1436): Process ended prematurely: osmo-stp_10.42.42.5(pid=1436) [trial-2351↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1436)] [trial-2351↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 00:29:14.015524 tst handover.py:18: Test FAILED (6.4 sec) 00:29:14.041347 run osmo-hlr_10.42.42.2(pid=1433): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1433)] 00:29:14.088177 run osmo-hlr_10.42.42.2(pid=1433): stdout: | (launched: 2022-12-09_00:29:11.209066) 00:29:14.136579 run osmo-hlr_10.42.42.2(pid=1433): stderr: | [0;m[1;31m20221209002911385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002911385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002911385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002911385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002911385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002911385 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002911397 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002911406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002911406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002911406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:29:14.204290 run osmo-msc_10.42.42.6(pid=1439): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1439)] 00:29:14.250829 run osmo-msc_10.42.42.6(pid=1439): stdout: | (launched: 2022-12-09_00:29:13.132685) 00:29:14.299288 run osmo-msc_10.42.42.6(pid=1439): stderr: | [0;m[38;5;43m20221209002913404 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209002913404 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb6a8576c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209002913404 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209002913404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209002913404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209002913404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209002913406 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209002913407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209002913408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209002913408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:29:14.347989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1432): Terminating (SIGTERM) 00:29:14.386766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1435): Terminating (SIGTERM) 00:29:14.425546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1438): Terminating (SIGTERM) 00:29:14.465074 --- ParallelTerminationStrategy: PID 1432 died... 00:29:14.483702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1432): Terminated: ok {rc=0} 00:29:14.527210 --- ParallelTerminationStrategy: PID 1435 died... 00:29:14.545646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1435): Terminated: ok {rc=0} 00:29:14.589315 --- ParallelTerminationStrategy: PID 1438 died... 00:29:14.607475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1438): Terminated: ok {rc=0} 00:29:14.692724 bus /sierra_3: Setting Powered False 00:29:15.791434 bus /sierra_3: Setting Powered False 00:29:16.927940 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 00:29:18.186143 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:29:18.191579 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 00:29:18.231897 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 00:29:18.258861 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 00:29:18.310763 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 00:29:18.351101 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 00:29:18.378055 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 00:29:18.932657 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 00:29:18.938025 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:29:18.949158 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 00:29:18.987614 tst handover.py: using LAC 17806 00:29:19.114456 tst handover.py: using RAC 211 00:29:19.242599 tst handover.py: using CellId 17806 00:29:19.372362 tst handover.py: using BVCI 17807 00:29:19.490971 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 00:29:19.525467 tst handover.py: using LAC 17807 00:29:19.647400 tst handover.py: using RAC 212 00:29:19.774383 tst handover.py: using CellId 17807 00:29:19.903659 tst handover.py: using BVCI 17808 00:29:20.022772 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:29:20.034359 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:29:20.045599 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:29:20.056742 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:29:20.067869 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:29:20.078937 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 00:29:20.193211 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 00:29:20.307768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:29:20.753240 run create_hlr_db(pid=1444): Launched 00:29:20.871023 bus /sierra_2: Setting Powered False 00:29:21.931420 run create_hlr_db(pid=1444): Terminated: ok {rc=0} 00:29:22.329751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1446): Launched 00:29:22.635449 run osmo-hlr_10.42.42.2(pid=1447): Launched 00:29:22.751553 run osmo-stp_10.42.42.5: Starting osmo-stp 00:29:23.253201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1449): Launched 00:29:23.558326 run osmo-stp_10.42.42.5(pid=1450): Launched 00:29:23.674647 run osmo-msc_10.42.42.6: Starting osmo-msc 00:29:24.199974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1452): Launched 00:29:24.507569 run osmo-msc_10.42.42.6(pid=1453): Launched 00:29:24.678977 run osmo-stp_10.42.42.5(pid=1450): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1450)] 00:29:24.808828 run osmo-stp_10.42.42.5(pid=1450): stdout: | (launched: 2022-12-09_00:29:23.502684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:24.939121 run osmo-stp_10.42.42.5(pid=1450): stderr: | [0;m[38;5;43m20221209002923674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002923675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002923675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002923675 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002923676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002923676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002923676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:25.066967 run osmo-stp_10.42.42.5(pid=1450): stdout: | (launched: 2022-12-09_00:29:23.502684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:25.189331 run osmo-stp_10.42.42.5(pid=1450): stderr: | [0;m[38;5;43m20221209002923674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002923675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002923675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002923675 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002923676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002923676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002923676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:25.335276 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1450): Process ended prematurely: osmo-stp_10.42.42.5(pid=1450) [trial-2351↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1450)] [trial-2351↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 00:29:25.343815 tst handover.py:18: Test FAILED (6.4 sec) 00:29:25.370269 run osmo-hlr_10.42.42.2(pid=1447): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1447)] 00:29:25.418336 run osmo-hlr_10.42.42.2(pid=1447): stdout: | (launched: 2022-12-09_00:29:22.579974) 00:29:25.467913 run osmo-hlr_10.42.42.2(pid=1447): stderr: | [0;m[1;31m20221209002922759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002922759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002922759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002922759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002922759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002922759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002922774 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002922783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002922784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002922784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:29:25.536797 run osmo-msc_10.42.42.6(pid=1453): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1453)] 00:29:25.584421 run osmo-msc_10.42.42.6(pid=1453): stdout: | (launched: 2022-12-09_00:29:24.451368) 00:29:25.633932 run osmo-msc_10.42.42.6(pid=1453): stderr: | [0;m[38;5;43m20221209002924724 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209002924724 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f62ba3f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209002924724 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209002924724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209002924724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209002924725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209002924726 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209002924727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209002924727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209002924727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:29:25.683882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1446): Terminating (SIGTERM) 00:29:25.723584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1449): Terminating (SIGTERM) 00:29:25.763386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1452): Terminating (SIGTERM) 00:29:25.803749 --- ParallelTerminationStrategy: PID 1446 died... 00:29:25.822610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1446): Terminated: ok {rc=0} 00:29:25.867083 --- ParallelTerminationStrategy: PID 1449 died... 00:29:25.885653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1449): Terminated: ok {rc=0} 00:29:25.929838 --- ParallelTerminationStrategy: PID 1452 died... 00:29:25.948306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1452): Terminated: ok {rc=0} 00:29:26.034407 bus /sierra_3: Setting Powered False 00:29:27.133899 bus /sierra_3: Setting Powered False 00:29:28.247435 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 00:29:29.495170 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:29:29.501024 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 00:29:29.555332 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 00:29:29.582429 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 00:29:29.634285 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 00:29:29.688411 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 00:29:29.715323 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 00:29:30.267926 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 00:29:30.273302 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:29:30.284485 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 00:29:30.323305 tst handover.py: using LAC 17808 00:29:30.451843 tst handover.py: using RAC 213 00:29:30.578391 tst handover.py: using CellId 17808 00:29:30.706230 tst handover.py: using BVCI 17809 00:29:30.827936 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 00:29:30.878795 tst handover.py: using LAC 17809 00:29:31.011337 tst handover.py: using RAC 214 00:29:31.143880 tst handover.py: using CellId 17809 00:29:31.289218 tst handover.py: using BVCI 17810 00:29:31.427559 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:29:31.439284 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:29:31.450776 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:29:31.462498 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:29:31.474159 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:29:31.485765 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 00:29:31.624338 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 00:29:31.760696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:29:32.242678 run create_hlr_db(pid=1458): Launched 00:29:32.392245 bus /sierra_2: Setting Powered False 00:29:33.455989 run create_hlr_db(pid=1458): Terminated: ok {rc=0} 00:29:33.864141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1460): Launched 00:29:34.169594 run osmo-hlr_10.42.42.2(pid=1461): Launched 00:29:34.285955 run osmo-stp_10.42.42.5: Starting osmo-stp 00:29:34.797590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1463): Launched 00:29:35.101695 run osmo-stp_10.42.42.5(pid=1464): Launched 00:29:35.218102 run osmo-msc_10.42.42.6: Starting osmo-msc 00:29:35.742511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1466): Launched 00:29:36.049143 run osmo-msc_10.42.42.6(pid=1467): Launched 00:29:36.219987 run osmo-stp_10.42.42.5(pid=1464): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1464)] 00:29:36.350077 run osmo-stp_10.42.42.5(pid=1464): stdout: | (launched: 2022-12-09_00:29:35.046172) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:36.480130 run osmo-stp_10.42.42.5(pid=1464): stderr: | [0;m[38;5;43m20221209002935216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002935216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002935216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002935217 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002935217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002935217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002935217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:36.607458 run osmo-stp_10.42.42.5(pid=1464): stdout: | (launched: 2022-12-09_00:29:35.046172) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:36.728779 run osmo-stp_10.42.42.5(pid=1464): stderr: | [0;m[38;5;43m20221209002935216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002935216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002935216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002935217 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002935217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002935217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002935217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:36.874119 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1464): Process ended prematurely: osmo-stp_10.42.42.5(pid=1464) [trial-2351↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1464)] [trial-2351↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 00:29:36.882419 tst handover.py:18: Test FAILED (6.6 sec) 00:29:36.909015 run osmo-hlr_10.42.42.2(pid=1461): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1461)] 00:29:36.956633 run osmo-hlr_10.42.42.2(pid=1461): stdout: | (launched: 2022-12-09_00:29:34.114170) 00:29:37.006157 run osmo-hlr_10.42.42.2(pid=1461): stderr: | [0;m[1;31m20221209002934290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002934290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002934290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002934290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002934290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002934291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002934303 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002934311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002934312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002934312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:29:37.074745 run osmo-msc_10.42.42.6(pid=1467): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1467)] 00:29:37.122187 run osmo-msc_10.42.42.6(pid=1467): stdout: | (launched: 2022-12-09_00:29:35.992373) 00:29:37.171521 run osmo-msc_10.42.42.6(pid=1467): stderr: | [0;m[38;5;43m20221209002936265 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209002936265 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd9683afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209002936265 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209002936265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209002936266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209002936266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209002936267 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209002936268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209002936268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209002936268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:29:37.221275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1460): Terminating (SIGTERM) 00:29:37.260879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1463): Terminating (SIGTERM) 00:29:37.300684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1466): Terminating (SIGTERM) 00:29:37.340625 --- ParallelTerminationStrategy: PID 1460 died... 00:29:37.359669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1460): Terminated: ok {rc=0} 00:29:37.403795 --- ParallelTerminationStrategy: PID 1463 died... 00:29:37.422259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1463): Terminated: ok {rc=0} 00:29:37.466423 --- ParallelTerminationStrategy: PID 1466 died... 00:29:37.484797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1466): Terminated: ok {rc=0} 00:29:37.570480 bus /sierra_3: Setting Powered False 00:29:38.669264 bus /sierra_3: Setting Powered False 00:29:39.784850 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 00:29:41.045574 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:29:41.050657 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 00:29:41.099662 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:29:41.125877 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 00:29:41.174910 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 00:29:41.223382 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:29:41.249379 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 00:29:41.804117 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 00:29:41.809276 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:29:41.820103 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:29:41.857164 tst handover.py: using LAC 17810 00:29:41.975798 tst handover.py: using RAC 215 00:29:42.093649 tst handover.py: using CellId 17810 00:29:42.210729 tst handover.py: using BVCI 17811 00:29:42.321983 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:29:42.366020 tst handover.py: using LAC 17811 00:29:42.483306 tst handover.py: using RAC 216 00:29:42.602120 tst handover.py: using CellId 17811 00:29:42.721118 tst handover.py: using BVCI 17812 00:29:42.831012 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:29:42.841916 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:29:42.852547 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:29:42.863713 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:29:42.874798 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:29:42.885881 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:29:43.004033 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:29:43.123362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:29:43.596879 run create_hlr_db(pid=1472): Launched 00:29:43.727920 bus /sierra_2: Setting Powered False 00:29:44.792447 run create_hlr_db(pid=1472): Terminated: ok {rc=0} 00:29:45.201115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1474): Launched 00:29:45.506315 run osmo-hlr_10.42.42.2(pid=1475): Launched 00:29:45.623207 run osmo-stp_10.42.42.5: Starting osmo-stp 00:29:46.187206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1477): Launched 00:29:46.541839 run osmo-stp_10.42.42.5(pid=1478): Launched 00:29:46.718088 run osmo-msc_10.42.42.6: Starting osmo-msc 00:29:47.474075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1480): Launched 00:29:47.799682 run osmo-msc_10.42.42.6(pid=1481): Launched 00:29:47.980411 run osmo-stp_10.42.42.5(pid=1478): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1478)] 00:29:48.116139 run osmo-stp_10.42.42.5(pid=1478): stdout: | (launched: 2022-12-09_00:29:46.467449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:48.252916 run osmo-stp_10.42.42.5(pid=1478): stderr: | [0;m[38;5;43m20221209002946805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002946806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002946806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002946806 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002946807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002946807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002946807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:48.389368 run osmo-stp_10.42.42.5(pid=1478): stdout: | (launched: 2022-12-09_00:29:46.467449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:48.518467 run osmo-stp_10.42.42.5(pid=1478): stderr: | [0;m[38;5;43m20221209002946805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002946806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002946806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002946806 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002946807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002946807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002946807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:48.673147 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1478): Process ended prematurely: osmo-stp_10.42.42.5(pid=1478) [trial-2351↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1478)] [trial-2351↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 00:29:48.682168 tst handover.py:18: Test FAILED (6.9 sec) 00:29:48.709759 run osmo-hlr_10.42.42.2(pid=1475): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1475)] 00:29:48.759788 run osmo-hlr_10.42.42.2(pid=1475): stdout: | (launched: 2022-12-09_00:29:45.451022) 00:29:48.811258 run osmo-hlr_10.42.42.2(pid=1475): stderr: | [0;m[1;31m20221209002945625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002945625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002945625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002945625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002945625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002945625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002945637 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002945647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002945647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002945647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:29:48.883202 run osmo-msc_10.42.42.6(pid=1481): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1481)] 00:29:48.933129 run osmo-msc_10.42.42.6(pid=1481): stdout: | (launched: 2022-12-09_00:29:47.740860) 00:29:48.984296 run osmo-msc_10.42.42.6(pid=1481): stderr: | [0;m[38;5;43m20221209002948065 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209002948065 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7f7dd83c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209002948066 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209002948066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209002948066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209002948066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209002948068 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209002948068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209002948068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209002948068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:29:49.035655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1474): Terminating (SIGTERM) 00:29:49.077153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1477): Terminating (SIGTERM) 00:29:49.119428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1480): Terminating (SIGTERM) 00:29:49.161607 --- ParallelTerminationStrategy: PID 1474 died... 00:29:49.181449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1474): Terminated: ok {rc=0} 00:29:49.227538 --- ParallelTerminationStrategy: PID 1477 died... 00:29:49.247007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1477): Terminated: ok {rc=0} 00:29:49.293531 --- ParallelTerminationStrategy: PID 1480 died... 00:29:49.312918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1480): Terminated: ok {rc=0} 00:29:49.400105 bus /sierra_3: Setting Powered False 00:29:50.497390 bus /sierra_3: Setting Powered False 00:29:51.612090 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 00:29:52.870091 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:29:52.875559 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 00:29:52.930387 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 00:29:52.957473 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 00:29:53.010153 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 00:29:53.065894 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 00:29:53.092700 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 00:29:53.645272 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 00:29:53.656422 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:29:53.667489 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:29:53.706039 tst handover.py: using LAC 17812 00:29:53.832931 tst handover.py: using RAC 217 00:29:53.960934 tst handover.py: using CellId 17812 00:29:54.086508 tst handover.py: using BVCI 17813 00:29:54.203191 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:29:54.258955 tst handover.py: using LAC 17813 00:29:54.388220 tst handover.py: using RAC 218 00:29:54.513830 tst handover.py: using CellId 17813 00:29:54.637768 tst handover.py: using BVCI 17814 00:29:54.754586 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:29:54.765972 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:29:54.776941 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:29:54.788315 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:29:54.799501 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:29:54.810672 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:29:54.927761 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:29:55.048663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:29:55.520155 run create_hlr_db(pid=1487): Launched 00:29:55.649721 bus /sierra_2: Setting Powered False 00:29:56.713177 run create_hlr_db(pid=1487): Terminated: ok {rc=0} 00:29:57.120031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1489): Launched 00:29:57.425278 run osmo-hlr_10.42.42.2(pid=1490): Launched 00:29:57.541939 run osmo-stp_10.42.42.5: Starting osmo-stp 00:29:58.054237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1492): Launched 00:29:58.358520 run osmo-stp_10.42.42.5(pid=1493): Launched 00:29:58.474991 run osmo-msc_10.42.42.6: Starting osmo-msc 00:29:58.998558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1495): Launched 00:29:59.303940 run osmo-msc_10.42.42.6(pid=1496): Launched 00:29:59.474867 run osmo-stp_10.42.42.5(pid=1493): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1493)] 00:29:59.604044 run osmo-stp_10.42.42.5(pid=1493): stdout: | (launched: 2022-12-09_00:29:58.302972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:59.733461 run osmo-stp_10.42.42.5(pid=1493): stderr: | [0;m[38;5;43m20221209002958472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002958472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002958472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002958473 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002958473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002958473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002958473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:59.860573 run osmo-stp_10.42.42.5(pid=1493): stdout: | (launched: 2022-12-09_00:29:58.302972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:59.981990 run osmo-stp_10.42.42.5(pid=1493): stderr: | [0;m[38;5;43m20221209002958472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209002958472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209002958472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209002958473 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209002958473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209002958473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209002958473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:00.127136 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1493): Process ended prematurely: osmo-stp_10.42.42.5(pid=1493) [trial-2351↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1493)] [trial-2351↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 00:30:00.135694 tst handover.py:18: Test FAILED (6.5 sec) 00:30:00.161891 run osmo-hlr_10.42.42.2(pid=1490): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1490)] 00:30:00.209409 run osmo-hlr_10.42.42.2(pid=1490): stdout: | (launched: 2022-12-09_00:29:57.370215) 00:30:00.258089 run osmo-hlr_10.42.42.2(pid=1490): stderr: | [0;m[1;31m20221209002957548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209002957548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209002957548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209002957548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209002957548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209002957548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209002957559 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209002957568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209002957568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209002957568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:30:00.326080 run osmo-msc_10.42.42.6(pid=1496): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1496)] 00:30:00.372905 run osmo-msc_10.42.42.6(pid=1496): stdout: | (launched: 2022-12-09_00:29:59.248369) 00:30:00.421495 run osmo-msc_10.42.42.6(pid=1496): stderr: | [0;m[38;5;43m20221209002959520 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209002959520 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0b0e341c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209002959520 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209002959520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209002959520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209002959520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209002959522 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209002959523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209002959523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209002959523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:30:00.470586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1489): Terminating (SIGTERM) 00:30:00.509815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1492): Terminating (SIGTERM) 00:30:00.548918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1495): Terminating (SIGTERM) 00:30:00.588881 --- ParallelTerminationStrategy: PID 1489 died... 00:30:00.607802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1489): Terminated: ok {rc=0} 00:30:00.651798 --- ParallelTerminationStrategy: PID 1492 died... 00:30:00.670159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1492): Terminated: ok {rc=0} 00:30:00.714290 --- ParallelTerminationStrategy: PID 1495 died... 00:30:00.732558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1495): Terminated: ok {rc=0} 00:30:00.815463 bus /sierra_3: Setting Powered False 00:30:01.936739 bus /sierra_3: Setting Powered False 00:30:03.048030 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 00:30:04.306558 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:30:04.311596 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 00:30:04.352623 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 00:30:04.378685 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 00:30:04.430542 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 00:30:04.472442 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 00:30:04.498641 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 00:30:05.045797 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 00:30:05.050902 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:30:05.061717 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 00:30:05.098769 tst handover.py: using LAC 17814 00:30:05.220037 tst handover.py: using RAC 219 00:30:05.341657 tst handover.py: using CellId 17814 00:30:05.461394 tst handover.py: using BVCI 17815 00:30:05.571224 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 00:30:05.604270 tst handover.py: using LAC 17815 00:30:05.722264 tst handover.py: using RAC 220 00:30:05.841285 tst handover.py: using CellId 17815 00:30:05.958030 tst handover.py: using BVCI 17816 00:30:06.070031 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:30:06.080752 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:30:06.091384 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:30:06.102408 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:30:06.113481 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:30:06.124483 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 00:30:06.242324 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 00:30:06.357710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:30:06.802799 run create_hlr_db(pid=1504): Launched 00:30:06.919051 bus /sierra_2: Setting Powered False 00:30:07.982455 run create_hlr_db(pid=1504): Terminated: ok {rc=0} 00:30:08.404896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1506): Launched 00:30:08.726982 run osmo-hlr_10.42.42.2(pid=1507): Launched 00:30:08.849109 run osmo-stp_10.42.42.5: Starting osmo-stp 00:30:09.376467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1509): Launched 00:30:09.699705 run osmo-stp_10.42.42.5(pid=1510): Launched 00:30:09.821632 run osmo-msc_10.42.42.6: Starting osmo-msc 00:30:10.377404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1512): Launched 00:30:10.700023 run osmo-msc_10.42.42.6(pid=1513): Launched 00:30:10.880140 run osmo-stp_10.42.42.5(pid=1510): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1510)] 00:30:11.016216 run osmo-stp_10.42.42.5(pid=1510): stdout: | (launched: 2022-12-09_00:30:09.641158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:11.152855 run osmo-stp_10.42.42.5(pid=1510): stderr: | [0;m[38;5;43m20221209003009835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003009836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003009836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003009836 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003009837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003009837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003009837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:11.288365 run osmo-stp_10.42.42.5(pid=1510): stdout: | (launched: 2022-12-09_00:30:09.641158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:11.416876 run osmo-stp_10.42.42.5(pid=1510): stderr: | [0;m[38;5;43m20221209003009835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003009836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003009836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003009836 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003009837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003009837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003009837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:11.571425 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1510): Process ended prematurely: osmo-stp_10.42.42.5(pid=1510) [trial-2351↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1510)] [trial-2351↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 00:30:11.580322 tst handover.py:18: Test FAILED (6.5 sec) 00:30:11.607500 run osmo-hlr_10.42.42.2(pid=1507): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1507)] 00:30:11.656776 run osmo-hlr_10.42.42.2(pid=1507): stdout: | (launched: 2022-12-09_00:30:08.668602) 00:30:11.707914 run osmo-hlr_10.42.42.2(pid=1507): stderr: | [0;m[1;31m20221209003008868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003008868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003008869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003008869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003008869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003008869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003008881 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003008889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003008889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003008890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:30:11.779575 run osmo-msc_10.42.42.6(pid=1513): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1513)] 00:30:11.828894 run osmo-msc_10.42.42.6(pid=1513): stdout: | (launched: 2022-12-09_00:30:10.641381) 00:30:11.880489 run osmo-msc_10.42.42.6(pid=1513): stderr: | [0;m[38;5;43m20221209003010962 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003010963 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9556d98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003010963 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003010963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003010963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003010963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003010965 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003010965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003010965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003010965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:30:11.931951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1506): Terminating (SIGTERM) 00:30:11.973127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1509): Terminating (SIGTERM) 00:30:12.014573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1512): Terminating (SIGTERM) 00:30:12.056100 --- ParallelTerminationStrategy: PID 1506 died... 00:30:12.075901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1506): Terminated: ok {rc=0} 00:30:12.121546 --- ParallelTerminationStrategy: PID 1509 died... 00:30:12.140691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1509): Terminated: ok {rc=0} 00:30:12.186118 --- ParallelTerminationStrategy: PID 1512 died... 00:30:12.205411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1512): Terminated: ok {rc=0} 00:30:12.291995 bus /sierra_3: Setting Powered False 00:30:13.389103 bus /sierra_3: Setting Powered False 00:30:14.504575 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 00:30:15.747638 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:30:15.754162 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:30:15.808149 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:30:15.840042 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:30:15.898899 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:30:15.961508 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:30:15.989792 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:30:16.529464 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 00:30:16.535224 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:30:16.547210 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:30:16.591921 tst handover.py: using LAC 17816 00:30:16.747099 tst handover.py: using RAC 221 00:30:16.881454 tst handover.py: using CellId 17816 00:30:17.002832 tst handover.py: using BVCI 17817 00:30:17.123024 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:30:17.172882 tst handover.py: using LAC 17817 00:30:17.330400 tst handover.py: using RAC 222 00:30:17.461584 tst handover.py: using CellId 17817 00:30:17.586303 tst handover.py: using BVCI 17818 00:30:17.703149 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:30:17.714381 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:30:17.725389 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:30:17.736356 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:30:17.747478 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:30:17.758533 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:30:17.879089 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:30:18.000306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:30:18.472383 run create_hlr_db(pid=1518): Launched 00:30:18.602905 bus /sierra_2: Setting Powered False 00:30:19.667041 run create_hlr_db(pid=1518): Terminated: ok {rc=0} 00:30:20.089349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1520): Launched 00:30:20.412786 run osmo-hlr_10.42.42.2(pid=1521): Launched 00:30:20.536070 run osmo-stp_10.42.42.5: Starting osmo-stp 00:30:21.064187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1523): Launched 00:30:21.387399 run osmo-stp_10.42.42.5(pid=1524): Launched 00:30:21.510719 run osmo-msc_10.42.42.6: Starting osmo-msc 00:30:22.069574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1526): Launched 00:30:22.393261 run osmo-msc_10.42.42.6(pid=1527): Launched 00:30:22.574216 run osmo-stp_10.42.42.5(pid=1524): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1524)] 00:30:22.710618 run osmo-stp_10.42.42.5(pid=1524): stdout: | (launched: 2022-12-09_00:30:21.328724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:22.847812 run osmo-stp_10.42.42.5(pid=1524): stderr: | [0;m[38;5;43m20221209003021520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003021520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003021520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003021521 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003021521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003021521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003021521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:22.984157 run osmo-stp_10.42.42.5(pid=1524): stdout: | (launched: 2022-12-09_00:30:21.328724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:23.113098 run osmo-stp_10.42.42.5(pid=1524): stderr: | [0;m[38;5;43m20221209003021520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003021520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003021520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003021521 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003021521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003021521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003021521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:23.267004 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1524): Process ended prematurely: osmo-stp_10.42.42.5(pid=1524) [trial-2351↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1524)] [trial-2351↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 00:30:23.275933 tst handover.py:18: Test FAILED (6.7 sec) 00:30:23.303291 run osmo-hlr_10.42.42.2(pid=1521): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1521)] 00:30:23.353129 run osmo-hlr_10.42.42.2(pid=1521): stdout: | (launched: 2022-12-09_00:30:20.354240) 00:30:23.404681 run osmo-hlr_10.42.42.2(pid=1521): stderr: | [0;m[1;31m20221209003020553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003020553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003020554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003020554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003020554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003020554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003020567 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003020575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003020575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003020575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:30:23.476409 run osmo-msc_10.42.42.6(pid=1527): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1527)] 00:30:23.525810 run osmo-msc_10.42.42.6(pid=1527): stdout: | (launched: 2022-12-09_00:30:22.334549) 00:30:23.577697 run osmo-msc_10.42.42.6(pid=1527): stderr: | [0;m[38;5;43m20221209003022656 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003022656 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa06b01bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003022656 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003022656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003022656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003022657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003022658 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003022659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003022659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003022659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:30:23.629367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1520): Terminating (SIGTERM) 00:30:23.670808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1523): Terminating (SIGTERM) 00:30:23.712205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1526): Terminating (SIGTERM) 00:30:23.754020 --- ParallelTerminationStrategy: PID 1520 died... 00:30:23.773509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1520): Terminated: ok {rc=0} 00:30:23.819109 --- ParallelTerminationStrategy: PID 1523 died... 00:30:23.838531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1523): Terminated: ok {rc=0} 00:30:23.884392 --- ParallelTerminationStrategy: PID 1526 died... 00:30:23.903855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1526): Terminated: ok {rc=0} 00:30:23.991200 bus /sierra_3: Setting Powered False 00:30:25.087340 bus /sierra_3: Setting Powered False 00:30:26.202385 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 00:30:27.464703 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:30:27.470223 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:30:27.523937 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:30:27.550828 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:30:27.605341 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:30:27.659134 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:30:27.685225 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:30:28.236370 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 00:30:28.242375 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:30:28.253665 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:30:28.290793 tst handover.py: using LAC 17818 00:30:28.409925 tst handover.py: using RAC 223 00:30:28.530787 tst handover.py: using CellId 17818 00:30:28.651200 tst handover.py: using BVCI 17819 00:30:28.763212 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:30:28.811917 tst handover.py: using LAC 17819 00:30:28.932914 tst handover.py: using RAC 224 00:30:29.052713 tst handover.py: using CellId 17819 00:30:29.184911 tst handover.py: using BVCI 17820 00:30:29.303654 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:30:29.315133 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:30:29.326479 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:30:29.338202 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:30:29.349996 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:30:29.361595 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:30:29.477758 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:30:29.595819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:30:30.041961 run create_hlr_db(pid=1532): Launched 00:30:30.159399 bus /sierra_2: Setting Powered False 00:30:31.236688 run create_hlr_db(pid=1532): Terminated: ok {rc=0} 00:30:31.693730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1534): Launched 00:30:32.037657 run osmo-hlr_10.42.42.2(pid=1535): Launched 00:30:32.270216 run osmo-stp_10.42.42.5: Starting osmo-stp 00:30:32.796654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1537): Launched 00:30:33.120608 run osmo-stp_10.42.42.5(pid=1538): Launched 00:30:33.244032 run osmo-msc_10.42.42.6: Starting osmo-msc 00:30:33.802017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1540): Launched 00:30:34.126005 run osmo-msc_10.42.42.6(pid=1541): Launched 00:30:34.306208 run osmo-stp_10.42.42.5(pid=1538): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1538)] 00:30:34.442552 run osmo-stp_10.42.42.5(pid=1538): stdout: | (launched: 2022-12-09_00:30:33.061916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:34.579162 run osmo-stp_10.42.42.5(pid=1538): stderr: | [0;m[38;5;43m20221209003033255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003033255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003033255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003033256 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003033258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003033258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003033258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:34.715514 run osmo-stp_10.42.42.5(pid=1538): stdout: | (launched: 2022-12-09_00:30:33.061916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:34.844651 run osmo-stp_10.42.42.5(pid=1538): stderr: | [0;m[38;5;43m20221209003033255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003033255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003033255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003033256 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003033258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003033258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003033258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:34.999720 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1538): Process ended prematurely: osmo-stp_10.42.42.5(pid=1538) [trial-2351↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1538)] [trial-2351↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 00:30:35.008806 tst handover.py:18: Test FAILED (6.8 sec) 00:30:35.036575 run osmo-hlr_10.42.42.2(pid=1535): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1535)] 00:30:35.086944 run osmo-hlr_10.42.42.2(pid=1535): stdout: | (launched: 2022-12-09_00:30:31.966638) 00:30:35.139088 run osmo-hlr_10.42.42.2(pid=1535): stderr: | [0;m[1;31m20221209003032227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003032227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003032227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003032227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003032228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003032228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003032241 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003032249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003032250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003032250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:30:35.211436 run osmo-msc_10.42.42.6(pid=1541): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1541)] 00:30:35.261473 run osmo-msc_10.42.42.6(pid=1541): stdout: | (launched: 2022-12-09_00:30:34.067293) 00:30:35.313648 run osmo-msc_10.42.42.6(pid=1541): stderr: | [0;m[38;5;43m20221209003034393 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003034393 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb8a8b32c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003034393 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003034393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003034393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003034394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003034395 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003034396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003034396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003034396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:30:35.366125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1534): Terminating (SIGTERM) 00:30:35.408236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1537): Terminating (SIGTERM) 00:30:35.450441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1540): Terminating (SIGTERM) 00:30:35.492838 --- ParallelTerminationStrategy: PID 1534 died... 00:30:35.512716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1534): Terminated: ok {rc=0} 00:30:35.559516 --- ParallelTerminationStrategy: PID 1537 died... 00:30:35.579053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1537): Terminated: ok {rc=0} 00:30:35.625281 --- ParallelTerminationStrategy: PID 1540 died... 00:30:35.645430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1540): Terminated: ok {rc=0} 00:30:35.732733 bus /sierra_3: Setting Powered False 00:30:36.831434 bus /sierra_3: Setting Powered False 00:30:37.944610 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 00:30:39.206723 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:30:39.212269 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 00:30:39.250682 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 00:30:39.278403 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 00:30:39.330222 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 00:30:39.367693 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 00:30:39.395306 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 00:30:39.947201 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 00:30:39.953051 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:30:39.964263 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 00:30:40.000659 tst handover.py: using LAC 17820 00:30:40.141502 tst handover.py: using RAC 225 00:30:40.274853 tst handover.py: using CellId 17820 00:30:40.401344 tst handover.py: using BVCI 17821 00:30:40.518536 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 00:30:40.558046 tst handover.py: using LAC 17821 00:30:40.683639 tst handover.py: using RAC 226 00:30:40.808920 tst handover.py: using CellId 17821 00:30:40.934446 tst handover.py: using BVCI 17822 00:30:41.051893 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:30:41.063022 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:30:41.074052 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:30:41.085554 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:30:41.096885 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:30:41.108407 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 00:30:41.228715 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 00:30:41.350916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:30:41.825614 run create_hlr_db(pid=1546): Launched 00:30:41.957430 bus /sierra_2: Setting Powered False 00:30:43.022035 run create_hlr_db(pid=1546): Terminated: ok {rc=0} 00:30:43.445623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1548): Launched 00:30:43.770089 run osmo-hlr_10.42.42.2(pid=1549): Launched 00:30:43.894159 run osmo-stp_10.42.42.5: Starting osmo-stp 00:30:44.427189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1551): Launched 00:30:44.750271 run osmo-stp_10.42.42.5(pid=1552): Launched 00:30:44.874293 run osmo-msc_10.42.42.6: Starting osmo-msc 00:30:45.433496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1554): Launched 00:30:45.757640 run osmo-msc_10.42.42.6(pid=1555): Launched 00:30:45.984431 run osmo-stp_10.42.42.5(pid=1552): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1552)] 00:30:46.257848 run osmo-stp_10.42.42.5(pid=1552): stdout: | (launched: 2022-12-09_00:30:44.691588) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:46.506601 run osmo-stp_10.42.42.5(pid=1552): stderr: | [0;m[38;5;43m20221209003044885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003044885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003044885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003044886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003044886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003044886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003044886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:46.680335 run osmo-stp_10.42.42.5(pid=1552): stdout: | (launched: 2022-12-09_00:30:44.691588) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:46.817959 run osmo-stp_10.42.42.5(pid=1552): stderr: | [0;m[38;5;43m20221209003044885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003044885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003044885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003044886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003044886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003044886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003044886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:46.975683 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1552): Process ended prematurely: osmo-stp_10.42.42.5(pid=1552) [trial-2351↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1552)] [trial-2351↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 00:30:46.985005 tst handover.py:18: Test FAILED (7.0 sec) 00:30:47.012921 run osmo-hlr_10.42.42.2(pid=1549): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1549)] 00:30:47.064635 run osmo-hlr_10.42.42.2(pid=1549): stdout: | (launched: 2022-12-09_00:30:43.711282) 00:30:47.117155 run osmo-hlr_10.42.42.2(pid=1549): stderr: | [0;m[1;31m20221209003043912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003043912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003043912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003043912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003043912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003043912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003043925 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003043934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003043934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003043934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:30:47.190125 run osmo-msc_10.42.42.6(pid=1555): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1555)] 00:30:47.240522 run osmo-msc_10.42.42.6(pid=1555): stdout: | (launched: 2022-12-09_00:30:45.698072) 00:30:47.293411 run osmo-msc_10.42.42.6(pid=1555): stderr: | [0;m[38;5;43m20221209003046203 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003046203 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa951d5ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003046203 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003046203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003046203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003046203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003046205 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003046206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003046206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003046206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:30:47.345273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1548): Terminating (SIGTERM) 00:30:47.386903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1551): Terminating (SIGTERM) 00:30:47.428555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1554): Terminating (SIGTERM) 00:30:47.470596 --- ParallelTerminationStrategy: PID 1548 died... 00:30:47.490525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1548): Terminated: ok {rc=0} 00:30:47.536470 --- ParallelTerminationStrategy: PID 1551 died... 00:30:47.555882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1551): Terminated: ok {rc=0} 00:30:47.602164 --- ParallelTerminationStrategy: PID 1554 died... 00:30:47.621721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1554): Terminated: ok {rc=0} 00:30:47.708789 bus /sierra_3: Setting Powered False 00:30:48.806249 bus /sierra_3: Setting Powered False 00:30:49.922612 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 00:30:51.163735 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:30:51.169564 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 00:30:51.220409 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 00:30:51.247478 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 00:30:51.298980 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 00:30:51.349640 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 00:30:51.376493 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 00:30:51.929563 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 00:30:51.934780 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:30:51.945913 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 00:30:51.980617 tst handover.py: using LAC 17822 00:30:52.101949 tst handover.py: using RAC 227 00:30:52.222350 tst handover.py: using CellId 17822 00:30:52.346784 tst handover.py: using BVCI 17823 00:30:52.458367 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 00:30:52.504362 tst handover.py: using LAC 17823 00:30:52.628580 tst handover.py: using RAC 228 00:30:52.746623 tst handover.py: using CellId 17823 00:30:52.864423 tst handover.py: using BVCI 17824 00:30:52.974694 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:30:52.985413 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:30:52.995881 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:30:53.006613 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:30:53.017568 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:30:53.028141 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 00:30:53.146286 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 00:30:53.261492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:30:53.708337 run create_hlr_db(pid=1560): Launched 00:30:53.826003 bus /sierra_2: Setting Powered False 00:30:54.886980 run create_hlr_db(pid=1560): Terminated: ok {rc=0} 00:30:55.304785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1562): Launched 00:30:55.631005 run osmo-hlr_10.42.42.2(pid=1563): Launched 00:30:55.755747 run osmo-stp_10.42.42.5: Starting osmo-stp 00:30:56.288606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1565): Launched 00:30:56.612326 run osmo-stp_10.42.42.5(pid=1566): Launched 00:30:56.735943 run osmo-msc_10.42.42.6: Starting osmo-msc 00:30:57.294864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1568): Launched 00:30:57.619602 run osmo-msc_10.42.42.6(pid=1569): Launched 00:30:57.800647 run osmo-stp_10.42.42.5(pid=1566): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1566)] 00:30:57.939185 run osmo-stp_10.42.42.5(pid=1566): stdout: | (launched: 2022-12-09_00:30:56.553652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:58.077222 run osmo-stp_10.42.42.5(pid=1566): stderr: | [0;m[38;5;43m20221209003056747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003056747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003056748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003056748 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003056750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003056750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003056750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:58.213222 run osmo-stp_10.42.42.5(pid=1566): stdout: | (launched: 2022-12-09_00:30:56.553652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:58.342279 run osmo-stp_10.42.42.5(pid=1566): stderr: | [0;m[38;5;43m20221209003056747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003056747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003056748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003056748 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003056750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003056750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003056750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:58.496567 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1566): Process ended prematurely: osmo-stp_10.42.42.5(pid=1566) [trial-2351↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1566)] [trial-2351↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 00:30:58.505771 tst handover.py:18: Test FAILED (6.6 sec) 00:30:58.533260 run osmo-hlr_10.42.42.2(pid=1563): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1563)] 00:30:58.583214 run osmo-hlr_10.42.42.2(pid=1563): stdout: | (launched: 2022-12-09_00:30:55.572152) 00:30:58.634854 run osmo-hlr_10.42.42.2(pid=1563): stderr: | [0;m[1;31m20221209003055770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003055770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003055770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003055770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003055770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003055770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003055782 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003055791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003055791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003055791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:30:58.706892 run osmo-msc_10.42.42.6(pid=1569): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1569)] 00:30:58.756882 run osmo-msc_10.42.42.6(pid=1569): stdout: | (launched: 2022-12-09_00:30:57.560503) 00:30:58.808503 run osmo-msc_10.42.42.6(pid=1569): stderr: | [0;m[38;5;43m20221209003057883 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003057883 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb699edec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003057883 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003057883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003057884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003057884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003057885 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003057886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003057886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003057886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:30:58.860325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1562): Terminating (SIGTERM) 00:30:58.902045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1565): Terminating (SIGTERM) 00:30:58.943565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1568): Terminating (SIGTERM) 00:30:58.985401 --- ParallelTerminationStrategy: PID 1562 died... 00:30:59.005123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1562): Terminated: ok {rc=0} 00:30:59.050803 --- ParallelTerminationStrategy: PID 1565 died... 00:30:59.070094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1565): Terminated: ok {rc=0} 00:30:59.115577 --- ParallelTerminationStrategy: PID 1568 died... 00:30:59.134974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1568): Terminated: ok {rc=0} 00:30:59.221867 bus /sierra_3: Setting Powered False 00:31:00.319734 bus /sierra_3: Setting Powered False 00:31:01.432675 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 00:31:02.683752 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:31:02.688728 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 00:31:02.735111 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:31:02.761270 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 00:31:02.811703 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 00:31:02.857164 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:31:02.883136 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 00:31:03.435311 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 00:31:03.440608 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:31:03.451717 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:31:03.485862 tst handover.py: using LAC 17824 00:31:03.606525 tst handover.py: using RAC 229 00:31:03.726259 tst handover.py: using CellId 17824 00:31:03.848344 tst handover.py: using BVCI 17825 00:31:03.961731 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:31:04.005726 tst handover.py: using LAC 17825 00:31:04.125786 tst handover.py: using RAC 230 00:31:04.251560 tst handover.py: using CellId 17825 00:31:04.371986 tst handover.py: using BVCI 17826 00:31:04.482919 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:31:04.494062 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:31:04.504846 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:31:04.516603 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:31:04.528171 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:31:04.539702 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:31:04.657312 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:31:04.772442 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:31:05.220828 run create_hlr_db(pid=1574): Launched 00:31:05.338011 bus /sierra_2: Setting Powered False 00:31:06.399201 run create_hlr_db(pid=1574): Terminated: ok {rc=0} 00:31:06.799832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1576): Launched 00:31:07.107142 run osmo-hlr_10.42.42.2(pid=1577): Launched 00:31:07.223661 run osmo-stp_10.42.42.5: Starting osmo-stp 00:31:07.727833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1579): Launched 00:31:08.035010 run osmo-stp_10.42.42.5(pid=1580): Launched 00:31:08.152026 run osmo-msc_10.42.42.6: Starting osmo-msc 00:31:08.679436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1582): Launched 00:31:08.986238 run osmo-msc_10.42.42.6(pid=1583): Launched 00:31:09.157166 run osmo-stp_10.42.42.5(pid=1580): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1580)] 00:31:09.286796 run osmo-stp_10.42.42.5(pid=1580): stdout: | (launched: 2022-12-09_00:31:07.979224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:09.416248 run osmo-stp_10.42.42.5(pid=1580): stderr: | [0;m[38;5;43m20221209003108149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003108149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003108150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003108150 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003108150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003108150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003108151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:09.543588 run osmo-stp_10.42.42.5(pid=1580): stdout: | (launched: 2022-12-09_00:31:07.979224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:09.665187 run osmo-stp_10.42.42.5(pid=1580): stderr: | [0;m[38;5;43m20221209003108149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003108149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003108150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003108150 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003108150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003108150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003108151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:09.810456 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1580): Process ended prematurely: osmo-stp_10.42.42.5(pid=1580) [trial-2351↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1580)] [trial-2351↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 00:31:09.818875 tst handover.py:18: Test FAILED (6.4 sec) 00:31:09.845481 run osmo-hlr_10.42.42.2(pid=1577): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1577)] 00:31:09.893380 run osmo-hlr_10.42.42.2(pid=1577): stdout: | (launched: 2022-12-09_00:31:07.051094) 00:31:09.943043 run osmo-hlr_10.42.42.2(pid=1577): stderr: | [0;m[1;31m20221209003107226 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003107227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003107227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003107227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003107227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003107227 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003107242 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003107251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003107252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003107252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:31:10.011840 run osmo-msc_10.42.42.6(pid=1583): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1583)] 00:31:10.059540 run osmo-msc_10.42.42.6(pid=1583): stdout: | (launched: 2022-12-09_00:31:08.930447) 00:31:10.109126 run osmo-msc_10.42.42.6(pid=1583): stderr: | [0;m[38;5;43m20221209003109204 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003109204 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fba5aa90c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003109204 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003109204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003109204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003109204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003109208 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003109209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003109209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003109209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:31:10.159171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1576): Terminating (SIGTERM) 00:31:10.198819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1579): Terminating (SIGTERM) 00:31:10.238636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1582): Terminating (SIGTERM) 00:31:10.278590 --- ParallelTerminationStrategy: PID 1576 died... 00:31:10.297571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1576): Terminated: ok {rc=0} 00:31:10.342356 --- ParallelTerminationStrategy: PID 1579 died... 00:31:10.360801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1579): Terminated: ok {rc=0} 00:31:10.405470 --- ParallelTerminationStrategy: PID 1582 died... 00:31:10.423966 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1582): Terminated: ok {rc=0} 00:31:10.509214 bus /sierra_3: Setting Powered False 00:31:11.607934 bus /sierra_3: Setting Powered False 00:31:12.723933 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 00:31:13.982725 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:31:13.988420 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 00:31:14.040254 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 00:31:14.067203 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 00:31:14.118889 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 00:31:14.170403 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 00:31:14.197525 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 00:31:14.749948 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 00:31:14.755187 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:31:14.766526 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:31:14.800919 tst handover.py: using LAC 17826 00:31:14.928208 tst handover.py: using RAC 231 00:31:15.054660 tst handover.py: using CellId 17826 00:31:15.182647 tst handover.py: using BVCI 17827 00:31:15.301167 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:31:15.351091 tst handover.py: using LAC 17827 00:31:15.479305 tst handover.py: using RAC 232 00:31:15.605911 tst handover.py: using CellId 17827 00:31:15.734299 tst handover.py: using BVCI 17828 00:31:15.872709 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:31:15.884704 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:31:15.900089 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:31:15.917892 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:31:15.930535 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:31:15.942838 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:31:16.067550 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:31:16.206362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:31:16.673119 run create_hlr_db(pid=1588): Launched 00:31:16.795222 bus /sierra_2: Setting Powered False 00:31:17.855838 run create_hlr_db(pid=1588): Terminated: ok {rc=0} 00:31:18.272653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1590): Launched 00:31:18.597066 run osmo-hlr_10.42.42.2(pid=1591): Launched 00:31:18.721402 run osmo-stp_10.42.42.5: Starting osmo-stp 00:31:19.255100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1593): Launched 00:31:19.579698 run osmo-stp_10.42.42.5(pid=1594): Launched 00:31:19.702835 run osmo-msc_10.42.42.6: Starting osmo-msc 00:31:20.261537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1596): Launched 00:31:20.585334 run osmo-msc_10.42.42.6(pid=1597): Launched 00:31:20.766391 run osmo-stp_10.42.42.5(pid=1594): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1594)] 00:31:20.906828 run osmo-stp_10.42.42.5(pid=1594): stdout: | (launched: 2022-12-09_00:31:19.520704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:21.042200 run osmo-stp_10.42.42.5(pid=1594): stderr: | [0;m[38;5;43m20221209003119715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003119715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003119715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003119716 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003119716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003119716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003119716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:21.177796 run osmo-stp_10.42.42.5(pid=1594): stdout: | (launched: 2022-12-09_00:31:19.520704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:21.306835 run osmo-stp_10.42.42.5(pid=1594): stderr: | [0;m[38;5;43m20221209003119715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003119715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003119715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003119716 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003119716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003119716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003119716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:21.461364 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1594): Process ended prematurely: osmo-stp_10.42.42.5(pid=1594) [trial-2351↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1594)] [trial-2351↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 00:31:21.470225 tst handover.py:18: Test FAILED (6.7 sec) 00:31:21.497303 run osmo-hlr_10.42.42.2(pid=1591): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1591)] 00:31:21.546894 run osmo-hlr_10.42.42.2(pid=1591): stdout: | (launched: 2022-12-09_00:31:18.538173) 00:31:21.598116 run osmo-hlr_10.42.42.2(pid=1591): stderr: | [0;m[1;31m20221209003118736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003118736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003118736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003118736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003118736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003118736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003118748 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003118757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003118757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003118757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:31:21.669657 run osmo-msc_10.42.42.6(pid=1597): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1597)] 00:31:21.719149 run osmo-msc_10.42.42.6(pid=1597): stdout: | (launched: 2022-12-09_00:31:20.526482) 00:31:21.770320 run osmo-msc_10.42.42.6(pid=1597): stderr: | [0;m[38;5;43m20221209003120850 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003120850 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd7fe7f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003120850 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003120850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003120850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003120850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003120852 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003120852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003120853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003120853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:31:21.821844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1590): Terminating (SIGTERM) 00:31:21.863130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1593): Terminating (SIGTERM) 00:31:21.905293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1596): Terminating (SIGTERM) 00:31:21.947302 --- ParallelTerminationStrategy: PID 1590 died... 00:31:21.967080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1590): Terminated: ok {rc=0} 00:31:22.013216 --- ParallelTerminationStrategy: PID 1593 died... 00:31:22.032544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1593): Terminated: ok {rc=0} 00:31:22.078147 --- ParallelTerminationStrategy: PID 1596 died... 00:31:22.097494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1596): Terminated: ok {rc=0} 00:31:22.184709 bus /sierra_3: Setting Powered False 00:31:23.283172 bus /sierra_3: Setting Powered False 00:31:24.401330 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 00:31:25.656356 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:31:25.662599 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 00:31:25.701610 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 00:31:25.728722 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 00:31:25.781718 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 00:31:25.820854 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 00:31:25.848089 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 00:31:26.398608 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 00:31:26.403891 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:31:26.415049 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 00:31:26.449545 tst handover.py: using LAC 17828 00:31:26.571966 tst handover.py: using RAC 233 00:31:26.693384 tst handover.py: using CellId 17828 00:31:26.812758 tst handover.py: using BVCI 17829 00:31:26.923201 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 00:31:26.958303 tst handover.py: using LAC 17829 00:31:27.088835 tst handover.py: using RAC 234 00:31:27.215874 tst handover.py: using CellId 17829 00:31:27.335654 tst handover.py: using BVCI 17830 00:31:27.446521 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:31:27.457444 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:31:27.468056 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:31:27.479136 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:31:27.490166 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:31:27.501309 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 00:31:27.619475 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 00:31:27.734541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:31:28.182221 run create_hlr_db(pid=1603): Launched 00:31:28.298535 bus /sierra_2: Setting Powered False 00:31:29.358818 run create_hlr_db(pid=1603): Terminated: ok {rc=0} 00:31:29.774945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1605): Launched 00:31:30.100901 run osmo-hlr_10.42.42.2(pid=1606): Launched 00:31:30.225410 run osmo-stp_10.42.42.5: Starting osmo-stp 00:31:30.755643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1608): Launched 00:31:31.103743 run osmo-stp_10.42.42.5(pid=1609): Launched 00:31:31.287027 run osmo-msc_10.42.42.6: Starting osmo-msc 00:31:32.010569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1611): Launched 00:31:32.342329 run osmo-msc_10.42.42.6(pid=1612): Launched 00:31:32.523684 run osmo-stp_10.42.42.5(pid=1609): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1609)] 00:31:32.660077 run osmo-stp_10.42.42.5(pid=1609): stdout: | (launched: 2022-12-09_00:31:31.040260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:32.798430 run osmo-stp_10.42.42.5(pid=1609): stderr: | [0;m[38;5;43m20221209003131387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003131387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003131388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003131390 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003131395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003131397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003131398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:32.935034 run osmo-stp_10.42.42.5(pid=1609): stdout: | (launched: 2022-12-09_00:31:31.040260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:33.064155 run osmo-stp_10.42.42.5(pid=1609): stderr: | [0;m[38;5;43m20221209003131387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003131387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003131388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003131390 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003131395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003131397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003131398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:33.218438 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1609): Process ended prematurely: osmo-stp_10.42.42.5(pid=1609) [trial-2351↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1609)] [trial-2351↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 00:31:33.227538 tst handover.py:18: Test FAILED (6.8 sec) 00:31:33.254931 run osmo-hlr_10.42.42.2(pid=1606): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1606)] 00:31:33.304942 run osmo-hlr_10.42.42.2(pid=1606): stdout: | (launched: 2022-12-09_00:31:30.041661) 00:31:33.356798 run osmo-hlr_10.42.42.2(pid=1606): stderr: | [0;m[1;31m20221209003130241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003130241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003130241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003130241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003130241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003130241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003130255 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003130263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003130263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003130263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:31:33.428774 run osmo-msc_10.42.42.6(pid=1612): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1612)] 00:31:33.478668 run osmo-msc_10.42.42.6(pid=1612): stdout: | (launched: 2022-12-09_00:31:32.279384) 00:31:33.530375 run osmo-msc_10.42.42.6(pid=1612): stderr: | [0;m[38;5;43m20221209003132604 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003132605 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f03b50f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003132605 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003132605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003132605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003132605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003132607 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003132607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003132607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003132607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:31:33.582364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1605): Terminating (SIGTERM) 00:31:33.623701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1608): Terminating (SIGTERM) 00:31:33.665541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1611): Terminating (SIGTERM) 00:31:33.707654 --- ParallelTerminationStrategy: PID 1605 died... 00:31:33.727532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1605): Terminated: ok {rc=0} 00:31:33.773477 --- ParallelTerminationStrategy: PID 1608 died... 00:31:33.792853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1608): Terminated: ok {rc=0} 00:31:33.838282 --- ParallelTerminationStrategy: PID 1611 died... 00:31:33.857609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1611): Terminated: ok {rc=0} 00:31:33.944352 bus /sierra_3: Setting Powered False 00:31:35.042852 bus /sierra_3: Setting Powered False 00:31:36.159957 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 00:31:37.401328 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:31:37.406788 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:31:37.457811 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:31:37.485286 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:31:37.543126 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:31:37.594152 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:31:37.621117 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:31:38.169814 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 00:31:38.175167 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:31:38.186318 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:31:38.220833 tst handover.py: using LAC 17830 00:31:38.345821 tst handover.py: using RAC 235 00:31:38.470455 tst handover.py: using CellId 17830 00:31:38.595582 tst handover.py: using BVCI 17831 00:31:38.712169 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:31:38.760561 tst handover.py: using LAC 17831 00:31:38.879489 tst handover.py: using RAC 236 00:31:38.998018 tst handover.py: using CellId 17831 00:31:39.116721 tst handover.py: using BVCI 17832 00:31:39.227110 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:31:39.238104 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:31:39.248710 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:31:39.260510 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:31:39.272022 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:31:39.283467 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:31:39.402808 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:31:39.522351 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:31:39.994461 run create_hlr_db(pid=1617): Launched 00:31:40.126470 bus /sierra_2: Setting Powered False 00:31:41.190224 run create_hlr_db(pid=1617): Terminated: ok {rc=0} 00:31:41.611340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1619): Launched 00:31:41.935388 run osmo-hlr_10.42.42.2(pid=1620): Launched 00:31:42.059185 run osmo-stp_10.42.42.5: Starting osmo-stp 00:31:42.589751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1622): Launched 00:31:42.913222 run osmo-stp_10.42.42.5(pid=1623): Launched 00:31:43.036074 run osmo-msc_10.42.42.6: Starting osmo-msc 00:31:43.592389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1625): Launched 00:31:43.916199 run osmo-msc_10.42.42.6(pid=1626): Launched 00:31:44.096504 run osmo-stp_10.42.42.5(pid=1623): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1623)] 00:31:44.237803 run osmo-stp_10.42.42.5(pid=1623): stdout: | (launched: 2022-12-09_00:31:42.854304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:44.375648 run osmo-stp_10.42.42.5(pid=1623): stderr: | [0;m[38;5;43m20221209003143046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003143046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003143046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003143047 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003143049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003143049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003143049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:44.509998 run osmo-stp_10.42.42.5(pid=1623): stdout: | (launched: 2022-12-09_00:31:42.854304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:44.638398 run osmo-stp_10.42.42.5(pid=1623): stderr: | [0;m[38;5;43m20221209003143046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003143046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003143046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003143047 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003143049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003143049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003143049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:44.792095 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1623): Process ended prematurely: osmo-stp_10.42.42.5(pid=1623) [trial-2351↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1623)] [trial-2351↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 00:31:44.801114 tst handover.py:18: Test FAILED (6.6 sec) 00:31:44.828061 run osmo-hlr_10.42.42.2(pid=1620): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1620)] 00:31:44.877346 run osmo-hlr_10.42.42.2(pid=1620): stdout: | (launched: 2022-12-09_00:31:41.876314) 00:31:44.928841 run osmo-hlr_10.42.42.2(pid=1620): stderr: | [0;m[1;31m20221209003142075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003142075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003142075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003142075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003142075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003142075 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003142087 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003142095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003142096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003142096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:31:45.000185 run osmo-msc_10.42.42.6(pid=1626): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1626)] 00:31:45.049365 run osmo-msc_10.42.42.6(pid=1626): stdout: | (launched: 2022-12-09_00:31:43.856870) 00:31:45.100239 run osmo-msc_10.42.42.6(pid=1626): stderr: | [0;m[38;5;43m20221209003144179 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003144180 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fef761e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003144180 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003144180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003144180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003144180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003144182 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003144182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003144183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003144183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:31:45.151423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1619): Terminating (SIGTERM) 00:31:45.192797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1622): Terminating (SIGTERM) 00:31:45.233979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1625): Terminating (SIGTERM) 00:31:45.275639 --- ParallelTerminationStrategy: PID 1619 died... 00:31:45.295352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1619): Terminated: ok {rc=0} 00:31:45.341047 --- ParallelTerminationStrategy: PID 1622 died... 00:31:45.360292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1622): Terminated: ok {rc=0} 00:31:45.405830 --- ParallelTerminationStrategy: PID 1625 died... 00:31:45.425143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1625): Terminated: ok {rc=0} 00:31:45.511770 bus /sierra_3: Setting Powered False 00:31:46.609368 bus /sierra_3: Setting Powered False 00:31:47.727441 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 00:31:48.985896 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:31:48.991350 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:31:49.041752 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:31:49.068673 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:31:49.120579 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:31:49.170548 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:31:49.197464 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:31:49.751249 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 00:31:49.757400 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:31:49.769251 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:31:49.803544 tst handover.py: using LAC 17832 00:31:49.928891 tst handover.py: using RAC 237 00:31:50.054014 tst handover.py: using CellId 17832 00:31:50.174383 tst handover.py: using BVCI 17833 00:31:50.294953 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:31:50.342249 tst handover.py: using LAC 17833 00:31:50.469409 tst handover.py: using RAC 238 00:31:50.594252 tst handover.py: using CellId 17833 00:31:50.719063 tst handover.py: using BVCI 17834 00:31:50.836027 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:31:50.847353 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:31:50.858536 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:31:50.869545 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:31:50.880562 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:31:50.891659 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:31:51.004070 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:31:51.118812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:31:51.564784 run create_hlr_db(pid=1631): Launched 00:31:51.682626 bus /sierra_2: Setting Powered False 00:31:52.743997 run create_hlr_db(pid=1631): Terminated: ok {rc=0} 00:31:53.160358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1633): Launched 00:31:53.484829 run osmo-hlr_10.42.42.2(pid=1634): Launched 00:31:53.609680 run osmo-stp_10.42.42.5: Starting osmo-stp 00:31:54.139588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1636): Launched 00:31:54.463538 run osmo-stp_10.42.42.5(pid=1637): Launched 00:31:54.587275 run osmo-msc_10.42.42.6: Starting osmo-msc 00:31:55.146730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1639): Launched 00:31:55.471300 run osmo-msc_10.42.42.6(pid=1640): Launched 00:31:55.651709 run osmo-stp_10.42.42.5(pid=1637): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1637)] 00:31:55.788129 run osmo-stp_10.42.42.5(pid=1637): stdout: | (launched: 2022-12-09_00:31:54.404713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:55.925275 run osmo-stp_10.42.42.5(pid=1637): stderr: | [0;m[38;5;43m20221209003154596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003154596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003154596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003154597 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003154597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003154597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003154597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:56.061731 run osmo-stp_10.42.42.5(pid=1637): stdout: | (launched: 2022-12-09_00:31:54.404713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:56.190670 run osmo-stp_10.42.42.5(pid=1637): stderr: | [0;m[38;5;43m20221209003154596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003154596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003154596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003154597 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003154597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003154597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003154597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:56.345578 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1637): Process ended prematurely: osmo-stp_10.42.42.5(pid=1637) [trial-2351↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1637)] [trial-2351↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 00:31:56.354651 tst handover.py:18: Test FAILED (6.6 sec) 00:31:56.382000 run osmo-hlr_10.42.42.2(pid=1634): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1634)] 00:31:56.431283 run osmo-hlr_10.42.42.2(pid=1634): stdout: | (launched: 2022-12-09_00:31:53.426253) 00:31:56.482608 run osmo-hlr_10.42.42.2(pid=1634): stderr: | [0;m[1;31m20221209003153624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003153624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003153624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003153624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003153624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003153624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003153636 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003153645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003153645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003153645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:31:56.554107 run osmo-msc_10.42.42.6(pid=1640): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1640)] 00:31:56.603286 run osmo-msc_10.42.42.6(pid=1640): stdout: | (launched: 2022-12-09_00:31:55.412359) 00:31:56.654261 run osmo-msc_10.42.42.6(pid=1640): stderr: | [0;m[38;5;43m20221209003155736 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003155736 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9c74085c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003155736 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003155736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003155737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003155737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003155738 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003155739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003155739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003155739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:31:56.705713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1633): Terminating (SIGTERM) 00:31:56.748010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1636): Terminating (SIGTERM) 00:31:56.789152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1639): Terminating (SIGTERM) 00:31:56.830557 --- ParallelTerminationStrategy: PID 1633 died... 00:31:56.850250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1633): Terminated: ok {rc=0} 00:31:56.895963 --- ParallelTerminationStrategy: PID 1636 died... 00:31:56.915590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1636): Terminated: ok {rc=0} 00:31:56.961227 --- ParallelTerminationStrategy: PID 1639 died... 00:31:56.980486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1639): Terminated: ok {rc=0} 00:31:57.066699 bus /sierra_3: Setting Powered False 00:31:58.163731 bus /sierra_3: Setting Powered False 00:31:59.277541 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 00:32:00.532308 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:32:00.537863 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 00:32:00.587565 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 00:32:00.614592 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 00:32:00.667453 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 00:32:00.716819 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 00:32:00.743772 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 00:32:01.313550 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 00:32:01.322788 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:32:01.337699 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 00:32:01.381532 tst handover.py: using LAC 17834 00:32:01.506429 tst handover.py: using RAC 239 00:32:01.656224 tst handover.py: using CellId 17834 00:32:01.818178 tst handover.py: using BVCI 17835 00:32:01.933193 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 00:32:01.983651 tst handover.py: using LAC 17835 00:32:02.112377 tst handover.py: using RAC 240 00:32:02.239248 tst handover.py: using CellId 17835 00:32:02.359034 tst handover.py: using BVCI 17836 00:32:02.468905 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:32:02.479776 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:32:02.490559 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:32:02.501928 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:32:02.512839 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:32:02.523889 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 00:32:02.641915 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 00:32:02.758582 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:32:03.204140 run create_hlr_db(pid=1645): Launched 00:32:03.320299 bus /sierra_2: Setting Powered False 00:32:04.382023 run create_hlr_db(pid=1645): Terminated: ok {rc=0} 00:32:04.780264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1647): Launched 00:32:05.085035 run osmo-hlr_10.42.42.2(pid=1648): Launched 00:32:05.201413 run osmo-stp_10.42.42.5: Starting osmo-stp 00:32:05.711842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1650): Launched 00:32:06.017594 run osmo-stp_10.42.42.5(pid=1651): Launched 00:32:06.134808 run osmo-msc_10.42.42.6: Starting osmo-msc 00:32:06.663737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1653): Launched 00:32:06.970416 run osmo-msc_10.42.42.6(pid=1654): Launched 00:32:07.142198 run osmo-stp_10.42.42.5(pid=1651): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1651)] 00:32:07.272276 run osmo-stp_10.42.42.5(pid=1651): stdout: | (launched: 2022-12-09_00:32:05.961832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:07.402097 run osmo-stp_10.42.42.5(pid=1651): stderr: | [0;m[38;5;43m20221209003206133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003206133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003206133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003206134 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003206134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003206134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003206134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:07.530114 run osmo-stp_10.42.42.5(pid=1651): stdout: | (launched: 2022-12-09_00:32:05.961832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:07.651898 run osmo-stp_10.42.42.5(pid=1651): stderr: | [0;m[38;5;43m20221209003206133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003206133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003206133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003206134 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003206134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003206134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003206134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:07.798164 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1651): Process ended prematurely: osmo-stp_10.42.42.5(pid=1651) [trial-2351↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1651)] [trial-2351↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 00:32:07.806393 tst handover.py:18: Test FAILED (6.5 sec) 00:32:07.832782 run osmo-hlr_10.42.42.2(pid=1648): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1648)] 00:32:07.880024 run osmo-hlr_10.42.42.2(pid=1648): stdout: | (launched: 2022-12-09_00:32:05.029299) 00:32:07.929229 run osmo-hlr_10.42.42.2(pid=1648): stderr: | [0;m[1;31m20221209003205204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003205204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003205204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003205204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003205204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003205204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003205216 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003205224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003205225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003205225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:32:07.997427 run osmo-msc_10.42.42.6(pid=1654): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1654)] 00:32:08.044508 run osmo-msc_10.42.42.6(pid=1654): stdout: | (launched: 2022-12-09_00:32:06.914446) 00:32:08.093294 run osmo-msc_10.42.42.6(pid=1654): stderr: | [0;m[38;5;43m20221209003207184 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003207185 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc4b6b5bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003207185 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003207185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003207185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003207185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003207187 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003207187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003207187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003207187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:32:08.142678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1647): Terminating (SIGTERM) 00:32:08.181955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1650): Terminating (SIGTERM) 00:32:08.221331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1653): Terminating (SIGTERM) 00:32:08.261021 --- ParallelTerminationStrategy: PID 1647 died... 00:32:08.279849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1647): Terminated: ok {rc=0} 00:32:08.323545 --- ParallelTerminationStrategy: PID 1650 died... 00:32:08.341762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1650): Terminated: ok {rc=0} 00:32:08.385380 --- ParallelTerminationStrategy: PID 1653 died... 00:32:08.403726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1653): Terminated: ok {rc=0} 00:32:08.489296 bus /sierra_3: Setting Powered False 00:32:09.588038 bus /sierra_3: Setting Powered False 00:32:10.702462 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 00:32:11.954388 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:32:11.959401 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 00:32:12.004051 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:32:12.030235 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 00:32:12.083640 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 00:32:12.128427 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:32:12.154272 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 00:32:12.702842 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 00:32:12.708087 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:32:12.718990 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:32:12.752415 tst handover.py: using LAC 17836 00:32:12.871761 tst handover.py: using RAC 241 00:32:12.990361 tst handover.py: using CellId 17836 00:32:13.111498 tst handover.py: using BVCI 17837 00:32:13.223663 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:32:13.267115 tst handover.py: using LAC 17837 00:32:13.389112 tst handover.py: using RAC 242 00:32:13.517090 tst handover.py: using CellId 17837 00:32:13.653646 tst handover.py: using BVCI 17838 00:32:13.766124 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:32:13.776888 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:32:13.787612 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:32:13.798813 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:32:13.810044 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:32:13.820804 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:32:13.939617 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:32:14.058983 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:32:14.534750 run create_hlr_db(pid=1659): Launched 00:32:14.666670 bus /sierra_2: Setting Powered False 00:32:15.731173 run create_hlr_db(pid=1659): Terminated: ok {rc=0} 00:32:16.193818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1661): Launched 00:32:16.573725 run osmo-hlr_10.42.42.2(pid=1662): Launched 00:32:16.801127 run osmo-stp_10.42.42.5: Starting osmo-stp 00:32:17.436487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1664): Launched 00:32:17.743716 run osmo-stp_10.42.42.5(pid=1665): Launched 00:32:17.860828 run osmo-msc_10.42.42.6: Starting osmo-msc 00:32:18.385727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1667): Launched 00:32:18.692488 run osmo-msc_10.42.42.6(pid=1668): Launched 00:32:18.864156 run osmo-stp_10.42.42.5(pid=1665): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1665)] 00:32:18.994458 run osmo-stp_10.42.42.5(pid=1665): stdout: | (launched: 2022-12-09_00:32:17.687571) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:19.124414 run osmo-stp_10.42.42.5(pid=1665): stderr: | [0;m[38;5;43m20221209003217860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003217860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003217860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003217860 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003217861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003217861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003217861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:19.251991 run osmo-stp_10.42.42.5(pid=1665): stdout: | (launched: 2022-12-09_00:32:17.687571) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:19.373687 run osmo-stp_10.42.42.5(pid=1665): stderr: | [0;m[38;5;43m20221209003217860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003217860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003217860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003217860 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003217861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003217861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003217861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:19.519433 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1665): Process ended prematurely: osmo-stp_10.42.42.5(pid=1665) [trial-2351↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1665)] [trial-2351↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 00:32:19.527628 tst handover.py:18: Test FAILED (6.8 sec) 00:32:19.553854 run osmo-hlr_10.42.42.2(pid=1662): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1662)] 00:32:19.601195 run osmo-hlr_10.42.42.2(pid=1662): stdout: | (launched: 2022-12-09_00:32:16.508940) 00:32:19.650005 run osmo-hlr_10.42.42.2(pid=1662): stderr: | [0;m[1;31m20221209003216744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003216744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003216744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003216744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003216744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003216744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003216767 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003216789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003216789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003216789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:32:19.717853 run osmo-msc_10.42.42.6(pid=1668): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1668)] 00:32:19.764745 run osmo-msc_10.42.42.6(pid=1668): stdout: | (launched: 2022-12-09_00:32:18.636656) 00:32:19.813377 run osmo-msc_10.42.42.6(pid=1668): stderr: | [0;m[38;5;43m20221209003218909 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003218910 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9873043c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003218910 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003218910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003218910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003218910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003218912 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003218912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003218912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003218913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:32:19.862275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1661): Terminating (SIGTERM) 00:32:19.901311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1664): Terminating (SIGTERM) 00:32:19.940376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1667): Terminating (SIGTERM) 00:32:19.979493 --- ParallelTerminationStrategy: PID 1661 died... 00:32:19.998291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1661): Terminated: ok {rc=0} 00:32:20.041938 --- ParallelTerminationStrategy: PID 1664 died... 00:32:20.060230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1664): Terminated: ok {rc=0} 00:32:20.103568 --- ParallelTerminationStrategy: PID 1667 died... 00:32:20.121805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1667): Terminated: ok {rc=0} 00:32:20.204131 bus /sierra_3: Setting Powered False 00:32:21.297732 bus /sierra_3: Setting Powered False 00:32:22.411243 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 00:32:23.660220 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:32:23.665215 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 00:32:23.714200 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 00:32:23.740358 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 00:32:23.790981 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 00:32:23.839343 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 00:32:23.865265 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 00:32:24.417229 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 00:32:24.422264 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:24.433174 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:32:24.466561 tst handover.py: using LAC 17838 00:32:24.586742 tst handover.py: using RAC 243 00:32:24.715300 tst handover.py: using CellId 17838 00:32:24.844360 tst handover.py: using BVCI 17839 00:32:24.964076 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:32:25.015213 tst handover.py: using LAC 17839 00:32:25.143867 tst handover.py: using RAC 244 00:32:25.271322 tst handover.py: using CellId 17839 00:32:25.404125 tst handover.py: using BVCI 17840 00:32:25.522233 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:25.533825 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:25.545057 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:25.557161 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:25.569310 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:25.581176 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:32:25.696738 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:32:25.812515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:32:26.260272 run create_hlr_db(pid=1673): Launched 00:32:26.378544 bus /sierra_2: Setting Powered False 00:32:27.439174 run create_hlr_db(pid=1673): Terminated: ok {rc=0} 00:32:27.855145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1675): Launched 00:32:28.179403 run osmo-hlr_10.42.42.2(pid=1676): Launched 00:32:28.302867 run osmo-stp_10.42.42.5: Starting osmo-stp 00:32:28.836288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1678): Launched 00:32:29.160863 run osmo-stp_10.42.42.5(pid=1679): Launched 00:32:29.284110 run osmo-msc_10.42.42.6: Starting osmo-msc 00:32:29.842040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1681): Launched 00:32:30.166449 run osmo-msc_10.42.42.6(pid=1682): Launched 00:32:30.347267 run osmo-stp_10.42.42.5(pid=1679): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1679)] 00:32:30.483918 run osmo-stp_10.42.42.5(pid=1679): stdout: | (launched: 2022-12-09_00:32:29.102176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:30.622049 run osmo-stp_10.42.42.5(pid=1679): stderr: | [0;m[38;5;43m20221209003229297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003229297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003229297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003229298 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003229298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003229298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003229298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:30.757797 run osmo-stp_10.42.42.5(pid=1679): stdout: | (launched: 2022-12-09_00:32:29.102176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:30.898178 run osmo-stp_10.42.42.5(pid=1679): stderr: | [0;m[38;5;43m20221209003229297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003229297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003229297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003229298 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003229298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003229298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003229298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:31.055696 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1679): Process ended prematurely: osmo-stp_10.42.42.5(pid=1679) [trial-2351↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1679)] [trial-2351↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 00:32:31.065076 tst handover.py:18: Test FAILED (6.6 sec) 00:32:31.093462 run osmo-hlr_10.42.42.2(pid=1676): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1676)] 00:32:31.143493 run osmo-hlr_10.42.42.2(pid=1676): stdout: | (launched: 2022-12-09_00:32:28.121116) 00:32:31.195429 run osmo-hlr_10.42.42.2(pid=1676): stderr: | [0;m[1;31m20221209003228320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003228320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003228320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003228320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003228320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003228321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003228334 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003228342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003228342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003228342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:32:31.268012 run osmo-msc_10.42.42.6(pid=1682): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1682)] 00:32:31.318568 run osmo-msc_10.42.42.6(pid=1682): stdout: | (launched: 2022-12-09_00:32:30.107596) 00:32:31.370662 run osmo-msc_10.42.42.6(pid=1682): stderr: | [0;m[38;5;43m20221209003230430 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003230430 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2aad4edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003230431 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003230431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003230431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003230431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003230433 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003230433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003230433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003230433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:32:31.423306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1675): Terminating (SIGTERM) 00:32:31.465681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1678): Terminating (SIGTERM) 00:32:31.507707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1681): Terminating (SIGTERM) 00:32:31.550289 --- ParallelTerminationStrategy: PID 1675 died... 00:32:31.570176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1675): Terminated: ok {rc=0} 00:32:31.617319 --- ParallelTerminationStrategy: PID 1678 died... 00:32:31.637335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1678): Terminated: ok {rc=0} 00:32:31.683979 --- ParallelTerminationStrategy: PID 1681 died... 00:32:31.704124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1681): Terminated: ok {rc=0} 00:32:31.797181 bus /sierra_3: Setting Powered False 00:32:32.894550 bus /sierra_3: Setting Powered False 00:32:34.007257 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 00:32:35.262054 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:32:35.267106 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 00:32:35.304487 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 00:32:35.330687 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 00:32:35.383118 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 00:32:35.419510 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 00:32:35.445433 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 00:32:35.993261 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 00:32:35.999248 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:32:36.010502 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 00:32:36.044703 tst handover.py: using LAC 17840 00:32:36.164786 tst handover.py: using RAC 245 00:32:36.285104 tst handover.py: using CellId 17840 00:32:36.404765 tst handover.py: using BVCI 17841 00:32:36.517901 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 00:32:36.553328 tst handover.py: using LAC 17841 00:32:36.675482 tst handover.py: using RAC 246 00:32:36.797300 tst handover.py: using CellId 17841 00:32:36.917307 tst handover.py: using BVCI 17842 00:32:37.028743 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:32:37.039551 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:32:37.050144 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:32:37.061469 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:32:37.072762 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:32:37.084194 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 00:32:37.204719 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 00:32:37.324119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:32:37.799634 run create_hlr_db(pid=1687): Launched 00:32:37.932033 bus /sierra_2: Setting Powered False 00:32:38.996671 run create_hlr_db(pid=1687): Terminated: ok {rc=0} 00:32:39.406593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1689): Launched 00:32:39.713519 run osmo-hlr_10.42.42.2(pid=1690): Launched 00:32:39.830830 run osmo-stp_10.42.42.5: Starting osmo-stp 00:32:40.334112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1692): Launched 00:32:40.639671 run osmo-stp_10.42.42.5(pid=1693): Launched 00:32:40.756227 run osmo-msc_10.42.42.6: Starting osmo-msc 00:32:41.282261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1695): Launched 00:32:41.588567 run osmo-msc_10.42.42.6(pid=1696): Launched 00:32:41.760199 run osmo-stp_10.42.42.5(pid=1693): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1693)] 00:32:41.890398 run osmo-stp_10.42.42.5(pid=1693): stdout: | (launched: 2022-12-09_00:32:40.583342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:42.020349 run osmo-stp_10.42.42.5(pid=1693): stderr: | [0;m[38;5;43m20221209003240755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003240755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003240756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003240756 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003240757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003240757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003240757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:42.148029 run osmo-stp_10.42.42.5(pid=1693): stdout: | (launched: 2022-12-09_00:32:40.583342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:42.270156 run osmo-stp_10.42.42.5(pid=1693): stderr: | [0;m[38;5;43m20221209003240755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003240755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003240756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003240756 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003240757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003240757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003240757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:42.415860 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1693): Process ended prematurely: osmo-stp_10.42.42.5(pid=1693) [trial-2351↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1693)] [trial-2351↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 00:32:42.424312 tst handover.py:18: Test FAILED (6.4 sec) 00:32:42.450739 run osmo-hlr_10.42.42.2(pid=1690): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1690)] 00:32:42.498683 run osmo-hlr_10.42.42.2(pid=1690): stdout: | (launched: 2022-12-09_00:32:39.657632) 00:32:42.548041 run osmo-hlr_10.42.42.2(pid=1690): stderr: | [0;m[1;31m20221209003239833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003239833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003239833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003239833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003239833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003239833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003239849 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003239860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003239860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003239860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:32:42.617352 run osmo-msc_10.42.42.6(pid=1696): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1696)] 00:32:42.665261 run osmo-msc_10.42.42.6(pid=1696): stdout: | (launched: 2022-12-09_00:32:41.532399) 00:32:42.714511 run osmo-msc_10.42.42.6(pid=1696): stderr: | [0;m[38;5;43m20221209003241803 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003241803 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fea9a208c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003241803 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003241803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003241803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003241803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003241805 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003241806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003241806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003241806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:32:42.764281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1689): Terminating (SIGTERM) 00:32:42.803772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1692): Terminating (SIGTERM) 00:32:42.843290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1695): Terminating (SIGTERM) 00:32:42.883105 --- ParallelTerminationStrategy: PID 1689 died... 00:32:42.901925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1689): Terminated: ok {rc=0} 00:32:42.946242 --- ParallelTerminationStrategy: PID 1692 died... 00:32:42.964504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1692): Terminated: ok {rc=0} 00:32:43.008500 --- ParallelTerminationStrategy: PID 1695 died... 00:32:43.027004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1695): Terminated: ok {rc=0} 00:32:43.109863 bus /sierra_3: Setting Powered False 00:32:44.207724 bus /sierra_3: Setting Powered False 00:32:45.325818 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 00:32:46.595493 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:32:46.601950 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:32:46.653743 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:32:46.682448 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:32:46.734389 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:32:46.787140 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:32:46.816239 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:32:47.360548 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 00:32:47.366978 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:32:47.378945 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:32:47.413645 tst handover.py: using LAC 17842 00:32:47.536557 tst handover.py: using RAC 247 00:32:47.656168 tst handover.py: using CellId 17842 00:32:47.776658 tst handover.py: using BVCI 17843 00:32:47.887249 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:32:47.933745 tst handover.py: using LAC 17843 00:32:48.055189 tst handover.py: using RAC 248 00:32:48.176406 tst handover.py: using CellId 17843 00:32:48.300695 tst handover.py: using BVCI 17844 00:32:48.412922 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:32:48.423967 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:32:48.434924 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:32:48.445884 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:32:48.456599 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:32:48.468096 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:32:48.586080 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:32:48.700604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:32:49.147406 run create_hlr_db(pid=1701): Launched 00:32:49.263652 bus /sierra_2: Setting Powered False 00:32:50.324288 run create_hlr_db(pid=1701): Terminated: ok {rc=0} 00:32:50.742319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1703): Launched 00:32:51.067841 run osmo-hlr_10.42.42.2(pid=1704): Launched 00:32:51.191471 run osmo-stp_10.42.42.5: Starting osmo-stp 00:32:51.723906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1706): Launched 00:32:52.048408 run osmo-stp_10.42.42.5(pid=1707): Launched 00:32:52.171238 run osmo-msc_10.42.42.6: Starting osmo-msc 00:32:52.730384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1709): Launched 00:32:53.056269 run osmo-msc_10.42.42.6(pid=1710): Launched 00:32:53.234392 run osmo-stp_10.42.42.5(pid=1707): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1707)] 00:32:53.368092 run osmo-stp_10.42.42.5(pid=1707): stdout: | (launched: 2022-12-09_00:32:51.989591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:53.498239 run osmo-stp_10.42.42.5(pid=1707): stderr: | [0;m[38;5;43m20221209003252183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003252184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003252184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003252184 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003252185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003252185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003252185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:53.626536 run osmo-stp_10.42.42.5(pid=1707): stdout: | (launched: 2022-12-09_00:32:51.989591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:53.748927 run osmo-stp_10.42.42.5(pid=1707): stderr: | [0;m[38;5;43m20221209003252183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003252184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003252184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003252184 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003252185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003252185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003252185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:53.895353 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1707): Process ended prematurely: osmo-stp_10.42.42.5(pid=1707) [trial-2351↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1707)] [trial-2351↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 00:32:53.903854 tst handover.py:18: Test FAILED (6.5 sec) 00:32:53.930262 run osmo-hlr_10.42.42.2(pid=1704): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1704)] 00:32:53.978141 run osmo-hlr_10.42.42.2(pid=1704): stdout: | (launched: 2022-12-09_00:32:51.009149) 00:32:54.027544 run osmo-hlr_10.42.42.2(pid=1704): stderr: | [0;m[1;31m20221209003251206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003251206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003251206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003251206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003251206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003251206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003251218 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003251227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003251227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003251227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:32:54.096343 run osmo-msc_10.42.42.6(pid=1710): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1710)] 00:32:54.143475 run osmo-msc_10.42.42.6(pid=1710): stdout: | (launched: 2022-12-09_00:32:52.997083) 00:32:54.192283 run osmo-msc_10.42.42.6(pid=1710): stderr: | [0;m[38;5;43m20221209003253271 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003253271 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f368ca83c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003253271 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003253271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003253271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003253272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003253273 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003253274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003253274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003253274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:32:54.241760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1703): Terminating (SIGTERM) 00:32:54.281356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1706): Terminating (SIGTERM) 00:32:54.321034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1709): Terminating (SIGTERM) 00:32:54.360738 --- ParallelTerminationStrategy: PID 1703 died... 00:32:54.379719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1703): Terminated: ok {rc=0} 00:32:54.423760 --- ParallelTerminationStrategy: PID 1706 died... 00:32:54.442296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1706): Terminated: ok {rc=0} 00:32:54.486189 --- ParallelTerminationStrategy: PID 1709 died... 00:32:54.504654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1709): Terminated: ok {rc=0} 00:32:54.588095 bus /sierra_3: Setting Powered False 00:32:55.682141 bus /sierra_3: Setting Powered False 00:32:56.796695 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 00:32:58.049018 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:32:58.054183 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:32:58.102315 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:32:58.128610 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:32:58.182786 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:32:58.233361 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:32:58.262515 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:32:58.808086 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 00:32:58.813604 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:32:58.824936 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:32:58.859020 tst handover.py: using LAC 17844 00:32:58.984701 tst handover.py: using RAC 249 00:32:59.109837 tst handover.py: using CellId 17844 00:32:59.234766 tst handover.py: using BVCI 17845 00:32:59.352351 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:32:59.404038 tst handover.py: using LAC 17845 00:32:59.530501 tst handover.py: using RAC 250 00:32:59.655540 tst handover.py: using CellId 17845 00:32:59.781530 tst handover.py: using BVCI 17846 00:32:59.894685 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:32:59.905581 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:32:59.916262 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:32:59.927044 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:32:59.938195 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:32:59.949203 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:33:00.067118 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:33:00.184810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:33:00.633746 run create_hlr_db(pid=1715): Launched 00:33:00.751747 bus /sierra_2: Setting Powered False 00:33:01.812313 run create_hlr_db(pid=1715): Terminated: ok {rc=0} 00:33:02.255188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1718): Launched 00:33:02.581612 run osmo-hlr_10.42.42.2(pid=1719): Launched 00:33:02.705766 run osmo-stp_10.42.42.5: Starting osmo-stp 00:33:03.238187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1721): Launched 00:33:03.564151 run osmo-stp_10.42.42.5(pid=1722): Launched 00:33:03.688448 run osmo-msc_10.42.42.6: Starting osmo-msc 00:33:04.250165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1724): Launched 00:33:04.576505 run osmo-msc_10.42.42.6(pid=1725): Launched 00:33:04.759312 run osmo-stp_10.42.42.5(pid=1722): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1722)] 00:33:04.897178 run osmo-stp_10.42.42.5(pid=1722): stdout: | (launched: 2022-12-09_00:33:03.504746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:05.035542 run osmo-stp_10.42.42.5(pid=1722): stderr: | [0;m[38;5;43m20221209003303699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003303700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003303700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003303700 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003303701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003303701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003303701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:05.172365 run osmo-stp_10.42.42.5(pid=1722): stdout: | (launched: 2022-12-09_00:33:03.504746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:05.302401 run osmo-stp_10.42.42.5(pid=1722): stderr: | [0;m[38;5;43m20221209003303699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003303700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003303700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003303700 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003303701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003303701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003303701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:05.457466 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1722): Process ended prematurely: osmo-stp_10.42.42.5(pid=1722) [trial-2351↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1722)] [trial-2351↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 00:33:05.466460 tst handover.py:18: Test FAILED (6.6 sec) 00:33:05.493728 run osmo-hlr_10.42.42.2(pid=1719): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1719)] 00:33:05.543343 run osmo-hlr_10.42.42.2(pid=1719): stdout: | (launched: 2022-12-09_00:33:02.522499) 00:33:05.595049 run osmo-hlr_10.42.42.2(pid=1719): stderr: | [0;m[1;31m20221209003302723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003302723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003302723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003302724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003302724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003302724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003302735 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003302744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003302744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003302744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:33:05.666783 run osmo-msc_10.42.42.6(pid=1725): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1725)] 00:33:05.716078 run osmo-msc_10.42.42.6(pid=1725): stdout: | (launched: 2022-12-09_00:33:04.517024) 00:33:05.767267 run osmo-msc_10.42.42.6(pid=1725): stderr: | [0;m[38;5;43m20221209003304841 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003304841 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0e60786c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003304841 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003304842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003304842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003304842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003304843 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003304844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003304844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003304844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:33:05.818593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1718): Terminating (SIGTERM) 00:33:05.860069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1721): Terminating (SIGTERM) 00:33:05.901824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1724): Terminating (SIGTERM) 00:33:05.943987 --- ParallelTerminationStrategy: PID 1718 died... 00:33:05.963358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1718): Terminated: ok {rc=0} 00:33:06.009386 --- ParallelTerminationStrategy: PID 1721 died... 00:33:06.028718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1721): Terminated: ok {rc=0} 00:33:06.074149 --- ParallelTerminationStrategy: PID 1724 died... 00:33:06.093546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1724): Terminated: ok {rc=0} 00:33:06.181401 bus /sierra_3: Setting Powered False 00:33:07.280252 bus /sierra_3: Setting Powered False 00:33:08.396123 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 00:33:09.654513 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:33:09.660110 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 00:33:09.717594 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:33:09.744451 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 00:33:09.795186 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 00:33:09.852992 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:33:09.879718 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 00:33:10.430596 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 00:33:10.435965 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:33:10.447094 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:33:10.497456 tst handover.py: using LAC 17846 00:33:10.616921 tst handover.py: using RAC 251 00:33:10.734256 tst handover.py: using CellId 17846 00:33:10.851662 tst handover.py: using BVCI 17847 00:33:10.962228 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:33:11.005325 tst handover.py: using LAC 17847 00:33:11.123119 tst handover.py: using RAC 252 00:33:11.241976 tst handover.py: using CellId 17847 00:33:11.359518 tst handover.py: using BVCI 17848 00:33:11.478458 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:33:11.490137 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:33:11.501589 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:33:11.513096 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:33:11.524551 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:33:11.535953 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:33:11.652447 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:33:11.767058 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:33:12.214613 run create_hlr_db(pid=1730): Launched 00:33:12.331993 bus /sierra_2: Setting Powered False 00:33:13.393148 run create_hlr_db(pid=1730): Terminated: ok {rc=0} 00:33:13.810858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1732): Launched 00:33:14.137539 run osmo-hlr_10.42.42.2(pid=1733): Launched 00:33:14.262060 run osmo-stp_10.42.42.5: Starting osmo-stp 00:33:14.796693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1735): Launched 00:33:15.123564 run osmo-stp_10.42.42.5(pid=1736): Launched 00:33:15.248005 run osmo-msc_10.42.42.6: Starting osmo-msc 00:33:15.808415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1738): Launched 00:33:16.155223 run osmo-msc_10.42.42.6(pid=1739): Launched 00:33:16.482731 run osmo-stp_10.42.42.5(pid=1736): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1736)] 00:33:16.638514 run osmo-stp_10.42.42.5(pid=1736): stdout: | (launched: 2022-12-09_00:33:15.064430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:16.872294 run osmo-stp_10.42.42.5(pid=1736): stderr: | [0;m[38;5;43m20221209003315255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003315255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003315255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003315256 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003315256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003315256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003315257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:17.172320 run osmo-stp_10.42.42.5(pid=1736): stdout: | (launched: 2022-12-09_00:33:15.064430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:17.343200 run osmo-stp_10.42.42.5(pid=1736): stderr: | [0;m[38;5;43m20221209003315255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003315255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003315255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003315256 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003315256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003315256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003315257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:17.501771 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1736): Process ended prematurely: osmo-stp_10.42.42.5(pid=1736) [trial-2351↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1736)] [trial-2351↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 00:33:17.510974 tst handover.py:18: Test FAILED (7.1 sec) 00:33:17.539068 run osmo-hlr_10.42.42.2(pid=1733): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1733)] 00:33:17.588899 run osmo-hlr_10.42.42.2(pid=1733): stdout: | (launched: 2022-12-09_00:33:14.078426) 00:33:17.640326 run osmo-hlr_10.42.42.2(pid=1733): stderr: | [0;m[1;31m20221209003314279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003314279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003314279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003314279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003314279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003314279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003314291 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003314299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003314299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003314299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:33:17.712191 run osmo-msc_10.42.42.6(pid=1739): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1739)] 00:33:17.761973 run osmo-msc_10.42.42.6(pid=1739): stdout: | (launched: 2022-12-09_00:33:16.090819) 00:33:17.813357 run osmo-msc_10.42.42.6(pid=1739): stderr: | [0;m[38;5;43m20221209003316786 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003316786 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f111de09c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003316786 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003316786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003316787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003316787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003316797 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003316797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003316797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003316797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:33:17.865103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1732): Terminating (SIGTERM) 00:33:17.906557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1735): Terminating (SIGTERM) 00:33:17.948139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1738): Terminating (SIGTERM) 00:33:17.990236 --- ParallelTerminationStrategy: PID 1732 died... 00:33:18.010073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1732): Terminated: ok {rc=0} 00:33:18.055781 --- ParallelTerminationStrategy: PID 1735 died... 00:33:18.075269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1735): Terminated: ok {rc=0} 00:33:18.120683 --- ParallelTerminationStrategy: PID 1738 died... 00:33:18.140103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1738): Terminated: ok {rc=0} 00:33:18.226070 bus /sierra_3: Setting Powered False 00:33:19.325128 bus /sierra_3: Setting Powered False 00:33:20.439930 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 00:33:21.704379 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:33:21.709608 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 00:33:21.772194 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 00:33:21.798686 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 00:33:21.850277 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 00:33:21.913218 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 00:33:21.939599 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 00:33:22.489329 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 00:33:22.494554 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:33:22.505593 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:33:22.552938 tst handover.py: using LAC 17848 00:33:22.673934 tst handover.py: using RAC 253 00:33:22.795214 tst handover.py: using CellId 17848 00:33:22.915176 tst handover.py: using BVCI 17849 00:33:23.027516 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:33:23.075935 tst handover.py: using LAC 17849 00:33:23.197220 tst handover.py: using RAC 254 00:33:23.318843 tst handover.py: using CellId 17849 00:33:23.437283 tst handover.py: using BVCI 17850 00:33:23.547665 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:33:23.558810 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:33:23.569639 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:33:23.580519 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:33:23.591579 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:33:23.602577 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:33:23.722196 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:33:23.845103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:33:24.320185 run create_hlr_db(pid=1744): Launched 00:33:24.451983 bus /sierra_2: Setting Powered False 00:33:25.515997 run create_hlr_db(pid=1744): Terminated: ok {rc=0} 00:33:25.924388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1746): Launched 00:33:26.232279 run osmo-hlr_10.42.42.2(pid=1747): Launched 00:33:26.349453 run osmo-stp_10.42.42.5: Starting osmo-stp 00:33:26.862212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1749): Launched 00:33:27.168464 run osmo-stp_10.42.42.5(pid=1750): Launched 00:33:27.285918 run osmo-msc_10.42.42.6: Starting osmo-msc 00:33:27.816454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1752): Launched 00:33:28.123259 run osmo-msc_10.42.42.6(pid=1753): Launched 00:33:28.294414 run osmo-stp_10.42.42.5(pid=1750): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1750)] 00:33:28.424572 run osmo-stp_10.42.42.5(pid=1750): stdout: | (launched: 2022-12-09_00:33:27.112326) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:28.554180 run osmo-stp_10.42.42.5(pid=1750): stderr: | [0;m[38;5;43m20221209003327286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003327286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003327286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003327286 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003327287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003327287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003327287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:28.681937 run osmo-stp_10.42.42.5(pid=1750): stdout: | (launched: 2022-12-09_00:33:27.112326) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:28.803932 run osmo-stp_10.42.42.5(pid=1750): stderr: | [0;m[38;5;43m20221209003327286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003327286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003327286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003327286 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003327287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003327287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003327287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:28.949626 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1750): Process ended prematurely: osmo-stp_10.42.42.5(pid=1750) [trial-2351↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1750)] [trial-2351↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 00:33:28.958150 tst handover.py:18: Test FAILED (6.5 sec) 00:33:28.984074 run osmo-hlr_10.42.42.2(pid=1747): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1747)] 00:33:29.031748 run osmo-hlr_10.42.42.2(pid=1747): stdout: | (launched: 2022-12-09_00:33:26.176573) 00:33:29.080681 run osmo-hlr_10.42.42.2(pid=1747): stderr: | [0;m[1;31m20221209003326356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003326356 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003326357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003326357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003326357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003326357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003326369 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003326379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003326380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003326380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:33:29.148815 run osmo-msc_10.42.42.6(pid=1753): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1753)] 00:33:29.195782 run osmo-msc_10.42.42.6(pid=1753): stdout: | (launched: 2022-12-09_00:33:28.067310) 00:33:29.244460 run osmo-msc_10.42.42.6(pid=1753): stderr: | [0;m[38;5;43m20221209003328340 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003328341 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa21c541c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003328341 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003328341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003328341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003328341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003328343 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003328343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003328343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003328343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:33:29.293597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1746): Terminating (SIGTERM) 00:33:29.333006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1749): Terminating (SIGTERM) 00:33:29.372574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1752): Terminating (SIGTERM) 00:33:29.412547 --- ParallelTerminationStrategy: PID 1746 died... 00:33:29.431321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1746): Terminated: ok {rc=0} 00:33:29.475310 --- ParallelTerminationStrategy: PID 1749 died... 00:33:29.493687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1749): Terminated: ok {rc=0} 00:33:29.537477 --- ParallelTerminationStrategy: PID 1752 died... 00:33:29.555676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1752): Terminated: ok {rc=0} 00:33:29.641957 bus /sierra_3: Setting Powered False 00:33:30.739784 bus /sierra_3: Setting Powered False 00:33:31.861543 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 00:33:33.128071 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:33:33.134485 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 00:33:33.185785 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 00:33:33.213049 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 00:33:33.265708 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 00:33:33.317375 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 00:33:33.344546 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 00:33:33.894570 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 00:33:33.900126 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:33.911438 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 00:33:33.960335 tst handover.py: using LAC 17850 00:33:34.089049 tst handover.py: using RAC 255 00:33:34.215850 tst handover.py: using CellId 17850 00:33:34.342584 tst handover.py: using BVCI 17851 00:33:34.462330 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 00:33:34.497430 tst handover.py: using LAC 17851 00:33:34.618537 tst handover.py: using RAC 1 00:33:34.738649 tst handover.py: using CellId 17851 00:33:34.859738 tst handover.py: using BVCI 17852 00:33:34.970716 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:34.981522 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:34.992025 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:35.003382 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:35.014791 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:35.026050 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 00:33:35.142174 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 00:33:35.261169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:33:35.735832 run create_hlr_db(pid=1758): Launched 00:33:35.867378 bus /sierra_2: Setting Powered False 00:33:36.931503 run create_hlr_db(pid=1758): Terminated: ok {rc=0} 00:33:37.341869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1760): Launched 00:33:37.648419 run osmo-hlr_10.42.42.2(pid=1761): Launched 00:33:37.765429 run osmo-stp_10.42.42.5: Starting osmo-stp 00:33:38.280052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1763): Launched 00:33:38.585755 run osmo-stp_10.42.42.5(pid=1764): Launched 00:33:38.703084 run osmo-msc_10.42.42.6: Starting osmo-msc 00:33:39.229129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1766): Launched 00:33:39.535411 run osmo-msc_10.42.42.6(pid=1767): Launched 00:33:39.706530 run osmo-stp_10.42.42.5(pid=1764): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1764)] 00:33:39.835959 run osmo-stp_10.42.42.5(pid=1764): stdout: | (launched: 2022-12-09_00:33:38.530027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:39.965615 run osmo-stp_10.42.42.5(pid=1764): stderr: | [0;m[38;5;43m20221209003338700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003338701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003338701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003338701 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003338702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003338702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003338702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:40.092914 run osmo-stp_10.42.42.5(pid=1764): stdout: | (launched: 2022-12-09_00:33:38.530027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:40.214376 run osmo-stp_10.42.42.5(pid=1764): stderr: | [0;m[38;5;43m20221209003338700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003338701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003338701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003338701 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003338702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003338702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003338702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:40.360051 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1764): Process ended prematurely: osmo-stp_10.42.42.5(pid=1764) [trial-2351↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1764)] [trial-2351↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 00:33:40.368296 tst handover.py:18: Test FAILED (6.5 sec) 00:33:40.394789 run osmo-hlr_10.42.42.2(pid=1761): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1761)] 00:33:40.442146 run osmo-hlr_10.42.42.2(pid=1761): stdout: | (launched: 2022-12-09_00:33:37.592489) 00:33:40.491200 run osmo-hlr_10.42.42.2(pid=1761): stderr: | [0;m[1;31m20221209003337769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003337769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003337769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003337769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003337769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003337769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003337781 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003337790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003337790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003337791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:33:40.559819 run osmo-msc_10.42.42.6(pid=1767): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1767)] 00:33:40.606959 run osmo-msc_10.42.42.6(pid=1767): stdout: | (launched: 2022-12-09_00:33:39.479425) 00:33:40.655808 run osmo-msc_10.42.42.6(pid=1767): stderr: | [0;m[38;5;43m20221209003339751 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003339752 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6b8ffd1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003339752 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003339752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003339752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003339752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003339754 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003339754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003339754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003339755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:33:40.705136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1760): Terminating (SIGTERM) 00:33:40.744480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1763): Terminating (SIGTERM) 00:33:40.783821 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1766): Terminating (SIGTERM) 00:33:40.823472 --- ParallelTerminationStrategy: PID 1760 died... 00:33:40.842182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1760): Terminated: ok {rc=0} 00:33:40.885928 --- ParallelTerminationStrategy: PID 1763 died... 00:33:40.904079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1763): Terminated: ok {rc=0} 00:33:40.947869 --- ParallelTerminationStrategy: PID 1766 died... 00:33:40.966101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1766): Terminated: ok {rc=0} 00:33:41.049049 bus /sierra_3: Setting Powered False 00:33:42.146064 bus /sierra_3: Setting Powered False 00:33:43.262012 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 00:33:44.519012 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:33:44.524633 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:33:44.588117 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:33:44.615298 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:33:44.666887 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:33:44.730872 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:33:44.757891 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:33:45.309871 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 00:33:45.316072 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:33:45.327991 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:33:45.375042 tst handover.py: using LAC 17852 00:33:45.494228 tst handover.py: using RAC 2 00:33:45.615390 tst handover.py: using CellId 17852 00:33:45.743012 tst handover.py: using BVCI 17853 00:33:45.864230 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:33:45.913892 tst handover.py: using LAC 17853 00:33:46.042236 tst handover.py: using RAC 3 00:33:46.165173 tst handover.py: using CellId 17853 00:33:46.296497 tst handover.py: using BVCI 17854 00:33:46.428222 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:33:46.440163 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:33:46.452014 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:33:46.466012 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:33:46.478738 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:33:46.491422 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:33:46.611663 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:33:46.731951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:33:47.206677 run create_hlr_db(pid=1772): Launched 00:33:47.336543 bus /sierra_2: Setting Powered False 00:33:48.400692 run create_hlr_db(pid=1772): Terminated: ok {rc=0} 00:33:48.810425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1774): Launched 00:33:49.118037 run osmo-hlr_10.42.42.2(pid=1775): Launched 00:33:49.234986 run osmo-stp_10.42.42.5: Starting osmo-stp 00:33:49.751789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1777): Launched 00:33:50.059146 run osmo-stp_10.42.42.5(pid=1778): Launched 00:33:50.175476 run osmo-msc_10.42.42.6: Starting osmo-msc 00:33:50.705361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1781): Launched 00:33:51.011829 run osmo-msc_10.42.42.6(pid=1782): Launched 00:33:51.184342 run osmo-stp_10.42.42.5(pid=1778): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1778)] 00:33:51.314624 run osmo-stp_10.42.42.5(pid=1778): stdout: | (launched: 2022-12-09_00:33:50.002887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:51.451223 run osmo-stp_10.42.42.5(pid=1778): stderr: | [0;m[38;5;43m20221209003350174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003350175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003350175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003350175 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003350176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003350176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003350176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:51.586639 run osmo-stp_10.42.42.5(pid=1778): stdout: | (launched: 2022-12-09_00:33:50.002887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:51.716300 run osmo-stp_10.42.42.5(pid=1778): stderr: | [0;m[38;5;43m20221209003350174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003350175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003350175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003350175 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003350176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003350176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003350176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:51.871329 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1778): Process ended prematurely: osmo-stp_10.42.42.5(pid=1778) [trial-2351↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1778)] [trial-2351↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 00:33:51.880154 tst handover.py:18: Test FAILED (6.6 sec) 00:33:51.908705 run osmo-hlr_10.42.42.2(pid=1775): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1775)] 00:33:51.958752 run osmo-hlr_10.42.42.2(pid=1775): stdout: | (launched: 2022-12-09_00:33:49.061681) 00:33:52.011035 run osmo-hlr_10.42.42.2(pid=1775): stderr: | [0;m[1;31m20221209003349238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003349238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003349238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003349238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003349238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003349238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003349250 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003349259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003349259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003349259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:33:52.083455 run osmo-msc_10.42.42.6(pid=1782): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1782)] 00:33:52.133238 run osmo-msc_10.42.42.6(pid=1782): stdout: | (launched: 2022-12-09_00:33:50.955880) 00:33:52.185222 run osmo-msc_10.42.42.6(pid=1782): stderr: | [0;m[38;5;43m20221209003351230 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003351230 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f577d7bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003351230 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003351230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003351230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003351230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003351232 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003351232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003351233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003351233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:33:52.237086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1774): Terminating (SIGTERM) 00:33:52.278771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1777): Terminating (SIGTERM) 00:33:52.320549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1781): Terminating (SIGTERM) 00:33:52.362815 --- ParallelTerminationStrategy: PID 1774 died... 00:33:52.382838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1774): Terminated: ok {rc=0} 00:33:52.429120 --- ParallelTerminationStrategy: PID 1777 died... 00:33:52.448621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1777): Terminated: ok {rc=0} 00:33:52.494687 --- ParallelTerminationStrategy: PID 1781 died... 00:33:52.514093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1781): Terminated: ok {rc=0} 00:33:52.603741 bus /sierra_3: Setting Powered False 00:33:53.702285 bus /sierra_3: Setting Powered False 00:33:54.818748 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 00:33:56.086659 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:33:56.091668 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:33:56.152492 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:33:56.178904 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:33:56.231334 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:33:56.292289 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:33:56.318071 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:33:56.868748 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 00:33:56.873854 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:33:56.884437 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:33:56.930825 tst handover.py: using LAC 17854 00:33:57.048893 tst handover.py: using RAC 4 00:33:57.166491 tst handover.py: using CellId 17854 00:33:57.284812 tst handover.py: using BVCI 17855 00:33:57.395324 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:33:57.440642 tst handover.py: using LAC 17855 00:33:57.559919 tst handover.py: using RAC 5 00:33:57.678656 tst handover.py: using CellId 17855 00:33:57.797352 tst handover.py: using BVCI 17856 00:33:57.907744 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:33:57.918518 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:33:57.929000 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:33:57.939878 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:33:57.950688 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:33:57.961447 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:33:58.079109 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:33:58.199756 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:33:58.648053 run create_hlr_db(pid=1789): Launched 00:33:58.764172 bus /sierra_2: Setting Powered False 00:33:59.825584 run create_hlr_db(pid=1789): Terminated: ok {rc=0} 00:34:00.224912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1791): Launched 00:34:00.530637 run osmo-hlr_10.42.42.2(pid=1792): Launched 00:34:00.647788 run osmo-stp_10.42.42.5: Starting osmo-stp 00:34:01.182492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1794): Launched 00:34:01.533540 run osmo-stp_10.42.42.5(pid=1795): Launched 00:34:01.665317 run osmo-msc_10.42.42.6: Starting osmo-msc 00:34:02.392758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1797): Launched 00:34:02.716179 run osmo-msc_10.42.42.6(pid=1798): Launched 00:34:02.895950 run osmo-stp_10.42.42.5(pid=1795): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1795)] 00:34:03.033147 run osmo-stp_10.42.42.5(pid=1795): stdout: | (launched: 2022-12-09_00:34:01.468571) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:03.170136 run osmo-stp_10.42.42.5(pid=1795): stderr: | [0;m[38;5;43m20221209003401816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003401816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003401816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003401816 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003401831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003401831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003401831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:03.306870 run osmo-stp_10.42.42.5(pid=1795): stdout: | (launched: 2022-12-09_00:34:01.468571) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:03.436156 run osmo-stp_10.42.42.5(pid=1795): stderr: | [0;m[38;5;43m20221209003401816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003401816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003401816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003401816 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003401831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003401831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003401831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:03.590945 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1795): Process ended prematurely: osmo-stp_10.42.42.5(pid=1795) [trial-2351↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1795)] [trial-2351↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 00:34:03.599597 tst handover.py:18: Test FAILED (6.7 sec) 00:34:03.626778 run osmo-hlr_10.42.42.2(pid=1792): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1792)] 00:34:03.676151 run osmo-hlr_10.42.42.2(pid=1792): stdout: | (launched: 2022-12-09_00:34:00.474738) 00:34:03.727235 run osmo-hlr_10.42.42.2(pid=1792): stderr: | [0;m[1;31m20221209003400652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003400652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003400653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003400653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003400653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003400653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003400665 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003400674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003400674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003400674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:34:03.798681 run osmo-msc_10.42.42.6(pid=1798): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1798)] 00:34:03.847851 run osmo-msc_10.42.42.6(pid=1798): stdout: | (launched: 2022-12-09_00:34:02.657298) 00:34:03.898909 run osmo-msc_10.42.42.6(pid=1798): stderr: | [0;m[38;5;43m20221209003402979 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003402979 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f37c8023c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003402979 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003402979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003402979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003402979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003402981 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003402982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003402982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003402982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:34:03.950398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1791): Terminating (SIGTERM) 00:34:03.991854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1794): Terminating (SIGTERM) 00:34:04.033086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1797): Terminating (SIGTERM) 00:34:04.074757 --- ParallelTerminationStrategy: PID 1791 died... 00:34:04.094424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1791): Terminated: ok {rc=0} 00:34:04.139857 --- ParallelTerminationStrategy: PID 1794 died... 00:34:04.159148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1794): Terminated: ok {rc=0} 00:34:04.204847 --- ParallelTerminationStrategy: PID 1797 died... 00:34:04.224432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1797): Terminated: ok {rc=0} 00:34:04.311241 bus /sierra_3: Setting Powered False 00:34:05.409458 bus /sierra_3: Setting Powered False 00:34:06.524023 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 00:34:07.794239 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:34:07.799764 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 00:34:07.859720 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 00:34:07.886700 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 00:34:07.940171 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 00:34:08.001438 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 00:34:08.028447 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 00:34:08.576443 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 00:34:08.581983 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:34:08.593345 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:34:08.637714 tst handover.py: using LAC 17856 00:34:08.767017 tst handover.py: using RAC 6 00:34:08.897307 tst handover.py: using CellId 17856 00:34:09.024459 tst handover.py: using BVCI 17857 00:34:09.141792 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:34:09.190649 tst handover.py: using LAC 17857 00:34:09.317366 tst handover.py: using RAC 7 00:34:09.446470 tst handover.py: using CellId 17857 00:34:09.572885 tst handover.py: using BVCI 17858 00:34:09.690485 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:34:09.702064 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:34:09.713445 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:34:09.724830 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:34:09.736180 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:34:09.747486 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:34:09.862018 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:34:09.981572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:34:10.455576 run create_hlr_db(pid=1803): Launched 00:34:10.586628 bus /sierra_2: Setting Powered False 00:34:11.650411 run create_hlr_db(pid=1803): Terminated: ok {rc=0} 00:34:12.074493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1805): Launched 00:34:12.399249 run osmo-hlr_10.42.42.2(pid=1806): Launched 00:34:12.522677 run osmo-stp_10.42.42.5: Starting osmo-stp 00:34:13.056678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1808): Launched 00:34:13.380890 run osmo-stp_10.42.42.5(pid=1809): Launched 00:34:13.504534 run osmo-msc_10.42.42.6: Starting osmo-msc 00:34:14.067010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1811): Launched 00:34:14.392282 run osmo-msc_10.42.42.6(pid=1812): Launched 00:34:14.573378 run osmo-stp_10.42.42.5(pid=1809): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1809)] 00:34:14.709905 run osmo-stp_10.42.42.5(pid=1809): stdout: | (launched: 2022-12-09_00:34:13.321590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:14.846896 run osmo-stp_10.42.42.5(pid=1809): stderr: | [0;m[38;5;43m20221209003413513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003413514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003413514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003413514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003413517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003413517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003413517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:14.983954 run osmo-stp_10.42.42.5(pid=1809): stdout: | (launched: 2022-12-09_00:34:13.321590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:15.113428 run osmo-stp_10.42.42.5(pid=1809): stderr: | [0;m[38;5;43m20221209003413513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003413514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003413514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003413514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003413517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003413517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003413517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:15.268000 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1809): Process ended prematurely: osmo-stp_10.42.42.5(pid=1809) [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1809)] [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 00:34:15.276871 tst handover.py:18: Test FAILED (6.7 sec) 00:34:15.304233 run osmo-hlr_10.42.42.2(pid=1806): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1806)] 00:34:15.353880 run osmo-hlr_10.42.42.2(pid=1806): stdout: | (launched: 2022-12-09_00:34:12.340156) 00:34:15.405957 run osmo-hlr_10.42.42.2(pid=1806): stderr: | [0;m[1;31m20221209003412541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003412541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003412541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003412541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003412542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003412542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003412554 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003412562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003412563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003412563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:34:15.477720 run osmo-msc_10.42.42.6(pid=1812): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1812)] 00:34:15.527350 run osmo-msc_10.42.42.6(pid=1812): stdout: | (launched: 2022-12-09_00:34:14.332804) 00:34:15.578641 run osmo-msc_10.42.42.6(pid=1812): stderr: | [0;m[38;5;43m20221209003414656 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003414656 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0a1964fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003414656 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003414656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003414657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003414657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003414658 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003414659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003414659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003414659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:34:15.630315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1805): Terminating (SIGTERM) 00:34:15.671775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1808): Terminating (SIGTERM) 00:34:15.713444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1811): Terminating (SIGTERM) 00:34:15.755083 --- ParallelTerminationStrategy: PID 1805 died... 00:34:15.774410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1805): Terminated: ok {rc=0} 00:34:15.819894 --- ParallelTerminationStrategy: PID 1808 died... 00:34:15.847448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1808): Terminated: ok {rc=0} 00:34:15.919831 --- ParallelTerminationStrategy: PID 1811 died... 00:34:15.939595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1811): Terminated: ok {rc=0} 00:34:16.027657 bus /sierra_3: Setting Powered False 00:34:17.130705 bus /sierra_3: Setting Powered False 00:34:18.247500 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 00:34:19.517268 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:34:19.522367 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 00:34:19.568786 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 00:34:19.594982 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 00:34:19.644457 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 00:34:19.690318 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 00:34:19.716715 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 00:34:20.269609 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 00:34:20.274868 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:20.285933 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 00:34:20.329659 tst handover.py: using LAC 17858 00:34:20.450288 tst handover.py: using RAC 8 00:34:20.570311 tst handover.py: using CellId 17858 00:34:20.690218 tst handover.py: using BVCI 17859 00:34:20.802620 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 00:34:20.840548 tst handover.py: using LAC 17859 00:34:20.967701 tst handover.py: using RAC 9 00:34:21.088055 tst handover.py: using CellId 17859 00:34:21.215555 tst handover.py: using BVCI 17860 00:34:21.333445 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:21.344862 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:21.356036 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:21.367230 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:21.378828 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:21.389989 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 00:34:21.508417 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 00:34:21.623687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:34:22.071149 run create_hlr_db(pid=1818): Launched 00:34:22.188658 bus /sierra_2: Setting Powered False 00:34:23.249510 run create_hlr_db(pid=1818): Terminated: ok {rc=0} 00:34:23.666044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1821): Launched 00:34:23.990649 run osmo-hlr_10.42.42.2(pid=1822): Launched 00:34:24.114988 run osmo-stp_10.42.42.5: Starting osmo-stp 00:34:24.645596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1824): Launched 00:34:24.969425 run osmo-stp_10.42.42.5(pid=1825): Launched 00:34:25.093561 run osmo-msc_10.42.42.6: Starting osmo-msc 00:34:25.653393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1827): Launched 00:34:25.977652 run osmo-msc_10.42.42.6(pid=1828): Launched 00:34:26.158972 run osmo-stp_10.42.42.5(pid=1825): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1825)] 00:34:26.295831 run osmo-stp_10.42.42.5(pid=1825): stdout: | (launched: 2022-12-09_00:34:24.910292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:26.432866 run osmo-stp_10.42.42.5(pid=1825): stderr: | [0;m[38;5;43m20221209003425103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003425104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003425104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003425104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003425105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003425105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003425105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:26.569071 run osmo-stp_10.42.42.5(pid=1825): stdout: | (launched: 2022-12-09_00:34:24.910292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:26.698415 run osmo-stp_10.42.42.5(pid=1825): stderr: | [0;m[38;5;43m20221209003425103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003425104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003425104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003425104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003425105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003425105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003425105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:26.853235 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1825): Process ended prematurely: osmo-stp_10.42.42.5(pid=1825) [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1825)] [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 00:34:26.862344 tst handover.py:18: Test FAILED (6.6 sec) 00:34:26.889996 run osmo-hlr_10.42.42.2(pid=1822): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1822)] 00:34:26.939079 run osmo-hlr_10.42.42.2(pid=1822): stdout: | (launched: 2022-12-09_00:34:23.931284) 00:34:26.990381 run osmo-hlr_10.42.42.2(pid=1822): stderr: | [0;m[1;31m20221209003424130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003424130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003424130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003424130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003424130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003424130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003424146 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003424154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003424155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003424155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:34:27.061549 run osmo-msc_10.42.42.6(pid=1828): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1828)] 00:34:27.110801 run osmo-msc_10.42.42.6(pid=1828): stdout: | (launched: 2022-12-09_00:34:25.918490) 00:34:27.161738 run osmo-msc_10.42.42.6(pid=1828): stderr: | [0;m[38;5;43m20221209003426242 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003426242 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9e79f59c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003426242 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003426242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003426242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003426242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003426244 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003426245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003426245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003426245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:34:27.213014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1821): Terminating (SIGTERM) 00:34:27.254048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1824): Terminating (SIGTERM) 00:34:27.295220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1827): Terminating (SIGTERM) 00:34:27.336648 --- ParallelTerminationStrategy: PID 1821 died... 00:34:27.356234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1821): Terminated: ok {rc=0} 00:34:27.401626 --- ParallelTerminationStrategy: PID 1824 died... 00:34:27.420774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1824): Terminated: ok {rc=0} 00:34:27.466528 --- ParallelTerminationStrategy: PID 1827 died... 00:34:27.486087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1827): Terminated: ok {rc=0} 00:34:27.572226 bus /sierra_3: Setting Powered False 00:34:28.668884 bus /sierra_3: Setting Powered False 00:34:29.784118 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 00:34:31.041051 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:34:31.049756 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:34:31.126698 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:34:31.161730 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:34:31.228721 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:34:31.307172 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:34:31.343734 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:34:31.875490 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 00:34:31.885072 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:31.903554 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:34:31.966271 tst handover.py: using LAC 17860 00:34:32.098504 tst handover.py: using RAC 10 00:34:32.250274 tst handover.py: using CellId 17860 00:34:32.371054 tst handover.py: using BVCI 17861 00:34:32.483904 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:34:32.530094 tst handover.py: using LAC 17861 00:34:32.657433 tst handover.py: using RAC 11 00:34:32.782848 tst handover.py: using CellId 17861 00:34:32.907858 tst handover.py: using BVCI 17862 00:34:33.025625 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:33.037282 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:33.048417 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:33.059899 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:33.071200 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:33.082465 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:34:33.198430 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:34:33.311884 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:34:33.759539 run create_hlr_db(pid=1833): Launched 00:34:33.877572 bus /sierra_2: Setting Powered False 00:34:34.939057 run create_hlr_db(pid=1833): Terminated: ok {rc=0} 00:34:35.356011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1835): Launched 00:34:35.682321 run osmo-hlr_10.42.42.2(pid=1836): Launched 00:34:35.806826 run osmo-stp_10.42.42.5: Starting osmo-stp 00:34:36.336924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1838): Launched 00:34:36.660809 run osmo-stp_10.42.42.5(pid=1839): Launched 00:34:36.784853 run osmo-msc_10.42.42.6: Starting osmo-msc 00:34:37.343484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1841): Launched 00:34:37.670255 run osmo-msc_10.42.42.6(pid=1842): Launched 00:34:37.850648 run osmo-stp_10.42.42.5(pid=1839): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1839)] 00:34:37.987181 run osmo-stp_10.42.42.5(pid=1839): stdout: | (launched: 2022-12-09_00:34:36.601787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:38.123898 run osmo-stp_10.42.42.5(pid=1839): stderr: | [0;m[38;5;43m20221209003436794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003436794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003436794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003436794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003436797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003436797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003436797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:38.260064 run osmo-stp_10.42.42.5(pid=1839): stdout: | (launched: 2022-12-09_00:34:36.601787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:38.389248 run osmo-stp_10.42.42.5(pid=1839): stderr: | [0;m[38;5;43m20221209003436794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003436794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003436794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003436794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003436797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003436797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003436797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:38.543619 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1839): Process ended prematurely: osmo-stp_10.42.42.5(pid=1839) [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1839)] [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 00:34:38.552434 tst handover.py:18: Test FAILED (6.7 sec) 00:34:38.579905 run osmo-hlr_10.42.42.2(pid=1836): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1836)] 00:34:38.629189 run osmo-hlr_10.42.42.2(pid=1836): stdout: | (launched: 2022-12-09_00:34:35.623377) 00:34:38.680142 run osmo-hlr_10.42.42.2(pid=1836): stderr: | [0;m[1;31m20221209003435821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003435821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003435821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003435821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003435821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003435821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003435834 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003435842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003435842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003435842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:34:38.751201 run osmo-msc_10.42.42.6(pid=1842): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1842)] 00:34:38.800284 run osmo-msc_10.42.42.6(pid=1842): stdout: | (launched: 2022-12-09_00:34:37.609309) 00:34:38.851061 run osmo-msc_10.42.42.6(pid=1842): stderr: | [0;m[38;5;43m20221209003437934 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003437934 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4d81ec4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003437934 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003437934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003437934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003437935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003437936 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003437937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003437937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003437937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:34:38.902258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1835): Terminating (SIGTERM) 00:34:38.943191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1838): Terminating (SIGTERM) 00:34:38.984102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1841): Terminating (SIGTERM) 00:34:39.025903 --- ParallelTerminationStrategy: PID 1835 died... 00:34:39.045468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1835): Terminated: ok {rc=0} 00:34:39.090980 --- ParallelTerminationStrategy: PID 1838 died... 00:34:39.110392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1838): Terminated: ok {rc=0} 00:34:39.155707 --- ParallelTerminationStrategy: PID 1841 died... 00:34:39.174987 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1841): Terminated: ok {rc=0} 00:34:39.260579 bus /sierra_3: Setting Powered False 00:34:40.357418 bus /sierra_3: Setting Powered False 00:34:41.471478 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 00:34:42.743040 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:34:42.748575 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:34:42.807072 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:34:42.834000 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:34:42.886990 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:34:42.945747 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:34:42.972521 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:34:43.524596 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 00:34:43.529933 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:43.541402 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:34:43.585731 tst handover.py: using LAC 17862 00:34:43.714359 tst handover.py: using RAC 12 00:34:43.842668 tst handover.py: using CellId 17862 00:34:43.971179 tst handover.py: using BVCI 17863 00:34:44.090418 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:34:44.138578 tst handover.py: using LAC 17863 00:34:44.266564 tst handover.py: using RAC 13 00:34:44.396339 tst handover.py: using CellId 17863 00:34:44.528271 tst handover.py: using BVCI 17864 00:34:44.646254 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:44.657683 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:44.668817 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:44.680065 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:44.691298 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:44.702533 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:34:44.817358 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:34:44.936673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:34:45.411686 run create_hlr_db(pid=1847): Launched 00:34:45.543419 bus /sierra_2: Setting Powered False 00:34:46.626490 run create_hlr_db(pid=1847): Terminated: ok {rc=0} 00:34:47.064864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1849): Launched 00:34:47.380184 run osmo-hlr_10.42.42.2(pid=1850): Launched 00:34:47.499052 run osmo-stp_10.42.42.5: Starting osmo-stp 00:34:48.013307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1852): Launched 00:34:48.319435 run osmo-stp_10.42.42.5(pid=1853): Launched 00:34:48.435349 run osmo-msc_10.42.42.6: Starting osmo-msc 00:34:48.960896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1855): Launched 00:34:49.268434 run osmo-msc_10.42.42.6(pid=1856): Launched 00:34:49.440321 run osmo-stp_10.42.42.5(pid=1853): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1853)] 00:34:49.570024 run osmo-stp_10.42.42.5(pid=1853): stdout: | (launched: 2022-12-09_00:34:48.263561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:49.700368 run osmo-stp_10.42.42.5(pid=1853): stderr: | [0;m[38;5;43m20221209003448434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003448435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003448435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003448435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003448436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003448436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003448436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:49.827636 run osmo-stp_10.42.42.5(pid=1853): stdout: | (launched: 2022-12-09_00:34:48.263561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:49.948912 run osmo-stp_10.42.42.5(pid=1853): stderr: | [0;m[38;5;43m20221209003448434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003448435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003448435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003448435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003448436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003448436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003448436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:50.094401 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1853): Process ended prematurely: osmo-stp_10.42.42.5(pid=1853) [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1853)] [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 00:34:50.102554 tst handover.py:18: Test FAILED (6.6 sec) 00:34:50.128731 run osmo-hlr_10.42.42.2(pid=1850): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1850)] 00:34:50.176380 run osmo-hlr_10.42.42.2(pid=1850): stdout: | (launched: 2022-12-09_00:34:47.323928) 00:34:50.225269 run osmo-hlr_10.42.42.2(pid=1850): stderr: | [0;m[1;31m20221209003447498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003447499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003447499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003447499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003447499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003447499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003447511 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003447519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003447519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003447519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:34:50.293730 run osmo-msc_10.42.42.6(pid=1856): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1856)] 00:34:50.341137 run osmo-msc_10.42.42.6(pid=1856): stdout: | (launched: 2022-12-09_00:34:49.211440) 00:34:50.389845 run osmo-msc_10.42.42.6(pid=1856): stderr: | [0;m[38;5;43m20221209003449485 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003449485 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6a06e16c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003449485 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003449485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003449485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003449486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003449487 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003449488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003449488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003449488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:34:50.439296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1849): Terminating (SIGTERM) 00:34:50.478238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1852): Terminating (SIGTERM) 00:34:50.517305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1855): Terminating (SIGTERM) 00:34:50.556565 --- ParallelTerminationStrategy: PID 1849 died... 00:34:50.575177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1849): Terminated: ok {rc=0} 00:34:50.618591 --- ParallelTerminationStrategy: PID 1852 died... 00:34:50.636738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1852): Terminated: ok {rc=0} 00:34:50.681142 --- ParallelTerminationStrategy: PID 1855 died... 00:34:50.699509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1855): Terminated: ok {rc=0} 00:34:50.785401 bus /sierra_3: Setting Powered False 00:34:51.885158 bus /sierra_3: Setting Powered False 00:34:53.000434 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 00:34:54.270601 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:34:54.275954 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 00:34:54.327877 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 00:34:54.355015 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 00:34:54.409451 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 00:34:54.461740 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 00:34:54.488650 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 00:34:55.038261 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 00:34:55.043649 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:55.055035 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 00:34:55.103691 tst handover.py: using LAC 17864 00:34:55.230359 tst handover.py: using RAC 14 00:34:55.358981 tst handover.py: using CellId 17864 00:34:55.485646 tst handover.py: using BVCI 17865 00:34:55.604668 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 00:34:55.640887 tst handover.py: using LAC 17865 00:34:55.768754 tst handover.py: using RAC 15 00:34:55.895249 tst handover.py: using CellId 17865 00:34:56.022607 tst handover.py: using BVCI 17866 00:34:56.142192 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:56.153489 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:56.164534 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:56.176302 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:56.187937 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:56.199550 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 00:34:56.315217 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 00:34:56.433817 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:34:56.910556 run create_hlr_db(pid=1861): Launched 00:34:57.042439 bus /sierra_2: Setting Powered False 00:34:58.106853 run create_hlr_db(pid=1861): Terminated: ok {rc=0} 00:34:58.530796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1863): Launched 00:34:58.856426 run osmo-hlr_10.42.42.2(pid=1864): Launched 00:34:58.980418 run osmo-stp_10.42.42.5: Starting osmo-stp 00:34:59.517988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1866): Launched 00:34:59.843747 run osmo-stp_10.42.42.5(pid=1867): Launched 00:34:59.967887 run osmo-msc_10.42.42.6: Starting osmo-msc 00:35:00.528285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1869): Launched 00:35:00.863278 run osmo-msc_10.42.42.6(pid=1870): Launched 00:35:01.060431 run osmo-stp_10.42.42.5(pid=1867): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1867)] 00:35:01.543016 run osmo-stp_10.42.42.5(pid=1867): stdout: | (launched: 2022-12-09_00:34:59.784411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:01.738440 run osmo-stp_10.42.42.5(pid=1867): stderr: | [0;m[38;5;43m20221209003459979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003459979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003459979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003459980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003459982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003459982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003459982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:01.880043 run osmo-stp_10.42.42.5(pid=1867): stdout: | (launched: 2022-12-09_00:34:59.784411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:02.012299 run osmo-stp_10.42.42.5(pid=1867): stderr: | [0;m[38;5;43m20221209003459979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003459979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003459979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003459980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003459982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003459982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003459982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:02.169536 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1867): Process ended prematurely: osmo-stp_10.42.42.5(pid=1867) [trial-2351↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1867)] [trial-2351↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 00:35:02.178516 tst handover.py:18: Test FAILED (7.1 sec) 00:35:02.206251 run osmo-hlr_10.42.42.2(pid=1864): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1864)] 00:35:02.256685 run osmo-hlr_10.42.42.2(pid=1864): stdout: | (launched: 2022-12-09_00:34:58.797392) 00:35:02.309199 run osmo-hlr_10.42.42.2(pid=1864): stderr: | [0;m[1;31m20221209003458999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003458999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003458999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003458999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003458999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003458999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003459014 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003459024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003459024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003459024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:35:02.393211 run osmo-msc_10.42.42.6(pid=1870): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1870)] 00:35:02.443842 run osmo-msc_10.42.42.6(pid=1870): stdout: | (launched: 2022-12-09_00:35:00.794434) 00:35:02.497303 run osmo-msc_10.42.42.6(pid=1870): stderr: | [0;m[38;5;43m20221209003501360 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003501360 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f005cea9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003501361 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003501361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003501362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003501363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003501370 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003501372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003501372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003501373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:35:02.550436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1863): Terminating (SIGTERM) 00:35:02.594686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1866): Terminating (SIGTERM) 00:35:02.638518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1869): Terminating (SIGTERM) 00:35:02.682583 --- ParallelTerminationStrategy: PID 1863 died... 00:35:02.702595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1863): Terminated: ok {rc=0} 00:35:02.749496 --- ParallelTerminationStrategy: PID 1866 died... 00:35:02.769717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1866): Terminated: ok {rc=0} 00:35:02.816163 --- ParallelTerminationStrategy: PID 1869 died... 00:35:02.836358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1869): Terminated: ok {rc=0} 00:35:02.924284 bus /sierra_3: Setting Powered False 00:35:04.021797 bus /sierra_3: Setting Powered False 00:35:05.134736 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 00:35:06.391415 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:35:06.397109 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:35:06.461344 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:35:06.488308 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:35:06.541284 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:35:06.609233 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:35:06.636008 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:35:07.183824 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 00:35:07.190067 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:35:07.201126 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:35:07.248919 tst handover.py: using LAC 17866 00:35:07.370776 tst handover.py: using RAC 16 00:35:07.498268 tst handover.py: using CellId 17866 00:35:07.627107 tst handover.py: using BVCI 17867 00:35:07.746316 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:35:07.794843 tst handover.py: using LAC 17867 00:35:07.924076 tst handover.py: using RAC 17 00:35:08.050419 tst handover.py: using CellId 17867 00:35:08.182039 tst handover.py: using BVCI 17868 00:35:08.300922 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:35:08.312270 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:35:08.323386 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:35:08.334642 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:35:08.345816 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:35:08.356942 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:35:08.473845 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:35:08.588896 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:35:09.038229 run create_hlr_db(pid=1885): Launched 00:35:09.155719 bus /sierra_2: Setting Powered False 00:35:10.217331 run create_hlr_db(pid=1885): Terminated: ok {rc=0} 00:35:10.617187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1887): Launched 00:35:10.924846 run osmo-hlr_10.42.42.2(pid=1888): Launched 00:35:11.042625 run osmo-stp_10.42.42.5: Starting osmo-stp 00:35:11.544137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1890): Launched 00:35:11.851829 run osmo-stp_10.42.42.5(pid=1891): Launched 00:35:11.969729 run osmo-msc_10.42.42.6: Starting osmo-msc 00:35:12.497074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1893): Launched 00:35:12.804878 run osmo-msc_10.42.42.6(pid=1894): Launched 00:35:13.117957 run osmo-stp_10.42.42.5(pid=1891): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1891)] 00:35:13.310531 run osmo-stp_10.42.42.5(pid=1891): stdout: | (launched: 2022-12-09_00:35:11.795523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:13.528176 run osmo-stp_10.42.42.5(pid=1891): stderr: | [0;m[38;5;43m20221209003511967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003511967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003511967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003511968 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003511968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003511968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003511968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:13.667827 run osmo-stp_10.42.42.5(pid=1891): stdout: | (launched: 2022-12-09_00:35:11.795523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:13.801886 run osmo-stp_10.42.42.5(pid=1891): stderr: | [0;m[38;5;43m20221209003511967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003511967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003511967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003511968 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003511968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003511968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003511968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:13.963719 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=1891): Process ended prematurely: osmo-stp_10.42.42.5(pid=1891) [trial-2351↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1891)] [trial-2351↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 00:35:13.973318 tst handover.py:18: Test FAILED (6.8 sec) 00:35:14.002033 run osmo-hlr_10.42.42.2(pid=1888): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1888)] 00:35:14.053792 run osmo-hlr_10.42.42.2(pid=1888): stdout: | (launched: 2022-12-09_00:35:10.868393) 00:35:14.107985 run osmo-hlr_10.42.42.2(pid=1888): stderr: | [0;m[1;31m20221209003511045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003511045 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003511046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003511046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003511046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003511046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003511058 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003511067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003511067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003511067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:35:14.181901 run osmo-msc_10.42.42.6(pid=1894): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1894)] 00:35:14.232728 run osmo-msc_10.42.42.6(pid=1894): stdout: | (launched: 2022-12-09_00:35:12.748260) 00:35:14.286642 run osmo-msc_10.42.42.6(pid=1894): stderr: | [0;m[38;5;43m20221209003513156 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003513156 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd305516c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003513156 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003513156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003513157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003513157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003513159 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003513159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003513159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003513159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:35:14.340020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1887): Terminating (SIGTERM) 00:35:14.384448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1890): Terminating (SIGTERM) 00:35:14.425832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1893): Terminating (SIGTERM) 00:35:14.467814 --- ParallelTerminationStrategy: PID 1887 died... 00:35:14.487282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1887): Terminated: ok {rc=0} 00:35:14.534672 --- ParallelTerminationStrategy: PID 1890 died... 00:35:14.554240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1890): Terminated: ok {rc=0} 00:35:14.601185 --- ParallelTerminationStrategy: PID 1893 died... 00:35:14.620603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1893): Terminated: ok {rc=0} 00:35:14.710108 bus /sierra_3: Setting Powered False 00:35:15.808144 bus /sierra_3: Setting Powered False 00:35:16.931349 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 00:35:18.223321 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:35:18.228803 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:35:18.292600 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:35:18.319889 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:35:18.372176 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:35:18.434025 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:35:18.460215 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:35:19.017794 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 00:35:19.022984 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:19.034360 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:35:19.083594 tst handover.py: using LAC 17868 00:35:19.208803 tst handover.py: using RAC 18 00:35:19.327955 tst handover.py: using CellId 17868 00:35:19.446992 tst handover.py: using BVCI 17869 00:35:19.558959 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:35:19.604210 tst handover.py: using LAC 17869 00:35:19.733462 tst handover.py: using RAC 19 00:35:19.861463 tst handover.py: using CellId 17869 00:35:19.987772 tst handover.py: using BVCI 17870 00:35:20.106306 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:20.117859 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:20.129206 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:20.140430 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:20.151631 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:20.162762 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:35:20.281295 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:35:20.400623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:35:20.876065 run create_hlr_db(pid=2253): Launched 00:35:21.009235 bus /sierra_2: Setting Powered False 00:35:22.071835 run create_hlr_db(pid=2253): Terminated: ok {rc=0} 00:35:22.496876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2255): Launched 00:35:22.822334 run osmo-hlr_10.42.42.2(pid=2256): Launched 00:35:22.946555 run osmo-stp_10.42.42.5: Starting osmo-stp 00:35:23.494640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2269): Launched 00:35:23.831288 run osmo-stp_10.42.42.5(pid=2350): Launched 00:35:24.014575 run osmo-msc_10.42.42.6: Starting osmo-msc 00:35:24.621713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2436): Launched 00:35:24.951428 run osmo-msc_10.42.42.6(pid=2437): Launched 00:35:25.298356 run osmo-stp_10.42.42.5(pid=2350): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2350)] 00:35:25.572083 run osmo-stp_10.42.42.5(pid=2350): stdout: | (launched: 2022-12-09_00:35:23.767861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:25.852793 run osmo-stp_10.42.42.5(pid=2350): stderr: | [0;m[38;5;43m20221209003524095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003524095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003524095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003524095 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003524103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003524103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003524103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:26.031084 run osmo-stp_10.42.42.5(pid=2350): stdout: | (launched: 2022-12-09_00:35:23.767861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:26.158722 run osmo-stp_10.42.42.5(pid=2350): stderr: | [0;m[38;5;43m20221209003524095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003524095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003524095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003524095 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003524103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003524103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003524103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:26.309015 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2350): Process ended prematurely: osmo-stp_10.42.42.5(pid=2350) [trial-2351↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2350)] [trial-2351↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 00:35:26.318900 tst handover.py:18: Test FAILED (7.3 sec) 00:35:26.347605 run osmo-hlr_10.42.42.2(pid=2256): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2256)] 00:35:26.399425 run osmo-hlr_10.42.42.2(pid=2256): stdout: | (launched: 2022-12-09_00:35:22.763191) 00:35:26.451410 run osmo-hlr_10.42.42.2(pid=2256): stderr: | [0;m[1;31m20221209003522964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003522964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003522964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003522964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003522964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003522964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003522977 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003522985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003522985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003522985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:35:26.524304 run osmo-msc_10.42.42.6(pid=2437): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2437)] 00:35:26.574986 run osmo-msc_10.42.42.6(pid=2437): stdout: | (launched: 2022-12-09_00:35:24.887994) 00:35:26.626916 run osmo-msc_10.42.42.6(pid=2437): stderr: | [0;m[38;5;43m20221209003525488 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003525489 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1108753c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003525489 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003525489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003525489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003525489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003525491 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003525491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003525491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003525491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:35:26.680608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2255): Terminating (SIGTERM) 00:35:26.723092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2269): Terminating (SIGTERM) 00:35:26.766859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2436): Terminating (SIGTERM) 00:35:26.809728 --- ParallelTerminationStrategy: PID 2255 died... 00:35:26.829980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2255): Terminated: ok {rc=0} 00:35:26.879647 --- ParallelTerminationStrategy: PID 2269 died... 00:35:26.899186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2269): Terminated: ok {rc=0} 00:35:26.946450 --- ParallelTerminationStrategy: PID 2436 died... 00:35:26.965908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2436): Terminated: ok {rc=0} 00:35:27.053544 bus /sierra_3: Setting Powered False 00:35:28.152470 bus /sierra_3: Setting Powered False 00:35:29.267682 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 00:35:30.534628 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:35:30.539610 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:35:30.589488 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:35:30.615515 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:35:30.667982 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:35:30.718649 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:35:30.744532 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:35:31.316157 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 00:35:31.333498 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:35:31.353840 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:35:31.393154 tst handover.py: using LAC 17870 00:35:31.551397 tst handover.py: using RAC 20 00:35:31.685295 tst handover.py: using CellId 17870 00:35:31.816545 tst handover.py: using BVCI 17871 00:35:31.942593 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:35:31.992227 tst handover.py: using LAC 17871 00:35:32.122698 tst handover.py: using RAC 21 00:35:32.251581 tst handover.py: using CellId 17871 00:35:32.377636 tst handover.py: using BVCI 17872 00:35:32.495839 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:35:32.507220 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:35:32.518395 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:35:32.530209 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:35:32.542047 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:35:32.553864 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:35:32.669773 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:35:32.784192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:35:33.233032 run create_hlr_db(pid=2443): Launched 00:35:33.350826 bus /sierra_2: Setting Powered False 00:35:34.412228 run create_hlr_db(pid=2443): Terminated: ok {rc=0} 00:35:34.830290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2445): Launched 00:35:35.156762 run osmo-hlr_10.42.42.2(pid=2446): Launched 00:35:35.281971 run osmo-stp_10.42.42.5: Starting osmo-stp 00:35:35.819382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2448): Launched 00:35:36.146264 run osmo-stp_10.42.42.5(pid=2449): Launched 00:35:36.270111 run osmo-msc_10.42.42.6: Starting osmo-msc 00:35:36.829664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2451): Launched 00:35:37.156166 run osmo-msc_10.42.42.6(pid=2452): Launched 00:35:37.337235 run osmo-stp_10.42.42.5(pid=2449): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2449)] 00:35:37.474153 run osmo-stp_10.42.42.5(pid=2449): stdout: | (launched: 2022-12-09_00:35:36.087049) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:37.611328 run osmo-stp_10.42.42.5(pid=2449): stderr: | [0;m[38;5;43m20221209003536279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003536280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003536280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003536280 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003536283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003536283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003536283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:37.748109 run osmo-stp_10.42.42.5(pid=2449): stdout: | (launched: 2022-12-09_00:35:36.087049) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:37.877615 run osmo-stp_10.42.42.5(pid=2449): stderr: | [0;m[38;5;43m20221209003536279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003536280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003536280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003536280 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003536283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003536283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003536283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:38.033257 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2449): Process ended prematurely: osmo-stp_10.42.42.5(pid=2449) [trial-2351↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2449)] [trial-2351↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 00:35:38.042448 tst handover.py:18: Test FAILED (6.7 sec) 00:35:38.070446 run osmo-hlr_10.42.42.2(pid=2446): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2446)] 00:35:38.120318 run osmo-hlr_10.42.42.2(pid=2446): stdout: | (launched: 2022-12-09_00:35:35.097629) 00:35:38.171738 run osmo-hlr_10.42.42.2(pid=2446): stderr: | [0;m[1;31m20221209003535299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003535299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003535299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003535299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003535299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003535299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003535314 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003535324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003535324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003535324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:35:38.243917 run osmo-msc_10.42.42.6(pid=2452): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2452)] 00:35:38.293568 run osmo-msc_10.42.42.6(pid=2452): stdout: | (launched: 2022-12-09_00:35:37.096575) 00:35:38.344748 run osmo-msc_10.42.42.6(pid=2452): stderr: | [0;m[38;5;43m20221209003537420 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003537420 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc3626d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003537421 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003537421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003537421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003537421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003537423 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003537423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003537423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003537423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:35:38.396233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2445): Terminating (SIGTERM) 00:35:38.437546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2448): Terminating (SIGTERM) 00:35:38.479050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2451): Terminating (SIGTERM) 00:35:38.520931 --- ParallelTerminationStrategy: PID 2445 died... 00:35:38.540721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2445): Terminated: ok {rc=0} 00:35:38.586687 --- ParallelTerminationStrategy: PID 2448 died... 00:35:38.606126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2448): Terminated: ok {rc=0} 00:35:38.652023 --- ParallelTerminationStrategy: PID 2451 died... 00:35:38.671421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2451): Terminated: ok {rc=0} 00:35:38.758443 bus /sierra_3: Setting Powered False 00:35:39.857114 bus /sierra_3: Setting Powered False 00:35:40.974940 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 00:35:42.231409 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:35:42.236855 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:35:42.287992 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:35:42.315008 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:35:42.366813 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:35:42.417444 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:35:42.444487 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:35:42.995263 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 00:35:43.000582 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:43.011684 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:35:43.051160 tst handover.py: using LAC 17872 00:35:43.177399 tst handover.py: using RAC 22 00:35:43.297779 tst handover.py: using CellId 17872 00:35:43.417524 tst handover.py: using BVCI 17873 00:35:43.530717 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:35:43.576111 tst handover.py: using LAC 17873 00:35:43.695894 tst handover.py: using RAC 23 00:35:43.813640 tst handover.py: using CellId 17873 00:35:43.932650 tst handover.py: using BVCI 17874 00:35:44.043158 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:44.053977 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:44.064408 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:44.075442 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:44.086367 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:44.097252 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:35:44.214956 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:35:44.331676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:35:44.807267 run create_hlr_db(pid=2457): Launched 00:35:44.938724 bus /sierra_2: Setting Powered False 00:35:46.024130 run create_hlr_db(pid=2457): Terminated: ok {rc=0} 00:35:46.493831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2459): Launched 00:35:46.822493 run osmo-hlr_10.42.42.2(pid=2460): Launched 00:35:47.062988 run osmo-stp_10.42.42.5: Starting osmo-stp 00:35:47.616448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2462): Launched 00:35:47.941273 run osmo-stp_10.42.42.5(pid=2463): Launched 00:35:48.065506 run osmo-msc_10.42.42.6: Starting osmo-msc 00:35:48.625997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2465): Launched 00:35:48.950469 run osmo-msc_10.42.42.6(pid=2466): Launched 00:35:49.131406 run osmo-stp_10.42.42.5(pid=2463): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2463)] 00:35:49.268236 run osmo-stp_10.42.42.5(pid=2463): stdout: | (launched: 2022-12-09_00:35:47.881925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:49.405689 run osmo-stp_10.42.42.5(pid=2463): stderr: | [0;m[38;5;43m20221209003548076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003548076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003548077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003548078 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003548078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003548078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003548078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:49.542011 run osmo-stp_10.42.42.5(pid=2463): stdout: | (launched: 2022-12-09_00:35:47.881925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:49.671255 run osmo-stp_10.42.42.5(pid=2463): stderr: | [0;m[38;5;43m20221209003548076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003548076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003548077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003548078 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003548078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003548078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003548078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:49.826144 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2463): Process ended prematurely: osmo-stp_10.42.42.5(pid=2463) [trial-2351↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2463)] [trial-2351↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 00:35:49.834906 tst handover.py:18: Test FAILED (6.8 sec) 00:35:49.862171 run osmo-hlr_10.42.42.2(pid=2460): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2460)] 00:35:49.911857 run osmo-hlr_10.42.42.2(pid=2460): stdout: | (launched: 2022-12-09_00:35:46.758705) 00:35:49.963063 run osmo-hlr_10.42.42.2(pid=2460): stderr: | [0;m[1;31m20221209003547107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003547107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003547107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003547107 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003547108 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003547108 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003547139 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003547161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003547161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003547161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:35:50.034824 run osmo-msc_10.42.42.6(pid=2466): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2466)] 00:35:50.084166 run osmo-msc_10.42.42.6(pid=2466): stdout: | (launched: 2022-12-09_00:35:48.891336) 00:35:50.135649 run osmo-msc_10.42.42.6(pid=2466): stderr: | [0;m[38;5;43m20221209003549213 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003549213 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3759832c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003549214 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003549214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003549214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003549214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003549216 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003549216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003549216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003549216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:35:50.187153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2459): Terminating (SIGTERM) 00:35:50.228481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2462): Terminating (SIGTERM) 00:35:50.270095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2465): Terminating (SIGTERM) 00:35:50.311994 --- ParallelTerminationStrategy: PID 2459 died... 00:35:50.331897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2459): Terminated: ok {rc=0} 00:35:50.378083 --- ParallelTerminationStrategy: PID 2462 died... 00:35:50.397627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2462): Terminated: ok {rc=0} 00:35:50.443399 --- ParallelTerminationStrategy: PID 2465 died... 00:35:50.462807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2465): Terminated: ok {rc=0} 00:35:50.549334 bus /sierra_3: Setting Powered False 00:35:51.646602 bus /sierra_3: Setting Powered False 00:35:52.762046 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2351 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 00:35:54.015351 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:35:54.020553 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:35:54.081948 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:35:54.108281 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:35:54.159402 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:35:54.220754 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:35:54.247283 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:35:54.801373 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2351 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 00:35:54.807032 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:54.819005 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:35:54.865747 tst handover.py: using LAC 17874 00:35:54.986383 tst handover.py: using RAC 24 00:35:55.106721 tst handover.py: using CellId 17874 00:35:55.226616 tst handover.py: using BVCI 17875 00:35:55.337228 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:35:55.383810 tst handover.py: using LAC 17875 00:35:55.503792 tst handover.py: using RAC 25 00:35:55.624343 tst handover.py: using CellId 17875 00:35:55.742786 tst handover.py: using BVCI 17876 00:35:55.853762 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:55.864472 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:55.875037 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:55.885868 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:55.896615 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:55.907381 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:35:56.019899 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:35:56.136250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:35:56.606872 run create_hlr_db(pid=2471): Launched 00:35:56.737116 bus /sierra_2: Setting Powered False 00:35:57.800547 run create_hlr_db(pid=2471): Terminated: ok {rc=0} 00:35:58.220637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2473): Launched 00:35:58.541530 run osmo-hlr_10.42.42.2(pid=2474): Launched 00:35:58.664023 run osmo-stp_10.42.42.5: Starting osmo-stp 00:35:59.189715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2476): Launched 00:35:59.511128 run osmo-stp_10.42.42.5(pid=2477): Launched 00:35:59.633475 run osmo-msc_10.42.42.6: Starting osmo-msc 00:36:00.186477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2479): Launched 00:36:00.508824 run osmo-msc_10.42.42.6(pid=2480): Launched 00:36:00.687599 run osmo-stp_10.42.42.5(pid=2477): ERR: Terminated: ERROR {rc=1} [trial-2351↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2477)] 00:36:00.844520 run osmo-stp_10.42.42.5(pid=2477): stdout: | (launched: 2022-12-09_00:35:59.452508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:36:01.105614 run osmo-stp_10.42.42.5(pid=2477): stderr: | [0;m[38;5;43m20221209003559645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003559645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003559645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003559646 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003559646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003559646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003559646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:36:01.235448 run osmo-stp_10.42.42.5(pid=2477): stdout: | (launched: 2022-12-09_00:35:59.452508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:36:01.362265 run osmo-stp_10.42.42.5(pid=2477): stderr: | [0;m[38;5;43m20221209003559645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221209003559645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221209003559645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221209003559646 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209003559646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209003559646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209003559646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:36:01.512913 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2477): Process ended prematurely: osmo-stp_10.42.42.5(pid=2477) [trial-2351↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2477)] [trial-2351↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 00:36:01.522449 tst handover.py:18: Test FAILED (6.7 sec) 00:36:01.551640 run osmo-hlr_10.42.42.2(pid=2474): ERR: Terminated: ERROR {rc=237} [trial-2351↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2474)] 00:36:01.602352 run osmo-hlr_10.42.42.2(pid=2474): stdout: | (launched: 2022-12-09_00:35:58.483380) 00:36:01.654162 run osmo-hlr_10.42.42.2(pid=2474): stderr: | [0;m[1;31m20221209003558683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221209003558683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221209003558683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221209003558683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221209003558683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221209003558683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221209003558699 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221209003558707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209003558707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209003558707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:36:01.727394 run osmo-msc_10.42.42.6(pid=2480): ERR: Terminated: ERROR {rc=2} [trial-2351↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2480)] 00:36:01.777675 run osmo-msc_10.42.42.6(pid=2480): stdout: | (launched: 2022-12-09_00:36:00.450291) 00:36:01.829595 run osmo-msc_10.42.42.6(pid=2480): stderr: | [0;m[38;5;43m20221209003600774 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221209003600774 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f031f2f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221209003600774 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221209003600774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221209003600774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221209003600774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221209003600776 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221209003600776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209003600777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209003600777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:36:01.882871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2473): Terminating (SIGTERM) 00:36:01.926139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2476): Terminating (SIGTERM) 00:36:01.970168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2479): Terminating (SIGTERM) 00:36:02.015176 --- ParallelTerminationStrategy: PID 2473 died... 00:36:02.035052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2473): Terminated: ok {rc=0} 00:36:02.084913 --- ParallelTerminationStrategy: PID 2476 died... 00:36:02.104477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2476): Terminated: ok {rc=0} 00:36:02.151582 --- ParallelTerminationStrategy: PID 2479 died... 00:36:02.171220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2479): Terminated: ok {rc=0} 00:36:02.259083 bus /sierra_3: Setting Powered False 00:36:03.355226 bus /sierra_3: Setting Powered False 00:36:04.467432 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2351 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 00:36:05.740290 tst trial-2351: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351/run.2022-12-08_23-11-41/trial-2351.xml -------------------------------------------------------------------------------------------- trial-2351 FAIL -------------------------------------------------------------------------------------------- 00:36:07.670083 tst trial-2351: trial-2351: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.1 sec) Error: osmo-nitb_10.42.42.2(pid=26141): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26141) [trial-2351↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26141)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.0 sec) Error: osmo-stp_10.42.42.5(pid=26152): Process ended prematurely: osmo-stp_10.42.42.5(pid=26152) [trial-2351↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26152)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=26161): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26161) [trial-2351↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26161)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26172): Process ended prematurely: osmo-stp_10.42.42.5(pid=26172) [trial-2351↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26172)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26186): Process ended prematurely: osmo-stp_10.42.42.5(pid=26186) [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26186)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26197): Process ended prematurely: osmo-stp_10.42.42.5(pid=26197) [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26197)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26211): Process ended prematurely: osmo-stp_10.42.42.5(pid=26211) [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26211)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26225): Process ended prematurely: osmo-stp_10.42.42.5(pid=26225) [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26225)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26239): Process ended prematurely: osmo-stp_10.42.42.5(pid=26239) [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26239)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26250): Process ended prematurely: osmo-stp_10.42.42.5(pid=26250) [trial-2351↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26250)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26264): Process ended prematurely: osmo-stp_10.42.42.5(pid=26264) [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26264)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26275): Process ended prematurely: osmo-stp_10.42.42.5(pid=26275) [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26275)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26289): Process ended prematurely: osmo-stp_10.42.42.5(pid=26289) [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26289)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26300): Process ended prematurely: osmo-stp_10.42.42.5(pid=26300) [trial-2351↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26300)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26314): Process ended prematurely: osmo-stp_10.42.42.5(pid=26314) [trial-2351↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26314)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26325): Process ended prematurely: osmo-stp_10.42.42.5(pid=26325) [trial-2351↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26325)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26340): Process ended prematurely: osmo-stp_10.42.42.5(pid=26340) [trial-2351↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26340)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26351): Process ended prematurely: osmo-stp_10.42.42.5(pid=26351) [trial-2351↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26351)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26368): Process ended prematurely: osmo-stp_10.42.42.5(pid=26368) [trial-2351↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26368)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26379): Process ended prematurely: osmo-stp_10.42.42.5(pid=26379) [trial-2351↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26379)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.9 sec) Error: osmo-stp_10.42.42.5(pid=26399): Process ended prematurely: osmo-stp_10.42.42.5(pid=26399) [trial-2351↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26399)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=26411): Process ended prematurely: osmo-stp_10.42.42.5(pid=26411) [trial-2351↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26411)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=26429): Process ended prematurely: osmo-stp_10.42.42.5(pid=26429) [trial-2351↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26429)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26439): Process ended prematurely: osmo-stp_10.42.42.5(pid=26439) [trial-2351↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26439)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26449): Process ended prematurely: osmo-stp_10.42.42.5(pid=26449) [trial-2351↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26449)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=26466): Process ended prematurely: osmo-stp_10.42.42.5(pid=26466) [trial-2351↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26466)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=26478): Process ended prematurely: osmo-stp_10.42.42.5(pid=26478) [trial-2351↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26478)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=26496): Process ended prematurely: osmo-stp_10.42.42.5(pid=26496) [trial-2351↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26496)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26507): Process ended prematurely: osmo-stp_10.42.42.5(pid=26507) [trial-2351↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26507)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26517): Process ended prematurely: osmo-stp_10.42.42.5(pid=26517) [trial-2351↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26517)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=26534): Process ended prematurely: osmo-stp_10.42.42.5(pid=26534) [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26534)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=26546): Process ended prematurely: osmo-stp_10.42.42.5(pid=26546) [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26546)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=26574): Process ended prematurely: osmo-stp_10.42.42.5(pid=26574) [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26574)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=26935): Process ended prematurely: osmo-stp_10.42.42.5(pid=26935) [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26935)] FAIL: ping_idle_ping.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=27121): Process ended prematurely: osmo-stp_10.42.42.5(pid=27121) [trial-2351↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27121)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=27138): Process ended prematurely: osmo-stp_10.42.42.5(pid=27138) [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27138)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=27150): Process ended prematurely: osmo-stp_10.42.42.5(pid=27150) [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27150)] FAIL: iperf3m4.py (11.5 sec) Error: osmo-stp_10.42.42.5(pid=27168): Process ended prematurely: osmo-stp_10.42.42.5(pid=27168) [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27168)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27178): Process ended prematurely: osmo-stp_10.42.42.5(pid=27178) [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27178)] FAIL: ping_idle_ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=27188): Process ended prematurely: osmo-stp_10.42.42.5(pid=27188) [trial-2351↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27188)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=27201): Process ended prematurely: osmo-stp_10.42.42.5(pid=27201) [trial-2351↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27201)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27214): Process ended prematurely: osmo-stp_10.42.42.5(pid=27214) [trial-2351↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27214)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=27222): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27222) [trial-2351↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27222)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27232): Process ended prematurely: osmo-stp_10.42.42.5(pid=27232) [trial-2351↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27232)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=27242): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27242) [trial-2351↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27242)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=27255): Process ended prematurely: osmo-stp_10.42.42.5(pid=27255) [trial-2351↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27255)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27272): Process ended prematurely: osmo-stp_10.42.42.5(pid=27272) [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27272)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27283): Process ended prematurely: osmo-stp_10.42.42.5(pid=27283) [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27283)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=27297): Process ended prematurely: osmo-stp_10.42.42.5(pid=27297) [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27297)] FAIL: mo_mt_call_osmux.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=27579): Process ended prematurely: osmo-stp_10.42.42.5(pid=27579) [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27579)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27594): Process ended prematurely: osmo-stp_10.42.42.5(pid=27594) [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27594)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27605): Process ended prematurely: osmo-stp_10.42.42.5(pid=27605) [trial-2351↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27605)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27619): Process ended prematurely: osmo-stp_10.42.42.5(pid=27619) [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27619)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27630): Process ended prematurely: osmo-stp_10.42.42.5(pid=27630) [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27630)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27644): Process ended prematurely: osmo-stp_10.42.42.5(pid=27644) [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27644)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27655): Process ended prematurely: osmo-stp_10.42.42.5(pid=27655) [trial-2351↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27655)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27670): Process ended prematurely: osmo-stp_10.42.42.5(pid=27670) [trial-2351↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27670)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27681): Process ended prematurely: osmo-stp_10.42.42.5(pid=27681) [trial-2351↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27681)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27695): Process ended prematurely: osmo-stp_10.42.42.5(pid=27695) [trial-2351↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27695)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27709): Process ended prematurely: osmo-stp_10.42.42.5(pid=27709) [trial-2351↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27709)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27724): Process ended prematurely: osmo-stp_10.42.42.5(pid=27724) [trial-2351↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27724)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27735): Process ended prematurely: osmo-stp_10.42.42.5(pid=27735) [trial-2351↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27735)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=27753): Process ended prematurely: osmo-stp_10.42.42.5(pid=27753) [trial-2351↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27753)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=27765): Process ended prematurely: osmo-stp_10.42.42.5(pid=27765) [trial-2351↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27765)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=27786): Process ended prematurely: osmo-stp_10.42.42.5(pid=27786) [trial-2351↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27786)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27796): Process ended prematurely: osmo-stp_10.42.42.5(pid=27796) [trial-2351↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27796)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27806): Process ended prematurely: osmo-stp_10.42.42.5(pid=27806) [trial-2351↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27806)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=27823): Process ended prematurely: osmo-stp_10.42.42.5(pid=27823) [trial-2351↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27823)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=27835): Process ended prematurely: osmo-stp_10.42.42.5(pid=27835) [trial-2351↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27835)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=27853): Process ended prematurely: osmo-stp_10.42.42.5(pid=27853) [trial-2351↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27853)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27863): Process ended prematurely: osmo-stp_10.42.42.5(pid=27863) [trial-2351↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27863)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27873): Process ended prematurely: osmo-stp_10.42.42.5(pid=27873) [trial-2351↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27873)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=27894): Process ended prematurely: osmo-stp_10.42.42.5(pid=27894) [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27894)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=27907): Process ended prematurely: osmo-stp_10.42.42.5(pid=27907) [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27907)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=27925): Process ended prematurely: osmo-stp_10.42.42.5(pid=27925) [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27925)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27935): Process ended prematurely: osmo-stp_10.42.42.5(pid=27935) [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27935)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27945): Process ended prematurely: osmo-stp_10.42.42.5(pid=27945) [trial-2351↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27945)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=27963): Process ended prematurely: osmo-stp_10.42.42.5(pid=27963) [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27963)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=27975): Process ended prematurely: osmo-stp_10.42.42.5(pid=27975) [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27975)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=27993): Process ended prematurely: osmo-stp_10.42.42.5(pid=27993) [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27993)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28003): Process ended prematurely: osmo-stp_10.42.42.5(pid=28003) [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28003)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28013): Process ended prematurely: osmo-stp_10.42.42.5(pid=28013) [trial-2351↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28013)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28026): Process ended prematurely: osmo-stp_10.42.42.5(pid=28026) [trial-2351↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28026)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=28039): Process ended prematurely: osmo-stp_10.42.42.5(pid=28039) [trial-2351↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28039)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=28049): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28049) [trial-2351↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28049)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=28062): Process ended prematurely: osmo-stp_10.42.42.5(pid=28062) [trial-2351↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28062)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=28071): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28071) [trial-2351↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28071)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=28081): Process ended prematurely: osmo-stp_10.42.42.5(pid=28081) [trial-2351↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28081)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28095): Process ended prematurely: osmo-stp_10.42.42.5(pid=28095) [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28095)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28106): Process ended prematurely: osmo-stp_10.42.42.5(pid=28106) [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28106)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28120): Process ended prematurely: osmo-stp_10.42.42.5(pid=28120) [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28120)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28131): Process ended prematurely: osmo-stp_10.42.42.5(pid=28131) [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28131)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28145): Process ended prematurely: osmo-stp_10.42.42.5(pid=28145) [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28145)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28156): Process ended prematurely: osmo-stp_10.42.42.5(pid=28156) [trial-2351↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28156)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28171): Process ended prematurely: osmo-stp_10.42.42.5(pid=28171) [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28171)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28182): Process ended prematurely: osmo-stp_10.42.42.5(pid=28182) [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28182)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28196): Process ended prematurely: osmo-stp_10.42.42.5(pid=28196) [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28196)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28207): Process ended prematurely: osmo-stp_10.42.42.5(pid=28207) [trial-2351↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28207)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28221): Process ended prematurely: osmo-stp_10.42.42.5(pid=28221) [trial-2351↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28221)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28232): Process ended prematurely: osmo-stp_10.42.42.5(pid=28232) [trial-2351↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28232)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28249): Process ended prematurely: osmo-stp_10.42.42.5(pid=28249) [trial-2351↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28249)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28260): Process ended prematurely: osmo-stp_10.42.42.5(pid=28260) [trial-2351↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28260)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28275): Process ended prematurely: osmo-stp_10.42.42.5(pid=28275) [trial-2351↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28275)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28287): Process ended prematurely: osmo-stp_10.42.42.5(pid=28287) [trial-2351↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28287)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28301): Process ended prematurely: osmo-stp_10.42.42.5(pid=28301) [trial-2351↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28301)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28312): Process ended prematurely: osmo-stp_10.42.42.5(pid=28312) [trial-2351↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28312)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28327): Process ended prematurely: osmo-stp_10.42.42.5(pid=28327) [trial-2351↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28327)] FAIL: emergency_preemptive_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28338): Process ended prematurely: osmo-stp_10.42.42.5(pid=28338) [trial-2351↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28338)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=28356): Process ended prematurely: osmo-stp_10.42.42.5(pid=28356) [trial-2351↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28356)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=28368): Process ended prematurely: osmo-stp_10.42.42.5(pid=28368) [trial-2351↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28368)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=28386): Process ended prematurely: osmo-stp_10.42.42.5(pid=28386) [trial-2351↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28386)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28396): Process ended prematurely: osmo-stp_10.42.42.5(pid=28396) [trial-2351↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28396)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28406): Process ended prematurely: osmo-stp_10.42.42.5(pid=28406) [trial-2351↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28406)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=28434): Process ended prematurely: osmo-stp_10.42.42.5(pid=28434) [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28434)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=28797): Process ended prematurely: osmo-stp_10.42.42.5(pid=28797) [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28797)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=28992): Process ended prematurely: osmo-stp_10.42.42.5(pid=28992) [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28992)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29002): Process ended prematurely: osmo-stp_10.42.42.5(pid=29002) [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29002)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29012): Process ended prematurely: osmo-stp_10.42.42.5(pid=29012) [trial-2351↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29012)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=29029): Process ended prematurely: osmo-stp_10.42.42.5(pid=29029) [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29029)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=29042): Process ended prematurely: osmo-stp_10.42.42.5(pid=29042) [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29042)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=29060): Process ended prematurely: osmo-stp_10.42.42.5(pid=29060) [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29060)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29070): Process ended prematurely: osmo-stp_10.42.42.5(pid=29070) [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29070)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29080): Process ended prematurely: osmo-stp_10.42.42.5(pid=29080) [trial-2351↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29080)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=29097): Process ended prematurely: osmo-stp_10.42.42.5(pid=29097) [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29097)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=29109): Process ended prematurely: osmo-stp_10.42.42.5(pid=29109) [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29109)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=29127): Process ended prematurely: osmo-stp_10.42.42.5(pid=29127) [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29127)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29144): Process ended prematurely: osmo-stp_10.42.42.5(pid=29144) [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29144)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29154): Process ended prematurely: osmo-stp_10.42.42.5(pid=29154) [trial-2351↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29154)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.7 sec) Error: osmo-stp_10.42.42.5(pid=29442): Process ended prematurely: osmo-stp_10.42.42.5(pid=29442) [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29442)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=29455): Process ended prematurely: osmo-stp_10.42.42.5(pid=29455) [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29455)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=29474): Process ended prematurely: osmo-stp_10.42.42.5(pid=29474) [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29474)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29485): Process ended prematurely: osmo-stp_10.42.42.5(pid=29485) [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29485)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29495): Process ended prematurely: osmo-stp_10.42.42.5(pid=29495) [trial-2351↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29495)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29508): Process ended prematurely: osmo-stp_10.42.42.5(pid=29508) [trial-2351↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29508)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29522): Process ended prematurely: osmo-stp_10.42.42.5(pid=29522) [trial-2351↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29522)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=29531): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29531) [trial-2351↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29531)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=29541): Process ended prematurely: osmo-stp_10.42.42.5(pid=29541) [trial-2351↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29541)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=29550): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29550) [trial-2351↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29550)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29560): Process ended prematurely: osmo-stp_10.42.42.5(pid=29560) [trial-2351↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29560)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29577): Process ended prematurely: osmo-stp_10.42.42.5(pid=29577) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29577)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29588): Process ended prematurely: osmo-stp_10.42.42.5(pid=29588) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29588)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29602): Process ended prematurely: osmo-stp_10.42.42.5(pid=29602) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29602)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29613): Process ended prematurely: osmo-stp_10.42.42.5(pid=29613) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29613)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29627): Process ended prematurely: osmo-stp_10.42.42.5(pid=29627) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29627)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29638): Process ended prematurely: osmo-stp_10.42.42.5(pid=29638) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29638)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29653): Process ended prematurely: osmo-stp_10.42.42.5(pid=29653) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29653)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29664): Process ended prematurely: osmo-stp_10.42.42.5(pid=29664) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29664)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29678): Process ended prematurely: osmo-stp_10.42.42.5(pid=29678) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29678)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29689): Process ended prematurely: osmo-stp_10.42.42.5(pid=29689) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29689)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29703): Process ended prematurely: osmo-stp_10.42.42.5(pid=29703) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29703)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29716): Process ended prematurely: osmo-stp_10.42.42.5(pid=29716) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29716)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29731): Process ended prematurely: osmo-stp_10.42.42.5(pid=29731) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29731)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29742): Process ended prematurely: osmo-stp_10.42.42.5(pid=29742) [trial-2351↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29742)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29756): Process ended prematurely: osmo-stp_10.42.42.5(pid=29756) [trial-2351↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29756)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29769): Process ended prematurely: osmo-stp_10.42.42.5(pid=29769) [trial-2351↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29769)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=29787): Process ended prematurely: osmo-stp_10.42.42.5(pid=29787) [trial-2351↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29787)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=29799): Process ended prematurely: osmo-stp_10.42.42.5(pid=29799) [trial-2351↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29799)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=29818): Process ended prematurely: osmo-stp_10.42.42.5(pid=29818) [trial-2351↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29818)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29828): Process ended prematurely: osmo-stp_10.42.42.5(pid=29828) [trial-2351↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29828)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29838): Process ended prematurely: osmo-stp_10.42.42.5(pid=29838) [trial-2351↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29838)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=29858): Process ended prematurely: osmo-stp_10.42.42.5(pid=29858) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29858)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=29870): Process ended prematurely: osmo-stp_10.42.42.5(pid=29870) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29870)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=29888): Process ended prematurely: osmo-stp_10.42.42.5(pid=29888) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29888)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29898): Process ended prematurely: osmo-stp_10.42.42.5(pid=29898) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29898)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29908): Process ended prematurely: osmo-stp_10.42.42.5(pid=29908) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29908)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=29925): Process ended prematurely: osmo-stp_10.42.42.5(pid=29925) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29925)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=29940): Process ended prematurely: osmo-stp_10.42.42.5(pid=29940) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29940)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=29958): Process ended prematurely: osmo-stp_10.42.42.5(pid=29958) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29958)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29969): Process ended prematurely: osmo-stp_10.42.42.5(pid=29969) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29969)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29979): Process ended prematurely: osmo-stp_10.42.42.5(pid=29979) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29979)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=30001): Process ended prematurely: osmo-stp_10.42.42.5(pid=30001) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30001)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=30013): Process ended prematurely: osmo-stp_10.42.42.5(pid=30013) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30013)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=30031): Process ended prematurely: osmo-stp_10.42.42.5(pid=30031) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30031)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30041): Process ended prematurely: osmo-stp_10.42.42.5(pid=30041) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30041)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30051): Process ended prematurely: osmo-stp_10.42.42.5(pid=30051) [trial-2351↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30051)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30064): Process ended prematurely: osmo-stp_10.42.42.5(pid=30064) [trial-2351↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30064)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30077): Process ended prematurely: osmo-stp_10.42.42.5(pid=30077) [trial-2351↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30077)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=30085): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30085) [trial-2351↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30085)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30095): Process ended prematurely: osmo-stp_10.42.42.5(pid=30095) [trial-2351↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30095)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=30104): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30104) [trial-2351↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30104)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30115): Process ended prematurely: osmo-stp_10.42.42.5(pid=30115) [trial-2351↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30115)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30129): Process ended prematurely: osmo-stp_10.42.42.5(pid=30129) [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30129)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30141): Process ended prematurely: osmo-stp_10.42.42.5(pid=30141) [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30141)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30155): Process ended prematurely: osmo-stp_10.42.42.5(pid=30155) [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30155)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30166): Process ended prematurely: osmo-stp_10.42.42.5(pid=30166) [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30166)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30181): Process ended prematurely: osmo-stp_10.42.42.5(pid=30181) [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30181)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30192): Process ended prematurely: osmo-stp_10.42.42.5(pid=30192) [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30192)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30206): Process ended prematurely: osmo-stp_10.42.42.5(pid=30206) [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30206)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30217): Process ended prematurely: osmo-stp_10.42.42.5(pid=30217) [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30217)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30231): Process ended prematurely: osmo-stp_10.42.42.5(pid=30231) [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30231)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30242): Process ended prematurely: osmo-stp_10.42.42.5(pid=30242) [trial-2351↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30242)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30256): Process ended prematurely: osmo-stp_10.42.42.5(pid=30256) [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30256)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30267): Process ended prematurely: osmo-stp_10.42.42.5(pid=30267) [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30267)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30284): Process ended prematurely: osmo-stp_10.42.42.5(pid=30284) [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30284)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30295): Process ended prematurely: osmo-stp_10.42.42.5(pid=30295) [trial-2351↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30295)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30311): Process ended prematurely: osmo-stp_10.42.42.5(pid=30311) [trial-2351↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30311)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30322): Process ended prematurely: osmo-stp_10.42.42.5(pid=30322) [trial-2351↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30322)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30336): Process ended prematurely: osmo-stp_10.42.42.5(pid=30336) [trial-2351↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30336)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30347): Process ended prematurely: osmo-stp_10.42.42.5(pid=30347) [trial-2351↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30347)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=30365): Process ended prematurely: osmo-stp_10.42.42.5(pid=30365) [trial-2351↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30365)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=30377): Process ended prematurely: osmo-stp_10.42.42.5(pid=30377) [trial-2351↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30377)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=30395): Process ended prematurely: osmo-stp_10.42.42.5(pid=30395) [trial-2351↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30395)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30405): Process ended prematurely: osmo-stp_10.42.42.5(pid=30405) [trial-2351↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30405)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30415): Process ended prematurely: osmo-stp_10.42.42.5(pid=30415) [trial-2351↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30415)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=30432): Process ended prematurely: osmo-stp_10.42.42.5(pid=30432) [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30432)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=30444): Process ended prematurely: osmo-stp_10.42.42.5(pid=30444) [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30444)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=30464): Process ended prematurely: osmo-stp_10.42.42.5(pid=30464) [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30464)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30474): Process ended prematurely: osmo-stp_10.42.42.5(pid=30474) [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30474)] FAIL: ping_idle_ping.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=30566): Process ended prematurely: osmo-stp_10.42.42.5(pid=30566) [trial-2351↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30566)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.7 sec) Error: osmo-stp_10.42.42.5(pid=30772): Process ended prematurely: osmo-stp_10.42.42.5(pid=30772) [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30772)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=30785): Process ended prematurely: osmo-stp_10.42.42.5(pid=30785) [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30785)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=30803): Process ended prematurely: osmo-stp_10.42.42.5(pid=30803) [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30803)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30813): Process ended prematurely: osmo-stp_10.42.42.5(pid=30813) [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30813)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30823): Process ended prematurely: osmo-stp_10.42.42.5(pid=30823) [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30823)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=30841): Process ended prematurely: osmo-stp_10.42.42.5(pid=30841) [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30841)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=30853): Process ended prematurely: osmo-stp_10.42.42.5(pid=30853) [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30853)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=30871): Process ended prematurely: osmo-stp_10.42.42.5(pid=30871) [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30871)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30881): Process ended prematurely: osmo-stp_10.42.42.5(pid=30881) [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30881)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30894): Process ended prematurely: osmo-stp_10.42.42.5(pid=30894) [trial-2351↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30894)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=30913): Process ended prematurely: osmo-stp_10.42.42.5(pid=30913) [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30913)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=30925): Process ended prematurely: osmo-stp_10.42.42.5(pid=30925) [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30925)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=30943): Process ended prematurely: osmo-stp_10.42.42.5(pid=30943) [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30943)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30953): Process ended prematurely: osmo-stp_10.42.42.5(pid=30953) [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30953)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30963): Process ended prematurely: osmo-stp_10.42.42.5(pid=30963) [trial-2351↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30963)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30977): Process ended prematurely: osmo-stp_10.42.42.5(pid=30977) [trial-2351↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30977)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30990): Process ended prematurely: osmo-stp_10.42.42.5(pid=30990) [trial-2351↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30990)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=30998): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30998) [trial-2351↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30998)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=31008): Process ended prematurely: osmo-stp_10.42.42.5(pid=31008) [trial-2351↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31008)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=31018): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31018) [trial-2351↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31018)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=31028): Process ended prematurely: osmo-stp_10.42.42.5(pid=31028) [trial-2351↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31028)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31043): Process ended prematurely: osmo-stp_10.42.42.5(pid=31043) [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31043)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31054): Process ended prematurely: osmo-stp_10.42.42.5(pid=31054) [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31054)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31068): Process ended prematurely: osmo-stp_10.42.42.5(pid=31068) [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31068)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31080): Process ended prematurely: osmo-stp_10.42.42.5(pid=31080) [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31080)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31094): Process ended prematurely: osmo-stp_10.42.42.5(pid=31094) [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31094)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31105): Process ended prematurely: osmo-stp_10.42.42.5(pid=31105) [trial-2351↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31105)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31119): Process ended prematurely: osmo-stp_10.42.42.5(pid=31119) [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31119)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31130): Process ended prematurely: osmo-stp_10.42.42.5(pid=31130) [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31130)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31144): Process ended prematurely: osmo-stp_10.42.42.5(pid=31144) [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31144)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31156): Process ended prematurely: osmo-stp_10.42.42.5(pid=31156) [trial-2351↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31156)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31171): Process ended prematurely: osmo-stp_10.42.42.5(pid=31171) [trial-2351↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31171)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31182): Process ended prematurely: osmo-stp_10.42.42.5(pid=31182) [trial-2351↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31182)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31196): Process ended prematurely: osmo-stp_10.42.42.5(pid=31196) [trial-2351↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31196)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31207): Process ended prematurely: osmo-stp_10.42.42.5(pid=31207) [trial-2351↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31207)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31223): Process ended prematurely: osmo-stp_10.42.42.5(pid=31223) [trial-2351↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31223)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31234): Process ended prematurely: osmo-stp_10.42.42.5(pid=31234) [trial-2351↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31234)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (9.9 sec) Error: osmo-stp_10.42.42.5(pid=31293): Process ended prematurely: osmo-stp_10.42.42.5(pid=31293) [trial-2351↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31293)] FAIL: iperf3.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=31320): Process ended prematurely: osmo-stp_10.42.42.5(pid=31320) [trial-2351↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31320)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=31343): Process ended prematurely: osmo-stp_10.42.42.5(pid=31343) [trial-2351↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31343)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31353): Process ended prematurely: osmo-stp_10.42.42.5(pid=31353) [trial-2351↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31353)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31363): Process ended prematurely: osmo-stp_10.42.42.5(pid=31363) [trial-2351↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31363)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=31380): Process ended prematurely: osmo-stp_10.42.42.5(pid=31380) [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31380)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=31392): Process ended prematurely: osmo-stp_10.42.42.5(pid=31392) [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31392)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=31410): Process ended prematurely: osmo-stp_10.42.42.5(pid=31410) [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31410)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=31420): Process ended prematurely: osmo-stp_10.42.42.5(pid=31420) [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31420)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31430): Process ended prematurely: osmo-stp_10.42.42.5(pid=31430) [trial-2351↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31430)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=31447): Process ended prematurely: osmo-stp_10.42.42.5(pid=31447) [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31447)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=31459): Process ended prematurely: osmo-stp_10.42.42.5(pid=31459) [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31459)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=31477): Process ended prematurely: osmo-stp_10.42.42.5(pid=31477) [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31477)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=31488): Process ended prematurely: osmo-stp_10.42.42.5(pid=31488) [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31488)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31498): Process ended prematurely: osmo-stp_10.42.42.5(pid=31498) [trial-2351↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31498)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=31516): Process ended prematurely: osmo-stp_10.42.42.5(pid=31516) [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31516)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=31528): Process ended prematurely: osmo-stp_10.42.42.5(pid=31528) [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31528)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=31546): Process ended prematurely: osmo-stp_10.42.42.5(pid=31546) [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31546)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=31556): Process ended prematurely: osmo-stp_10.42.42.5(pid=31556) [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31556)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31567): Process ended prematurely: osmo-stp_10.42.42.5(pid=31567) [trial-2351↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31567)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31581): Process ended prematurely: osmo-stp_10.42.42.5(pid=31581) [trial-2351↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31581)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=31594): Process ended prematurely: osmo-stp_10.42.42.5(pid=31594) [trial-2351↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31594)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=31602): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31602) [trial-2351↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31602)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31612): Process ended prematurely: osmo-stp_10.42.42.5(pid=31612) [trial-2351↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31612)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=31621): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31621) [trial-2351↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31621)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31631): Process ended prematurely: osmo-stp_10.42.42.5(pid=31631) [trial-2351↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31631)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31646): Process ended prematurely: osmo-stp_10.42.42.5(pid=31646) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31646)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31660): Process ended prematurely: osmo-stp_10.42.42.5(pid=31660) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31660)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31674): Process ended prematurely: osmo-stp_10.42.42.5(pid=31674) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31674)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31685): Process ended prematurely: osmo-stp_10.42.42.5(pid=31685) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31685)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31700): Process ended prematurely: osmo-stp_10.42.42.5(pid=31700) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31700)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31711): Process ended prematurely: osmo-stp_10.42.42.5(pid=31711) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31711)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31725): Process ended prematurely: osmo-stp_10.42.42.5(pid=31725) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31725)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31736): Process ended prematurely: osmo-stp_10.42.42.5(pid=31736) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31736)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31750): Process ended prematurely: osmo-stp_10.42.42.5(pid=31750) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31750)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31761): Process ended prematurely: osmo-stp_10.42.42.5(pid=31761) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31761)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31775): Process ended prematurely: osmo-stp_10.42.42.5(pid=31775) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31775)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31786): Process ended prematurely: osmo-stp_10.42.42.5(pid=31786) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31786)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31800): Process ended prematurely: osmo-stp_10.42.42.5(pid=31800) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31800)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31811): Process ended prematurely: osmo-stp_10.42.42.5(pid=31811) [trial-2351↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31811)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31825): Process ended prematurely: osmo-stp_10.42.42.5(pid=31825) [trial-2351↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31825)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31836): Process ended prematurely: osmo-stp_10.42.42.5(pid=31836) [trial-2351↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31836)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=31854): Process ended prematurely: osmo-stp_10.42.42.5(pid=31854) [trial-2351↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31854)] FAIL: iperf3.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=32138): Process ended prematurely: osmo-stp_10.42.42.5(pid=32138) [trial-2351↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32138)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=32157): Process ended prematurely: osmo-stp_10.42.42.5(pid=32157) [trial-2351↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32157)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32167): Process ended prematurely: osmo-stp_10.42.42.5(pid=32167) [trial-2351↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32167)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32177): Process ended prematurely: osmo-stp_10.42.42.5(pid=32177) [trial-2351↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32177)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=32194): Process ended prematurely: osmo-stp_10.42.42.5(pid=32194) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32194)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=32206): Process ended prematurely: osmo-stp_10.42.42.5(pid=32206) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32206)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=32224): Process ended prematurely: osmo-stp_10.42.42.5(pid=32224) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32224)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32234): Process ended prematurely: osmo-stp_10.42.42.5(pid=32234) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32234)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32244): Process ended prematurely: osmo-stp_10.42.42.5(pid=32244) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32244)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=32263): Process ended prematurely: osmo-stp_10.42.42.5(pid=32263) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32263)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=32278): Process ended prematurely: osmo-stp_10.42.42.5(pid=32278) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32278)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=32296): Process ended prematurely: osmo-stp_10.42.42.5(pid=32296) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32296)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32306): Process ended prematurely: osmo-stp_10.42.42.5(pid=32306) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32306)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32316): Process ended prematurely: osmo-stp_10.42.42.5(pid=32316) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32316)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=32334): Process ended prematurely: osmo-stp_10.42.42.5(pid=32334) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32334)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=32346): Process ended prematurely: osmo-stp_10.42.42.5(pid=32346) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32346)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=32364): Process ended prematurely: osmo-stp_10.42.42.5(pid=32364) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32364)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32374): Process ended prematurely: osmo-stp_10.42.42.5(pid=32374) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32374)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32384): Process ended prematurely: osmo-stp_10.42.42.5(pid=32384) [trial-2351↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32384)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32397): Process ended prematurely: osmo-stp_10.42.42.5(pid=32397) [trial-2351↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32397)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32411): Process ended prematurely: osmo-stp_10.42.42.5(pid=32411) [trial-2351↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32411)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=32419): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32419) [trial-2351↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32419)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32429): Process ended prematurely: osmo-stp_10.42.42.5(pid=32429) [trial-2351↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32429)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=32438): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32438) [trial-2351↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32438)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=32452): Process ended prematurely: osmo-stp_10.42.42.5(pid=32452) [trial-2351↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32452)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32466): Process ended prematurely: osmo-stp_10.42.42.5(pid=32466) [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32466)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32477): Process ended prematurely: osmo-stp_10.42.42.5(pid=32477) [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32477)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32492): Process ended prematurely: osmo-stp_10.42.42.5(pid=32492) [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32492)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32503): Process ended prematurely: osmo-stp_10.42.42.5(pid=32503) [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32503)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32517): Process ended prematurely: osmo-stp_10.42.42.5(pid=32517) [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32517)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32528): Process ended prematurely: osmo-stp_10.42.42.5(pid=32528) [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32528)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32542): Process ended prematurely: osmo-stp_10.42.42.5(pid=32542) [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32542)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32553): Process ended prematurely: osmo-stp_10.42.42.5(pid=32553) [trial-2351↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32553)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32567): Process ended prematurely: osmo-stp_10.42.42.5(pid=32567) [trial-2351↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32567)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32578): Process ended prematurely: osmo-stp_10.42.42.5(pid=32578) [trial-2351↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32578)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32594): Process ended prematurely: osmo-stp_10.42.42.5(pid=32594) [trial-2351↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32594)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32605): Process ended prematurely: osmo-stp_10.42.42.5(pid=32605) [trial-2351↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32605)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=32626): Process ended prematurely: osmo-stp_10.42.42.5(pid=32626) [trial-2351↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32626)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=32638): Process ended prematurely: osmo-stp_10.42.42.5(pid=32638) [trial-2351↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32638)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=32656): Process ended prematurely: osmo-stp_10.42.42.5(pid=32656) [trial-2351↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32656)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=32666): Process ended prematurely: osmo-stp_10.42.42.5(pid=32666) [trial-2351↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32666)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32677): Process ended prematurely: osmo-stp_10.42.42.5(pid=32677) [trial-2351↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32677)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=32694): Process ended prematurely: osmo-stp_10.42.42.5(pid=32694) [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32694)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=32706): Process ended prematurely: osmo-stp_10.42.42.5(pid=32706) [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32706)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=32724): Process ended prematurely: osmo-stp_10.42.42.5(pid=32724) [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32724)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=32734): Process ended prematurely: osmo-stp_10.42.42.5(pid=32734) [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32734)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32744): Process ended prematurely: osmo-stp_10.42.42.5(pid=32744) [trial-2351↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32744)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=32765): Process ended prematurely: osmo-stp_10.42.42.5(pid=32765) [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32765)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=309): Process ended prematurely: osmo-stp_10.42.42.5(pid=309) [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=309)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=327): Process ended prematurely: osmo-stp_10.42.42.5(pid=327) [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=327)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=341): Process ended prematurely: osmo-stp_10.42.42.5(pid=341) [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=341)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=359): Process ended prematurely: osmo-stp_10.42.42.5(pid=359) [trial-2351↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=359)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=377): Process ended prematurely: osmo-stp_10.42.42.5(pid=377) [trial-2351↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=377)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=390): Process ended prematurely: osmo-stp_10.42.42.5(pid=390) [trial-2351↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=390)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=400): Process ended prematurely: osmo-nitb_10.42.42.2(pid=400) [trial-2351↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=400)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=410): Process ended prematurely: osmo-stp_10.42.42.5(pid=410) [trial-2351↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=410)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=424): Process ended prematurely: osmo-stp_10.42.42.5(pid=424) [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=424)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=435): Process ended prematurely: osmo-stp_10.42.42.5(pid=435) [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=435)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=449): Process ended prematurely: osmo-stp_10.42.42.5(pid=449) [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=449)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=460): Process ended prematurely: osmo-stp_10.42.42.5(pid=460) [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=460)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=474): Process ended prematurely: osmo-stp_10.42.42.5(pid=474) [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=474)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=485): Process ended prematurely: osmo-stp_10.42.42.5(pid=485) [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=485)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=499): Process ended prematurely: osmo-stp_10.42.42.5(pid=499) [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=499)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=510): Process ended prematurely: osmo-stp_10.42.42.5(pid=510) [trial-2351↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=510)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=527): Process ended prematurely: osmo-stp_10.42.42.5(pid=527) [trial-2351↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=527)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=538): Process ended prematurely: osmo-stp_10.42.42.5(pid=538) [trial-2351↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=538)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=553): Process ended prematurely: osmo-stp_10.42.42.5(pid=553) [trial-2351↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=553)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=564): Process ended prematurely: osmo-stp_10.42.42.5(pid=564) [trial-2351↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=564)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=578): Process ended prematurely: osmo-stp_10.42.42.5(pid=578) [trial-2351↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=578)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=589): Process ended prematurely: osmo-stp_10.42.42.5(pid=589) [trial-2351↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=589)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=607): Process ended prematurely: osmo-stp_10.42.42.5(pid=607) [trial-2351↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=607)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=619): Process ended prematurely: osmo-stp_10.42.42.5(pid=619) [trial-2351↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=619)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=637): Process ended prematurely: osmo-stp_10.42.42.5(pid=637) [trial-2351↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=637)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=647): Process ended prematurely: osmo-stp_10.42.42.5(pid=647) [trial-2351↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=647)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=657): Process ended prematurely: osmo-stp_10.42.42.5(pid=657) [trial-2351↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=657)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=674): Process ended prematurely: osmo-stp_10.42.42.5(pid=674) [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=674)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=686): Process ended prematurely: osmo-stp_10.42.42.5(pid=686) [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=686)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=706): Process ended prematurely: osmo-stp_10.42.42.5(pid=706) [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=706)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=716): Process ended prematurely: osmo-stp_10.42.42.5(pid=716) [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=716)] FAIL: ping_idle_ping.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=1026): Process ended prematurely: osmo-stp_10.42.42.5(pid=1026) [trial-2351↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1026)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.7 sec) Error: osmo-stp_10.42.42.5(pid=1044): Process ended prematurely: osmo-stp_10.42.42.5(pid=1044) [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1044)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=1057): Process ended prematurely: osmo-stp_10.42.42.5(pid=1057) [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1057)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=1075): Process ended prematurely: osmo-stp_10.42.42.5(pid=1075) [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1075)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1085): Process ended prematurely: osmo-stp_10.42.42.5(pid=1085) [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1085)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1095): Process ended prematurely: osmo-stp_10.42.42.5(pid=1095) [trial-2351↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1095)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=1112): Process ended prematurely: osmo-stp_10.42.42.5(pid=1112) [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1112)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=1130): Process ended prematurely: osmo-stp_10.42.42.5(pid=1130) [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1130)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=1154): Process ended prematurely: osmo-stp_10.42.42.5(pid=1154) [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1154)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1167): Process ended prematurely: osmo-stp_10.42.42.5(pid=1167) [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1167)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1179): Process ended prematurely: osmo-stp_10.42.42.5(pid=1179) [trial-2351↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1179)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1193): Process ended prematurely: osmo-stp_10.42.42.5(pid=1193) [trial-2351↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1193)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=1201): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1201) [trial-2351↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1201)] FAIL: esme_connect_policy_closed.py (2.0 sec) Error: osmo-nitb_10.42.42.2(pid=1203): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1203) [trial-2351↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1203)] FAIL: esme_ms_sms_storeforward.py (2.8 sec) Error: osmo-nitb_10.42.42.2(pid=1205): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1205) [trial-2351↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1205)] FAIL: esme_ms_sms_transaction.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=1207): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1207) [trial-2351↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1207)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.9 sec) Error: osmo-hlr_10.42.42.2(pid=1217): Process ended prematurely: osmo-hlr_10.42.42.2(pid=1217) [trial-2351↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1217)] FAIL: esme_connect_policy_closed.py (6.1 sec) Error: osmo-hlr_10.42.42.2(pid=1228): Process ended prematurely: osmo-hlr_10.42.42.2(pid=1228) [trial-2351↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1228)] FAIL: esme_ms_sms_storeforward.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=1241): Process ended prematurely: osmo-stp_10.42.42.5(pid=1241) [trial-2351↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1241)] FAIL: esme_ms_sms_transaction.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1252): Process ended prematurely: osmo-stp_10.42.42.5(pid=1252) [trial-2351↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1252)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1266): Process ended prematurely: osmo-stp_10.42.42.5(pid=1266) [trial-2351↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1266)] FAIL: register_a5_0_authreq.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1277): Process ended prematurely: osmo-stp_10.42.42.5(pid=1277) [trial-2351↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1277)] FAIL: register_a5_1_authreq.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1288): Process ended prematurely: osmo-stp_10.42.42.5(pid=1288) [trial-2351↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1288)] FAIL: register_a5_3_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1299): Process ended prematurely: osmo-stp_10.42.42.5(pid=1299) [trial-2351↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1299)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (19.9 sec) Error: srsepc(pid=1320): Process ended prematurely: srsepc(pid=1320) [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1320)] FAIL: iperf3_bidir.py (18.8 sec) Error: srsepc(pid=1336): Process ended prematurely: srsepc(pid=1336) [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1336)] FAIL: iperf3_dl.py (18.7 sec) Error: srsepc(pid=1355): Process ended prematurely: srsepc(pid=1355) [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1355)] FAIL: iperf3_ul.py (19.0 sec) Error: srsepc(pid=1371): Process ended prematurely: srsepc(pid=1371) [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1371)] FAIL: ping.py (18.4 sec) Error: srsepc(pid=1387): Process ended prematurely: srsepc(pid=1387) [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1387)] FAIL: rrc_idle_mo_ping.py (18.5 sec) Error: srsepc(pid=1404): Process ended prematurely: srsepc(pid=1404) [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1404)] FAIL: rrc_idle_mt_ping.py (18.7 sec) Error: srsepc(pid=1423): Process ended prematurely: srsepc(pid=1423) [trial-2351↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=1423)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1436): Process ended prematurely: osmo-stp_10.42.42.5(pid=1436) [trial-2351↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1436)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1450): Process ended prematurely: osmo-stp_10.42.42.5(pid=1450) [trial-2351↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1450)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1464): Process ended prematurely: osmo-stp_10.42.42.5(pid=1464) [trial-2351↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1464)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=1478): Process ended prematurely: osmo-stp_10.42.42.5(pid=1478) [trial-2351↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1478)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1493): Process ended prematurely: osmo-stp_10.42.42.5(pid=1493) [trial-2351↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1493)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1510): Process ended prematurely: osmo-stp_10.42.42.5(pid=1510) [trial-2351↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1510)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1524): Process ended prematurely: osmo-stp_10.42.42.5(pid=1524) [trial-2351↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1524)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1538): Process ended prematurely: osmo-stp_10.42.42.5(pid=1538) [trial-2351↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1538)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=1552): Process ended prematurely: osmo-stp_10.42.42.5(pid=1552) [trial-2351↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1552)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1566): Process ended prematurely: osmo-stp_10.42.42.5(pid=1566) [trial-2351↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1566)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1580): Process ended prematurely: osmo-stp_10.42.42.5(pid=1580) [trial-2351↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1580)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1594): Process ended prematurely: osmo-stp_10.42.42.5(pid=1594) [trial-2351↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1594)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1609): Process ended prematurely: osmo-stp_10.42.42.5(pid=1609) [trial-2351↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1609)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1623): Process ended prematurely: osmo-stp_10.42.42.5(pid=1623) [trial-2351↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1623)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1637): Process ended prematurely: osmo-stp_10.42.42.5(pid=1637) [trial-2351↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1637)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1651): Process ended prematurely: osmo-stp_10.42.42.5(pid=1651) [trial-2351↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1651)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1665): Process ended prematurely: osmo-stp_10.42.42.5(pid=1665) [trial-2351↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1665)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1679): Process ended prematurely: osmo-stp_10.42.42.5(pid=1679) [trial-2351↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1679)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1693): Process ended prematurely: osmo-stp_10.42.42.5(pid=1693) [trial-2351↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1693)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1707): Process ended prematurely: osmo-stp_10.42.42.5(pid=1707) [trial-2351↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1707)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1722): Process ended prematurely: osmo-stp_10.42.42.5(pid=1722) [trial-2351↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1722)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=1736): Process ended prematurely: osmo-stp_10.42.42.5(pid=1736) [trial-2351↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1736)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1750): Process ended prematurely: osmo-stp_10.42.42.5(pid=1750) [trial-2351↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1750)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1764): Process ended prematurely: osmo-stp_10.42.42.5(pid=1764) [trial-2351↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1764)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1778): Process ended prematurely: osmo-stp_10.42.42.5(pid=1778) [trial-2351↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1778)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1795): Process ended prematurely: osmo-stp_10.42.42.5(pid=1795) [trial-2351↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1795)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1809): Process ended prematurely: osmo-stp_10.42.42.5(pid=1809) [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1809)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1825): Process ended prematurely: osmo-stp_10.42.42.5(pid=1825) [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1825)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1839): Process ended prematurely: osmo-stp_10.42.42.5(pid=1839) [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1839)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1853): Process ended prematurely: osmo-stp_10.42.42.5(pid=1853) [trial-2351↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1853)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=1867): Process ended prematurely: osmo-stp_10.42.42.5(pid=1867) [trial-2351↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1867)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1891): Process ended prematurely: osmo-stp_10.42.42.5(pid=1891) [trial-2351↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1891)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=2350): Process ended prematurely: osmo-stp_10.42.42.5(pid=2350) [trial-2351↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2350)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2449): Process ended prematurely: osmo-stp_10.42.42.5(pid=2449) [trial-2351↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2449)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2463): Process ended prematurely: osmo-stp_10.42.42.5(pid=2463) [trial-2351↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2463)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2477): Process ended prematurely: osmo-stp_10.42.42.5(pid=2477) [trial-2351↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2477)] + rm -rf trial-2351/inst + cd trial-2351 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-08 23:11:30 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351-run.tgz run.2022-12-08_23-11-41 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2351-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17648.tgz osmo-bts-oc2g.build-5528.tgz osmo-bts-sysmo.build-8032.tgz osmo-bts.build-7501.tgz osmo-ggsn.build-6676.tgz osmo-hlr.build-8695.tgz osmo-hnbgw.build-2940.tgz osmo-mgw.build-8940.tgz osmo-msc.build-29250.tgz osmo-nitb.build-12961.tgz osmo-pcu-oc2g.build-3905.tgz osmo-pcu-sysmo.build-5187.tgz osmo-pcu.build-5148.tgz osmo-sgsn.build-30028.tgz osmo-stp.build-9235.tgz osmo-trx.build-4672.tgz osmocom-bb.build-4693.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE