![[Jenkins]](/jenkins/static/717955cb/images/svgs/logo.svg){kind=logo}
Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12961 originally caused by: Started by upstream project "master-openbsc" build number 13157 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17648 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7501 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6675 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8695 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8940 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2940 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29250 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5148 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30027 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4672 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12961 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9235 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4692 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8032 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5187 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5528 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3905 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins3350476959997599152.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-08 20:04:22 + trial_dir_prefix=trial- + rm -rf trial-2348 trial-2348-bin.tgz trial-2348-run.tgz + trial_dir=trial-2349 + mkdir -p trial-2349 + mv open5gs.build-8.tgz osmo-bsc.build-17648.tgz osmo-bts-oc2g.build-5528.tgz osmo-bts-sysmo.build-8032.tgz osmo-bts.build-7501.tgz osmo-ggsn.build-6675.tgz osmo-hlr.build-8695.tgz osmo-hnbgw.build-2940.tgz osmo-mgw.build-8940.tgz osmo-msc.build-29250.tgz osmo-nitb.build-12961.tgz osmo-pcu-oc2g.build-3905.tgz osmo-pcu-sysmo.build-5187.tgz osmo-pcu.build-5148.tgz osmo-sgsn.build-30027.tgz osmo-stp.build-9235.tgz osmo-trx.build-4672.tgz osmocom-bb.build-4692.tgz srslte.build-19.tgz trial-2349 + cat open5gs.build-8.md5 osmo-bsc.build-17648.md5 osmo-bts-oc2g.build-5528.md5 osmo-bts-sysmo.build-8032.md5 osmo-bts.build-7501.md5 osmo-ggsn.build-6675.md5 osmo-hlr.build-8695.md5 osmo-hnbgw.build-2940.md5 osmo-mgw.build-8940.md5 osmo-msc.build-29250.md5 osmo-nitb.build-12961.md5 osmo-pcu-oc2g.build-3905.md5 osmo-pcu-sysmo.build-5187.md5 osmo-pcu.build-5148.md5 osmo-sgsn.build-30027.md5 osmo-stp.build-9235.md5 osmo-trx.build-4672.md5 osmocom-bb.build-4692.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17648.md5 osmo-bts-oc2g.build-5528.md5 osmo-bts-sysmo.build-8032.md5 osmo-bts.build-7501.md5 osmo-ggsn.build-6675.md5 osmo-hlr.build-8695.md5 osmo-hnbgw.build-2940.md5 osmo-mgw.build-8940.md5 osmo-msc.build-29250.md5 osmo-nitb.build-12961.md5 osmo-pcu-oc2g.build-3905.md5 osmo-pcu-sysmo.build-5187.md5 osmo-pcu.build-5148.md5 osmo-sgsn.build-30027.md5 osmo-stp.build-9235.md5 osmo-trx.build-4672.md5 osmocom-bb.build-4692.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2349 combinations: None trial: 'trial-2349' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2349 -------------------------------------------------------------------------------------------- 20:04:33.338488 tst trial-2349: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/log --------------------------------------------------------------------- trial-2349 nitb_sms:sysmo --------------------------------------------------------------------- 20:06:40.027805 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:06:40.031341 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 20:06:40.052168 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 20:06:40.059460 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 20:06:40.115080 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 20:06:40.137261 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 20:06:40.145398 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 20:06:40.684112 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 20:06:40.689487 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 20:06:40.700796 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 20:06:41.086555 tst mo_mt_sms.py: using LAC 16493 20:06:41.321736 tst mo_mt_sms.py: using RAC 173 20:06:41.439707 tst mo_mt_sms.py: using CellId 16493 20:06:41.556382 tst mo_mt_sms.py: using BVCI 16494 20:06:41.671610 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 20:06:41.852595 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 20:06:41.971687 tst mo_mt_sms.py:9: start nitb and bts... 20:06:42.189755 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:06:44.543225 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9034): Launched 20:06:44.869497 run osmo-nitb_10.42.42.2(pid=9035): Launched 20:06:45.047502 run osmo-nitb_10.42.42.2(pid=9035): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9035)] 20:06:45.180756 run osmo-nitb_10.42.42.2(pid=9035): stdout: | (launched: 2022-12-08_20:06:44.809161) 20:06:45.315555 run osmo-nitb_10.42.42.2(pid=9035): stderr: | (launched: 2022-12-08_20:06:44.857422) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:06:45.450382 run osmo-nitb_10.42.42.2(pid=9035): stdout: | (launched: 2022-12-08_20:06:44.809161) 20:06:45.579015 run osmo-nitb_10.42.42.2(pid=9035): stderr: | (launched: 2022-12-08_20:06:44.857422) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:06:45.733020 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=9035): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9035) [trial-2349↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9035)] [trial-2349↪nitb_sms:sysmo↪mo_mt_sms.py:11] 20:06:45.741850 tst mo_mt_sms.py:11: Test FAILED (5.0 sec) 20:06:45.748723 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9034): Terminating (SIGTERM) 20:06:45.959254 --- ParallelTerminationStrategy: PID 9034 died... 20:06:45.980754 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9034): Terminated: ok {rc=0} 20:06:46.070490 bus /sierra_3: Setting Powered False 20:06:47.177819 bus /sierra_3: Setting Powered False 20:06:48.298681 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 sms:sysmo --------------------------------------------------------------------- 20:06:49.484517 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:06:49.489184 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 20:06:49.511079 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 20:06:49.540079 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 20:06:49.596865 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 20:06:49.618413 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 20:06:49.645845 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 20:06:50.191910 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 sms:sysmo mo_mt_sms.py ---------------------------------------------- 20:06:50.197178 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 20:06:50.208187 tst sms:sysmo: Using 1 x bts (candidates: 1) 20:06:50.243130 tst mo_mt_sms.py: using LAC 16494 20:06:50.364225 tst mo_mt_sms.py: using RAC 174 20:06:50.481807 tst mo_mt_sms.py: using CellId 16494 20:06:50.600825 tst mo_mt_sms.py: using BVCI 16495 20:06:50.710223 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 20:06:50.721039 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 20:06:50.731484 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 20:06:50.742247 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 20:06:50.752927 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 20:06:50.763734 tst sms:sysmo: Using 1 x modem (candidates: 2) 20:06:50.881882 tst sms:sysmo: Using 1 x modem (candidates: 2) 20:06:51.002671 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:06:52.712854 run create_hlr_db(pid=9039): Launched 20:06:52.830473 bus /sierra_2: Setting Powered False 20:06:53.890664 run create_hlr_db(pid=9039): Terminated: ok {rc=0} 20:06:54.339262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9041): Launched 20:06:54.666558 run osmo-hlr_10.42.42.2(pid=9042): Launched 20:06:54.791534 run osmo-stp_10.42.42.5: Starting osmo-stp 20:06:57.363124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9044): Launched 20:06:57.691027 run osmo-stp_10.42.42.5(pid=9045): Launched 20:06:57.816530 run osmo-msc_10.42.42.6: Starting osmo-msc 20:07:03.244939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9047): Launched 20:07:03.550870 run osmo-msc_10.42.42.6(pid=9048): Launched 20:07:03.721832 run osmo-stp_10.42.42.5(pid=9045): ERR: Terminated: ERROR {rc=1} [trial-2349↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9045)] 20:07:03.850301 run osmo-stp_10.42.42.5(pid=9045): stdout: | (launched: 2022-12-08_20:06:57.630270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:03.978458 run osmo-stp_10.42.42.5(pid=9045): stderr: | [0;m[38;5;43m20221208200657826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200657826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200657826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200657827 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200657827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200657827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200657827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:04.104500 run osmo-stp_10.42.42.5(pid=9045): stdout: | (launched: 2022-12-08_20:06:57.630270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:04.225298 run osmo-stp_10.42.42.5(pid=9045): stderr: | [0;m[38;5;43m20221208200657826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200657826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200657826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200657827 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200657827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200657827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200657827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:04.369200 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9045): Process ended prematurely: osmo-stp_10.42.42.5(pid=9045) [trial-2349↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9045)] [trial-2349↪sms:sysmo↪mo_mt_sms.py:16] 20:07:04.377404 tst mo_mt_sms.py:16: Test FAILED (14.2 sec) 20:07:04.404067 run osmo-hlr_10.42.42.2(pid=9042): ERR: Terminated: ERROR {rc=237} [trial-2349↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9042)] 20:07:04.452794 run osmo-hlr_10.42.42.2(pid=9042): stdout: | (launched: 2022-12-08_20:06:54.605779) 20:07:04.503379 run osmo-hlr_10.42.42.2(pid=9042): stderr: | [0;m[1;31m20221208200654808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208200654808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208200654808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208200654808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208200654808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208200654808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208200654820 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208200654829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208200654829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208200654829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:07:04.573489 run osmo-msc_10.42.42.6(pid=9048): ERR: Terminated: ERROR {rc=2} [trial-2349↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9048)] 20:07:04.621870 run osmo-msc_10.42.42.6(pid=9048): stdout: | (launched: 2022-12-08_20:07:03.493764) 20:07:04.671871 run osmo-msc_10.42.42.6(pid=9048): stderr: | [0;m[38;5;43m20221208200703766 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208200703766 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe22dc07c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208200703767 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208200703767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208200703767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208200703767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208200703769 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208200703769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208200703769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208200703769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:07:04.722609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9041): Terminating (SIGTERM) 20:07:04.763538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9044): Terminating (SIGTERM) 20:07:04.804183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9047): Terminating (SIGTERM) 20:07:04.844908 --- ParallelTerminationStrategy: PID 9041 died... 20:07:04.864393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9041): Terminated: ok {rc=0} 20:07:04.909363 --- ParallelTerminationStrategy: PID 9044 died... 20:07:04.928409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9044): Terminated: ok {rc=0} 20:07:04.973702 --- ParallelTerminationStrategy: PID 9047 died... 20:07:04.992459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9047): Terminated: ok {rc=0} 20:07:05.077963 bus /sierra_3: Setting Powered False 20:07:06.178216 bus /sierra_3: Setting Powered False 20:07:07.295843 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 nitb_ussd:sysmo --------------------------------------------------------------------- 20:07:08.517258 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:07:08.521415 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 20:07:08.543358 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 20:07:08.551014 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 20:07:08.587723 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 20:07:08.609568 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 20:07:08.616735 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 20:07:09.137547 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2349 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 20:07:09.142718 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 20:07:09.154132 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 20:07:09.192085 tst assert_extension.py: using LAC 16495 20:07:09.319838 tst assert_extension.py: using RAC 175 20:07:09.443221 tst assert_extension.py: using CellId 16495 20:07:09.573153 tst assert_extension.py: using BVCI 16496 20:07:09.692387 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 20:07:09.810305 tst assert_extension.py:10: start nitb and bts... 20:07:10.013361 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:07:10.632043 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9054): Launched 20:07:10.938704 run osmo-nitb_10.42.42.2(pid=9055): Launched 20:07:11.108369 run osmo-nitb_10.42.42.2(pid=9055): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9055)] 20:07:11.244271 run osmo-nitb_10.42.42.2(pid=9055): stdout: | (launched: 2022-12-08_20:07:10.881467) 20:07:11.381871 run osmo-nitb_10.42.42.2(pid=9055): stderr: | (launched: 2022-12-08_20:07:10.926333) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:07:11.519420 run osmo-nitb_10.42.42.2(pid=9055): stdout: | (launched: 2022-12-08_20:07:10.881467) 20:07:11.650899 run osmo-nitb_10.42.42.2(pid=9055): stderr: | (launched: 2022-12-08_20:07:10.926333) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8fda692268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9055): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9055) [trial-2349↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9055)] 20:07:12.054908 tst osmo-nitb_10.42.42.2(pid=9055): stdout: | (launched: 2022-12-08_20:07:10.881467) 20:07:12.176682 tst osmo-nitb_10.42.42.2(pid=9055): stderr: | (launched: 2022-12-08_20:07:10.926333) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:07:12.320605 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9055): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9055) [trial-2349↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9055)] [trial-2349↪nitb_ussd:sysmo↪assert_extension.py:12] 20:07:12.329082 tst assert_extension.py:12: Test FAILED (3.2 sec) 20:07:12.335980 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9054): Terminating (SIGTERM) 20:07:12.545807 --- ParallelTerminationStrategy: PID 9054 died... 20:07:12.567076 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9054): Terminated: ok {rc=0} 20:07:12.652376 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 ussd:sysmo --------------------------------------------------------------------- 20:07:13.816127 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:07:13.820761 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 20:07:13.843262 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 20:07:13.870894 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 20:07:13.906712 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 20:07:13.928821 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 20:07:13.956929 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 20:07:14.482884 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2349 ussd:sysmo assert_extension.py ---------------------------------------------- 20:07:14.488183 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 20:07:14.499121 tst ussd:sysmo: Using 1 x bts (candidates: 1) 20:07:14.535332 tst assert_extension.py: using LAC 16496 20:07:14.665141 tst assert_extension.py: using RAC 176 20:07:14.793640 tst assert_extension.py: using CellId 16496 20:07:14.921625 tst assert_extension.py: using BVCI 16497 20:07:15.039503 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 20:07:15.050630 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 20:07:15.061664 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 20:07:15.072682 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 20:07:15.083762 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 20:07:15.094725 tst ussd:sysmo: Using 1 x modem (candidates: 1) 20:07:15.209478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:07:15.681233 run create_hlr_db(pid=9059): Launched 20:07:15.797981 bus /sierra_2: Setting Powered False 20:07:16.857165 run create_hlr_db(pid=9059): Terminated: ok {rc=0} 20:07:17.353637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9061): Launched 20:07:17.659905 run osmo-hlr_10.42.42.2(pid=9062): Launched 20:07:17.774638 run osmo-stp_10.42.42.5: Starting osmo-stp 20:07:18.300694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9064): Launched 20:07:18.607888 run osmo-stp_10.42.42.5(pid=9065): Launched 20:07:18.725904 run osmo-msc_10.42.42.6: Starting osmo-msc 20:07:19.275353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9067): Launched 20:07:19.582766 run osmo-msc_10.42.42.6(pid=9068): Launched 20:07:19.754088 run osmo-stp_10.42.42.5(pid=9065): ERR: Terminated: ERROR {rc=1} [trial-2349↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9065)] 20:07:19.883013 run osmo-stp_10.42.42.5(pid=9065): stdout: | (launched: 2022-12-08_20:07:18.550766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:20.012227 run osmo-stp_10.42.42.5(pid=9065): stderr: | [0;m[38;5;43m20221208200718723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200718723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200718723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200718724 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200718724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200718724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200718724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:20.139485 run osmo-stp_10.42.42.5(pid=9065): stdout: | (launched: 2022-12-08_20:07:18.550766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:20.259799 run osmo-stp_10.42.42.5(pid=9065): stderr: | [0;m[38;5;43m20221208200718723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200718723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200718723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200718724 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200718724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200718724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200718724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:20.404796 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9065): Process ended prematurely: osmo-stp_10.42.42.5(pid=9065) [trial-2349↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9065)] [trial-2349↪ussd:sysmo↪assert_extension.py:17] 20:07:20.413088 tst assert_extension.py:17: Test FAILED (5.9 sec) 20:07:20.439522 run osmo-hlr_10.42.42.2(pid=9062): ERR: Terminated: ERROR {rc=237} [trial-2349↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9062)] 20:07:20.488449 run osmo-hlr_10.42.42.2(pid=9062): stdout: | (launched: 2022-12-08_20:07:17.602804) 20:07:20.538873 run osmo-hlr_10.42.42.2(pid=9062): stderr: | [0;m[1;31m20221208200717779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208200717779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208200717779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208200717779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208200717779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208200717779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208200717845 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208200717854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208200717854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208200717855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:07:20.608822 run osmo-msc_10.42.42.6(pid=9068): ERR: Terminated: ERROR {rc=2} [trial-2349↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9068)] 20:07:20.657462 run osmo-msc_10.42.42.6(pid=9068): stdout: | (launched: 2022-12-08_20:07:19.525343) 20:07:20.707559 run osmo-msc_10.42.42.6(pid=9068): stderr: | [0;m[38;5;43m20221208200719799 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208200719799 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f98d55b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208200719799 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208200719800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208200719800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208200719800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208200719802 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208200719802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208200719802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208200719802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:07:20.758188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9061): Terminating (SIGTERM) 20:07:20.798735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9064): Terminating (SIGTERM) 20:07:20.839236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9067): Terminating (SIGTERM) 20:07:20.879917 --- ParallelTerminationStrategy: PID 9061 died... 20:07:20.899109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9061): Terminated: ok {rc=0} 20:07:20.943984 --- ParallelTerminationStrategy: PID 9064 died... 20:07:20.962821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9064): Terminated: ok {rc=0} 20:07:21.007701 --- ParallelTerminationStrategy: PID 9067 died... 20:07:21.026435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9067): Terminated: ok {rc=0} 20:07:21.114174 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 20:07:22.310144 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:07:22.316569 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 20:07:22.337497 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 20:07:22.366071 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 20:07:22.418908 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 20:07:22.439778 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 20:07:22.466802 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 20:07:23.016261 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 20:07:23.067791 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:23.079020 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:07:23.137513 tst mo_mt_call.py: using LAC 16497 20:07:23.270629 tst mo_mt_call.py: using RAC 177 20:07:23.401403 tst mo_mt_call.py: using CellId 16497 20:07:23.534248 tst mo_mt_call.py: using BVCI 16498 20:07:23.655495 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:23.667444 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:23.678875 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:23.690433 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:23.701990 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:23.713613 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:07:23.834124 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:07:23.954804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:07:24.469501 run create_hlr_db(pid=9073): Launched 20:07:24.603286 bus /sierra_2: Setting Powered False 20:07:25.667562 run create_hlr_db(pid=9073): Terminated: ok {rc=0} 20:07:26.128707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9075): Launched 20:07:26.494669 run osmo-hlr_10.42.42.2(pid=9076): Launched 20:07:26.621766 run osmo-stp_10.42.42.5: Starting osmo-stp 20:07:27.196029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9078): Launched 20:07:27.528531 run osmo-stp_10.42.42.5(pid=9079): Launched 20:07:27.655496 run osmo-msc_10.42.42.6: Starting osmo-msc 20:07:28.254909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9081): Launched 20:07:28.586755 run osmo-msc_10.42.42.6(pid=9082): Launched 20:07:28.770467 run osmo-stp_10.42.42.5(pid=9079): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9079)] 20:07:28.909584 run osmo-stp_10.42.42.5(pid=9079): stdout: | (launched: 2022-12-08_20:07:27.467275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:29.049616 run osmo-stp_10.42.42.5(pid=9079): stderr: | [0;m[38;5;43m20221208200727660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200727660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200727660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200727661 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200727663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200727663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200727663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:29.187989 run osmo-stp_10.42.42.5(pid=9079): stdout: | (launched: 2022-12-08_20:07:27.467275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:29.319157 run osmo-stp_10.42.42.5(pid=9079): stderr: | [0;m[38;5;43m20221208200727660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200727660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200727660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200727661 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200727663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200727663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200727663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:29.475735 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9079): Process ended prematurely: osmo-stp_10.42.42.5(pid=9079) [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9079)] [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 20:07:29.485122 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 20:07:29.512926 run osmo-hlr_10.42.42.2(pid=9076): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9076)] 20:07:29.563695 run osmo-hlr_10.42.42.2(pid=9076): stdout: | (launched: 2022-12-08_20:07:26.430509) 20:07:29.616211 run osmo-hlr_10.42.42.2(pid=9076): stderr: | [0;m[1;31m20221208200726634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208200726634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208200726634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208200726634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208200726634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208200726634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208200726652 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208200726661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208200726662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208200726662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:07:29.689008 run osmo-msc_10.42.42.6(pid=9082): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9082)] 20:07:29.739518 run osmo-msc_10.42.42.6(pid=9082): stdout: | (launched: 2022-12-08_20:07:28.524858) 20:07:29.791917 run osmo-msc_10.42.42.6(pid=9082): stderr: | [0;m[38;5;43m20221208200728850 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208200728850 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdedcce0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208200728850 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208200728850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208200728850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208200728850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208200728852 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208200728852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208200728853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208200728853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:07:29.844764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9075): Terminating (SIGTERM) 20:07:29.887145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9078): Terminating (SIGTERM) 20:07:29.929511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9081): Terminating (SIGTERM) 20:07:29.972358 --- ParallelTerminationStrategy: PID 9075 died... 20:07:29.992652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9075): Terminated: ok {rc=0} 20:07:30.039724 --- ParallelTerminationStrategy: PID 9078 died... 20:07:30.059559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9078): Terminated: ok {rc=0} 20:07:30.106219 --- ParallelTerminationStrategy: PID 9081 died... 20:07:30.125948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9081): Terminated: ok {rc=0} 20:07:30.215013 bus /sierra_3: Setting Powered False 20:07:31.312881 bus /sierra_3: Setting Powered False 20:07:32.429055 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 20:07:33.581904 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:33.594410 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:07:33.695131 tst mo_mt_call_osmux.py: using LAC 16498 20:07:33.824751 tst mo_mt_call_osmux.py: using RAC 178 20:07:33.953110 tst mo_mt_call_osmux.py: using CellId 16498 20:07:34.081019 tst mo_mt_call_osmux.py: using BVCI 16499 20:07:34.201719 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:34.213405 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:34.224842 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:34.236389 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:34.247995 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:34.259492 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:07:34.377183 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:07:34.498718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:07:35.014554 run create_hlr_db(pid=9084): Launched 20:07:35.148452 bus /sierra_2: Setting Powered False 20:07:36.213636 run create_hlr_db(pid=9084): Terminated: ok {rc=0} 20:07:36.657380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9086): Launched 20:07:36.970289 run osmo-hlr_10.42.42.2(pid=9087): Launched 20:07:37.090443 run osmo-stp_10.42.42.5: Starting osmo-stp 20:07:37.643463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9089): Launched 20:07:37.955872 run osmo-stp_10.42.42.5(pid=9090): Launched 20:07:38.075464 run osmo-msc_10.42.42.6: Starting osmo-msc 20:07:38.636576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9092): Launched 20:07:38.948874 run osmo-msc_10.42.42.6(pid=9093): Launched 20:07:39.123007 run osmo-stp_10.42.42.5(pid=9090): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9090)] 20:07:39.254653 run osmo-stp_10.42.42.5(pid=9090): stdout: | (launched: 2022-12-08_20:07:37.897755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:39.386302 run osmo-stp_10.42.42.5(pid=9090): stderr: | [0;m[38;5;43m20221208200738070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200738070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200738070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200738071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200738071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200738071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200738071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:39.516252 run osmo-stp_10.42.42.5(pid=9090): stdout: | (launched: 2022-12-08_20:07:37.897755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:39.639871 run osmo-stp_10.42.42.5(pid=9090): stderr: | [0;m[38;5;43m20221208200738070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200738070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200738070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200738071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200738071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200738071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200738071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:39.787159 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9090): Process ended prematurely: osmo-stp_10.42.42.5(pid=9090) [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9090)] [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 20:07:39.796214 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:07:39.823495 run osmo-hlr_10.42.42.2(pid=9087): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9087)] 20:07:39.872305 run osmo-hlr_10.42.42.2(pid=9087): stdout: | (launched: 2022-12-08_20:07:36.911907) 20:07:39.922547 run osmo-hlr_10.42.42.2(pid=9087): stderr: | [0;m[1;31m20221208200737147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208200737147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208200737147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208200737147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208200737147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208200737147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208200737160 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208200737169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208200737169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208200737169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:07:39.992339 run osmo-msc_10.42.42.6(pid=9093): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9093)] 20:07:40.041100 run osmo-msc_10.42.42.6(pid=9093): stdout: | (launched: 2022-12-08_20:07:38.890436) 20:07:40.091521 run osmo-msc_10.42.42.6(pid=9093): stderr: | [0;m[38;5;43m20221208200739165 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208200739166 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3b9c2f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208200739166 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208200739166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208200739166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208200739166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208200739168 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208200739168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208200739169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208200739169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:07:40.142007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9086): Terminating (SIGTERM) 20:07:40.182449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9089): Terminating (SIGTERM) 20:07:40.222942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9092): Terminating (SIGTERM) 20:07:40.263594 --- ParallelTerminationStrategy: PID 9086 died... 20:07:40.282830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9086): Terminated: ok {rc=0} 20:07:40.328510 --- ParallelTerminationStrategy: PID 9089 died... 20:07:40.347384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9089): Terminated: ok {rc=0} 20:07:40.392307 --- ParallelTerminationStrategy: PID 9092 died... 20:07:40.411199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9092): Terminated: ok {rc=0} 20:07:40.497051 bus /sierra_3: Setting Powered False 20:07:41.596170 bus /sierra_3: Setting Powered False 20:07:42.713317 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 20:07:43.945940 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:07:43.952481 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 20:07:43.974046 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 20:07:44.000930 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 20:07:44.051230 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 20:07:44.071951 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 20:07:44.098940 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 20:07:44.657112 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 20:07:44.706518 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:07:44.717869 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:07:44.772803 tst mo_mt_call.py: using LAC 16499 20:07:44.897389 tst mo_mt_call.py: using RAC 179 20:07:45.019661 tst mo_mt_call.py: using CellId 16499 20:07:45.141954 tst mo_mt_call.py: using BVCI 16500 20:07:45.263314 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:07:45.275152 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:07:45.286741 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:07:45.298374 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:07:45.309861 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:07:45.323444 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:07:45.441036 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:07:45.561999 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:07:46.082837 run create_hlr_db(pid=9098): Launched 20:07:46.209725 bus /sierra_2: Setting Powered False 20:07:47.299698 run create_hlr_db(pid=9098): Terminated: ok {rc=0} 20:07:47.747964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9111): Launched 20:07:48.093796 run osmo-hlr_10.42.42.2(pid=9112): Launched 20:07:48.349974 run osmo-stp_10.42.42.5: Starting osmo-stp 20:07:48.998563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9114): Launched 20:07:49.347538 run osmo-stp_10.42.42.5(pid=9115): Launched 20:07:49.600875 run osmo-msc_10.42.42.6: Starting osmo-msc 20:07:50.289294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9117): Launched 20:07:50.643176 run osmo-msc_10.42.42.6(pid=9119): Launched 20:07:51.017942 run osmo-stp_10.42.42.5(pid=9115): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9115)] 20:07:51.305676 run osmo-stp_10.42.42.5(pid=9115): stdout: | (launched: 2022-12-08_20:07:49.284851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:51.471979 run osmo-stp_10.42.42.5(pid=9115): stderr: | [0;m[38;5;43m20221208200749588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200749588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200749588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200749589 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200749589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200749589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200749589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:51.612519 run osmo-stp_10.42.42.5(pid=9115): stdout: | (launched: 2022-12-08_20:07:49.284851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:51.746103 run osmo-stp_10.42.42.5(pid=9115): stderr: | [0;m[38;5;43m20221208200749588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200749588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200749588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200749589 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200749589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200749589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200749589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:51.906164 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9115): Process ended prematurely: osmo-stp_10.42.42.5(pid=9115) [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9115)] [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 20:07:51.916618 tst mo_mt_call.py:8: Test FAILED (7.2 sec) 20:07:51.946246 run osmo-hlr_10.42.42.2(pid=9112): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9112)] 20:07:51.998526 run osmo-hlr_10.42.42.2(pid=9112): stdout: | (launched: 2022-12-08_20:07:48.032515) 20:07:52.051898 run osmo-hlr_10.42.42.2(pid=9112): stderr: | [0;m[1;31m20221208200748345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208200748345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208200748345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208200748345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208200748345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208200748345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208200748363 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208200748380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208200748380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208200748380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:07:52.126464 run osmo-msc_10.42.42.6(pid=9119): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9119)] 20:07:52.179793 run osmo-msc_10.42.42.6(pid=9119): stdout: | (launched: 2022-12-08_20:07:50.576883) 20:07:52.234165 run osmo-msc_10.42.42.6(pid=9119): stderr: | [0;m[38;5;43m20221208200751086 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208200751087 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f81dcb2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208200751087 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208200751087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208200751087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208200751087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208200751097 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208200751097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208200751097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208200751097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:07:52.288337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9111): Terminating (SIGTERM) 20:07:52.332306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9114): Terminating (SIGTERM) 20:07:52.378220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9117): Terminating (SIGTERM) 20:07:52.423602 --- ParallelTerminationStrategy: PID 9111 died... 20:07:52.444424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9111): Terminated: ok {rc=0} 20:07:52.493667 --- ParallelTerminationStrategy: PID 9114 died... 20:07:52.514284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9114): Terminated: ok {rc=0} 20:07:52.562934 --- ParallelTerminationStrategy: PID 9117 died... 20:07:52.583595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9117): Terminated: ok {rc=0} 20:07:52.674955 bus /sierra_3: Setting Powered False 20:07:53.776075 bus /sierra_3: Setting Powered False 20:07:54.919939 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 20:07:56.118184 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:07:56.131088 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:07:56.195290 tst mo_mt_call_osmux.py: using LAC 16500 20:07:56.337719 tst mo_mt_call_osmux.py: using RAC 180 20:07:56.469676 tst mo_mt_call_osmux.py: using CellId 16500 20:07:56.602149 tst mo_mt_call_osmux.py: using BVCI 16501 20:07:56.728228 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:07:56.740631 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:07:56.752674 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:07:56.764829 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:07:56.777497 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:07:56.789523 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:07:56.916047 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:07:57.045966 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:07:57.579456 run create_hlr_db(pid=9380): Launched 20:07:57.753377 bus /sierra_2: Setting Powered False 20:07:58.816242 run create_hlr_db(pid=9380): Terminated: ok {rc=0} 20:07:59.275867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9382): Launched 20:07:59.611098 run osmo-hlr_10.42.42.2(pid=9383): Launched 20:07:59.851299 run osmo-stp_10.42.42.5: Starting osmo-stp 20:08:00.605782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9385): Launched 20:08:00.956178 run osmo-stp_10.42.42.5(pid=9386): Launched 20:08:01.208329 run osmo-msc_10.42.42.6: Starting osmo-msc 20:08:01.916242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9388): Launched 20:08:02.352488 run osmo-msc_10.42.42.6(pid=9389): Launched 20:08:02.760340 run osmo-stp_10.42.42.5(pid=9386): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9386)] 20:08:03.138218 run osmo-stp_10.42.42.5(pid=9386): stdout: | (launched: 2022-12-08_20:08:00.894523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:03.335580 run osmo-stp_10.42.42.5(pid=9386): stderr: | [0;m[38;5;43m20221208200801241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200801242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200801242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200801242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200801243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200801243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200801243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:03.513526 run osmo-stp_10.42.42.5(pid=9386): stdout: | (launched: 2022-12-08_20:08:00.894523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:03.697749 run osmo-stp_10.42.42.5(pid=9386): stderr: | [0;m[38;5;43m20221208200801241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200801242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200801242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200801242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200801243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200801243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200801243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:03.852414 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9386): Process ended prematurely: osmo-stp_10.42.42.5(pid=9386) [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9386)] [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 20:08:03.862460 tst mo_mt_call_osmux.py:8: Test FAILED (7.8 sec) 20:08:03.893289 run osmo-hlr_10.42.42.2(pid=9383): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9383)] 20:08:03.946037 run osmo-hlr_10.42.42.2(pid=9383): stdout: | (launched: 2022-12-08_20:07:59.550915) 20:08:03.999855 run osmo-hlr_10.42.42.2(pid=9383): stderr: | [0;m[1;31m20221208200759897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208200759897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208200759897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208200759897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208200759897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208200759897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208200759932 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208200759945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208200759945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208200759946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:08:04.074060 run osmo-msc_10.42.42.6(pid=9389): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9389)] 20:08:04.125536 run osmo-msc_10.42.42.6(pid=9389): stdout: | (launched: 2022-12-08_20:08:02.277375) 20:08:04.180901 run osmo-msc_10.42.42.6(pid=9389): stderr: | [0;m[38;5;43m20221208200802797 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208200802797 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6ca94a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208200802797 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208200802797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208200802797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208200802798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208200802799 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208200802800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208200802800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208200802800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:08:04.235141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9382): Terminating (SIGTERM) 20:08:04.279688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9385): Terminating (SIGTERM) 20:08:04.325429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9388): Terminating (SIGTERM) 20:08:04.372086 --- ParallelTerminationStrategy: PID 9382 died... 20:08:04.392672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9382): Terminated: ok {rc=0} 20:08:04.442797 --- ParallelTerminationStrategy: PID 9385 died... 20:08:04.462832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9385): Terminated: ok {rc=0} 20:08:04.511795 --- ParallelTerminationStrategy: PID 9388 died... 20:08:04.533038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9388): Terminated: ok {rc=0} 20:08:04.623824 bus /sierra_3: Setting Powered False 20:08:05.724272 bus /sierra_3: Setting Powered False 20:08:06.844601 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 20:08:08.094631 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:08:08.101712 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 20:08:08.124131 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 20:08:08.155665 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 20:08:08.208284 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 20:08:08.231575 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 20:08:08.261362 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 20:08:08.814838 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 20:08:08.870457 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:08.883371 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:08:08.941511 tst mo_mt_call.py: using LAC 16501 20:08:09.074917 tst mo_mt_call.py: using RAC 181 20:08:09.208310 tst mo_mt_call.py: using CellId 16501 20:08:09.342595 tst mo_mt_call.py: using BVCI 16502 20:08:09.470237 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:09.482912 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:09.495678 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:09.508120 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:09.520432 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:09.534381 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:08:09.663718 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:08:09.792829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:08:10.315943 run create_hlr_db(pid=9395): Launched 20:08:10.452245 bus /sierra_2: Setting Powered False 20:08:11.517712 run create_hlr_db(pid=9395): Terminated: ok {rc=0} 20:08:11.962806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9397): Launched 20:08:12.275610 run osmo-hlr_10.42.42.2(pid=9398): Launched 20:08:12.395435 run osmo-stp_10.42.42.5: Starting osmo-stp 20:08:12.949207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9400): Launched 20:08:13.262004 run osmo-stp_10.42.42.5(pid=9401): Launched 20:08:13.382840 run osmo-msc_10.42.42.6: Starting osmo-msc 20:08:13.943042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9403): Launched 20:08:14.256654 run osmo-msc_10.42.42.6(pid=9404): Launched 20:08:14.431635 run osmo-stp_10.42.42.5(pid=9401): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9401)] 20:08:14.562913 run osmo-stp_10.42.42.5(pid=9401): stdout: | (launched: 2022-12-08_20:08:13.203708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:14.694343 run osmo-stp_10.42.42.5(pid=9401): stderr: | [0;m[38;5;43m20221208200813377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200813378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200813378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200813378 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200813379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200813379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200813379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:14.824254 run osmo-stp_10.42.42.5(pid=9401): stdout: | (launched: 2022-12-08_20:08:13.203708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:14.947393 run osmo-stp_10.42.42.5(pid=9401): stderr: | [0;m[38;5;43m20221208200813377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200813378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200813378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200813378 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200813379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200813379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200813379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:15.095156 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9401): Process ended prematurely: osmo-stp_10.42.42.5(pid=9401) [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9401)] [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 20:08:15.104056 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:08:15.131319 run osmo-hlr_10.42.42.2(pid=9398): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9398)] 20:08:15.180400 run osmo-hlr_10.42.42.2(pid=9398): stdout: | (launched: 2022-12-08_20:08:12.217320) 20:08:15.230795 run osmo-hlr_10.42.42.2(pid=9398): stderr: | [0;m[1;31m20221208200812397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208200812397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208200812397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208200812397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208200812397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208200812397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208200812412 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208200812423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208200812423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208200812423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:08:15.301040 run osmo-msc_10.42.42.6(pid=9404): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9404)] 20:08:15.349993 run osmo-msc_10.42.42.6(pid=9404): stdout: | (launched: 2022-12-08_20:08:14.198250) 20:08:15.400536 run osmo-msc_10.42.42.6(pid=9404): stderr: | [0;m[38;5;43m20221208200814472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208200814472 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f841679fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208200814472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208200814472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208200814472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208200814472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208200814474 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208200814474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208200814475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208200814475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:08:15.451571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9397): Terminating (SIGTERM) 20:08:15.492243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9400): Terminating (SIGTERM) 20:08:15.532516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9403): Terminating (SIGTERM) 20:08:15.573086 --- ParallelTerminationStrategy: PID 9397 died... 20:08:15.592386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9397): Terminated: ok {rc=0} 20:08:15.637773 --- ParallelTerminationStrategy: PID 9400 died... 20:08:15.656670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9400): Terminated: ok {rc=0} 20:08:15.701854 --- ParallelTerminationStrategy: PID 9403 died... 20:08:15.720693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9403): Terminated: ok {rc=0} 20:08:15.805844 bus /sierra_3: Setting Powered False 20:08:16.911663 bus /sierra_3: Setting Powered False 20:08:18.032080 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 20:08:19.180274 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:19.192349 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:08:19.249802 tst mo_mt_call_osmux.py: using LAC 16502 20:08:19.370712 tst mo_mt_call_osmux.py: using RAC 182 20:08:19.493170 tst mo_mt_call_osmux.py: using CellId 16502 20:08:19.614093 tst mo_mt_call_osmux.py: using BVCI 16503 20:08:19.728282 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:19.739541 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:19.750618 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:19.761882 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:19.773067 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:19.784291 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:08:19.905971 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:08:20.025567 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:08:20.509351 run create_hlr_db(pid=9406): Launched 20:08:20.628392 bus /sierra_2: Setting Powered False 20:08:21.689913 run create_hlr_db(pid=9406): Terminated: ok {rc=0} 20:08:22.144281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9408): Launched 20:08:22.477681 run osmo-hlr_10.42.42.2(pid=9409): Launched 20:08:22.604301 run osmo-stp_10.42.42.5: Starting osmo-stp 20:08:23.176552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9411): Launched 20:08:23.510237 run osmo-stp_10.42.42.5(pid=9412): Launched 20:08:23.635909 run osmo-msc_10.42.42.6: Starting osmo-msc 20:08:24.236241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9414): Launched 20:08:24.570386 run osmo-msc_10.42.42.6(pid=9415): Launched 20:08:24.754639 run osmo-stp_10.42.42.5(pid=9412): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9412)] 20:08:24.895072 run osmo-stp_10.42.42.5(pid=9412): stdout: | (launched: 2022-12-08_20:08:23.447847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:25.035901 run osmo-stp_10.42.42.5(pid=9412): stderr: | [0;m[38;5;43m20221208200823643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200823643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200823643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200823644 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200823644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200823644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200823644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:25.174738 run osmo-stp_10.42.42.5(pid=9412): stdout: | (launched: 2022-12-08_20:08:23.447847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:25.306074 run osmo-stp_10.42.42.5(pid=9412): stderr: | [0;m[38;5;43m20221208200823643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200823643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200823643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200823644 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200823644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200823644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200823644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:25.463493 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9412): Process ended prematurely: osmo-stp_10.42.42.5(pid=9412) [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9412)] [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 20:08:25.473129 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:08:25.501298 run osmo-hlr_10.42.42.2(pid=9409): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9409)] 20:08:25.552038 run osmo-hlr_10.42.42.2(pid=9409): stdout: | (launched: 2022-12-08_20:08:22.415761) 20:08:25.604479 run osmo-hlr_10.42.42.2(pid=9409): stderr: | [0;m[1;31m20221208200822617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208200822617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208200822617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208200822617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208200822617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208200822617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208200822630 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208200822638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208200822638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208200822638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:08:25.677285 run osmo-msc_10.42.42.6(pid=9415): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9415)] 20:08:25.727800 run osmo-msc_10.42.42.6(pid=9415): stdout: | (launched: 2022-12-08_20:08:24.507653) 20:08:25.780440 run osmo-msc_10.42.42.6(pid=9415): stderr: | [0;m[38;5;43m20221208200824836 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208200824836 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fad6cd6dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208200824837 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208200824837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208200824837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208200824837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208200824839 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208200824839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208200824839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208200824839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:08:25.833226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9408): Terminating (SIGTERM) 20:08:25.875570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9411): Terminating (SIGTERM) 20:08:25.918018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9414): Terminating (SIGTERM) 20:08:25.960534 --- ParallelTerminationStrategy: PID 9408 died... 20:08:25.981124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9408): Terminated: ok {rc=0} 20:08:26.028054 --- ParallelTerminationStrategy: PID 9411 died... 20:08:26.047636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9411): Terminated: ok {rc=0} 20:08:26.094249 --- ParallelTerminationStrategy: PID 9414 died... 20:08:26.113890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9414): Terminated: ok {rc=0} 20:08:26.202189 bus /sierra_3: Setting Powered False 20:08:27.301482 bus /sierra_3: Setting Powered False 20:08:28.419087 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 20:08:29.657485 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:08:29.664044 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 20:08:29.684796 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 20:08:29.713243 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 20:08:29.764776 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 20:08:29.785467 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 20:08:29.812436 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 20:08:30.363117 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 20:08:30.412935 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:30.423997 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:08:30.479679 tst mo_mt_call.py: using LAC 16503 20:08:30.602508 tst mo_mt_call.py: using RAC 183 20:08:30.725703 tst mo_mt_call.py: using CellId 16503 20:08:30.856615 tst mo_mt_call.py: using BVCI 16504 20:08:30.983180 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:30.995448 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:31.007488 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:31.020233 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:31.033079 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:31.045942 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:08:31.172819 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:08:31.290817 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:08:31.827080 run create_hlr_db(pid=9420): Launched 20:08:31.998611 bus /sierra_2: Setting Powered False 20:08:33.063808 run create_hlr_db(pid=9420): Terminated: ok {rc=0} 20:08:33.509875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9422): Launched 20:08:33.822512 run osmo-hlr_10.42.42.2(pid=9423): Launched 20:08:33.940085 run osmo-stp_10.42.42.5: Starting osmo-stp 20:08:34.477173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9425): Launched 20:08:34.789302 run osmo-stp_10.42.42.5(pid=9426): Launched 20:08:34.907378 run osmo-msc_10.42.42.6: Starting osmo-msc 20:08:35.467826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9428): Launched 20:08:35.779782 run osmo-msc_10.42.42.6(pid=9429): Launched 20:08:35.952879 run osmo-stp_10.42.42.5(pid=9426): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9426)] 20:08:36.085488 run osmo-stp_10.42.42.5(pid=9426): stdout: | (launched: 2022-12-08_20:08:34.730476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:36.216608 run osmo-stp_10.42.42.5(pid=9426): stderr: | [0;m[38;5;43m20221208200834905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200834905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200834905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200834906 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200834906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200834906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200834906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:36.346129 run osmo-stp_10.42.42.5(pid=9426): stdout: | (launched: 2022-12-08_20:08:34.730476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:36.469241 run osmo-stp_10.42.42.5(pid=9426): stderr: | [0;m[38;5;43m20221208200834905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200834905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200834905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200834906 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200834906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200834906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200834906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:36.616495 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9426): Process ended prematurely: osmo-stp_10.42.42.5(pid=9426) [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9426)] [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 20:08:36.625433 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:08:36.652120 run osmo-hlr_10.42.42.2(pid=9423): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9423)] 20:08:36.700893 run osmo-hlr_10.42.42.2(pid=9423): stdout: | (launched: 2022-12-08_20:08:33.763491) 20:08:36.751126 run osmo-hlr_10.42.42.2(pid=9423): stderr: | [0;m[1;31m20221208200833944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208200833945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208200833945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208200833945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208200833945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208200833945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208200833957 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208200833966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208200833967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208200833967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:08:36.821239 run osmo-msc_10.42.42.6(pid=9429): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9429)] 20:08:36.869622 run osmo-msc_10.42.42.6(pid=9429): stdout: | (launched: 2022-12-08_20:08:35.721106) 20:08:36.919646 run osmo-msc_10.42.42.6(pid=9429): stderr: | [0;m[38;5;43m20221208200835997 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208200835998 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8be12aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208200835998 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208200835998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208200835998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208200835998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208200836000 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208200836000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208200836000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208200836000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:08:36.970185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9422): Terminating (SIGTERM) 20:08:37.010570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9425): Terminating (SIGTERM) 20:08:37.050642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9428): Terminating (SIGTERM) 20:08:37.090928 --- ParallelTerminationStrategy: PID 9422 died... 20:08:37.110238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9422): Terminated: ok {rc=0} 20:08:37.155316 --- ParallelTerminationStrategy: PID 9425 died... 20:08:37.174072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9425): Terminated: ok {rc=0} 20:08:37.218991 --- ParallelTerminationStrategy: PID 9428 died... 20:08:37.237718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9428): Terminated: ok {rc=0} 20:08:37.325919 bus /sierra_3: Setting Powered False 20:08:38.425733 bus /sierra_3: Setting Powered False 20:08:39.541815 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 20:08:40.690458 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:40.702391 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:08:40.758444 tst mo_mt_call_osmux.py: using LAC 16504 20:08:40.881571 tst mo_mt_call_osmux.py: using RAC 184 20:08:41.014434 tst mo_mt_call_osmux.py: using CellId 16504 20:08:41.144774 tst mo_mt_call_osmux.py: using BVCI 16505 20:08:41.265989 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:41.277742 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:41.289349 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:41.300809 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:41.312252 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:41.323860 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:08:41.441553 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:08:41.563224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:08:42.080410 run create_hlr_db(pid=9431): Launched 20:08:42.215001 bus /sierra_2: Setting Powered False 20:08:43.279658 run create_hlr_db(pid=9431): Terminated: ok {rc=0} 20:08:43.742603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9433): Launched 20:08:44.075745 run osmo-hlr_10.42.42.2(pid=9434): Launched 20:08:44.200940 run osmo-stp_10.42.42.5: Starting osmo-stp 20:08:44.773252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9436): Launched 20:08:45.107339 run osmo-stp_10.42.42.5(pid=9437): Launched 20:08:45.232297 run osmo-msc_10.42.42.6: Starting osmo-msc 20:08:45.833690 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9439): Launched 20:08:46.189849 run osmo-msc_10.42.42.6(pid=9440): Launched 20:08:46.572150 run osmo-stp_10.42.42.5(pid=9437): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9437)] 20:08:46.812198 run osmo-stp_10.42.42.5(pid=9437): stdout: | (launched: 2022-12-08_20:08:45.045049) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:46.947187 run osmo-stp_10.42.42.5(pid=9437): stderr: | [0;m[38;5;43m20221208200845241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200845241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200845242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200845242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200845243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200845243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200845243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:47.081877 run osmo-stp_10.42.42.5(pid=9437): stdout: | (launched: 2022-12-08_20:08:45.045049) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:47.211596 run osmo-stp_10.42.42.5(pid=9437): stderr: | [0;m[38;5;43m20221208200845241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200845241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200845242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200845242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200845243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200845243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200845243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:47.365651 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9437): Process ended prematurely: osmo-stp_10.42.42.5(pid=9437) [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9437)] [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 20:08:47.375567 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 20:08:47.405689 run osmo-hlr_10.42.42.2(pid=9434): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9434)] 20:08:47.457495 run osmo-hlr_10.42.42.2(pid=9434): stdout: | (launched: 2022-12-08_20:08:44.013216) 20:08:47.510147 run osmo-hlr_10.42.42.2(pid=9434): stderr: | [0;m[1;31m20221208200844218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208200844218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208200844218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208200844218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208200844218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208200844218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208200844290 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208200844300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208200844300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208200844300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:08:47.583261 run osmo-msc_10.42.42.6(pid=9440): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9440)] 20:08:47.634150 run osmo-msc_10.42.42.6(pid=9440): stdout: | (launched: 2022-12-08_20:08:46.123985) 20:08:47.686965 run osmo-msc_10.42.42.6(pid=9440): stderr: | [0;m[38;5;43m20221208200846499 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208200846499 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f300d053c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208200846500 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208200846500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208200846500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208200846500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208200846502 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208200846503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208200846503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208200846503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:08:47.739724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9433): Terminating (SIGTERM) 20:08:47.782434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9436): Terminating (SIGTERM) 20:08:47.825286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9439): Terminating (SIGTERM) 20:08:47.868032 --- ParallelTerminationStrategy: PID 9433 died... 20:08:47.888382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9433): Terminated: ok {rc=0} 20:08:47.935329 --- ParallelTerminationStrategy: PID 9436 died... 20:08:47.955301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9436): Terminated: ok {rc=0} 20:08:48.002498 --- ParallelTerminationStrategy: PID 9439 died... 20:08:48.022286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9439): Terminated: ok {rc=0} 20:08:48.112403 bus /sierra_3: Setting Powered False 20:08:49.213670 bus /sierra_3: Setting Powered False 20:08:50.330454 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 20:08:51.576216 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:08:51.584106 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 20:08:51.605047 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 20:08:51.633490 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 20:08:51.685217 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 20:08:51.707023 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 20:08:51.734642 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 20:08:52.288182 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 20:08:52.341662 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:08:52.353534 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:08:52.411158 tst mo_mt_call.py: using LAC 16505 20:08:52.541836 tst mo_mt_call.py: using RAC 185 20:08:52.672771 tst mo_mt_call.py: using CellId 16505 20:08:52.802994 tst mo_mt_call.py: using BVCI 16506 20:08:52.923749 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:08:52.935450 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:08:52.947095 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:08:52.958714 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:08:52.970358 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:08:52.982442 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:08:53.101824 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:08:53.219743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:08:53.700870 run create_hlr_db(pid=9446): Launched 20:08:53.819350 bus /sierra_2: Setting Powered False 20:08:54.880649 run create_hlr_db(pid=9446): Terminated: ok {rc=0} 20:08:55.314660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9448): Launched 20:08:55.626401 run osmo-hlr_10.42.42.2(pid=9449): Launched 20:08:55.744898 run osmo-stp_10.42.42.5: Starting osmo-stp 20:08:56.294866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9451): Launched 20:08:56.608209 run osmo-stp_10.42.42.5(pid=9452): Launched 20:08:56.726703 run osmo-msc_10.42.42.6: Starting osmo-msc 20:08:57.290404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9454): Launched 20:08:57.602804 run osmo-msc_10.42.42.6(pid=9455): Launched 20:08:57.776789 run osmo-stp_10.42.42.5(pid=9452): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9452)] 20:08:57.908938 run osmo-stp_10.42.42.5(pid=9452): stdout: | (launched: 2022-12-08_20:08:56.549231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:58.040569 run osmo-stp_10.42.42.5(pid=9452): stderr: | [0;m[38;5;43m20221208200856722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200856722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200856722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200856723 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200856723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200856723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200856723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:58.170345 run osmo-stp_10.42.42.5(pid=9452): stdout: | (launched: 2022-12-08_20:08:56.549231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:58.293512 run osmo-stp_10.42.42.5(pid=9452): stderr: | [0;m[38;5;43m20221208200856722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200856722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200856722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200856723 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200856723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200856723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200856723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:58.440733 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9452): Process ended prematurely: osmo-stp_10.42.42.5(pid=9452) [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9452)] [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 20:08:58.449600 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 20:08:58.476543 run osmo-hlr_10.42.42.2(pid=9449): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9449)] 20:08:58.525223 run osmo-hlr_10.42.42.2(pid=9449): stdout: | (launched: 2022-12-08_20:08:55.567647) 20:08:58.576737 run osmo-hlr_10.42.42.2(pid=9449): stderr: | [0;m[1;31m20221208200855748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208200855749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208200855749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208200855749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208200855749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208200855749 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208200855765 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208200855774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208200855774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208200855775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:08:58.649187 run osmo-msc_10.42.42.6(pid=9455): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9455)] 20:08:58.698833 run osmo-msc_10.42.42.6(pid=9455): stdout: | (launched: 2022-12-08_20:08:57.544012) 20:08:58.757309 run osmo-msc_10.42.42.6(pid=9455): stderr: | [0;m[38;5;43m20221208200857820 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208200857820 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3716757c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208200857820 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208200857820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208200857821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208200857821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208200857823 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208200857823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208200857823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208200857823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:08:58.811038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9448): Terminating (SIGTERM) 20:08:58.852856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9451): Terminating (SIGTERM) 20:08:58.893261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9454): Terminating (SIGTERM) 20:08:58.934000 --- ParallelTerminationStrategy: PID 9448 died... 20:08:58.953400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9448): Terminated: ok {rc=0} 20:08:58.999182 --- ParallelTerminationStrategy: PID 9451 died... 20:08:59.018154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9451): Terminated: ok {rc=0} 20:08:59.063664 --- ParallelTerminationStrategy: PID 9454 died... 20:08:59.082790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9454): Terminated: ok {rc=0} 20:08:59.171183 bus /sierra_3: Setting Powered False 20:09:00.271045 bus /sierra_3: Setting Powered False 20:09:01.400719 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 20:09:02.567772 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:09:02.580433 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:09:02.644588 tst mo_mt_call_osmux.py: using LAC 16506 20:09:02.775741 tst mo_mt_call_osmux.py: using RAC 186 20:09:02.904265 tst mo_mt_call_osmux.py: using CellId 16506 20:09:03.033406 tst mo_mt_call_osmux.py: using BVCI 16507 20:09:03.154736 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:09:03.166687 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:09:03.178472 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:09:03.190361 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:09:03.202335 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:09:03.214270 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:09:03.331742 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:09:03.453382 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:09:03.934168 run create_hlr_db(pid=9474): Launched 20:09:04.053229 bus /sierra_2: Setting Powered False 20:09:05.114801 run create_hlr_db(pid=9474): Terminated: ok {rc=0} 20:09:05.568284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9476): Launched 20:09:05.900160 run osmo-hlr_10.42.42.2(pid=9477): Launched 20:09:06.025958 run osmo-stp_10.42.42.5: Starting osmo-stp 20:09:06.598627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9479): Launched 20:09:06.931816 run osmo-stp_10.42.42.5(pid=9480): Launched 20:09:07.058065 run osmo-msc_10.42.42.6: Starting osmo-msc 20:09:07.658308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9482): Launched 20:09:07.992501 run osmo-msc_10.42.42.6(pid=9483): Launched 20:09:08.179090 run osmo-stp_10.42.42.5(pid=9480): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9480)] 20:09:08.318495 run osmo-stp_10.42.42.5(pid=9480): stdout: | (launched: 2022-12-08_20:09:06.869803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:08.458470 run osmo-stp_10.42.42.5(pid=9480): stderr: | [0;m[38;5;43m20221208200907066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200907066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200907066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200907067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200907067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200907067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200907067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:08.597610 run osmo-stp_10.42.42.5(pid=9480): stdout: | (launched: 2022-12-08_20:09:06.869803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:08.729206 run osmo-stp_10.42.42.5(pid=9480): stderr: | [0;m[38;5;43m20221208200907066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200907066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200907066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200907067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200907067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200907067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200907067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:08.886268 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9480): Process ended prematurely: osmo-stp_10.42.42.5(pid=9480) [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9480)] [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 20:09:08.895936 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 20:09:08.923973 run osmo-hlr_10.42.42.2(pid=9477): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9477)] 20:09:08.974899 run osmo-hlr_10.42.42.2(pid=9477): stdout: | (launched: 2022-12-08_20:09:05.838173) 20:09:09.027382 run osmo-hlr_10.42.42.2(pid=9477): stderr: | [0;m[1;31m20221208200906041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208200906041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208200906041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208200906041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208200906041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208200906041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208200906054 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208200906062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208200906062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208200906062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:09:09.100277 run osmo-msc_10.42.42.6(pid=9483): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9483)] 20:09:09.151455 run osmo-msc_10.42.42.6(pid=9483): stdout: | (launched: 2022-12-08_20:09:07.930105) 20:09:09.204226 run osmo-msc_10.42.42.6(pid=9483): stderr: | [0;m[38;5;43m20221208200908257 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208200908257 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faadc418c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208200908257 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208200908257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208200908257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208200908258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208200908259 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208200908260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208200908260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208200908260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:09:09.256907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9476): Terminating (SIGTERM) 20:09:09.299025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9479): Terminating (SIGTERM) 20:09:09.341079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9482): Terminating (SIGTERM) 20:09:09.383425 --- ParallelTerminationStrategy: PID 9476 died... 20:09:09.403587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9476): Terminated: ok {rc=0} 20:09:09.450305 --- ParallelTerminationStrategy: PID 9479 died... 20:09:09.470036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9479): Terminated: ok {rc=0} 20:09:09.516188 --- ParallelTerminationStrategy: PID 9482 died... 20:09:09.535887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9482): Terminated: ok {rc=0} 20:09:09.623695 bus /sierra_3: Setting Powered False 20:09:10.723732 bus /sierra_3: Setting Powered False 20:09:11.841727 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:09:13.079389 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:09:13.086540 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:09:13.108893 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 20:09:13.136568 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:09:13.190574 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:09:13.212315 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 20:09:13.240022 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:09:13.792351 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 20:09:13.845245 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:13.857248 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:09:13.915578 tst mo_mt_call.py: using LAC 16507 20:09:14.045447 tst mo_mt_call.py: using RAC 187 20:09:14.169362 tst mo_mt_call.py: using CellId 16507 20:09:14.290696 tst mo_mt_call.py: using BVCI 16508 20:09:14.404900 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:14.416180 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:14.427206 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:14.438448 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:14.449712 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:14.461039 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:09:14.585141 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:09:14.705308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:09:15.223968 run create_hlr_db(pid=9488): Launched 20:09:15.358418 bus /sierra_2: Setting Powered False 20:09:16.426732 run create_hlr_db(pid=9488): Terminated: ok {rc=0} 20:09:16.879305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9490): Launched 20:09:17.210207 run osmo-hlr_10.42.42.2(pid=9491): Launched 20:09:17.331595 run osmo-stp_10.42.42.5: Starting osmo-stp 20:09:17.906562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9493): Launched 20:09:18.240808 run osmo-stp_10.42.42.5(pid=9494): Launched 20:09:18.366376 run osmo-msc_10.42.42.6: Starting osmo-msc 20:09:18.967704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9496): Launched 20:09:19.302533 run osmo-msc_10.42.42.6(pid=9497): Launched 20:09:19.489205 run osmo-stp_10.42.42.5(pid=9494): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9494)] 20:09:19.628551 run osmo-stp_10.42.42.5(pid=9494): stdout: | (launched: 2022-12-08_20:09:18.177980) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:19.768752 run osmo-stp_10.42.42.5(pid=9494): stderr: | [0;m[38;5;43m20221208200918374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200918375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200918375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200918375 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200918376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200918376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200918376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:19.908657 run osmo-stp_10.42.42.5(pid=9494): stdout: | (launched: 2022-12-08_20:09:18.177980) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:20.040849 run osmo-stp_10.42.42.5(pid=9494): stderr: | [0;m[38;5;43m20221208200918374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200918375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200918375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200918375 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200918376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200918376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200918376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:20.199236 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9494): Process ended prematurely: osmo-stp_10.42.42.5(pid=9494) [trial-2349↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9494)] [trial-2349↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 20:09:20.209063 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:09:20.237035 run osmo-hlr_10.42.42.2(pid=9491): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9491)] 20:09:20.287543 run osmo-hlr_10.42.42.2(pid=9491): stdout: | (launched: 2022-12-08_20:09:17.150815) 20:09:20.340004 run osmo-hlr_10.42.42.2(pid=9491): stderr: | [0;m[1;31m20221208200917328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208200917328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208200917328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208200917328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208200917328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208200917328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208200917341 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208200917349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208200917349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208200917349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:09:20.412562 run osmo-msc_10.42.42.6(pid=9497): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9497)] 20:09:20.463470 run osmo-msc_10.42.42.6(pid=9497): stdout: | (launched: 2022-12-08_20:09:19.239622) 20:09:20.515456 run osmo-msc_10.42.42.6(pid=9497): stderr: | [0;m[38;5;43m20221208200919569 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208200919569 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe72d7c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208200919569 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208200919569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208200919569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208200919570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208200919571 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208200919572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208200919572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208200919572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:09:20.567837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9490): Terminating (SIGTERM) 20:09:20.609812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9493): Terminating (SIGTERM) 20:09:20.651982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9496): Terminating (SIGTERM) 20:09:20.694682 --- ParallelTerminationStrategy: PID 9490 died... 20:09:20.714842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9490): Terminated: ok {rc=0} 20:09:20.761376 --- ParallelTerminationStrategy: PID 9493 died... 20:09:20.781328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9493): Terminated: ok {rc=0} 20:09:20.828281 --- ParallelTerminationStrategy: PID 9496 died... 20:09:20.848352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9496): Terminated: ok {rc=0} 20:09:20.938067 bus /sierra_3: Setting Powered False 20:09:22.035730 bus /sierra_3: Setting Powered False 20:09:23.153808 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 20:09:24.306005 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:24.318716 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:09:24.378678 tst mo_mt_call_osmux.py: using LAC 16508 20:09:24.510311 tst mo_mt_call_osmux.py: using RAC 188 20:09:24.632742 tst mo_mt_call_osmux.py: using CellId 16508 20:09:24.753778 tst mo_mt_call_osmux.py: using BVCI 16509 20:09:24.867004 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:24.878286 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:24.889534 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:24.901349 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:24.913190 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:24.925660 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:09:25.045290 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:09:25.164741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:09:25.648022 run create_hlr_db(pid=9500): Launched 20:09:25.766122 bus /sierra_2: Setting Powered False 20:09:26.828685 run create_hlr_db(pid=9500): Terminated: ok {rc=0} 20:09:27.262704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9502): Launched 20:09:27.575594 run osmo-hlr_10.42.42.2(pid=9503): Launched 20:09:27.695096 run osmo-stp_10.42.42.5: Starting osmo-stp 20:09:28.233288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9505): Launched 20:09:28.567078 run osmo-stp_10.42.42.5(pid=9506): Launched 20:09:28.693161 run osmo-msc_10.42.42.6: Starting osmo-msc 20:09:29.294175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9508): Launched 20:09:29.627321 run osmo-msc_10.42.42.6(pid=9509): Launched 20:09:29.812517 run osmo-stp_10.42.42.5(pid=9506): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9506)] 20:09:29.951394 run osmo-stp_10.42.42.5(pid=9506): stdout: | (launched: 2022-12-08_20:09:28.503780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:30.091598 run osmo-stp_10.42.42.5(pid=9506): stderr: | [0;m[38;5;43m20221208200928699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200928699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200928700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200928700 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200928702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200928703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200928703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:30.230960 run osmo-stp_10.42.42.5(pid=9506): stdout: | (launched: 2022-12-08_20:09:28.503780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:30.362415 run osmo-stp_10.42.42.5(pid=9506): stderr: | [0;m[38;5;43m20221208200928699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200928699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200928700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200928700 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200928702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200928703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200928703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:30.519682 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9506): Process ended prematurely: osmo-stp_10.42.42.5(pid=9506) [trial-2349↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9506)] [trial-2349↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 20:09:30.529460 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:09:30.557660 run osmo-hlr_10.42.42.2(pid=9503): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9503)] 20:09:30.608380 run osmo-hlr_10.42.42.2(pid=9503): stdout: | (launched: 2022-12-08_20:09:27.516597) 20:09:30.660794 run osmo-hlr_10.42.42.2(pid=9503): stderr: | [0;m[1;31m20221208200927696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208200927696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208200927696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208200927696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208200927696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208200927696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208200927708 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208200927716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208200927716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208200927716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:09:30.733480 run osmo-msc_10.42.42.6(pid=9509): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9509)] 20:09:30.784118 run osmo-msc_10.42.42.6(pid=9509): stdout: | (launched: 2022-12-08_20:09:29.564739) 20:09:30.847394 run osmo-msc_10.42.42.6(pid=9509): stderr: | [0;m[38;5;43m20221208200929892 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208200929892 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f29fb923c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208200929892 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208200929892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208200929892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208200929892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208200929894 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208200929895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208200929895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208200929895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:09:30.910478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9502): Terminating (SIGTERM) 20:09:30.953120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9505): Terminating (SIGTERM) 20:09:30.995925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9508): Terminating (SIGTERM) 20:09:31.039030 --- ParallelTerminationStrategy: PID 9502 died... 20:09:31.059374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9502): Terminated: ok {rc=0} 20:09:31.107351 --- ParallelTerminationStrategy: PID 9505 died... 20:09:31.127454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9505): Terminated: ok {rc=0} 20:09:31.174761 --- ParallelTerminationStrategy: PID 9508 died... 20:09:31.194929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9508): Terminated: ok {rc=0} 20:09:31.285926 bus /sierra_3: Setting Powered False 20:09:32.386199 bus /sierra_3: Setting Powered False 20:09:33.501922 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:09:34.743614 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:09:34.749862 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:09:34.771780 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 20:09:34.799843 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 20:09:34.854360 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:09:34.876159 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 20:09:34.903970 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 20:09:35.454124 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 20:09:35.507250 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:35.518865 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:09:35.577819 tst mo_mt_call.py: using LAC 16509 20:09:35.710641 tst mo_mt_call.py: using RAC 189 20:09:35.839636 tst mo_mt_call.py: using CellId 16509 20:09:35.967670 tst mo_mt_call.py: using BVCI 16510 20:09:36.082038 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:36.093457 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:36.104316 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:36.115722 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:36.127278 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:36.138340 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:09:36.258738 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:09:36.379380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:09:36.862642 run create_hlr_db(pid=9514): Launched 20:09:36.980865 bus /sierra_2: Setting Powered False 20:09:38.042669 run create_hlr_db(pid=9514): Terminated: ok {rc=0} 20:09:38.498782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9516): Launched 20:09:38.832608 run osmo-hlr_10.42.42.2(pid=9517): Launched 20:09:38.958885 run osmo-stp_10.42.42.5: Starting osmo-stp 20:09:39.537134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9519): Launched 20:09:39.871443 run osmo-stp_10.42.42.5(pid=9520): Launched 20:09:40.001636 run osmo-msc_10.42.42.6: Starting osmo-msc 20:09:40.603055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9522): Launched 20:09:40.936560 run osmo-msc_10.42.42.6(pid=9523): Launched 20:09:41.120880 run osmo-stp_10.42.42.5(pid=9520): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9520)] 20:09:41.260447 run osmo-stp_10.42.42.5(pid=9520): stdout: | (launched: 2022-12-08_20:09:39.809145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:41.400666 run osmo-stp_10.42.42.5(pid=9520): stderr: | [0;m[38;5;43m20221208200940004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200940004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200940005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200940005 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200940006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200940006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200940006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:41.540362 run osmo-stp_10.42.42.5(pid=9520): stdout: | (launched: 2022-12-08_20:09:39.809145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:41.671983 run osmo-stp_10.42.42.5(pid=9520): stderr: | [0;m[38;5;43m20221208200940004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200940004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200940005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200940005 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200940006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200940006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200940006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:41.831538 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9520): Process ended prematurely: osmo-stp_10.42.42.5(pid=9520) [trial-2349↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9520)] [trial-2349↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 20:09:41.840734 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:09:41.868351 run osmo-hlr_10.42.42.2(pid=9517): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9517)] 20:09:41.916926 run osmo-hlr_10.42.42.2(pid=9517): stdout: | (launched: 2022-12-08_20:09:38.770187) 20:09:41.967276 run osmo-hlr_10.42.42.2(pid=9517): stderr: | [0;m[1;31m20221208200938971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208200938971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208200938971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208200938971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208200938971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208200938971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208200938984 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208200938992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208200938992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208200938993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:09:42.037141 run osmo-msc_10.42.42.6(pid=9523): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9523)] 20:09:42.085433 run osmo-msc_10.42.42.6(pid=9523): stdout: | (launched: 2022-12-08_20:09:40.873995) 20:09:42.135602 run osmo-msc_10.42.42.6(pid=9523): stderr: | [0;m[38;5;43m20221208200941202 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208200941202 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f47096d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208200941202 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208200941202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208200941202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208200941203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208200941204 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208200941205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208200941205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208200941205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:09:42.185764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9516): Terminating (SIGTERM) 20:09:42.226023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9519): Terminating (SIGTERM) 20:09:42.266398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9522): Terminating (SIGTERM) 20:09:42.307121 --- ParallelTerminationStrategy: PID 9516 died... 20:09:42.326437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9516): Terminated: ok {rc=0} 20:09:42.371741 --- ParallelTerminationStrategy: PID 9519 died... 20:09:42.390629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9519): Terminated: ok {rc=0} 20:09:42.435452 --- ParallelTerminationStrategy: PID 9522 died... 20:09:42.454333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9522): Terminated: ok {rc=0} 20:09:42.539519 bus /sierra_3: Setting Powered False 20:09:43.635596 bus /sierra_3: Setting Powered False 20:09:44.752002 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 20:09:45.930484 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:45.943402 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:09:46.010987 tst mo_mt_call_osmux.py: using LAC 16510 20:09:46.177549 tst mo_mt_call_osmux.py: using RAC 190 20:09:46.301005 tst mo_mt_call_osmux.py: using CellId 16510 20:09:46.426241 tst mo_mt_call_osmux.py: using BVCI 16511 20:09:46.579800 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:46.594270 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:46.606254 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:46.618044 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:46.629793 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:46.641544 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:09:46.784375 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:09:46.928495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:09:47.452663 run create_hlr_db(pid=9525): Launched 20:09:47.588012 bus /sierra_2: Setting Powered False 20:09:48.652596 run create_hlr_db(pid=9525): Terminated: ok {rc=0} 20:09:49.096729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9527): Launched 20:09:49.408917 run osmo-hlr_10.42.42.2(pid=9528): Launched 20:09:49.529222 run osmo-stp_10.42.42.5: Starting osmo-stp 20:09:50.075821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9530): Launched 20:09:50.387472 run osmo-stp_10.42.42.5(pid=9531): Launched 20:09:50.505631 run osmo-msc_10.42.42.6: Starting osmo-msc 20:09:51.066621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9533): Launched 20:09:51.377161 run osmo-msc_10.42.42.6(pid=9534): Launched 20:09:51.549312 run osmo-stp_10.42.42.5(pid=9531): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9531)] 20:09:51.681155 run osmo-stp_10.42.42.5(pid=9531): stdout: | (launched: 2022-12-08_20:09:50.328850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:51.812526 run osmo-stp_10.42.42.5(pid=9531): stderr: | [0;m[38;5;43m20221208200950501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200950501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200950502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200950502 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200950502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200950503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200950503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:51.941504 run osmo-stp_10.42.42.5(pid=9531): stdout: | (launched: 2022-12-08_20:09:50.328850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:52.064091 run osmo-stp_10.42.42.5(pid=9531): stderr: | [0;m[38;5;43m20221208200950501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208200950501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208200950502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208200950502 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208200950502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208200950503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208200950503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:52.211221 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9531): Process ended prematurely: osmo-stp_10.42.42.5(pid=9531) [trial-2349↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9531)] [trial-2349↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 20:09:52.220071 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:09:52.246592 run osmo-hlr_10.42.42.2(pid=9528): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9528)] 20:09:52.294912 run osmo-hlr_10.42.42.2(pid=9528): stdout: | (launched: 2022-12-08_20:09:49.350300) 20:09:52.344623 run osmo-hlr_10.42.42.2(pid=9528): stderr: | [0;m[1;31m20221208200949529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208200949529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208200949529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208200949529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208200949529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208200949529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208200949543 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208200949554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208200949554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208200949554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:09:52.413850 run osmo-msc_10.42.42.6(pid=9534): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9534)] 20:09:52.461894 run osmo-msc_10.42.42.6(pid=9534): stdout: | (launched: 2022-12-08_20:09:51.318079) 20:09:52.511538 run osmo-msc_10.42.42.6(pid=9534): stderr: | [0;m[38;5;43m20221208200951594 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208200951594 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdee1c45c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208200951594 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208200951594 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208200951595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208200951595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208200951596 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208200951597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208200951597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208200951597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:09:52.561335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9527): Terminating (SIGTERM) 20:09:52.601337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9530): Terminating (SIGTERM) 20:09:52.641392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9533): Terminating (SIGTERM) 20:09:52.681798 --- ParallelTerminationStrategy: PID 9527 died... 20:09:52.700826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9527): Terminated: ok {rc=0} 20:09:52.745193 --- ParallelTerminationStrategy: PID 9530 died... 20:09:52.763562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9530): Terminated: ok {rc=0} 20:09:52.808350 --- ParallelTerminationStrategy: PID 9533 died... 20:09:52.827127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9533): Terminated: ok {rc=0} 20:09:52.914315 bus /sierra_3: Setting Powered False 20:09:54.014284 bus /sierra_3: Setting Powered False 20:09:55.131979 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 emergency:sysmo --------------------------------------------------------------------- 20:09:56.370691 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:09:56.375436 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 20:09:56.397406 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 20:09:56.425058 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 20:09:56.511857 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 20:09:56.533649 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 20:09:56.561237 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 20:09:57.147160 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2349 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 20:09:57.152355 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:09:57.163583 tst emergency:sysmo: Using 1 x bts (candidates: 1) 20:09:57.200137 tst emergency_mo_mt_call.py: using LAC 16511 20:09:57.327532 tst emergency_mo_mt_call.py: using RAC 191 20:09:57.454246 tst emergency_mo_mt_call.py: using CellId 16511 20:09:57.581832 tst emergency_mo_mt_call.py: using BVCI 16512 20:09:57.700629 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:09:57.711889 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:09:57.723003 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:09:57.734043 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:09:57.745032 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:09:57.755988 tst emergency:sysmo: Using 1 x modem (candidates: 4) 20:09:57.878604 tst emergency:sysmo: Using 1 x modem (candidates: 4) 20:09:57.999979 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:09:58.507734 run create_hlr_db(pid=9539): Launched 20:09:58.638926 bus /sierra_2: Setting Powered False 20:09:59.703141 run create_hlr_db(pid=9539): Terminated: ok {rc=0} 20:10:00.142550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9541): Launched 20:10:00.449460 run osmo-hlr_10.42.42.2(pid=9542): Launched 20:10:00.565678 run osmo-stp_10.42.42.5: Starting osmo-stp 20:10:01.138599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9544): Launched 20:10:01.466050 run osmo-stp_10.42.42.5(pid=9545): Launched 20:10:01.769378 tst emergency_mo_mt_call.py: using MSISDN 6837 20:10:02.037103 run osmo-msc_10.42.42.6: Starting osmo-msc 20:10:02.656400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9550): Launched 20:10:02.984081 run osmo-msc_10.42.42.6(pid=9551): Launched 20:10:03.163791 run osmo-stp_10.42.42.5(pid=9545): ERR: Terminated: ERROR {rc=1} [trial-2349↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9545)] 20:10:03.300377 run osmo-stp_10.42.42.5(pid=9545): stdout: | (launched: 2022-12-08_20:10:01.404640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:03.437417 run osmo-stp_10.42.42.5(pid=9545): stderr: | [0;m[38;5;43m20221208201001627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201001627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201001627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201001628 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201001628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201001628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201001628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:03.573688 run osmo-stp_10.42.42.5(pid=9545): stdout: | (launched: 2022-12-08_20:10:01.404640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:03.702569 run osmo-stp_10.42.42.5(pid=9545): stderr: | [0;m[38;5;43m20221208201001627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201001627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201001627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201001628 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201001628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201001628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201001628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:03.856442 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=9545): Process ended prematurely: osmo-stp_10.42.42.5(pid=9545) [trial-2349↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9545)] [trial-2349↪emergency:sysmo↪emergency_mo_mt_call.py:19] 20:10:03.865339 tst emergency_mo_mt_call.py:19: Test FAILED (6.7 sec) 20:10:03.892506 run osmo-hlr_10.42.42.2(pid=9542): ERR: Terminated: ERROR {rc=237} [trial-2349↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9542)] 20:10:03.942610 run osmo-hlr_10.42.42.2(pid=9542): stdout: | (launched: 2022-12-08_20:10:00.391352) 20:10:03.994451 run osmo-hlr_10.42.42.2(pid=9542): stderr: | [0;m[1;31m20221208201000568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201000568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201000568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201000568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201000568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201000568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201000581 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201000592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201000592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201000592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:10:04.066973 run osmo-msc_10.42.42.6(pid=9551): ERR: Terminated: ERROR {rc=2} [trial-2349↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9551)] 20:10:04.117393 run osmo-msc_10.42.42.6(pid=9551): stdout: | (launched: 2022-12-08_20:10:02.922512) 20:10:04.169421 run osmo-msc_10.42.42.6(pid=9551): stderr: | [0;m[38;5;43m20221208201003250 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208201003250 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe25a083c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208201003250 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208201003250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208201003250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208201003251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208201003252 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208201003253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208201003253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208201003253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:10:04.221857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9541): Terminating (SIGTERM) 20:10:04.263934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9544): Terminating (SIGTERM) 20:10:04.305949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9550): Terminating (SIGTERM) 20:10:04.348428 --- ParallelTerminationStrategy: PID 9541 died... 20:10:04.368291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9541): Terminated: ok {rc=0} 20:10:04.414518 --- ParallelTerminationStrategy: PID 9544 died... 20:10:04.434120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9544): Terminated: ok {rc=0} 20:10:04.480299 --- ParallelTerminationStrategy: PID 9550 died... 20:10:04.499868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9550): Terminated: ok {rc=0} 20:10:04.589418 bus /sierra_3: Setting Powered False 20:10:05.689528 bus /sierra_3: Setting Powered False 20:10:06.809109 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 20:10:07.896448 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:10:07.908051 tst emergency:sysmo: Using 1 x bts (candidates: 1) 20:10:07.946653 tst emergency_preemptive_call.py: using LAC 16512 20:10:08.066697 tst emergency_preemptive_call.py: using RAC 192 20:10:08.188190 tst emergency_preemptive_call.py: using CellId 16512 20:10:08.317018 tst emergency_preemptive_call.py: using BVCI 16513 20:10:08.434565 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:10:08.446005 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:10:08.457269 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:10:08.468500 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:10:08.479541 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:10:08.490573 tst emergency:sysmo: Using 1 x modem (candidates: 4) 20:10:08.608287 tst emergency:sysmo: Using 1 x modem (candidates: 4) 20:10:08.728657 tst emergency:sysmo: Using 1 x modem (candidates: 4) 20:10:08.846942 tst emergency:sysmo: Using 1 x modem (candidates: 4) 20:10:08.967622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:10:09.475287 run create_hlr_db(pid=9553): Launched 20:10:09.606311 bus /sierra_2: Setting Powered False 20:10:10.669718 run create_hlr_db(pid=9553): Terminated: ok {rc=0} 20:10:11.108211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9555): Launched 20:10:11.416347 run osmo-hlr_10.42.42.2(pid=9556): Launched 20:10:11.531675 run osmo-stp_10.42.42.5: Starting osmo-stp 20:10:12.070193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9558): Launched 20:10:12.377203 run osmo-stp_10.42.42.5(pid=9559): Launched 20:10:12.501549 tst emergency_preemptive_call.py: using MSISDN 6838 20:10:12.657647 run osmo-msc_10.42.42.6: Starting osmo-msc 20:10:13.206163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9561): Launched 20:10:13.513013 run osmo-msc_10.42.42.6(pid=9562): Launched 20:10:13.690745 run osmo-stp_10.42.42.5(pid=9559): ERR: Terminated: ERROR {rc=1} [trial-2349↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9559)] 20:10:13.820361 run osmo-stp_10.42.42.5(pid=9559): stdout: | (launched: 2022-12-08_20:10:12.318656) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:13.949781 run osmo-stp_10.42.42.5(pid=9559): stderr: | [0;m[38;5;43m20221208201012489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201012489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201012490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201012490 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201012492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201012492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201012492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:14.077385 run osmo-stp_10.42.42.5(pid=9559): stdout: | (launched: 2022-12-08_20:10:12.318656) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:14.198746 run osmo-stp_10.42.42.5(pid=9559): stderr: | [0;m[38;5;43m20221208201012489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201012489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201012490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201012490 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201012492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201012492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201012492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:14.343662 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=9559): Process ended prematurely: osmo-stp_10.42.42.5(pid=9559) [trial-2349↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9559)] [trial-2349↪emergency:sysmo↪emergency_preemptive_call.py:32] 20:10:14.352125 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 20:10:14.378534 run osmo-hlr_10.42.42.2(pid=9556): ERR: Terminated: ERROR {rc=237} [trial-2349↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9556)] 20:10:14.427382 run osmo-hlr_10.42.42.2(pid=9556): stdout: | (launched: 2022-12-08_20:10:11.358556) 20:10:14.478003 run osmo-hlr_10.42.42.2(pid=9556): stderr: | [0;m[1;31m20221208201011536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201011536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201011536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201011536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201011537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201011537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201011550 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201011559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201011559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201011559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:10:14.548209 run osmo-msc_10.42.42.6(pid=9562): ERR: Terminated: ERROR {rc=2} [trial-2349↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9562)] 20:10:14.597436 run osmo-msc_10.42.42.6(pid=9562): stdout: | (launched: 2022-12-08_20:10:13.454825) 20:10:14.647784 run osmo-msc_10.42.42.6(pid=9562): stderr: | [0;m[38;5;43m20221208201013732 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208201013732 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f61174fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208201013732 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208201013732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208201013732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208201013732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208201013734 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208201013735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208201013735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208201013735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:10:14.698813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9555): Terminating (SIGTERM) 20:10:14.739290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9558): Terminating (SIGTERM) 20:10:14.779789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9561): Terminating (SIGTERM) 20:10:14.820355 --- ParallelTerminationStrategy: PID 9555 died... 20:10:14.839797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9555): Terminated: ok {rc=0} 20:10:14.884931 --- ParallelTerminationStrategy: PID 9558 died... 20:10:14.903884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9558): Terminated: ok {rc=0} 20:10:14.949151 --- ParallelTerminationStrategy: PID 9561 died... 20:10:14.967975 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9561): Terminated: ok {rc=0} 20:10:15.055614 bus /sierra_9: Setting Powered False 20:10:16.155916 bus /sierra_9: Setting Powered False 20:10:17.273977 bus /sierra_8: Setting Powered False 20:10:18.372937 bus /sierra_8: Setting Powered False 20:10:19.490195 bus /sierra_3: Setting Powered False 20:10:20.589243 bus /sierra_3: Setting Powered False 20:10:21.707099 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:sysmo --------------------------------------------------------------------- 20:10:22.970163 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:10:22.975491 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 20:10:22.997527 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 20:10:23.037714 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 20:10:23.125640 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 20:10:23.147258 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 20:10:23.186853 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 20:10:23.782160 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 20:10:23.836839 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:23.847919 tst gprs:sysmo: Using 1 x bts (candidates: 1) 20:10:23.882184 tst cs_paging_gprs_active.py: using LAC 16513 20:10:24.013199 tst cs_paging_gprs_active.py: using RAC 193 20:10:24.141382 tst cs_paging_gprs_active.py: using CellId 16513 20:10:24.271589 tst cs_paging_gprs_active.py: using BVCI 16514 20:10:24.386716 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:24.397595 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:24.408208 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:24.419692 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:24.431152 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:24.442900 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:24.453625 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:24.464653 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:24.475886 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:10:24.597638 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:10:24.716831 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:10:24.927419 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:10:25.243168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9567): Launched 20:10:25.516434 run iperf3-srv_10.42.42.10(pid=9568): Launched 20:10:25.633916 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:10:25.842536 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:10:26.155885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9569): Launched 20:10:26.428170 run iperf3-srv_10.42.42.10(pid=9570): Launched 20:10:26.544539 tst cs_paging_gprs_active.py:38: start network... 20:10:26.752184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:10:27.235580 run create_hlr_db(pid=9571): Launched 20:10:27.353612 bus /sierra_2: Setting Powered False 20:10:28.415203 run create_hlr_db(pid=9571): Terminated: ok {rc=0} 20:10:28.870647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9573): Launched 20:10:29.206464 run osmo-hlr_10.42.42.2(pid=9574): Launched 20:10:29.332893 run osmo-stp_10.42.42.5: Starting osmo-stp 20:10:29.878338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9576): Launched 20:10:30.190831 run osmo-stp_10.42.42.5(pid=9577): Launched 20:10:30.308853 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:10:31.842994 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9579): Launched 20:10:31.977663 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:10:32.247125 run patchelf(pid=9580): Launched 20:10:32.420561 run osmo-stp_10.42.42.5(pid=9577): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9577)] 20:10:32.552519 run osmo-stp_10.42.42.5(pid=9577): stdout: | (launched: 2022-12-08_20:10:30.131657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:32.686278 run osmo-stp_10.42.42.5(pid=9577): stderr: | [0;m[38;5;43m20221208201030307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201030307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201030308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201030308 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201030309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201030309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201030309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:32.819438 run osmo-stp_10.42.42.5(pid=9577): stdout: | (launched: 2022-12-08_20:10:30.131657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:32.947094 run osmo-stp_10.42.42.5(pid=9577): stderr: | [0;m[38;5;43m20221208201030307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201030307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201030308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201030308 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201030309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201030309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201030309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:33.098865 run patchelf(pid=9580): Terminating (SIGINT) 20:10:33.273622 run patchelf(pid=9580): Terminated: ok {rc=0} 20:10:33.399531 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9577): Process ended prematurely: osmo-stp_10.42.42.5(pid=9577) [trial-2349↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9577)] [trial-2349↪gprs:sysmo↪cs_paging_gprs_active.py:38] 20:10:33.409229 tst cs_paging_gprs_active.py:38: Test FAILED (9.6 sec) 20:10:33.437210 run osmo-hlr_10.42.42.2(pid=9574): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9574)] 20:10:33.485971 run osmo-hlr_10.42.42.2(pid=9574): stdout: | (launched: 2022-12-08_20:10:29.143456) 20:10:33.536211 run osmo-hlr_10.42.42.2(pid=9574): stderr: | [0;m[1;31m20221208201029347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201029347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201029347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201029347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201029348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201029348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201029360 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201029369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201029369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201029369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:10:33.586807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9567): Terminating (SIGTERM) 20:10:33.627426 run iperf3-srv_10.42.42.10(pid=9568): Terminating (SIGTERM) 20:10:33.667792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9569): Terminating (SIGTERM) 20:10:33.708122 run iperf3-srv_10.42.42.10(pid=9570): Terminating (SIGTERM) 20:10:33.748704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9573): Terminating (SIGTERM) 20:10:33.789093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9576): Terminating (SIGTERM) 20:10:33.829955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9579): Terminating (SIGTERM) 20:10:33.870553 --- ParallelTerminationStrategy: PID 9567 died... 20:10:33.889890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9567): Terminated: ok {rc=0} 20:10:33.935377 --- ParallelTerminationStrategy: PID 9568 died... 20:10:33.954118 run iperf3-srv_10.42.42.10(pid=9568): Terminated {rc=256} 20:10:33.998898 --- ParallelTerminationStrategy: PID 9569 died... 20:10:34.017658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9569): Terminated: ok {rc=0} 20:10:34.062430 --- ParallelTerminationStrategy: PID 9570 died... 20:10:34.081157 run iperf3-srv_10.42.42.10(pid=9570): Terminated {rc=256} 20:10:34.125891 --- ParallelTerminationStrategy: PID 9573 died... 20:10:34.144756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9573): Terminated: ok {rc=0} 20:10:34.189505 --- ParallelTerminationStrategy: PID 9576 died... 20:10:34.208247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9576): Terminated: ok {rc=0} 20:10:34.253684 --- ParallelTerminationStrategy: PID 9579 died... 20:10:34.272410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9579): Terminated: ok {rc=0} 20:10:34.359860 bus /gobi_0: Setting Powered False 20:10:35.460158 bus /gobi_0: Setting Powered False 20:10:36.578468 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:sysmo iperf3.py ---------------------------------------------- 20:10:37.728424 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:37.739910 tst gprs:sysmo: Using 1 x bts (candidates: 1) 20:10:37.777330 tst iperf3.py: using LAC 16514 20:10:37.909189 tst iperf3.py: using RAC 194 20:10:38.041754 tst iperf3.py: using CellId 16514 20:10:38.171812 tst iperf3.py: using BVCI 16515 20:10:38.294387 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:38.305698 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:38.316679 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:38.327738 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:38.338626 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:38.349588 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:38.360621 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:38.373203 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:38.385502 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:10:38.503638 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:10:38.713140 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:10:39.026404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9581): Launched 20:10:39.297825 run iperf3-srv_10.42.42.10(pid=9582): Launched 20:10:39.414036 tst iperf3.py:8: start network... 20:10:39.620739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:10:40.103238 run create_hlr_db(pid=9583): Launched 20:10:40.221836 bus /gobi_6: Setting Powered False 20:10:41.283132 run create_hlr_db(pid=9583): Terminated: ok {rc=0} 20:10:41.736210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9585): Launched 20:10:42.070637 run osmo-hlr_10.42.42.2(pid=9586): Launched 20:10:42.196086 run osmo-stp_10.42.42.5: Starting osmo-stp 20:10:42.772466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9588): Launched 20:10:43.104612 run osmo-stp_10.42.42.5(pid=9589): Launched 20:10:43.230526 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:10:43.803062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9591): Launched 20:10:43.930459 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:10:44.213534 run patchelf(pid=9592): Launched 20:10:44.398135 run osmo-stp_10.42.42.5(pid=9589): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9589)] 20:10:44.538255 run osmo-stp_10.42.42.5(pid=9589): stdout: | (launched: 2022-12-08_20:10:43.042196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:44.679713 run osmo-stp_10.42.42.5(pid=9589): stderr: | [0;m[38;5;43m20221208201043239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201043239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201043239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201043240 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201043240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201043240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201043240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:44.820601 run osmo-stp_10.42.42.5(pid=9589): stdout: | (launched: 2022-12-08_20:10:43.042196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:44.955914 run osmo-stp_10.42.42.5(pid=9589): stderr: | [0;m[38;5;43m20221208201043239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201043239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201043239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201043240 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201043240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201043240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201043240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:45.116887 run patchelf(pid=9592): Terminating (SIGINT) 20:10:45.303099 run patchelf(pid=9592): Terminated: ok {rc=0} 20:10:45.437020 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9589): Process ended prematurely: osmo-stp_10.42.42.5(pid=9589) [trial-2349↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9589)] [trial-2349↪gprs:sysmo↪iperf3.py:8] 20:10:45.447181 tst iperf3.py:8: Test FAILED (7.8 sec) 20:10:45.475876 run osmo-hlr_10.42.42.2(pid=9586): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9586)] 20:10:45.526577 run osmo-hlr_10.42.42.2(pid=9586): stdout: | (launched: 2022-12-08_20:10:42.007883) 20:10:45.579361 run osmo-hlr_10.42.42.2(pid=9586): stderr: | [0;m[1;31m20221208201042211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201042211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201042211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201042211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201042211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201042212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201042222 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201042231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201042231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201042231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:10:45.632387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9581): Terminating (SIGTERM) 20:10:45.674686 run iperf3-srv_10.42.42.10(pid=9582): Terminating (SIGTERM) 20:10:45.716722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9585): Terminating (SIGTERM) 20:10:45.759428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9588): Terminating (SIGTERM) 20:10:45.801699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9591): Terminating (SIGTERM) 20:10:45.861461 --- ParallelTerminationStrategy: PID 9581 died... 20:10:45.883623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9581): Terminated: ok {rc=0} 20:10:45.938709 --- ParallelTerminationStrategy: PID 9582 died... 20:10:45.958683 run iperf3-srv_10.42.42.10(pid=9582): Terminated {rc=256} 20:10:46.008285 --- ParallelTerminationStrategy: PID 9585 died... 20:10:46.028421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9585): Terminated: ok {rc=0} 20:10:46.076790 --- ParallelTerminationStrategy: PID 9588 died... 20:10:46.096906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9588): Terminated: ok {rc=0} 20:10:46.145573 --- ParallelTerminationStrategy: PID 9591 died... 20:10:46.165610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9591): Terminated: ok {rc=0} 20:10:46.256451 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:sysmo iperf3m4.py ---------------------------------------------- 20:10:47.408534 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:47.420185 tst gprs:sysmo: Using 1 x bts (candidates: 1) 20:10:47.457824 tst iperf3m4.py: using LAC 16515 20:10:47.589232 tst iperf3m4.py: using RAC 195 20:10:47.718716 tst iperf3m4.py: using CellId 16515 20:10:47.848786 tst iperf3m4.py: using BVCI 16516 20:10:47.969773 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:47.981289 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:47.992276 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:48.003485 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:48.014409 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:48.025343 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:48.036358 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:48.047809 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:48.059114 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:10:48.176701 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:10:48.300537 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:10:48.419252 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:10:48.536010 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:10:48.744327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:10:49.058282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9593): Launched 20:10:49.330831 run iperf3-srv_10.42.42.10(pid=9594): Launched 20:10:49.447554 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:10:49.655566 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:10:49.969124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9595): Launched 20:10:50.241848 run iperf3-srv_10.42.42.10(pid=9596): Launched 20:10:50.358352 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:10:50.566052 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:10:50.879048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9597): Launched 20:10:51.151759 run iperf3-srv_10.42.42.10(pid=9598): Launched 20:10:51.268072 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:10:51.475047 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:10:51.787688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9599): Launched 20:10:52.079861 run iperf3-srv_10.42.42.10(pid=9600): Launched 20:10:52.196190 tst iperf3m4.py:8: start network... 20:10:52.403849 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:10:52.887297 run create_hlr_db(pid=9601): Launched 20:10:53.006604 bus /gobi_6: Setting Powered False 20:10:54.068724 run create_hlr_db(pid=9601): Terminated: ok {rc=0} 20:10:54.524575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9603): Launched 20:10:54.859017 run osmo-hlr_10.42.42.2(pid=9604): Launched 20:10:54.985045 run osmo-stp_10.42.42.5: Starting osmo-stp 20:10:55.561156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9606): Launched 20:10:55.893818 run osmo-stp_10.42.42.5(pid=9607): Launched 20:10:56.020115 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:10:56.592395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9609): Launched 20:10:56.719650 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:10:57.002571 run patchelf(pid=9610): Launched 20:10:57.190185 run osmo-stp_10.42.42.5(pid=9607): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9607)] 20:10:57.331193 run osmo-stp_10.42.42.5(pid=9607): stdout: | (launched: 2022-12-08_20:10:55.831211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:57.472730 run osmo-stp_10.42.42.5(pid=9607): stderr: | [0;m[38;5;43m20221208201056030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201056030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201056031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201056031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201056032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201056032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201056032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:57.614682 run osmo-stp_10.42.42.5(pid=9607): stdout: | (launched: 2022-12-08_20:10:55.831211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:57.750716 run osmo-stp_10.42.42.5(pid=9607): stderr: | [0;m[38;5;43m20221208201056030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201056030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201056031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201056031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201056032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201056032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201056032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:57.911717 run patchelf(pid=9610): Terminating (SIGINT) 20:10:58.098262 run patchelf(pid=9610): Terminated: ok {rc=0} 20:10:58.231652 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9607): Process ended prematurely: osmo-stp_10.42.42.5(pid=9607) [trial-2349↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9607)] [trial-2349↪gprs:sysmo↪iperf3m4.py:8] 20:10:58.241751 tst iperf3m4.py:8: Test FAILED (10.9 sec) 20:10:58.270739 run osmo-hlr_10.42.42.2(pid=9604): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9604)] 20:10:58.321848 run osmo-hlr_10.42.42.2(pid=9604): stdout: | (launched: 2022-12-08_20:10:54.796212) 20:10:58.374501 run osmo-hlr_10.42.42.2(pid=9604): stderr: | [0;m[1;31m20221208201055000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201055000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201055000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201055000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201055000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201055001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201055013 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201055021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201055022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201055022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:10:58.427617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9593): Terminating (SIGTERM) 20:10:58.470233 run iperf3-srv_10.42.42.10(pid=9594): Terminating (SIGTERM) 20:10:58.512877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9595): Terminating (SIGTERM) 20:10:58.555512 run iperf3-srv_10.42.42.10(pid=9596): Terminating (SIGTERM) 20:10:58.598020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9597): Terminating (SIGTERM) 20:10:58.640532 run iperf3-srv_10.42.42.10(pid=9598): Terminating (SIGTERM) 20:10:58.682898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9599): Terminating (SIGTERM) 20:10:58.725514 run iperf3-srv_10.42.42.10(pid=9600): Terminating (SIGTERM) 20:10:58.767810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9603): Terminating (SIGTERM) 20:10:58.810585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9606): Terminating (SIGTERM) 20:10:58.852847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9609): Terminating (SIGTERM) 20:10:58.895529 --- ParallelTerminationStrategy: PID 9593 died... 20:10:58.915895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9593): Terminated: ok {rc=0} 20:10:58.963155 --- ParallelTerminationStrategy: PID 9594 died... 20:10:58.983018 run iperf3-srv_10.42.42.10(pid=9594): Terminated {rc=256} 20:10:59.029595 --- ParallelTerminationStrategy: PID 9595 died... 20:10:59.049704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9595): Terminated: ok {rc=0} 20:10:59.096599 --- ParallelTerminationStrategy: PID 9596 died... 20:10:59.116396 run iperf3-srv_10.42.42.10(pid=9596): Terminated {rc=256} 20:10:59.163132 --- ParallelTerminationStrategy: PID 9597 died... 20:10:59.183086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9597): Terminated: ok {rc=0} 20:10:59.229723 --- ParallelTerminationStrategy: PID 9598 died... 20:10:59.249583 run iperf3-srv_10.42.42.10(pid=9598): Terminated {rc=256} 20:10:59.296066 --- ParallelTerminationStrategy: PID 9599 died... 20:10:59.316021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9599): Terminated: ok {rc=0} 20:10:59.362732 --- ParallelTerminationStrategy: PID 9600 died... 20:10:59.382525 run iperf3-srv_10.42.42.10(pid=9600): Terminated {rc=256} 20:10:59.429110 --- ParallelTerminationStrategy: PID 9603 died... 20:10:59.449109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9603): Terminated: ok {rc=0} 20:10:59.495868 --- ParallelTerminationStrategy: PID 9606 died... 20:10:59.515773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9606): Terminated: ok {rc=0} 20:10:59.562709 --- ParallelTerminationStrategy: PID 9609 died... 20:10:59.582638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9609): Terminated: ok {rc=0} 20:10:59.671681 bus /gobi_4: Setting Powered False 20:11:00.773107 bus /gobi_4: Setting Powered False 20:11:01.901052 bus /gobi_1: Setting Powered False 20:11:02.999498 bus /gobi_1: Setting Powered False 20:11:04.115815 bus /gobi_0: Setting Powered False 20:11:05.216241 bus /gobi_0: Setting Powered False 20:11:06.333301 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:sysmo ping.py ---------------------------------------------- 20:11:07.438522 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:07.450376 tst gprs:sysmo: Using 1 x bts (candidates: 1) 20:11:07.487733 tst ping.py: using LAC 16516 20:11:07.619233 tst ping.py: using RAC 196 20:11:07.749570 tst ping.py: using CellId 16516 20:11:07.879677 tst ping.py: using BVCI 16517 20:11:07.999950 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:08.011335 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:08.022402 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:08.034015 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:08.045519 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:08.057282 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:08.068796 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:08.080499 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:11:08.198681 tst ping.py:19: start network... 20:11:08.403324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:11:08.879052 run create_hlr_db(pid=9611): Launched 20:11:08.994784 bus /gobi_6: Setting Powered False 20:11:10.055683 run create_hlr_db(pid=9611): Terminated: ok {rc=0} 20:11:10.505059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9613): Launched 20:11:10.833838 run osmo-hlr_10.42.42.2(pid=9614): Launched 20:11:10.957433 run osmo-stp_10.42.42.5: Starting osmo-stp 20:11:11.519471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9616): Launched 20:11:11.846606 run osmo-stp_10.42.42.5(pid=9617): Launched 20:11:11.969686 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:11:12.532316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9619): Launched 20:11:12.656612 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:11:12.933596 run patchelf(pid=9620): Launched 20:11:13.115331 run osmo-stp_10.42.42.5(pid=9617): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9617)] 20:11:13.253706 run osmo-stp_10.42.42.5(pid=9617): stdout: | (launched: 2022-12-08_20:11:11.785156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:13.393591 run osmo-stp_10.42.42.5(pid=9617): stderr: | [0;m[38;5;43m20221208201111980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201111981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201111981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201111981 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201111983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201111984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201111984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:13.533611 run osmo-stp_10.42.42.5(pid=9617): stdout: | (launched: 2022-12-08_20:11:11.785156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:13.666918 run osmo-stp_10.42.42.5(pid=9617): stderr: | [0;m[38;5;43m20221208201111980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201111981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201111981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201111981 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201111983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201111984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201111984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:13.825054 run patchelf(pid=9620): Terminating (SIGINT) 20:11:14.007602 run patchelf(pid=9620): Terminated: ok {rc=0} 20:11:14.140325 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9617): Process ended prematurely: osmo-stp_10.42.42.5(pid=9617) [trial-2349↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9617)] [trial-2349↪gprs:sysmo↪ping.py:22] 20:11:14.150034 tst ping.py:22: Test FAILED (6.7 sec) 20:11:14.178210 run osmo-hlr_10.42.42.2(pid=9614): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9614)] 20:11:14.228742 run osmo-hlr_10.42.42.2(pid=9614): stdout: | (launched: 2022-12-08_20:11:10.772035) 20:11:14.281151 run osmo-hlr_10.42.42.2(pid=9614): stderr: | [0;m[1;31m20221208201110973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201110973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201110973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201110973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201110973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201110973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201110990 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201110999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201110999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201110999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:11:14.333786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9613): Terminating (SIGTERM) 20:11:14.376210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9616): Terminating (SIGTERM) 20:11:14.418674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9619): Terminating (SIGTERM) 20:11:14.461898 --- ParallelTerminationStrategy: PID 9613 died... 20:11:14.482287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9613): Terminated: ok {rc=0} 20:11:14.529219 --- ParallelTerminationStrategy: PID 9616 died... 20:11:14.548922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9616): Terminated: ok {rc=0} 20:11:14.595539 --- ParallelTerminationStrategy: PID 9619 died... 20:11:14.615496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9619): Terminated: ok {rc=0} 20:11:14.703941 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 20:11:15.792456 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:15.804047 tst gprs:sysmo: Using 1 x bts (candidates: 1) 20:11:15.851098 tst ping_idle_ping.py: using LAC 16517 20:11:15.999879 tst ping_idle_ping.py: using RAC 197 20:11:16.125351 tst ping_idle_ping.py: using CellId 16517 20:11:16.275325 tst ping_idle_ping.py: using BVCI 16518 20:11:16.397118 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:16.408387 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:16.419636 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:16.431646 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:16.443563 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:16.455310 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:16.467453 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:16.479063 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:11:16.620475 tst ping_idle_ping.py:24: start network... 20:11:16.862948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:11:17.441207 run create_hlr_db(pid=9621): Launched 20:11:17.559498 bus /gobi_6: Setting Powered False 20:11:18.620090 run create_hlr_db(pid=9621): Terminated: ok {rc=0} 20:11:19.069350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9623): Launched 20:11:19.380137 run osmo-hlr_10.42.42.2(pid=9624): Launched 20:11:19.496659 run osmo-stp_10.42.42.5: Starting osmo-stp 20:11:20.036855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9626): Launched 20:11:20.344399 run osmo-stp_10.42.42.5(pid=9627): Launched 20:11:20.459456 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:11:20.987986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9629): Launched 20:11:21.105887 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:11:21.365304 run patchelf(pid=9630): Launched 20:11:21.534709 run osmo-stp_10.42.42.5(pid=9627): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9627)] 20:11:21.663901 run osmo-stp_10.42.42.5(pid=9627): stdout: | (launched: 2022-12-08_20:11:20.286339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:21.794710 run osmo-stp_10.42.42.5(pid=9627): stderr: | [0;m[38;5;43m20221208201120461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201120461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201120462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201120462 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201120462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201120463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201120463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:21.925379 run osmo-stp_10.42.42.5(pid=9627): stdout: | (launched: 2022-12-08_20:11:20.286339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:22.050385 run osmo-stp_10.42.42.5(pid=9627): stderr: | [0;m[38;5;43m20221208201120461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201120461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201120462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201120462 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201120462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201120463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201120463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:22.198669 run patchelf(pid=9630): Terminating (SIGINT) 20:11:22.369608 run patchelf(pid=9630): Terminated: ok {rc=0} 20:11:22.492560 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9627): Process ended prematurely: osmo-stp_10.42.42.5(pid=9627) [trial-2349↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9627)] [trial-2349↪gprs:sysmo↪ping_idle_ping.py:27] 20:11:22.501515 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 20:11:22.528597 run osmo-hlr_10.42.42.2(pid=9624): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9624)] 20:11:22.576523 run osmo-hlr_10.42.42.2(pid=9624): stdout: | (launched: 2022-12-08_20:11:19.322363) 20:11:22.626313 run osmo-hlr_10.42.42.2(pid=9624): stderr: | [0;m[1;31m20221208201119498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201119498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201119498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201119498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201119498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201119498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201119510 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201119519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201119519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201119519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:11:22.676564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9623): Terminating (SIGTERM) 20:11:22.716621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9626): Terminating (SIGTERM) 20:11:22.756536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9629): Terminating (SIGTERM) 20:11:22.796596 --- ParallelTerminationStrategy: PID 9623 died... 20:11:22.815816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9623): Terminated: ok {rc=0} 20:11:22.860760 --- ParallelTerminationStrategy: PID 9626 died... 20:11:22.879395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9626): Terminated: ok {rc=0} 20:11:22.923698 --- ParallelTerminationStrategy: PID 9629 died... 20:11:22.942331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9629): Terminated: ok {rc=0} 20:11:23.028692 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 20:11:24.313047 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:11:24.318521 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 20:11:24.340314 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 20:11:24.379775 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 20:11:24.467745 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 20:11:24.488727 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 20:11:24.527757 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 20:11:25.119155 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 20:11:25.169454 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:25.180136 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:11:25.216325 tst cs_paging_gprs_active.py: using LAC 16518 20:11:25.338296 tst cs_paging_gprs_active.py: using RAC 198 20:11:25.460204 tst cs_paging_gprs_active.py: using CellId 16518 20:11:25.582634 tst cs_paging_gprs_active.py: using BVCI 16519 20:11:25.695563 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:25.706609 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:25.717300 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:25.728183 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:25.738994 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:25.749963 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:25.760909 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:25.771903 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:25.782943 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:11:25.903565 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:11:26.023704 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:11:26.233978 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:11:26.547872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9635): Launched 20:11:26.821733 run iperf3-srv_10.42.42.10(pid=9636): Launched 20:11:26.939220 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:11:27.148550 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:11:27.463084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9637): Launched 20:11:27.735880 run iperf3-srv_10.42.42.10(pid=9638): Launched 20:11:27.852417 tst cs_paging_gprs_active.py:38: start network... 20:11:28.059917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:11:28.543145 run create_hlr_db(pid=9639): Launched 20:11:28.660672 bus /gobi_6: Setting Powered False 20:11:29.720910 run create_hlr_db(pid=9639): Terminated: ok {rc=0} 20:11:30.153309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9641): Launched 20:11:30.464897 run osmo-hlr_10.42.42.2(pid=9642): Launched 20:11:30.583079 run osmo-stp_10.42.42.5: Starting osmo-stp 20:11:31.133631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9644): Launched 20:11:31.461182 run osmo-stp_10.42.42.5(pid=9645): Launched 20:11:31.738664 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:11:32.380823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9647): Launched 20:11:32.500172 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:11:32.764420 run patchelf(pid=9648): Launched 20:11:32.936705 run osmo-stp_10.42.42.5(pid=9645): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9645)] 20:11:33.067889 run osmo-stp_10.42.42.5(pid=9645): stdout: | (launched: 2022-12-08_20:11:31.397832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:33.200817 run osmo-stp_10.42.42.5(pid=9645): stderr: | [0;m[38;5;43m20221208201131654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201131654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201131654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201131655 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201131657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201131657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201131657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:33.333908 run osmo-stp_10.42.42.5(pid=9645): stdout: | (launched: 2022-12-08_20:11:31.397832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:33.461206 run osmo-stp_10.42.42.5(pid=9645): stderr: | [0;m[38;5;43m20221208201131654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201131654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201131654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201131655 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201131657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201131657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201131657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:33.612048 run patchelf(pid=9648): Terminating (SIGINT) 20:11:33.786082 run patchelf(pid=9648): Terminated: ok {rc=0} 20:11:33.911705 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9645): Process ended prematurely: osmo-stp_10.42.42.5(pid=9645) [trial-2349↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9645)] [trial-2349↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 20:11:33.921354 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 20:11:33.949229 run osmo-hlr_10.42.42.2(pid=9642): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9642)] 20:11:33.997895 run osmo-hlr_10.42.42.2(pid=9642): stdout: | (launched: 2022-12-08_20:11:30.406173) 20:11:34.048372 run osmo-hlr_10.42.42.2(pid=9642): stderr: | [0;m[1;31m20221208201130584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201130584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201130584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201130584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201130584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201130584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201130597 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201130605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201130605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201130606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:11:34.099405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9635): Terminating (SIGTERM) 20:11:34.140139 run iperf3-srv_10.42.42.10(pid=9636): Terminating (SIGTERM) 20:11:34.180733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9637): Terminating (SIGTERM) 20:11:34.221040 run iperf3-srv_10.42.42.10(pid=9638): Terminating (SIGTERM) 20:11:34.261730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9641): Terminating (SIGTERM) 20:11:34.302511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9644): Terminating (SIGTERM) 20:11:34.342887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9647): Terminating (SIGTERM) 20:11:34.383704 --- ParallelTerminationStrategy: PID 9635 died... 20:11:34.402999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9635): Terminated: ok {rc=0} 20:11:34.447677 --- ParallelTerminationStrategy: PID 9636 died... 20:11:34.466307 run iperf3-srv_10.42.42.10(pid=9636): Terminated {rc=256} 20:11:34.510729 --- ParallelTerminationStrategy: PID 9637 died... 20:11:34.529437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9637): Terminated: ok {rc=0} 20:11:34.573720 --- ParallelTerminationStrategy: PID 9638 died... 20:11:34.592243 run iperf3-srv_10.42.42.10(pid=9638): Terminated {rc=256} 20:11:34.636552 --- ParallelTerminationStrategy: PID 9641 died... 20:11:34.655165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9641): Terminated: ok {rc=0} 20:11:34.699443 --- ParallelTerminationStrategy: PID 9644 died... 20:11:34.718201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9644): Terminated: ok {rc=0} 20:11:34.763082 --- ParallelTerminationStrategy: PID 9647 died... 20:11:34.781981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9647): Terminated: ok {rc=0} 20:11:34.868254 bus /gobi_0: Setting Powered False 20:11:35.968180 bus /gobi_0: Setting Powered False 20:11:37.085448 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 20:11:38.233229 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:38.244937 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:11:38.283347 tst iperf3.py: using LAC 16519 20:11:38.406848 tst iperf3.py: using RAC 199 20:11:38.529639 tst iperf3.py: using CellId 16519 20:11:38.661198 tst iperf3.py: using BVCI 16520 20:11:38.782249 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:38.794106 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:38.805648 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:38.816835 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:38.828107 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:38.839215 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:38.850749 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:38.862114 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:38.873599 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:11:38.995498 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:11:39.220704 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:11:39.555612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9649): Launched 20:11:39.844811 run iperf3-srv_10.42.42.10(pid=9650): Launched 20:11:39.969980 tst iperf3.py:8: start network... 20:11:40.178824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:11:40.664602 run create_hlr_db(pid=9651): Launched 20:11:40.783087 bus /gobi_6: Setting Powered False 20:11:41.844544 run create_hlr_db(pid=9651): Terminated: ok {rc=0} 20:11:42.303265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9653): Launched 20:11:42.638562 run osmo-hlr_10.42.42.2(pid=9654): Launched 20:11:42.767313 run osmo-stp_10.42.42.5: Starting osmo-stp 20:11:43.339352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9656): Launched 20:11:43.672512 run osmo-stp_10.42.42.5(pid=9657): Launched 20:11:43.798506 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:11:44.373473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9659): Launched 20:11:44.501364 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:11:44.784648 run patchelf(pid=9660): Launched 20:11:44.969963 run osmo-stp_10.42.42.5(pid=9657): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9657)] 20:11:45.111310 run osmo-stp_10.42.42.5(pid=9657): stdout: | (launched: 2022-12-08_20:11:43.610229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:45.253275 run osmo-stp_10.42.42.5(pid=9657): stderr: | [0;m[38;5;43m20221208201143807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201143808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201143808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201143808 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201143809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201143809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201143809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:45.395481 run osmo-stp_10.42.42.5(pid=9657): stdout: | (launched: 2022-12-08_20:11:43.610229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:45.531642 run osmo-stp_10.42.42.5(pid=9657): stderr: | [0;m[38;5;43m20221208201143807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201143808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201143808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201143808 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201143809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201143809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201143809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:45.693380 run patchelf(pid=9660): Terminating (SIGINT) 20:11:45.888284 run patchelf(pid=9660): Terminated: ok {rc=0} 20:11:46.023092 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9657): Process ended prematurely: osmo-stp_10.42.42.5(pid=9657) [trial-2349↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9657)] [trial-2349↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 20:11:46.033842 tst iperf3.py:8: Test FAILED (7.8 sec) 20:11:46.065035 run osmo-hlr_10.42.42.2(pid=9654): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9654)] 20:11:46.116435 run osmo-hlr_10.42.42.2(pid=9654): stdout: | (launched: 2022-12-08_20:11:42.575890) 20:11:46.169529 run osmo-hlr_10.42.42.2(pid=9654): stderr: | [0;m[1;31m20221208201142779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201142780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201142780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201142780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201142780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201142780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201142792 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201142800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201142801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201142801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:11:46.224497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9649): Terminating (SIGTERM) 20:11:46.269093 run iperf3-srv_10.42.42.10(pid=9650): Terminating (SIGTERM) 20:11:46.315971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9653): Terminating (SIGTERM) 20:11:46.360940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9656): Terminating (SIGTERM) 20:11:46.407367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9659): Terminating (SIGTERM) 20:11:46.452725 --- ParallelTerminationStrategy: PID 9649 died... 20:11:46.473214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9649): Terminated: ok {rc=0} 20:11:46.523758 --- ParallelTerminationStrategy: PID 9650 died... 20:11:46.543663 run iperf3-srv_10.42.42.10(pid=9650): Terminated {rc=256} 20:11:46.593198 --- ParallelTerminationStrategy: PID 9653 died... 20:11:46.613400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9653): Terminated: ok {rc=0} 20:11:46.661302 --- ParallelTerminationStrategy: PID 9656 died... 20:11:46.681602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9656): Terminated: ok {rc=0} 20:11:46.730136 --- ParallelTerminationStrategy: PID 9659 died... 20:11:46.750491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9659): Terminated: ok {rc=0} 20:11:46.847293 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 20:11:48.001339 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:48.013558 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:11:48.055267 tst iperf3m4.py: using LAC 16520 20:11:48.184746 tst iperf3m4.py: using RAC 200 20:11:48.310708 tst iperf3m4.py: using CellId 16520 20:11:48.440336 tst iperf3m4.py: using BVCI 16521 20:11:48.562921 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:48.574467 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:48.585948 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:48.597250 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:48.608412 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:48.619559 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:48.630913 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:48.641996 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:48.653253 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:11:48.774662 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:11:48.898911 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:11:49.017666 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:11:49.139184 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:11:49.363412 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:11:49.699950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9661): Launched 20:11:49.991231 run iperf3-srv_10.42.42.10(pid=9662): Launched 20:11:50.116246 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:11:50.340581 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:11:50.677220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9663): Launched 20:11:50.968043 run iperf3-srv_10.42.42.10(pid=9664): Launched 20:11:51.092527 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:11:51.316097 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:11:51.651260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9665): Launched 20:11:51.942155 run iperf3-srv_10.42.42.10(pid=9666): Launched 20:11:52.068174 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:11:52.292330 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:11:52.628073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9667): Launched 20:11:52.919054 run iperf3-srv_10.42.42.10(pid=9668): Launched 20:11:53.043962 tst iperf3m4.py:8: start network... 20:11:53.268061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:11:53.784631 run create_hlr_db(pid=9669): Launched 20:11:53.918656 bus /gobi_6: Setting Powered False 20:11:54.983764 run create_hlr_db(pid=9669): Terminated: ok {rc=0} 20:11:55.428807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9671): Launched 20:11:55.741256 run osmo-hlr_10.42.42.2(pid=9672): Launched 20:11:55.859273 run osmo-stp_10.42.42.5: Starting osmo-stp 20:11:56.408477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9674): Launched 20:11:56.721986 run osmo-stp_10.42.42.5(pid=9675): Launched 20:11:56.840566 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:11:57.377039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9677): Launched 20:11:57.495740 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:11:57.760805 run patchelf(pid=9678): Launched 20:11:57.933508 run osmo-stp_10.42.42.5(pid=9675): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9675)] 20:11:58.064189 run osmo-stp_10.42.42.5(pid=9675): stdout: | (launched: 2022-12-08_20:11:56.662930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:58.196344 run osmo-stp_10.42.42.5(pid=9675): stderr: | [0;m[38;5;43m20221208201156836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201156836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201156837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201156837 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201156838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201156838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201156838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:58.328190 run osmo-stp_10.42.42.5(pid=9675): stdout: | (launched: 2022-12-08_20:11:56.662930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:58.454602 run osmo-stp_10.42.42.5(pid=9675): stderr: | [0;m[38;5;43m20221208201156836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201156836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201156837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201156837 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201156838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201156838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201156838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:58.604905 run patchelf(pid=9678): Terminating (SIGINT) 20:11:58.778914 run patchelf(pid=9678): Terminated: ok {rc=0} 20:11:58.904081 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9675): Process ended prematurely: osmo-stp_10.42.42.5(pid=9675) [trial-2349↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9675)] [trial-2349↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 20:11:58.913647 tst iperf3m4.py:8: Test FAILED (11.0 sec) 20:11:58.941587 run osmo-hlr_10.42.42.2(pid=9672): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9672)] 20:11:58.989871 run osmo-hlr_10.42.42.2(pid=9672): stdout: | (launched: 2022-12-08_20:11:55.682096) 20:11:59.039489 run osmo-hlr_10.42.42.2(pid=9672): stderr: | [0;m[1;31m20221208201155861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201155861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201155861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201155861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201155861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201155861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201155875 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201155884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201155885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201155885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:11:59.089760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9661): Terminating (SIGTERM) 20:11:59.129577 run iperf3-srv_10.42.42.10(pid=9662): Terminating (SIGTERM) 20:11:59.169277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9663): Terminating (SIGTERM) 20:11:59.209682 run iperf3-srv_10.42.42.10(pid=9664): Terminating (SIGTERM) 20:11:59.249196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9665): Terminating (SIGTERM) 20:11:59.288730 run iperf3-srv_10.42.42.10(pid=9666): Terminating (SIGTERM) 20:11:59.328354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9667): Terminating (SIGTERM) 20:11:59.368046 run iperf3-srv_10.42.42.10(pid=9668): Terminating (SIGTERM) 20:11:59.407584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9671): Terminating (SIGTERM) 20:11:59.447171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9674): Terminating (SIGTERM) 20:11:59.486719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9677): Terminating (SIGTERM) 20:11:59.526576 --- ParallelTerminationStrategy: PID 9661 died... 20:11:59.545555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9661): Terminated: ok {rc=0} 20:11:59.590174 --- ParallelTerminationStrategy: PID 9662 died... 20:11:59.608755 run iperf3-srv_10.42.42.10(pid=9662): Terminated {rc=256} 20:11:59.653326 --- ParallelTerminationStrategy: PID 9663 died... 20:11:59.671997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9663): Terminated: ok {rc=0} 20:11:59.716772 --- ParallelTerminationStrategy: PID 9664 died... 20:11:59.735543 run iperf3-srv_10.42.42.10(pid=9664): Terminated {rc=256} 20:11:59.779892 --- ParallelTerminationStrategy: PID 9665 died... 20:11:59.798536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9665): Terminated: ok {rc=0} 20:11:59.843347 --- ParallelTerminationStrategy: PID 9666 died... 20:11:59.862198 run iperf3-srv_10.42.42.10(pid=9666): Terminated {rc=256} 20:11:59.906644 --- ParallelTerminationStrategy: PID 9667 died... 20:11:59.925256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9667): Terminated: ok {rc=0} 20:11:59.969552 --- ParallelTerminationStrategy: PID 9668 died... 20:11:59.988242 run iperf3-srv_10.42.42.10(pid=9668): Terminated {rc=256} 20:12:00.032533 --- ParallelTerminationStrategy: PID 9671 died... 20:12:00.051312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9671): Terminated: ok {rc=0} 20:12:00.095594 --- ParallelTerminationStrategy: PID 9674 died... 20:12:00.114575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9674): Terminated: ok {rc=0} 20:12:00.158499 --- ParallelTerminationStrategy: PID 9677 died... 20:12:00.177406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9677): Terminated: ok {rc=0} 20:12:00.263236 bus /gobi_4: Setting Powered False 20:12:01.369328 bus /gobi_4: Setting Powered False 20:12:02.494458 bus /gobi_1: Setting Powered False 20:12:03.594490 bus /gobi_1: Setting Powered False 20:12:04.713831 bus /gobi_0: Setting Powered False 20:12:05.814901 bus /gobi_0: Setting Powered False 20:12:06.932195 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 20:12:08.037177 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:08.049243 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:12:08.091890 tst ping.py: using LAC 16521 20:12:08.211074 tst ping.py: using RAC 201 20:12:08.328146 tst ping.py: using CellId 16521 20:12:08.446145 tst ping.py: using BVCI 16522 20:12:08.556301 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:08.567503 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:08.578622 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:08.590336 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:08.601396 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:08.612193 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:08.623213 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:08.634275 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:12:08.758383 tst ping.py:19: start network... 20:12:08.978571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:12:09.485224 run create_hlr_db(pid=9679): Launched 20:12:09.617612 bus /gobi_6: Setting Powered False 20:12:10.682213 run create_hlr_db(pid=9679): Terminated: ok {rc=0} 20:12:11.139534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9681): Launched 20:12:11.467044 run osmo-hlr_10.42.42.2(pid=9682): Launched 20:12:11.591149 run osmo-stp_10.42.42.5: Starting osmo-stp 20:12:12.153352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9684): Launched 20:12:12.480610 run osmo-stp_10.42.42.5(pid=9685): Launched 20:12:12.604728 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:12:13.169341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9687): Launched 20:12:13.293878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:12:13.572043 run patchelf(pid=9688): Launched 20:12:13.752800 run osmo-stp_10.42.42.5(pid=9685): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9685)] 20:12:13.890311 run osmo-stp_10.42.42.5(pid=9685): stdout: | (launched: 2022-12-08_20:12:12.419159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:14.029226 run osmo-stp_10.42.42.5(pid=9685): stderr: | [0;m[38;5;43m20221208201212614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201212614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201212614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201212615 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201212617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201212617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201212617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:14.168281 run osmo-stp_10.42.42.5(pid=9685): stdout: | (launched: 2022-12-08_20:12:12.419159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:14.300879 run osmo-stp_10.42.42.5(pid=9685): stderr: | [0;m[38;5;43m20221208201212614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201212614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201212614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201212615 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201212617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201212617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201212617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:14.458338 run patchelf(pid=9688): Terminating (SIGINT) 20:12:14.640824 run patchelf(pid=9688): Terminated: ok {rc=0} 20:12:14.771770 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9685): Process ended prematurely: osmo-stp_10.42.42.5(pid=9685) [trial-2349↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9685)] [trial-2349↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 20:12:14.781333 tst ping.py:22: Test FAILED (6.7 sec) 20:12:14.810054 run osmo-hlr_10.42.42.2(pid=9682): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9682)] 20:12:14.860736 run osmo-hlr_10.42.42.2(pid=9682): stdout: | (launched: 2022-12-08_20:12:11.405592) 20:12:14.913300 run osmo-hlr_10.42.42.2(pid=9682): stderr: | [0;m[1;31m20221208201211607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201211607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201211607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201211607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201211608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201211608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201211619 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201211628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201211628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201211628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:12:14.966400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9681): Terminating (SIGTERM) 20:12:15.009031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9684): Terminating (SIGTERM) 20:12:15.051610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9687): Terminating (SIGTERM) 20:12:15.094752 --- ParallelTerminationStrategy: PID 9681 died... 20:12:15.115138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9681): Terminated: ok {rc=0} 20:12:15.162616 --- ParallelTerminationStrategy: PID 9684 died... 20:12:15.182604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9684): Terminated: ok {rc=0} 20:12:15.229571 --- ParallelTerminationStrategy: PID 9687 died... 20:12:15.249502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9687): Terminated: ok {rc=0} 20:12:15.337998 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 20:12:16.430907 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:16.447174 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:12:16.495632 tst ping_idle_ping.py: using LAC 16522 20:12:16.619975 tst ping_idle_ping.py: using RAC 202 20:12:16.795934 tst ping_idle_ping.py: using CellId 16522 20:12:16.924093 tst ping_idle_ping.py: using BVCI 16523 20:12:17.077344 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:17.090460 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:17.104196 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:17.117379 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:17.129521 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:17.141792 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:17.154799 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:17.167465 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:12:17.297449 tst ping_idle_ping.py:24: start network... 20:12:17.502956 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:12:17.975388 run create_hlr_db(pid=9689): Launched 20:12:18.092522 bus /gobi_6: Setting Powered False 20:12:19.157219 run create_hlr_db(pid=9689): Terminated: ok {rc=0} 20:12:19.615471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9691): Launched 20:12:19.944345 run osmo-hlr_10.42.42.2(pid=9692): Launched 20:12:20.068372 run osmo-stp_10.42.42.5: Starting osmo-stp 20:12:20.631374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9694): Launched 20:12:20.959835 run osmo-stp_10.42.42.5(pid=9695): Launched 20:12:21.082833 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:12:21.648674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9697): Launched 20:12:21.775527 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:12:22.053306 run patchelf(pid=9698): Launched 20:12:22.234984 run osmo-stp_10.42.42.5(pid=9695): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9695)] 20:12:22.373219 run osmo-stp_10.42.42.5(pid=9695): stdout: | (launched: 2022-12-08_20:12:20.898170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:22.512327 run osmo-stp_10.42.42.5(pid=9695): stderr: | [0;m[38;5;43m20221208201221092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201221093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201221093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201221093 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201221095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201221096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201221096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:22.651828 run osmo-stp_10.42.42.5(pid=9695): stdout: | (launched: 2022-12-08_20:12:20.898170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:22.785443 run osmo-stp_10.42.42.5(pid=9695): stderr: | [0;m[38;5;43m20221208201221092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201221093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201221093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201221093 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201221095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201221096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201221096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:22.943462 run patchelf(pid=9698): Terminating (SIGINT) 20:12:23.126532 run patchelf(pid=9698): Terminated: ok {rc=0} 20:12:23.257989 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9695): Process ended prematurely: osmo-stp_10.42.42.5(pid=9695) [trial-2349↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9695)] [trial-2349↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 20:12:23.267614 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 20:12:23.295468 run osmo-hlr_10.42.42.2(pid=9692): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9692)] 20:12:23.345381 run osmo-hlr_10.42.42.2(pid=9692): stdout: | (launched: 2022-12-08_20:12:19.882817) 20:12:23.396894 run osmo-hlr_10.42.42.2(pid=9692): stderr: | [0;m[1;31m20221208201220083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201220083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201220083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201220083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201220083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201220083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201220098 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201220108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201220108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201220108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:12:23.449372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9691): Terminating (SIGTERM) 20:12:23.491144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9694): Terminating (SIGTERM) 20:12:23.533097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9697): Terminating (SIGTERM) 20:12:23.575224 --- ParallelTerminationStrategy: PID 9691 died... 20:12:23.595386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9691): Terminated: ok {rc=0} 20:12:23.641844 --- ParallelTerminationStrategy: PID 9694 died... 20:12:23.661572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9694): Terminated: ok {rc=0} 20:12:23.707407 --- ParallelTerminationStrategy: PID 9697 died... 20:12:23.727539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9697): Terminated: ok {rc=0} 20:12:23.814969 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 20:12:25.099271 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:12:25.105554 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 20:12:25.127298 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 20:12:25.166283 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 20:12:25.254093 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 20:12:25.274956 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 20:12:25.314058 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 20:12:25.906913 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 20:12:25.956828 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:25.967793 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:12:26.024542 tst cs_paging_gprs_active.py: using LAC 16523 20:12:26.146930 tst cs_paging_gprs_active.py: using RAC 203 20:12:26.269383 tst cs_paging_gprs_active.py: using CellId 16523 20:12:26.391880 tst cs_paging_gprs_active.py: using BVCI 16524 20:12:26.515951 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:26.527563 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:26.539053 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:26.550470 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:26.561847 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:26.573018 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:26.584553 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:26.596220 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:26.607853 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:12:26.727677 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:12:26.850858 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:12:27.075871 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:12:27.411328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9704): Launched 20:12:27.701847 run iperf3-srv_10.42.42.10(pid=9705): Launched 20:12:27.828094 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:12:28.051375 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:12:28.387053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9706): Launched 20:12:28.676645 run iperf3-srv_10.42.42.10(pid=9707): Launched 20:12:28.801435 tst cs_paging_gprs_active.py:38: start network... 20:12:29.025337 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:12:29.544131 run create_hlr_db(pid=9708): Launched 20:12:29.667226 bus /gobi_6: Setting Powered False 20:12:30.728371 run create_hlr_db(pid=9708): Terminated: ok {rc=0} 20:12:31.229624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9710): Launched 20:12:31.602539 run osmo-hlr_10.42.42.2(pid=9711): Launched 20:12:31.869632 run osmo-stp_10.42.42.5: Starting osmo-stp 20:12:32.542570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9713): Launched 20:12:32.856898 run osmo-stp_10.42.42.5(pid=9714): Launched 20:12:32.974892 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:12:33.512010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9716): Launched 20:12:33.631667 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:12:33.896235 run patchelf(pid=9717): Launched 20:12:34.068924 run osmo-stp_10.42.42.5(pid=9714): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9714)] 20:12:34.199970 run osmo-stp_10.42.42.5(pid=9714): stdout: | (launched: 2022-12-08_20:12:32.797460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:34.332593 run osmo-stp_10.42.42.5(pid=9714): stderr: | [0;m[38;5;43m20221208201232971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201232971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201232971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201232971 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201232974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201232974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201232974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:34.465520 run osmo-stp_10.42.42.5(pid=9714): stdout: | (launched: 2022-12-08_20:12:32.797460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:34.592670 run osmo-stp_10.42.42.5(pid=9714): stderr: | [0;m[38;5;43m20221208201232971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201232971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201232971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201232971 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201232974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201232974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201232974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:34.743324 run patchelf(pid=9717): Terminating (SIGINT) 20:12:34.917621 run patchelf(pid=9717): Terminated: ok {rc=0} 20:12:35.042700 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9714): Process ended prematurely: osmo-stp_10.42.42.5(pid=9714) [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9714)] [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 20:12:35.052042 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 20:12:35.079674 run osmo-hlr_10.42.42.2(pid=9711): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9711)] 20:12:35.127859 run osmo-hlr_10.42.42.2(pid=9711): stdout: | (launched: 2022-12-08_20:12:31.535318) 20:12:35.177650 run osmo-hlr_10.42.42.2(pid=9711): stderr: | [0;m[1;31m20221208201231767 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201231767 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201231768 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201231768 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201231768 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201231768 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201231781 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201231793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201231794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201231794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:12:35.228002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9704): Terminating (SIGTERM) 20:12:35.268451 run iperf3-srv_10.42.42.10(pid=9705): Terminating (SIGTERM) 20:12:35.308683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9706): Terminating (SIGTERM) 20:12:35.349041 run iperf3-srv_10.42.42.10(pid=9707): Terminating (SIGTERM) 20:12:35.389282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9710): Terminating (SIGTERM) 20:12:35.429578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9713): Terminating (SIGTERM) 20:12:35.469876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9716): Terminating (SIGTERM) 20:12:35.510314 --- ParallelTerminationStrategy: PID 9704 died... 20:12:35.529523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9704): Terminated: ok {rc=0} 20:12:35.574605 --- ParallelTerminationStrategy: PID 9705 died... 20:12:35.593196 run iperf3-srv_10.42.42.10(pid=9705): Terminated {rc=256} 20:12:35.637606 --- ParallelTerminationStrategy: PID 9706 died... 20:12:35.656350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9706): Terminated: ok {rc=0} 20:12:35.701014 --- ParallelTerminationStrategy: PID 9707 died... 20:12:35.720064 run iperf3-srv_10.42.42.10(pid=9707): Terminated {rc=256} 20:12:35.765300 --- ParallelTerminationStrategy: PID 9710 died... 20:12:35.783984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9710): Terminated: ok {rc=0} 20:12:35.828383 --- ParallelTerminationStrategy: PID 9713 died... 20:12:35.847078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9713): Terminated: ok {rc=0} 20:12:35.891373 --- ParallelTerminationStrategy: PID 9716 died... 20:12:35.910058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9716): Terminated: ok {rc=0} 20:12:35.996726 bus /gobi_0: Setting Powered False 20:12:37.096394 bus /gobi_0: Setting Powered False 20:12:38.213699 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 20:12:39.360780 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:39.372436 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:12:39.432000 tst iperf3.py: using LAC 16524 20:12:39.554753 tst iperf3.py: using RAC 204 20:12:39.688056 tst iperf3.py: using CellId 16524 20:12:39.817226 tst iperf3.py: using BVCI 16525 20:12:39.931268 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:39.942292 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:39.953061 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:39.964103 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:39.975049 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:39.985925 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:39.997023 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:40.007876 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:40.019009 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:12:40.137026 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:12:40.345533 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:12:40.658902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9724): Launched 20:12:40.931890 run iperf3-srv_10.42.42.10(pid=9725): Launched 20:12:41.047966 tst iperf3.py:8: start network... 20:12:41.255857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:12:41.736497 run create_hlr_db(pid=9726): Launched 20:12:41.854298 bus /gobi_6: Setting Powered False 20:12:42.915322 run create_hlr_db(pid=9726): Terminated: ok {rc=0} 20:12:43.347350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9728): Launched 20:12:43.659067 run osmo-hlr_10.42.42.2(pid=9729): Launched 20:12:43.777907 run osmo-stp_10.42.42.5: Starting osmo-stp 20:12:44.314239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9731): Launched 20:12:44.624492 run osmo-stp_10.42.42.5(pid=9732): Launched 20:12:44.742850 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:12:45.278827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9734): Launched 20:12:45.397932 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:12:45.661865 run patchelf(pid=9735): Launched 20:12:45.834993 run osmo-stp_10.42.42.5(pid=9732): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9732)] 20:12:45.982749 run osmo-stp_10.42.42.5(pid=9732): stdout: | (launched: 2022-12-08_20:12:44.566021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:46.118078 run osmo-stp_10.42.42.5(pid=9732): stderr: | [0;m[38;5;43m20221208201244738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201244738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201244739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201244739 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201244740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201244740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201244740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:46.254452 run osmo-stp_10.42.42.5(pid=9732): stdout: | (launched: 2022-12-08_20:12:44.566021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:46.384693 run osmo-stp_10.42.42.5(pid=9732): stderr: | [0;m[38;5;43m20221208201244738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201244738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201244739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201244739 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201244740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201244740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201244740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:46.539323 run patchelf(pid=9735): Terminating (SIGINT) 20:12:46.718985 run patchelf(pid=9735): Terminated: ok {rc=0} 20:12:46.847454 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9732): Process ended prematurely: osmo-stp_10.42.42.5(pid=9732) [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9732)] [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 20:12:46.858537 tst iperf3.py:8: Test FAILED (7.5 sec) 20:12:46.889236 run osmo-hlr_10.42.42.2(pid=9729): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9729)] 20:12:46.941544 run osmo-hlr_10.42.42.2(pid=9729): stdout: | (launched: 2022-12-08_20:12:43.600261) 20:12:46.996767 run osmo-hlr_10.42.42.2(pid=9729): stderr: | [0;m[1;31m20221208201243780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201243780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201243780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201243780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201243780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201243780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201243793 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201243802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201243802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201243802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:12:47.050920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9724): Terminating (SIGTERM) 20:12:47.094986 run iperf3-srv_10.42.42.10(pid=9725): Terminating (SIGTERM) 20:12:47.141659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9728): Terminating (SIGTERM) 20:12:47.185524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9731): Terminating (SIGTERM) 20:12:47.227903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9734): Terminating (SIGTERM) 20:12:47.270653 --- ParallelTerminationStrategy: PID 9724 died... 20:12:47.290835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9724): Terminated: ok {rc=0} 20:12:47.337596 --- ParallelTerminationStrategy: PID 9725 died... 20:12:47.357578 run iperf3-srv_10.42.42.10(pid=9725): Terminated {rc=256} 20:12:47.404480 --- ParallelTerminationStrategy: PID 9728 died... 20:12:47.424333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9728): Terminated: ok {rc=0} 20:12:47.471252 --- ParallelTerminationStrategy: PID 9731 died... 20:12:47.491292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9731): Terminated: ok {rc=0} 20:12:47.538270 --- ParallelTerminationStrategy: PID 9734 died... 20:12:47.558428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9734): Terminated: ok {rc=0} 20:12:47.647457 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 20:12:48.802429 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:48.814755 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:12:48.871929 tst iperf3m4.py: using LAC 16525 20:12:49.002515 tst iperf3m4.py: using RAC 205 20:12:49.133443 tst iperf3m4.py: using CellId 16525 20:12:49.257393 tst iperf3m4.py: using BVCI 16526 20:12:49.372202 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:49.383678 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:49.394675 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:49.405858 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:49.417000 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:49.428052 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:49.439607 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:49.450709 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:49.463182 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:12:49.584029 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:12:49.705874 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:12:49.824879 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:12:49.946477 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:12:50.172093 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:12:50.507381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9736): Launched 20:12:50.798899 run iperf3-srv_10.42.42.10(pid=9737): Launched 20:12:50.924232 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:12:51.148766 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:12:51.484252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9738): Launched 20:12:51.775024 run iperf3-srv_10.42.42.10(pid=9739): Launched 20:12:51.899394 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:12:52.124025 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:12:52.459223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9740): Launched 20:12:52.750109 run iperf3-srv_10.42.42.10(pid=9741): Launched 20:12:52.875982 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:12:53.100420 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:12:53.435948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9742): Launched 20:12:53.726540 run iperf3-srv_10.42.42.10(pid=9743): Launched 20:12:53.852123 tst iperf3m4.py:8: start network... 20:12:54.075193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:12:54.592672 run create_hlr_db(pid=9744): Launched 20:12:54.718044 bus /gobi_6: Setting Powered False 20:12:55.779779 run create_hlr_db(pid=9744): Terminated: ok {rc=0} 20:12:56.213303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9746): Launched 20:12:56.525127 run osmo-hlr_10.42.42.2(pid=9747): Launched 20:12:56.644351 run osmo-stp_10.42.42.5: Starting osmo-stp 20:12:57.195646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9749): Launched 20:12:57.507657 run osmo-stp_10.42.42.5(pid=9750): Launched 20:12:57.627239 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:12:58.162849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9752): Launched 20:12:58.280658 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:12:58.544269 run patchelf(pid=9753): Launched 20:12:58.717121 run osmo-stp_10.42.42.5(pid=9750): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9750)] 20:12:58.848091 run osmo-stp_10.42.42.5(pid=9750): stdout: | (launched: 2022-12-08_20:12:57.448687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:58.980328 run osmo-stp_10.42.42.5(pid=9750): stderr: | [0;m[38;5;43m20221208201257621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201257621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201257621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201257622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201257624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201257624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201257624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:59.112487 run osmo-stp_10.42.42.5(pid=9750): stdout: | (launched: 2022-12-08_20:12:57.448687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:59.239285 run osmo-stp_10.42.42.5(pid=9750): stderr: | [0;m[38;5;43m20221208201257621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201257621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201257621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201257622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201257624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201257624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201257624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:59.389473 run patchelf(pid=9753): Terminating (SIGINT) 20:12:59.563374 run patchelf(pid=9753): Terminated: ok {rc=0} 20:12:59.688620 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9750): Process ended prematurely: osmo-stp_10.42.42.5(pid=9750) [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9750)] [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 20:12:59.698176 tst iperf3m4.py:8: Test FAILED (10.9 sec) 20:12:59.726238 run osmo-hlr_10.42.42.2(pid=9747): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9747)] 20:12:59.774460 run osmo-hlr_10.42.42.2(pid=9747): stdout: | (launched: 2022-12-08_20:12:56.466165) 20:12:59.824180 run osmo-hlr_10.42.42.2(pid=9747): stderr: | [0;m[1;31m20221208201256648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201256648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201256648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201256648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201256648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201256648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201256659 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201256668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201256668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201256668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:12:59.874191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9736): Terminating (SIGTERM) 20:12:59.914346 run iperf3-srv_10.42.42.10(pid=9737): Terminating (SIGTERM) 20:12:59.954563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9738): Terminating (SIGTERM) 20:12:59.994690 run iperf3-srv_10.42.42.10(pid=9739): Terminating (SIGTERM) 20:13:00.034806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9740): Terminating (SIGTERM) 20:13:00.074927 run iperf3-srv_10.42.42.10(pid=9741): Terminating (SIGTERM) 20:13:00.114958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9742): Terminating (SIGTERM) 20:13:00.155027 run iperf3-srv_10.42.42.10(pid=9743): Terminating (SIGTERM) 20:13:00.195008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9746): Terminating (SIGTERM) 20:13:00.235419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9749): Terminating (SIGTERM) 20:13:00.275933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9752): Terminating (SIGTERM) 20:13:00.316229 --- ParallelTerminationStrategy: PID 9736 died... 20:13:00.335958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9736): Terminated: ok {rc=0} 20:13:00.381282 --- ParallelTerminationStrategy: PID 9737 died... 20:13:00.400103 run iperf3-srv_10.42.42.10(pid=9737): Terminated {rc=256} 20:13:00.445282 --- ParallelTerminationStrategy: PID 9738 died... 20:13:00.463794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9738): Terminated: ok {rc=0} 20:13:00.508614 --- ParallelTerminationStrategy: PID 9739 died... 20:13:00.527427 run iperf3-srv_10.42.42.10(pid=9739): Terminated {rc=256} 20:13:00.571845 --- ParallelTerminationStrategy: PID 9740 died... 20:13:00.590695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9740): Terminated: ok {rc=0} 20:13:00.635274 --- ParallelTerminationStrategy: PID 9741 died... 20:13:00.654021 run iperf3-srv_10.42.42.10(pid=9741): Terminated {rc=256} 20:13:00.698510 --- ParallelTerminationStrategy: PID 9742 died... 20:13:00.717313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9742): Terminated: ok {rc=0} 20:13:00.761953 --- ParallelTerminationStrategy: PID 9743 died... 20:13:00.780758 run iperf3-srv_10.42.42.10(pid=9743): Terminated {rc=256} 20:13:00.825420 --- ParallelTerminationStrategy: PID 9746 died... 20:13:00.861947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9746): Terminated: ok {rc=0} 20:13:00.921755 --- ParallelTerminationStrategy: PID 9749 died... 20:13:00.942971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9749): Terminated: ok {rc=0} 20:13:00.994586 --- ParallelTerminationStrategy: PID 9752 died... 20:13:01.015660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9752): Terminated: ok {rc=0} 20:13:01.109801 bus /gobi_4: Setting Powered False 20:13:02.214324 bus /gobi_4: Setting Powered False 20:13:03.329347 bus /gobi_1: Setting Powered False 20:13:04.425187 bus /gobi_1: Setting Powered False 20:13:05.542000 bus /gobi_0: Setting Powered False 20:13:06.641472 bus /gobi_0: Setting Powered False 20:13:07.760242 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 20:13:08.863427 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:08.875710 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:13:08.934620 tst ping.py: using LAC 16526 20:13:09.063376 tst ping.py: using RAC 206 20:13:09.193055 tst ping.py: using CellId 16526 20:13:09.319871 tst ping.py: using BVCI 16527 20:13:09.439772 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:09.451241 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:09.462555 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:09.473801 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:09.484914 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:09.496107 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:09.507586 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:09.518928 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:13:09.639281 tst ping.py:19: start network... 20:13:09.859200 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:13:10.365219 run create_hlr_db(pid=9754): Launched 20:13:10.488222 bus /gobi_6: Setting Powered False 20:13:11.553493 run create_hlr_db(pid=9754): Terminated: ok {rc=0} 20:13:11.992084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9756): Launched 20:13:12.299950 run osmo-hlr_10.42.42.2(pid=9757): Launched 20:13:12.417741 run osmo-stp_10.42.42.5: Starting osmo-stp 20:13:12.956597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9759): Launched 20:13:13.263414 run osmo-stp_10.42.42.5(pid=9760): Launched 20:13:13.379936 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:13:13.904061 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9762): Launched 20:13:14.020852 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:13:14.279448 run patchelf(pid=9763): Launched 20:13:14.448157 run osmo-stp_10.42.42.5(pid=9760): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9760)] 20:13:14.576890 run osmo-stp_10.42.42.5(pid=9760): stdout: | (launched: 2022-12-08_20:13:13.205696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:14.707258 run osmo-stp_10.42.42.5(pid=9760): stderr: | [0;m[38;5;43m20221208201313377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201313377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201313377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201313378 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201313380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201313380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201313380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:14.837439 run osmo-stp_10.42.42.5(pid=9760): stdout: | (launched: 2022-12-08_20:13:13.205696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:14.962231 run osmo-stp_10.42.42.5(pid=9760): stderr: | [0;m[38;5;43m20221208201313377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201313377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201313377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201313378 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201313380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201313380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201313380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:15.109796 run patchelf(pid=9763): Terminating (SIGINT) 20:13:15.280235 run patchelf(pid=9763): Terminated: ok {rc=0} 20:13:15.403203 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9760): Process ended prematurely: osmo-stp_10.42.42.5(pid=9760) [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9760)] [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 20:13:15.412122 tst ping.py:22: Test FAILED (6.5 sec) 20:13:15.439191 run osmo-hlr_10.42.42.2(pid=9757): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9757)] 20:13:15.487031 run osmo-hlr_10.42.42.2(pid=9757): stdout: | (launched: 2022-12-08_20:13:12.242033) 20:13:15.536415 run osmo-hlr_10.42.42.2(pid=9757): stderr: | [0;m[1;31m20221208201312420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201312420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201312420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201312421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201312421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201312421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201312433 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201312441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201312441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201312441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:13:15.586353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9756): Terminating (SIGTERM) 20:13:15.626261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9759): Terminating (SIGTERM) 20:13:15.666524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9762): Terminating (SIGTERM) 20:13:15.706959 --- ParallelTerminationStrategy: PID 9756 died... 20:13:15.726013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9756): Terminated: ok {rc=0} 20:13:15.770232 --- ParallelTerminationStrategy: PID 9759 died... 20:13:15.788851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9759): Terminated: ok {rc=0} 20:13:15.841934 --- ParallelTerminationStrategy: PID 9762 died... 20:13:15.869252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9762): Terminated: ok {rc=0} 20:13:15.973988 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 20:13:17.062431 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:17.076201 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:13:17.141305 tst ping_idle_ping.py: using LAC 16527 20:13:17.267918 tst ping_idle_ping.py: using RAC 207 20:13:17.395752 tst ping_idle_ping.py: using CellId 16527 20:13:17.517455 tst ping_idle_ping.py: using BVCI 16528 20:13:17.627462 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:17.638433 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:17.649263 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:17.660209 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:17.671108 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:17.681947 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:17.693071 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:17.703916 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:13:17.824869 tst ping_idle_ping.py:24: start network... 20:13:18.046481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:13:18.556267 run create_hlr_db(pid=9764): Launched 20:13:18.682992 bus /gobi_6: Setting Powered False 20:13:19.747608 run create_hlr_db(pid=9764): Terminated: ok {rc=0} 20:13:20.189859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9766): Launched 20:13:20.499799 run osmo-hlr_10.42.42.2(pid=9767): Launched 20:13:20.616643 run osmo-stp_10.42.42.5: Starting osmo-stp 20:13:21.158482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9769): Launched 20:13:21.465470 run osmo-stp_10.42.42.5(pid=9770): Launched 20:13:21.582250 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:13:22.113442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9772): Launched 20:13:22.230569 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:13:22.490804 run patchelf(pid=9773): Launched 20:13:22.660604 run osmo-stp_10.42.42.5(pid=9770): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9770)] 20:13:22.789973 run osmo-stp_10.42.42.5(pid=9770): stdout: | (launched: 2022-12-08_20:13:21.407148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:22.920891 run osmo-stp_10.42.42.5(pid=9770): stderr: | [0;m[38;5;43m20221208201321581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201321581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201321582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201321583 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201321584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201321584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201321584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:23.051654 run osmo-stp_10.42.42.5(pid=9770): stdout: | (launched: 2022-12-08_20:13:21.407148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:23.177203 run osmo-stp_10.42.42.5(pid=9770): stderr: | [0;m[38;5;43m20221208201321581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201321581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201321582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201321583 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201321584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201321584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201321584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:23.325066 run patchelf(pid=9773): Terminating (SIGINT) 20:13:23.496326 run patchelf(pid=9773): Terminated: ok {rc=0} 20:13:23.619893 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9770): Process ended prematurely: osmo-stp_10.42.42.5(pid=9770) [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9770)] [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 20:13:23.629310 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 20:13:23.656182 run osmo-hlr_10.42.42.2(pid=9767): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9767)] 20:13:23.704398 run osmo-hlr_10.42.42.2(pid=9767): stdout: | (launched: 2022-12-08_20:13:20.441475) 20:13:23.754025 run osmo-hlr_10.42.42.2(pid=9767): stderr: | [0;m[1;31m20221208201320622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201320622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201320622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201320622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201320622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201320622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201320634 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201320644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201320645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201320645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:13:23.804405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9766): Terminating (SIGTERM) 20:13:23.844562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9769): Terminating (SIGTERM) 20:13:23.884751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9772): Terminating (SIGTERM) 20:13:23.925398 --- ParallelTerminationStrategy: PID 9766 died... 20:13:23.944552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9766): Terminated: ok {rc=0} 20:13:23.989317 --- ParallelTerminationStrategy: PID 9769 died... 20:13:24.008028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9769): Terminated: ok {rc=0} 20:13:24.053396 --- ParallelTerminationStrategy: PID 9772 died... 20:13:24.072241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9772): Terminated: ok {rc=0} 20:13:24.158112 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:13:25.443256 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:13:25.449244 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:13:25.470027 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 20:13:25.509491 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 20:13:25.596854 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:13:25.617641 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 20:13:25.656376 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 20:13:26.250903 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 20:13:26.301123 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:26.311943 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:13:26.369717 tst cs_paging_gprs_active.py: using LAC 16528 20:13:26.491023 tst cs_paging_gprs_active.py: using RAC 208 20:13:26.612803 tst cs_paging_gprs_active.py: using CellId 16528 20:13:26.736100 tst cs_paging_gprs_active.py: using BVCI 16529 20:13:26.850778 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:26.861871 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:26.872546 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:26.883624 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:26.894677 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:26.905716 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:26.916738 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:26.927662 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:26.938911 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:13:27.062218 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:13:27.186580 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:13:27.412233 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:13:27.747569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9778): Launched 20:13:28.039910 run iperf3-srv_10.42.42.10(pid=9779): Launched 20:13:28.165501 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:13:28.390719 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:13:28.726672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9780): Launched 20:13:29.017259 run iperf3-srv_10.42.42.10(pid=9781): Launched 20:13:29.141395 tst cs_paging_gprs_active.py:38: start network... 20:13:29.365118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:13:29.879890 run create_hlr_db(pid=9782): Launched 20:13:30.014681 bus /gobi_6: Setting Powered False 20:13:31.078816 run create_hlr_db(pid=9782): Terminated: ok {rc=0} 20:13:31.550001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9784): Launched 20:13:31.900842 run osmo-hlr_10.42.42.2(pid=9785): Launched 20:13:32.129219 run osmo-stp_10.42.42.5: Starting osmo-stp 20:13:32.705941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9787): Launched 20:13:33.042449 run osmo-stp_10.42.42.5(pid=9788): Launched 20:13:33.168676 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:13:33.745093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9790): Launched 20:13:33.872149 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:13:34.155246 run patchelf(pid=9791): Launched 20:13:34.340152 run osmo-stp_10.42.42.5(pid=9788): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9788)] 20:13:34.480314 run osmo-stp_10.42.42.5(pid=9788): stdout: | (launched: 2022-12-08_20:13:32.979674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:34.621993 run osmo-stp_10.42.42.5(pid=9788): stderr: | [0;m[38;5;43m20221208201333177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201333177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201333178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201333178 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201333178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201333179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201333179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:34.763958 run osmo-stp_10.42.42.5(pid=9788): stdout: | (launched: 2022-12-08_20:13:32.979674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:34.899995 run osmo-stp_10.42.42.5(pid=9788): stderr: | [0;m[38;5;43m20221208201333177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201333177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201333178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201333178 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201333178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201333179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201333179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:35.061237 run patchelf(pid=9791): Terminating (SIGINT) 20:13:35.247755 run patchelf(pid=9791): Terminated: ok {rc=0} 20:13:35.382119 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9788): Process ended prematurely: osmo-stp_10.42.42.5(pid=9788) [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9788)] [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 20:13:35.392399 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 20:13:35.421190 run osmo-hlr_10.42.42.2(pid=9785): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9785)] 20:13:35.471743 run osmo-hlr_10.42.42.2(pid=9785): stdout: | (launched: 2022-12-08_20:13:31.835418) 20:13:35.524033 run osmo-hlr_10.42.42.2(pid=9785): stderr: | [0;m[1;31m20221208201332133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201332133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201332133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201332133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201332133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201332133 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201332146 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201332155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201332155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201332155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:13:35.576788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9778): Terminating (SIGTERM) 20:13:35.618980 run iperf3-srv_10.42.42.10(pid=9779): Terminating (SIGTERM) 20:13:35.661077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9780): Terminating (SIGTERM) 20:13:35.703365 run iperf3-srv_10.42.42.10(pid=9781): Terminating (SIGTERM) 20:13:35.747181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9784): Terminating (SIGTERM) 20:13:35.789168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9787): Terminating (SIGTERM) 20:13:35.831121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9790): Terminating (SIGTERM) 20:13:35.873432 --- ParallelTerminationStrategy: PID 9778 died... 20:13:35.893480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9778): Terminated: ok {rc=0} 20:13:35.939926 --- ParallelTerminationStrategy: PID 9779 died... 20:13:35.959590 run iperf3-srv_10.42.42.10(pid=9779): Terminated {rc=256} 20:13:36.006094 --- ParallelTerminationStrategy: PID 9780 died... 20:13:36.025769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9780): Terminated: ok {rc=0} 20:13:36.071857 --- ParallelTerminationStrategy: PID 9781 died... 20:13:36.091510 run iperf3-srv_10.42.42.10(pid=9781): Terminated {rc=256} 20:13:36.138158 --- ParallelTerminationStrategy: PID 9784 died... 20:13:36.157736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9784): Terminated: ok {rc=0} 20:13:36.203979 --- ParallelTerminationStrategy: PID 9787 died... 20:13:36.223589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9787): Terminated: ok {rc=0} 20:13:36.269546 --- ParallelTerminationStrategy: PID 9790 died... 20:13:36.289146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9790): Terminated: ok {rc=0} 20:13:36.376570 bus /gobi_0: Setting Powered False 20:13:37.476297 bus /gobi_0: Setting Powered False 20:13:38.592476 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 20:13:39.743513 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:39.755642 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:13:39.817517 tst iperf3.py: using LAC 16529 20:13:39.948714 tst iperf3.py: using RAC 209 20:13:40.078710 tst iperf3.py: using CellId 16529 20:13:40.210737 tst iperf3.py: using BVCI 16530 20:13:40.332854 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:40.344414 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:40.355753 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:40.367074 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:40.378256 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:40.389445 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:40.400912 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:40.412093 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:40.423393 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:13:40.541862 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:13:40.750947 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:13:41.064066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9792): Launched 20:13:41.337193 run iperf3-srv_10.42.42.10(pid=9793): Launched 20:13:41.454619 tst iperf3.py:8: start network... 20:13:41.663097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:13:42.146730 run create_hlr_db(pid=9794): Launched 20:13:42.276168 bus /gobi_6: Setting Powered False 20:13:43.338431 run create_hlr_db(pid=9794): Terminated: ok {rc=0} 20:13:43.793391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9796): Launched 20:13:44.127643 run osmo-hlr_10.42.42.2(pid=9797): Launched 20:13:44.254965 run osmo-stp_10.42.42.5: Starting osmo-stp 20:13:44.832832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9799): Launched 20:13:45.166752 run osmo-stp_10.42.42.5(pid=9800): Launched 20:13:45.293135 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:13:45.869733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9802): Launched 20:13:46.038498 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:13:46.331305 run patchelf(pid=9803): Launched 20:13:46.528130 run osmo-stp_10.42.42.5(pid=9800): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9800)] 20:13:46.671875 run osmo-stp_10.42.42.5(pid=9800): stdout: | (launched: 2022-12-08_20:13:45.103609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:46.816393 run osmo-stp_10.42.42.5(pid=9800): stderr: | [0;m[38;5;43m20221208201345302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201345302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201345302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201345303 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201345303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201345303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201345303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:46.963219 run osmo-stp_10.42.42.5(pid=9800): stdout: | (launched: 2022-12-08_20:13:45.103609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:47.134856 run osmo-stp_10.42.42.5(pid=9800): stderr: | [0;m[38;5;43m20221208201345302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201345302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201345302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201345303 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201345303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201345303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201345303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:47.286906 run patchelf(pid=9803): Terminating (SIGINT) 20:13:47.462354 run patchelf(pid=9803): Terminated: ok {rc=0} 20:13:47.588258 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9800): Process ended prematurely: osmo-stp_10.42.42.5(pid=9800) [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9800)] [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 20:13:47.598036 tst iperf3.py:8: Test FAILED (7.9 sec) 20:13:47.625800 run osmo-hlr_10.42.42.2(pid=9797): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9797)] 20:13:47.674390 run osmo-hlr_10.42.42.2(pid=9797): stdout: | (launched: 2022-12-08_20:13:44.064844) 20:13:47.724257 run osmo-hlr_10.42.42.2(pid=9797): stderr: | [0;m[1;31m20221208201344269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201344269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201344269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201344269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201344269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201344269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201344281 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201344290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201344290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201344290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:13:47.774823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9792): Terminating (SIGTERM) 20:13:47.815695 run iperf3-srv_10.42.42.10(pid=9793): Terminating (SIGTERM) 20:13:47.855860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9796): Terminating (SIGTERM) 20:13:47.896749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9799): Terminating (SIGTERM) 20:13:47.937767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9802): Terminating (SIGTERM) 20:13:47.978434 --- ParallelTerminationStrategy: PID 9792 died... 20:13:47.997480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9792): Terminated: ok {rc=0} 20:13:48.042958 --- ParallelTerminationStrategy: PID 9793 died... 20:13:48.062007 run iperf3-srv_10.42.42.10(pid=9793): Terminated {rc=256} 20:13:48.106943 --- ParallelTerminationStrategy: PID 9796 died... 20:13:48.125868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9796): Terminated: ok {rc=0} 20:13:48.170401 --- ParallelTerminationStrategy: PID 9799 died... 20:13:48.189195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9799): Terminated: ok {rc=0} 20:13:48.234650 --- ParallelTerminationStrategy: PID 9802 died... 20:13:48.253727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9802): Terminated: ok {rc=0} 20:13:48.340752 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 20:13:49.489757 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:49.501382 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:13:49.560217 tst iperf3m4.py: using LAC 16530 20:13:49.683305 tst iperf3m4.py: using RAC 210 20:13:49.806139 tst iperf3m4.py: using CellId 16530 20:13:49.929665 tst iperf3m4.py: using BVCI 16531 20:13:50.042296 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:50.053420 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:50.064252 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:50.075468 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:50.086525 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:50.097622 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:50.108714 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:50.119761 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:50.131188 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:13:50.249174 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:13:50.369414 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:13:50.488193 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:13:50.608917 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:13:50.833841 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:13:51.168924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9804): Launched 20:13:51.461525 run iperf3-srv_10.42.42.10(pid=9805): Launched 20:13:51.586860 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:13:51.811708 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:13:52.148537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9806): Launched 20:13:52.440280 run iperf3-srv_10.42.42.10(pid=9807): Launched 20:13:52.567099 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:13:52.791262 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:13:53.127117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9808): Launched 20:13:53.419272 run iperf3-srv_10.42.42.10(pid=9809): Launched 20:13:53.544361 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:13:53.769166 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:13:54.105903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9810): Launched 20:13:54.399518 run iperf3-srv_10.42.42.10(pid=9811): Launched 20:13:54.523927 tst iperf3m4.py:8: start network... 20:13:54.748116 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:13:55.265571 run create_hlr_db(pid=9812): Launched 20:13:55.400398 bus /gobi_6: Setting Powered False 20:13:56.465978 run create_hlr_db(pid=9812): Terminated: ok {rc=0} 20:13:56.911974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9814): Launched 20:13:57.247856 run osmo-hlr_10.42.42.2(pid=9815): Launched 20:13:57.374798 run osmo-stp_10.42.42.5: Starting osmo-stp 20:13:57.958580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9817): Launched 20:13:58.295586 run osmo-stp_10.42.42.5(pid=9818): Launched 20:13:58.421584 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:13:58.998469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9820): Launched 20:13:59.126112 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:13:59.410811 run patchelf(pid=9821): Launched 20:13:59.597199 run osmo-stp_10.42.42.5(pid=9818): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9818)] 20:13:59.738143 run osmo-stp_10.42.42.5(pid=9818): stdout: | (launched: 2022-12-08_20:13:58.232830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:59.880151 run osmo-stp_10.42.42.5(pid=9818): stderr: | [0;m[38;5;43m20221208201358430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201358430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201358431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201358431 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201358431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201358432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201358432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:00.022263 run osmo-stp_10.42.42.5(pid=9818): stdout: | (launched: 2022-12-08_20:13:58.232830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:00.159266 run osmo-stp_10.42.42.5(pid=9818): stderr: | [0;m[38;5;43m20221208201358430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201358430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201358431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201358431 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201358431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201358432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201358432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:00.321221 run patchelf(pid=9821): Terminating (SIGINT) 20:14:00.508436 run patchelf(pid=9821): Terminated: ok {rc=0} 20:14:00.642752 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9818): Process ended prematurely: osmo-stp_10.42.42.5(pid=9818) [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9818)] [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 20:14:00.652856 tst iperf3m4.py:8: Test FAILED (11.2 sec) 20:14:00.681720 run osmo-hlr_10.42.42.2(pid=9815): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9815)] 20:14:00.732103 run osmo-hlr_10.42.42.2(pid=9815): stdout: | (launched: 2022-12-08_20:13:57.184788) 20:14:00.783822 run osmo-hlr_10.42.42.2(pid=9815): stderr: | [0;m[1;31m20221208201357390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201357390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201357390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201357390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201357390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201357390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201357403 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201357411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201357412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201357412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:14:00.844520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9804): Terminating (SIGTERM) 20:14:00.908324 run iperf3-srv_10.42.42.10(pid=9805): Terminating (SIGTERM) 20:14:00.971552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9806): Terminating (SIGTERM) 20:14:01.020105 run iperf3-srv_10.42.42.10(pid=9807): Terminating (SIGTERM) 20:14:01.064771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9808): Terminating (SIGTERM) 20:14:01.109534 run iperf3-srv_10.42.42.10(pid=9809): Terminating (SIGTERM) 20:14:01.155452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9810): Terminating (SIGTERM) 20:14:01.200169 run iperf3-srv_10.42.42.10(pid=9811): Terminating (SIGTERM) 20:14:01.245773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9814): Terminating (SIGTERM) 20:14:01.289781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9817): Terminating (SIGTERM) 20:14:01.333646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9820): Terminating (SIGTERM) 20:14:01.380591 --- ParallelTerminationStrategy: PID 9804 died... 20:14:01.402132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9804): Terminated: ok {rc=0} 20:14:01.453031 --- ParallelTerminationStrategy: PID 9805 died... 20:14:01.472799 run iperf3-srv_10.42.42.10(pid=9805): Terminated {rc=256} 20:14:01.520880 --- ParallelTerminationStrategy: PID 9806 died... 20:14:01.541140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9806): Terminated: ok {rc=0} 20:14:01.590872 --- ParallelTerminationStrategy: PID 9807 died... 20:14:01.610856 run iperf3-srv_10.42.42.10(pid=9807): Terminated {rc=256} 20:14:01.659701 --- ParallelTerminationStrategy: PID 9808 died... 20:14:01.680250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9808): Terminated: ok {rc=0} 20:14:01.728395 --- ParallelTerminationStrategy: PID 9809 died... 20:14:01.748541 run iperf3-srv_10.42.42.10(pid=9809): Terminated {rc=256} 20:14:01.797899 --- ParallelTerminationStrategy: PID 9810 died... 20:14:01.817946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9810): Terminated: ok {rc=0} 20:14:01.866287 --- ParallelTerminationStrategy: PID 9811 died... 20:14:01.886473 run iperf3-srv_10.42.42.10(pid=9811): Terminated {rc=256} 20:14:01.935310 --- ParallelTerminationStrategy: PID 9814 died... 20:14:01.959597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9814): Terminated: ok {rc=0} 20:14:02.017419 --- ParallelTerminationStrategy: PID 9817 died... 20:14:02.037900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9817): Terminated: ok {rc=0} 20:14:02.086422 --- ParallelTerminationStrategy: PID 9820 died... 20:14:02.106357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9820): Terminated: ok {rc=0} 20:14:02.197561 bus /gobi_4: Setting Powered False 20:14:03.296151 bus /gobi_4: Setting Powered False 20:14:04.413535 bus /gobi_1: Setting Powered False 20:14:05.513586 bus /gobi_1: Setting Powered False 20:14:06.630631 bus /gobi_0: Setting Powered False 20:14:07.730093 bus /gobi_0: Setting Powered False 20:14:08.844537 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 20:14:09.949057 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:09.961195 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:14:10.020108 tst ping.py: using LAC 16531 20:14:10.148921 tst ping.py: using RAC 211 20:14:10.276667 tst ping.py: using CellId 16531 20:14:10.404156 tst ping.py: using BVCI 16532 20:14:10.522791 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:10.534328 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:10.545588 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:10.556793 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:10.568186 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:10.579472 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:10.590928 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:10.602202 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:14:10.723993 tst ping.py:19: start network... 20:14:10.944225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:14:11.450987 run create_hlr_db(pid=9822): Launched 20:14:11.583152 bus /gobi_6: Setting Powered False 20:14:12.647532 run create_hlr_db(pid=9822): Terminated: ok {rc=0} 20:14:13.085909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9824): Launched 20:14:13.393678 run osmo-hlr_10.42.42.2(pid=9825): Launched 20:14:13.509781 run osmo-stp_10.42.42.5: Starting osmo-stp 20:14:14.056311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9827): Launched 20:14:14.363696 run osmo-stp_10.42.42.5(pid=9828): Launched 20:14:14.480267 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:14:15.007822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9830): Launched 20:14:15.125255 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:14:15.384545 run patchelf(pid=9831): Launched 20:14:15.554369 run osmo-stp_10.42.42.5(pid=9828): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9828)] 20:14:15.684020 run osmo-stp_10.42.42.5(pid=9828): stdout: | (launched: 2022-12-08_20:14:14.305672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:15.814850 run osmo-stp_10.42.42.5(pid=9828): stderr: | [0;m[38;5;43m20221208201414481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201414481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201414482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201414482 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201414482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201414483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201414483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:15.958730 run osmo-stp_10.42.42.5(pid=9828): stdout: | (launched: 2022-12-08_20:14:14.305672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:16.086629 run osmo-stp_10.42.42.5(pid=9828): stderr: | [0;m[38;5;43m20221208201414481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201414481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201414482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201414482 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201414482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201414483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201414483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:16.238584 run patchelf(pid=9831): Terminating (SIGINT) 20:14:16.416462 run patchelf(pid=9831): Terminated: ok {rc=0} 20:14:16.543452 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9828): Process ended prematurely: osmo-stp_10.42.42.5(pid=9828) [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9828)] [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 20:14:16.553728 tst ping.py:22: Test FAILED (6.6 sec) 20:14:16.583956 run osmo-hlr_10.42.42.2(pid=9825): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9825)] 20:14:16.635374 run osmo-hlr_10.42.42.2(pid=9825): stdout: | (launched: 2022-12-08_20:14:13.335546) 20:14:16.688264 run osmo-hlr_10.42.42.2(pid=9825): stderr: | [0;m[1;31m20221208201413513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201413513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201413513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201413513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201413513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201413513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201413525 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201413534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201413534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201413534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:14:16.741828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9824): Terminating (SIGTERM) 20:14:16.784772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9827): Terminating (SIGTERM) 20:14:16.828161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9830): Terminating (SIGTERM) 20:14:16.872593 --- ParallelTerminationStrategy: PID 9824 died... 20:14:16.892830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9824): Terminated: ok {rc=0} 20:14:16.941163 --- ParallelTerminationStrategy: PID 9827 died... 20:14:16.960927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9827): Terminated: ok {rc=0} 20:14:17.008833 --- ParallelTerminationStrategy: PID 9830 died... 20:14:17.028747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9830): Terminated: ok {rc=0} 20:14:17.119284 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 20:14:18.206691 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:18.218390 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:14:18.276804 tst ping_idle_ping.py: using LAC 16532 20:14:18.397622 tst ping_idle_ping.py: using RAC 212 20:14:18.518825 tst ping_idle_ping.py: using CellId 16532 20:14:18.637620 tst ping_idle_ping.py: using BVCI 16533 20:14:18.748219 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:18.759560 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:18.770499 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:18.781615 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:18.793156 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:18.804651 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:18.815974 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:18.827144 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:14:18.947323 tst ping_idle_ping.py:24: start network... 20:14:19.170857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:14:19.683507 run create_hlr_db(pid=9832): Launched 20:14:19.816228 bus /gobi_6: Setting Powered False 20:14:20.881430 run create_hlr_db(pid=9832): Terminated: ok {rc=0} 20:14:21.321350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9834): Launched 20:14:21.631898 run osmo-hlr_10.42.42.2(pid=9835): Launched 20:14:21.748212 run osmo-stp_10.42.42.5: Starting osmo-stp 20:14:22.314647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9837): Launched 20:14:22.644821 run osmo-stp_10.42.42.5(pid=9838): Launched 20:14:22.769022 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:14:23.336917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9840): Launched 20:14:23.462378 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:14:23.742083 run patchelf(pid=9841): Launched 20:14:23.924522 run osmo-stp_10.42.42.5(pid=9838): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9838)] 20:14:24.063607 run osmo-stp_10.42.42.5(pid=9838): stdout: | (launched: 2022-12-08_20:14:22.583337) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:24.204683 run osmo-stp_10.42.42.5(pid=9838): stderr: | [0;m[38;5;43m20221208201422777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201422777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201422777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201422778 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201422780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201422780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201422780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:24.345513 run osmo-stp_10.42.42.5(pid=9838): stdout: | (launched: 2022-12-08_20:14:22.583337) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:24.479611 run osmo-stp_10.42.42.5(pid=9838): stderr: | [0;m[38;5;43m20221208201422777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201422777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201422777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201422778 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201422780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201422780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201422780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:24.638507 run patchelf(pid=9841): Terminating (SIGINT) 20:14:24.822437 run patchelf(pid=9841): Terminated: ok {rc=0} 20:14:24.954712 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9838): Process ended prematurely: osmo-stp_10.42.42.5(pid=9838) [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9838)] [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 20:14:24.964179 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 20:14:24.992707 run osmo-hlr_10.42.42.2(pid=9835): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9835)] 20:14:25.043606 run osmo-hlr_10.42.42.2(pid=9835): stdout: | (launched: 2022-12-08_20:14:21.572815) 20:14:25.096243 run osmo-hlr_10.42.42.2(pid=9835): stderr: | [0;m[1;31m20221208201421754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201421755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201421755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201421755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201421755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201421755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201421767 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201421776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201421776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201421776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:14:25.149806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9834): Terminating (SIGTERM) 20:14:25.192514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9837): Terminating (SIGTERM) 20:14:25.235364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9840): Terminating (SIGTERM) 20:14:25.278324 --- ParallelTerminationStrategy: PID 9834 died... 20:14:25.298709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9834): Terminated: ok {rc=0} 20:14:25.346028 --- ParallelTerminationStrategy: PID 9837 died... 20:14:25.366115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9837): Terminated: ok {rc=0} 20:14:25.413380 --- ParallelTerminationStrategy: PID 9840 died... 20:14:25.433391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9840): Terminated: ok {rc=0} 20:14:25.523521 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:14:26.818655 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:14:26.826420 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:14:26.848405 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 20:14:26.884817 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:14:26.939547 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:14:26.961419 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 20:14:26.997283 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:14:27.557312 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2349 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 20:14:27.562948 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:14:27.574774 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:14:27.633293 tst switch_tch_pdch.py: using LAC 16533 20:14:27.763247 tst switch_tch_pdch.py: using RAC 213 20:14:27.891816 tst switch_tch_pdch.py: using CellId 16533 20:14:28.019289 tst switch_tch_pdch.py: using BVCI 16534 20:14:28.138893 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:14:28.151057 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:14:28.162696 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:14:28.174294 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:14:28.185792 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:14:28.197670 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:14:28.209620 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:14:28.221313 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:14:28.340260 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:14:28.462488 tst switch_tch_pdch.py:51: start network... 20:14:28.666458 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:14:29.136939 run create_hlr_db(pid=9846): Launched 20:14:29.254135 bus /gobi_6: Setting Powered False 20:14:30.314912 run create_hlr_db(pid=9846): Terminated: ok {rc=0} 20:14:30.741528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9848): Launched 20:14:31.053623 run osmo-hlr_10.42.42.2(pid=9849): Launched 20:14:31.313822 run osmo-stp_10.42.42.5: Starting osmo-stp 20:14:31.942537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9851): Launched 20:14:32.265776 run osmo-stp_10.42.42.5(pid=9852): Launched 20:14:32.398716 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:14:32.942503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9854): Launched 20:14:33.058648 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:14:33.317440 run patchelf(pid=9855): Launched 20:14:33.487142 run osmo-stp_10.42.42.5(pid=9852): ERR: Terminated: ERROR {rc=1} [trial-2349↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9852)] 20:14:33.616269 run osmo-stp_10.42.42.5(pid=9852): stdout: | (launched: 2022-12-08_20:14:32.205893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:33.747489 run osmo-stp_10.42.42.5(pid=9852): stderr: | [0;m[38;5;43m20221208201432405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201432405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201432405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201432405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201432406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201432406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201432406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:33.878828 run osmo-stp_10.42.42.5(pid=9852): stdout: | (launched: 2022-12-08_20:14:32.205893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:34.003389 run osmo-stp_10.42.42.5(pid=9852): stderr: | [0;m[38;5;43m20221208201432405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201432405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201432405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201432405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201432406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201432406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201432406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:34.151334 run patchelf(pid=9855): Terminating (SIGINT) 20:14:34.323798 run patchelf(pid=9855): Terminated: ok {rc=0} 20:14:34.447691 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9852): Process ended prematurely: osmo-stp_10.42.42.5(pid=9852) [trial-2349↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9852)] [trial-2349↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 20:14:34.456719 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 20:14:34.484237 run osmo-hlr_10.42.42.2(pid=9849): ERR: Terminated: ERROR {rc=237} [trial-2349↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9849)] 20:14:34.532334 run osmo-hlr_10.42.42.2(pid=9849): stdout: | (launched: 2022-12-08_20:14:30.992636) 20:14:34.582230 run osmo-hlr_10.42.42.2(pid=9849): stderr: | [0;m[1;31m20221208201431263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201431263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201431263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201431264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201431264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201431264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201431287 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201431304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201431304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201431304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:14:34.632268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9848): Terminating (SIGTERM) 20:14:34.672507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9851): Terminating (SIGTERM) 20:14:34.712641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9854): Terminating (SIGTERM) 20:14:34.752931 --- ParallelTerminationStrategy: PID 9848 died... 20:14:34.772338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9848): Terminated: ok {rc=0} 20:14:34.817373 --- ParallelTerminationStrategy: PID 9851 died... 20:14:34.836463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9851): Terminated: ok {rc=0} 20:14:34.881221 --- ParallelTerminationStrategy: PID 9854 died... 20:14:34.899950 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9854): Terminated: ok {rc=0} 20:14:34.987104 bus /gobi_0: Setting Powered False 20:14:36.087446 bus /gobi_0: Setting Powered False 20:14:37.204459 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 20:14:38.441576 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:14:38.447788 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 20:14:38.469452 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 20:14:38.505326 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 20:14:38.561024 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 20:14:38.582757 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 20:14:38.617495 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 20:14:39.175098 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2349 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 20:14:39.180614 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:14:39.192311 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 20:14:39.250758 tst switch_tch_pdch.py: using LAC 16534 20:14:39.379284 tst switch_tch_pdch.py: using RAC 214 20:14:39.508151 tst switch_tch_pdch.py: using CellId 16534 20:14:39.635426 tst switch_tch_pdch.py: using BVCI 16535 20:14:39.755036 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:14:39.766572 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:14:39.778189 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:14:39.789507 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:14:39.800682 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:14:39.811890 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:14:39.823393 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:14:39.834641 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:14:39.956002 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:14:40.077397 tst switch_tch_pdch.py:51: start network... 20:14:40.298784 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:14:40.778196 run create_hlr_db(pid=9859): Launched 20:14:40.911256 bus /gobi_6: Setting Powered False 20:14:41.975354 run create_hlr_db(pid=9859): Terminated: ok {rc=0} 20:14:42.387287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9861): Launched 20:14:42.694527 run osmo-hlr_10.42.42.2(pid=9862): Launched 20:14:42.809289 run osmo-stp_10.42.42.5: Starting osmo-stp 20:14:43.322728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9864): Launched 20:14:43.628886 run osmo-stp_10.42.42.5(pid=9865): Launched 20:14:43.743594 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:14:44.243249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9867): Launched 20:14:44.360105 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:14:44.619950 run patchelf(pid=9868): Launched 20:14:44.789829 run osmo-stp_10.42.42.5(pid=9865): ERR: Terminated: ERROR {rc=1} [trial-2349↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9865)] 20:14:44.919161 run osmo-stp_10.42.42.5(pid=9865): stdout: | (launched: 2022-12-08_20:14:43.571062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:45.050337 run osmo-stp_10.42.42.5(pid=9865): stderr: | [0;m[38;5;43m20221208201443744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201443744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201443744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201443744 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201443745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201443745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201443745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:45.181880 run osmo-stp_10.42.42.5(pid=9865): stdout: | (launched: 2022-12-08_20:14:43.571062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:45.306913 run osmo-stp_10.42.42.5(pid=9865): stderr: | [0;m[38;5;43m20221208201443744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201443744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201443744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201443744 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201443745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201443745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201443745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:45.455410 run patchelf(pid=9868): Terminating (SIGINT) 20:14:45.626397 run patchelf(pid=9868): Terminated: ok {rc=0} 20:14:45.749527 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9865): Process ended prematurely: osmo-stp_10.42.42.5(pid=9865) [trial-2349↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9865)] [trial-2349↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 20:14:45.758457 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 20:14:45.785728 run osmo-hlr_10.42.42.2(pid=9862): ERR: Terminated: ERROR {rc=237} [trial-2349↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9862)] 20:14:45.834539 run osmo-hlr_10.42.42.2(pid=9862): stdout: | (launched: 2022-12-08_20:14:42.636240) 20:14:45.886679 run osmo-hlr_10.42.42.2(pid=9862): stderr: | [0;m[1;31m20221208201442817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201442818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201442818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201442818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201442818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201442818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201442830 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201442839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201442839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201442839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:14:45.943416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9861): Terminating (SIGTERM) 20:14:45.985850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9864): Terminating (SIGTERM) 20:14:46.029115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9867): Terminating (SIGTERM) 20:14:46.072389 --- ParallelTerminationStrategy: PID 9861 died... 20:14:46.092468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9861): Terminated: ok {rc=0} 20:14:46.141410 --- ParallelTerminationStrategy: PID 9864 died... 20:14:46.161236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9864): Terminated: ok {rc=0} 20:14:46.209211 --- ParallelTerminationStrategy: PID 9867 died... 20:14:46.228911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9867): Terminated: ok {rc=0} 20:14:46.318107 bus /gobi_0: Setting Powered False 20:14:47.416055 bus /gobi_0: Setting Powered False 20:14:48.529935 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 nitb_sms:oc2g --------------------------------------------------------------------- 20:14:49.770451 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:14:49.775135 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 20:14:49.796660 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 20:14:49.804436 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 20:14:49.859368 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 20:14:49.881391 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 20:14:49.888421 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 20:14:50.424036 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 20:14:50.429413 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 20:14:50.440474 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 20:14:50.481114 tst mo_mt_sms.py: using LAC 16535 20:14:50.598464 tst mo_mt_sms.py: using RAC 215 20:14:50.713370 tst mo_mt_sms.py: using CellId 16535 20:14:50.829342 tst mo_mt_sms.py: using BVCI 16536 20:14:50.937588 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 20:14:51.056527 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 20:14:51.172735 tst mo_mt_sms.py:9: start nitb and bts... 20:14:51.372849 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:14:51.983372 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9872): Launched 20:14:52.285467 run osmo-nitb_10.42.42.2(pid=9873): Launched 20:14:52.453989 run osmo-nitb_10.42.42.2(pid=9873): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9873)] 20:14:52.588813 run osmo-nitb_10.42.42.2(pid=9873): stdout: | (launched: 2022-12-08_20:14:52.228559) 20:14:52.724939 run osmo-nitb_10.42.42.2(pid=9873): stderr: | (launched: 2022-12-08_20:14:52.272733) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:14:52.861536 run osmo-nitb_10.42.42.2(pid=9873): stdout: | (launched: 2022-12-08_20:14:52.228559) 20:14:52.991650 run osmo-nitb_10.42.42.2(pid=9873): stderr: | (launched: 2022-12-08_20:14:52.272733) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8fda692268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9873): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9873) [trial-2349↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9873)] 20:14:53.401079 tst osmo-nitb_10.42.42.2(pid=9873): stdout: | (launched: 2022-12-08_20:14:52.228559) 20:14:53.521608 tst osmo-nitb_10.42.42.2(pid=9873): stderr: | (launched: 2022-12-08_20:14:52.272733) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:14:53.663492 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=9873): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9873) [trial-2349↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9873)] [trial-2349↪nitb_sms:oc2g↪mo_mt_sms.py:11] 20:14:53.671861 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 20:14:53.678526 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9872): Terminating (SIGTERM) 20:14:53.889511 --- ParallelTerminationStrategy: PID 9872 died... 20:14:53.909867 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9872): Terminated: ok {rc=0} 20:14:53.996452 bus /sierra_3: Setting Powered False 20:14:55.095781 bus /sierra_3: Setting Powered False 20:14:56.211102 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 sms:oc2g --------------------------------------------------------------------- 20:14:57.392756 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:14:57.397278 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 20:14:57.418663 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 20:14:57.446251 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 20:14:57.502184 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 20:14:57.523951 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 20:14:57.551728 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 20:14:58.096164 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 sms:oc2g mo_mt_sms.py ---------------------------------------------- 20:14:58.101297 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 20:14:58.112375 tst sms:oc2g: Using 1 x bts (candidates: 1) 20:14:58.147741 tst mo_mt_sms.py: using LAC 16536 20:14:58.274839 tst mo_mt_sms.py: using RAC 216 20:14:58.401360 tst mo_mt_sms.py: using CellId 16536 20:14:58.528737 tst mo_mt_sms.py: using BVCI 16537 20:14:58.646057 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 20:14:58.657085 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 20:14:58.667940 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 20:14:58.678808 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 20:14:58.689601 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 20:14:58.700403 tst sms:oc2g: Using 1 x modem (candidates: 2) 20:14:58.814192 tst sms:oc2g: Using 1 x modem (candidates: 2) 20:14:58.932569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:14:59.431244 run create_hlr_db(pid=9878): Launched 20:14:59.560499 bus /sierra_2: Setting Powered False 20:15:00.624381 run create_hlr_db(pid=9878): Terminated: ok {rc=0} 20:15:01.101858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9880): Launched 20:15:01.447132 run osmo-hlr_10.42.42.2(pid=9881): Launched 20:15:01.611318 run osmo-stp_10.42.42.5: Starting osmo-stp 20:15:02.421203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9886): Launched 20:15:02.750394 run osmo-stp_10.42.42.5(pid=9887): Launched 20:15:02.872750 run osmo-msc_10.42.42.6: Starting osmo-msc 20:15:03.452360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9889): Launched 20:15:03.774034 run osmo-msc_10.42.42.6(pid=9890): Launched 20:15:03.952650 run osmo-stp_10.42.42.5(pid=9887): ERR: Terminated: ERROR {rc=1} [trial-2349↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9887)] 20:15:04.087120 run osmo-stp_10.42.42.5(pid=9887): stdout: | (launched: 2022-12-08_20:15:02.690324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:04.222534 run osmo-stp_10.42.42.5(pid=9887): stderr: | [0;m[38;5;43m20221208201502883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201502884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201502884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201502884 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201502885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201502885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201502885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:04.357174 run osmo-stp_10.42.42.5(pid=9887): stdout: | (launched: 2022-12-08_20:15:02.690324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:04.483845 run osmo-stp_10.42.42.5(pid=9887): stderr: | [0;m[38;5;43m20221208201502883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201502884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201502884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201502884 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201502885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201502885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201502885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:04.635692 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9887): Process ended prematurely: osmo-stp_10.42.42.5(pid=9887) [trial-2349↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9887)] [trial-2349↪sms:oc2g↪mo_mt_sms.py:16] 20:15:04.644335 tst mo_mt_sms.py:16: Test FAILED (6.5 sec) 20:15:04.671366 run osmo-hlr_10.42.42.2(pid=9881): ERR: Terminated: ERROR {rc=237} [trial-2349↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9881)] 20:15:04.721060 run osmo-hlr_10.42.42.2(pid=9881): stdout: | (launched: 2022-12-08_20:15:01.378924) 20:15:04.772441 run osmo-hlr_10.42.42.2(pid=9881): stderr: | [0;m[1;31m20221208201501815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201501815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201501815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201501815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201501815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201501815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201501829 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201501849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201501849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201501849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:15:04.844352 run osmo-msc_10.42.42.6(pid=9890): ERR: Terminated: ERROR {rc=2} [trial-2349↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9890)] 20:15:04.894170 run osmo-msc_10.42.42.6(pid=9890): stdout: | (launched: 2022-12-08_20:15:03.713858) 20:15:04.945620 run osmo-msc_10.42.42.6(pid=9890): stderr: | [0;m[38;5;43m20221208201504042 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208201504043 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbc02e8ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208201504043 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208201504043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208201504043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208201504043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208201504045 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208201504045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208201504045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208201504046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:15:04.997384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9880): Terminating (SIGTERM) 20:15:05.038903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9886): Terminating (SIGTERM) 20:15:05.080603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9889): Terminating (SIGTERM) 20:15:05.122540 --- ParallelTerminationStrategy: PID 9880 died... 20:15:05.142492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9880): Terminated: ok {rc=0} 20:15:05.188583 --- ParallelTerminationStrategy: PID 9886 died... 20:15:05.207970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9886): Terminated: ok {rc=0} 20:15:05.253808 --- ParallelTerminationStrategy: PID 9889 died... 20:15:05.273309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9889): Terminated: ok {rc=0} 20:15:05.359533 bus /sierra_3: Setting Powered False 20:15:06.458841 bus /sierra_3: Setting Powered False 20:15:07.575803 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 nitb_ussd:oc2g --------------------------------------------------------------------- 20:15:08.791763 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:15:08.795868 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 20:15:08.817272 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 20:15:08.824627 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 20:15:08.860437 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 20:15:08.881948 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 20:15:08.889551 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 20:15:09.409758 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2349 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 20:15:09.416592 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 20:15:09.427835 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 20:15:09.462924 tst assert_extension.py: using LAC 16537 20:15:09.591460 tst assert_extension.py: using RAC 217 20:15:09.718553 tst assert_extension.py: using CellId 16537 20:15:09.845283 tst assert_extension.py: using BVCI 16538 20:15:09.961406 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 20:15:10.076574 tst assert_extension.py:10: start nitb and bts... 20:15:10.277147 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:15:10.883836 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9895): Launched 20:15:11.183962 run osmo-nitb_10.42.42.2(pid=9896): Launched 20:15:11.349067 run osmo-nitb_10.42.42.2(pid=9896): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9896)] 20:15:11.484026 run osmo-nitb_10.42.42.2(pid=9896): stdout: | (launched: 2022-12-08_20:15:11.127635) 20:15:11.620307 run osmo-nitb_10.42.42.2(pid=9896): stderr: | (launched: 2022-12-08_20:15:11.171847) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:15:11.756214 run osmo-nitb_10.42.42.2(pid=9896): stdout: | (launched: 2022-12-08_20:15:11.127635) 20:15:11.886150 run osmo-nitb_10.42.42.2(pid=9896): stderr: | (launched: 2022-12-08_20:15:11.171847) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8fda692268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9896): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9896) [trial-2349↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9896)] 20:15:12.296272 tst osmo-nitb_10.42.42.2(pid=9896): stdout: | (launched: 2022-12-08_20:15:11.127635) 20:15:12.415900 tst osmo-nitb_10.42.42.2(pid=9896): stderr: | (launched: 2022-12-08_20:15:11.171847) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:15:12.557893 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9896): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9896) [trial-2349↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9896)] [trial-2349↪nitb_ussd:oc2g↪assert_extension.py:12] 20:15:12.566255 tst assert_extension.py:12: Test FAILED (3.1 sec) 20:15:12.573058 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9895): Terminating (SIGTERM) 20:15:12.782619 --- ParallelTerminationStrategy: PID 9895 died... 20:15:12.803758 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9895): Terminated: ok {rc=0} 20:15:12.889935 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 ussd:oc2g --------------------------------------------------------------------- 20:15:14.054550 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:15:14.058885 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 20:15:14.080095 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 20:15:14.107911 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 20:15:14.143325 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 20:15:14.164171 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 20:15:14.191401 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 20:15:14.717518 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2349 ussd:oc2g assert_extension.py ---------------------------------------------- 20:15:14.722628 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 20:15:14.733347 tst ussd:oc2g: Using 1 x bts (candidates: 1) 20:15:14.768777 tst assert_extension.py: using LAC 16538 20:15:14.886372 tst assert_extension.py: using RAC 218 20:15:15.005354 tst assert_extension.py: using CellId 16538 20:15:15.122700 tst assert_extension.py: using BVCI 16539 20:15:15.232387 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 20:15:15.243007 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 20:15:15.253448 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 20:15:15.264419 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 20:15:15.275805 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 20:15:15.286982 tst ussd:oc2g: Using 1 x modem (candidates: 1) 20:15:15.405217 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:15:15.926585 run create_hlr_db(pid=9900): Launched 20:15:16.100062 bus /sierra_2: Setting Powered False 20:15:17.159159 run create_hlr_db(pid=9900): Terminated: ok {rc=0} 20:15:17.590788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9902): Launched 20:15:17.891393 run osmo-hlr_10.42.42.2(pid=9903): Launched 20:15:18.004610 run osmo-stp_10.42.42.5: Starting osmo-stp 20:15:18.523958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9905): Launched 20:15:18.824843 run osmo-stp_10.42.42.5(pid=9906): Launched 20:15:18.938904 run osmo-msc_10.42.42.6: Starting osmo-msc 20:15:19.479278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9908): Launched 20:15:19.778749 run osmo-msc_10.42.42.6(pid=9909): Launched 20:15:19.943496 run osmo-stp_10.42.42.5(pid=9906): ERR: Terminated: ERROR {rc=1} [trial-2349↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9906)] 20:15:20.070002 run osmo-stp_10.42.42.5(pid=9906): stdout: | (launched: 2022-12-08_20:15:18.768506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:20.197511 run osmo-stp_10.42.42.5(pid=9906): stderr: | [0;m[38;5;43m20221208201518940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201518940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201518940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201518941 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201518941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201518941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201518941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:20.322258 run osmo-stp_10.42.42.5(pid=9906): stdout: | (launched: 2022-12-08_20:15:18.768506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:20.441023 run osmo-stp_10.42.42.5(pid=9906): stderr: | [0;m[38;5;43m20221208201518940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201518940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201518940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201518941 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201518941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201518941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201518941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:20.583378 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9906): Process ended prematurely: osmo-stp_10.42.42.5(pid=9906) [trial-2349↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9906)] [trial-2349↪ussd:oc2g↪assert_extension.py:17] 20:15:20.591654 tst assert_extension.py:17: Test FAILED (5.9 sec) 20:15:20.625720 run osmo-hlr_10.42.42.2(pid=9903): ERR: Terminated: ERROR {rc=237} [trial-2349↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9903)] 20:15:20.673564 run osmo-hlr_10.42.42.2(pid=9903): stdout: | (launched: 2022-12-08_20:15:17.834447) 20:15:20.722825 run osmo-hlr_10.42.42.2(pid=9903): stderr: | [0;m[1;31m20221208201518013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201518013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201518013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201518013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201518014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201518014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201518026 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201518034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201518035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201518035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:15:20.791326 run osmo-msc_10.42.42.6(pid=9909): ERR: Terminated: ERROR {rc=2} [trial-2349↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9909)] 20:15:20.838814 run osmo-msc_10.42.42.6(pid=9909): stdout: | (launched: 2022-12-08_20:15:19.721722) 20:15:20.887452 run osmo-msc_10.42.42.6(pid=9909): stderr: | [0;m[38;5;43m20221208201519996 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208201519996 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8238243c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208201519996 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208201519996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208201519996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208201519997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208201519999 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208201519999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208201519999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208201520000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:15:20.937312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9902): Terminating (SIGTERM) 20:15:20.977214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9905): Terminating (SIGTERM) 20:15:21.017226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9908): Terminating (SIGTERM) 20:15:21.057226 --- ParallelTerminationStrategy: PID 9902 died... 20:15:21.076108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9902): Terminated: ok {rc=0} 20:15:21.120200 --- ParallelTerminationStrategy: PID 9905 died... 20:15:21.138850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9905): Terminated: ok {rc=0} 20:15:21.182599 --- ParallelTerminationStrategy: PID 9908 died... 20:15:21.201134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9908): Terminated: ok {rc=0} 20:15:21.283894 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 20:15:22.480707 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:15:22.488315 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 20:15:22.509430 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 20:15:22.536219 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 20:15:22.589660 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 20:15:22.611021 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 20:15:22.638439 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 20:15:23.185311 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 20:15:23.239322 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:23.250872 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:15:23.308540 tst mo_mt_call.py: using LAC 16539 20:15:23.438279 tst mo_mt_call.py: using RAC 219 20:15:23.568943 tst mo_mt_call.py: using CellId 16539 20:15:23.698234 tst mo_mt_call.py: using BVCI 16540 20:15:23.817532 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:23.829156 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:23.840431 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:23.851847 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:23.863279 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:23.874668 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:15:23.993595 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:15:24.111532 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:15:24.582758 run create_hlr_db(pid=9914): Launched 20:15:24.699667 bus /sierra_2: Setting Powered False 20:15:25.759745 run create_hlr_db(pid=9914): Terminated: ok {rc=0} 20:15:26.183881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9916): Launched 20:15:26.489295 run osmo-hlr_10.42.42.2(pid=9917): Launched 20:15:26.605982 run osmo-stp_10.42.42.5: Starting osmo-stp 20:15:27.126874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9919): Launched 20:15:27.431171 run osmo-stp_10.42.42.5(pid=9920): Launched 20:15:27.547260 run osmo-msc_10.42.42.6: Starting osmo-msc 20:15:28.109516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9922): Launched 20:15:28.414694 run osmo-msc_10.42.42.6(pid=9923): Launched 20:15:28.584524 run osmo-stp_10.42.42.5(pid=9920): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9920)] 20:15:28.713858 run osmo-stp_10.42.42.5(pid=9920): stdout: | (launched: 2022-12-08_20:15:27.374064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:28.842623 run osmo-stp_10.42.42.5(pid=9920): stderr: | [0;m[38;5;43m20221208201527547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201527547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201527548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201527548 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201527549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201527549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201527549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:28.968942 run osmo-stp_10.42.42.5(pid=9920): stdout: | (launched: 2022-12-08_20:15:27.374064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:29.089147 run osmo-stp_10.42.42.5(pid=9920): stderr: | [0;m[38;5;43m20221208201527547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201527547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201527548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201527548 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201527549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201527549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201527549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:29.233121 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9920): Process ended prematurely: osmo-stp_10.42.42.5(pid=9920) [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9920)] [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 20:15:29.241960 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 20:15:29.268661 run osmo-hlr_10.42.42.2(pid=9917): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9917)] 20:15:29.316347 run osmo-hlr_10.42.42.2(pid=9917): stdout: | (launched: 2022-12-08_20:15:26.432048) 20:15:29.365646 run osmo-hlr_10.42.42.2(pid=9917): stderr: | [0;m[1;31m20221208201526610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201526610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201526610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201526610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201526610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201526610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201526623 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201526631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201526631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201526631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:15:29.434219 run osmo-msc_10.42.42.6(pid=9923): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9923)] 20:15:29.481793 run osmo-msc_10.42.42.6(pid=9923): stdout: | (launched: 2022-12-08_20:15:28.357942) 20:15:29.530845 run osmo-msc_10.42.42.6(pid=9923): stderr: | [0;m[38;5;43m20221208201528633 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208201528633 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd2f86d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208201528633 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208201528633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208201528633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208201528634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208201528636 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208201528636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208201528636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208201528636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:15:29.580548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9916): Terminating (SIGTERM) 20:15:29.620050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9919): Terminating (SIGTERM) 20:15:29.659573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9922): Terminating (SIGTERM) 20:15:29.699573 --- ParallelTerminationStrategy: PID 9916 died... 20:15:29.718522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9916): Terminated: ok {rc=0} 20:15:29.762910 --- ParallelTerminationStrategy: PID 9919 died... 20:15:29.781504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9919): Terminated: ok {rc=0} 20:15:29.826697 --- ParallelTerminationStrategy: PID 9922 died... 20:15:29.845510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9922): Terminated: ok {rc=0} 20:15:29.932210 bus /sierra_3: Setting Powered False 20:15:31.030493 bus /sierra_3: Setting Powered False 20:15:32.161105 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 20:15:33.309439 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:33.321231 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:15:33.380814 tst mo_mt_call_osmux.py: using LAC 16540 20:15:33.499225 tst mo_mt_call_osmux.py: using RAC 220 20:15:33.619744 tst mo_mt_call_osmux.py: using CellId 16540 20:15:33.738383 tst mo_mt_call_osmux.py: using BVCI 16541 20:15:33.849317 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:33.860388 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:33.871372 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:33.882529 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:33.893715 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:33.904928 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:15:34.026303 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:15:34.144110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:15:34.610965 run create_hlr_db(pid=9925): Launched 20:15:34.725764 bus /sierra_2: Setting Powered False 20:15:35.785266 run create_hlr_db(pid=9925): Terminated: ok {rc=0} 20:15:36.226857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9927): Launched 20:15:36.531663 run osmo-hlr_10.42.42.2(pid=9928): Launched 20:15:36.646366 run osmo-stp_10.42.42.5: Starting osmo-stp 20:15:37.166163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9930): Launched 20:15:37.465328 run osmo-stp_10.42.42.5(pid=9931): Launched 20:15:37.579980 run osmo-msc_10.42.42.6: Starting osmo-msc 20:15:38.121353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9933): Launched 20:15:38.421425 run osmo-msc_10.42.42.6(pid=9934): Launched 20:15:38.589509 run osmo-stp_10.42.42.5(pid=9931): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9931)] 20:15:38.716702 run osmo-stp_10.42.42.5(pid=9931): stdout: | (launched: 2022-12-08_20:15:37.410158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:38.844216 run osmo-stp_10.42.42.5(pid=9931): stderr: | [0;m[38;5;43m20221208201537578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201537578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201537579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201537579 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201537579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201537580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201537580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:38.969973 run osmo-stp_10.42.42.5(pid=9931): stdout: | (launched: 2022-12-08_20:15:37.410158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:39.089271 run osmo-stp_10.42.42.5(pid=9931): stderr: | [0;m[38;5;43m20221208201537578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201537578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201537579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201537579 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201537579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201537580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201537580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:39.231667 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9931): Process ended prematurely: osmo-stp_10.42.42.5(pid=9931) [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9931)] [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 20:15:39.240435 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 20:15:39.266679 run osmo-hlr_10.42.42.2(pid=9928): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9928)] 20:15:39.314300 run osmo-hlr_10.42.42.2(pid=9928): stdout: | (launched: 2022-12-08_20:15:36.476841) 20:15:39.363200 run osmo-hlr_10.42.42.2(pid=9928): stderr: | [0;m[1;31m20221208201536648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201536648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201536648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201536648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201536648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201536648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201536660 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201536669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201536669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201536669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:15:39.431203 run osmo-msc_10.42.42.6(pid=9934): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9934)] 20:15:39.478276 run osmo-msc_10.42.42.6(pid=9934): stdout: | (launched: 2022-12-08_20:15:38.366506) 20:15:39.526780 run osmo-msc_10.42.42.6(pid=9934): stderr: | [0;m[38;5;43m20221208201538636 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208201538636 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6d6c85fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208201538636 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208201538636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208201538636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208201538636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208201538638 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208201538639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208201538639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208201538639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:15:39.576035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9927): Terminating (SIGTERM) 20:15:39.615326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9930): Terminating (SIGTERM) 20:15:39.654804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9933): Terminating (SIGTERM) 20:15:39.695054 --- ParallelTerminationStrategy: PID 9927 died... 20:15:39.713923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9927): Terminated: ok {rc=0} 20:15:39.757806 --- ParallelTerminationStrategy: PID 9930 died... 20:15:39.776291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9930): Terminated: ok {rc=0} 20:15:39.820456 --- ParallelTerminationStrategy: PID 9933 died... 20:15:39.838852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9933): Terminated: ok {rc=0} 20:15:39.923781 bus /sierra_3: Setting Powered False 20:15:41.022961 bus /sierra_3: Setting Powered False 20:15:42.137579 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 20:15:43.374581 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:15:43.381582 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 20:15:43.403050 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 20:15:43.430303 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 20:15:43.486113 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 20:15:43.507860 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 20:15:43.535136 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 20:15:44.079731 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 20:15:44.129130 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:15:44.140338 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:15:44.199432 tst mo_mt_call.py: using LAC 16541 20:15:44.317931 tst mo_mt_call.py: using RAC 221 20:15:44.436942 tst mo_mt_call.py: using CellId 16541 20:15:44.553452 tst mo_mt_call.py: using BVCI 16542 20:15:44.663015 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:15:44.674048 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:15:44.684888 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:15:44.695988 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:15:44.706989 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:15:44.718264 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:15:44.837794 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:15:44.957858 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:15:45.460836 run create_hlr_db(pid=9940): Launched 20:15:45.593128 bus /sierra_2: Setting Powered False 20:15:46.669411 run create_hlr_db(pid=9940): Terminated: ok {rc=0} 20:15:47.189506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9942): Launched 20:15:47.516744 run osmo-hlr_10.42.42.2(pid=9943): Launched 20:15:47.639725 run osmo-stp_10.42.42.5: Starting osmo-stp 20:15:48.194849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9945): Launched 20:15:48.519137 run osmo-stp_10.42.42.5(pid=9946): Launched 20:15:48.642779 run osmo-msc_10.42.42.6: Starting osmo-msc 20:15:49.226850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9948): Launched 20:15:49.551447 run osmo-msc_10.42.42.6(pid=9949): Launched 20:15:49.732038 run osmo-stp_10.42.42.5(pid=9946): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9946)] 20:15:49.868245 run osmo-stp_10.42.42.5(pid=9946): stdout: | (launched: 2022-12-08_20:15:48.460417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:50.005621 run osmo-stp_10.42.42.5(pid=9946): stderr: | [0;m[38;5;43m20221208201548649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201548649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201548649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201548650 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201548650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201548650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201548650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:50.141620 run osmo-stp_10.42.42.5(pid=9946): stdout: | (launched: 2022-12-08_20:15:48.460417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:50.270551 run osmo-stp_10.42.42.5(pid=9946): stderr: | [0;m[38;5;43m20221208201548649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201548649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201548649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201548650 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201548650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201548650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201548650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:50.425524 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9946): Process ended prematurely: osmo-stp_10.42.42.5(pid=9946) [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9946)] [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 20:15:50.434918 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:15:50.462724 run osmo-hlr_10.42.42.2(pid=9943): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9943)] 20:15:50.513120 run osmo-hlr_10.42.42.2(pid=9943): stdout: | (launched: 2022-12-08_20:15:47.457639) 20:15:50.565293 run osmo-hlr_10.42.42.2(pid=9943): stderr: | [0;m[1;31m20221208201547652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201547652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201547652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201547652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201547652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201547652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201547664 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201547673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201547673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201547673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:15:50.638015 run osmo-msc_10.42.42.6(pid=9949): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9949)] 20:15:50.688257 run osmo-msc_10.42.42.6(pid=9949): stdout: | (launched: 2022-12-08_20:15:49.492477) 20:15:50.740034 run osmo-msc_10.42.42.6(pid=9949): stderr: | [0;m[38;5;43m20221208201549811 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208201549812 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f125f705c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208201549812 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208201549812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208201549812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208201549812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208201549814 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208201549814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208201549814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208201549815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:15:50.792313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9942): Terminating (SIGTERM) 20:15:50.834120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9945): Terminating (SIGTERM) 20:15:50.876110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9948): Terminating (SIGTERM) 20:15:50.918359 --- ParallelTerminationStrategy: PID 9942 died... 20:15:50.938409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9942): Terminated: ok {rc=0} 20:15:50.985131 --- ParallelTerminationStrategy: PID 9945 died... 20:15:51.005196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9945): Terminated: ok {rc=0} 20:15:51.051385 --- ParallelTerminationStrategy: PID 9948 died... 20:15:51.071013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9948): Terminated: ok {rc=0} 20:15:51.159049 bus /sierra_3: Setting Powered False 20:15:52.257637 bus /sierra_3: Setting Powered False 20:15:53.375000 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 20:15:54.522061 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:15:54.533669 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:15:54.590881 tst mo_mt_call_osmux.py: using LAC 16542 20:15:54.711176 tst mo_mt_call_osmux.py: using RAC 222 20:15:54.831076 tst mo_mt_call_osmux.py: using CellId 16542 20:15:54.952911 tst mo_mt_call_osmux.py: using BVCI 16543 20:15:55.063499 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:15:55.074580 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:15:55.085436 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:15:55.096395 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:15:55.107557 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:15:55.118801 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:15:55.238641 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:15:55.364544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:15:55.866772 run create_hlr_db(pid=9951): Launched 20:15:55.998340 bus /sierra_2: Setting Powered False 20:15:57.062643 run create_hlr_db(pid=9951): Terminated: ok {rc=0} 20:15:57.493778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9953): Launched 20:15:57.794752 run osmo-hlr_10.42.42.2(pid=9954): Launched 20:15:57.908406 run osmo-stp_10.42.42.5: Starting osmo-stp 20:15:58.424372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9956): Launched 20:15:58.724939 run osmo-stp_10.42.42.5(pid=9957): Launched 20:15:58.840383 run osmo-msc_10.42.42.6: Starting osmo-msc 20:15:59.383725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9959): Launched 20:15:59.685403 run osmo-msc_10.42.42.6(pid=9960): Launched 20:15:59.854190 run osmo-stp_10.42.42.5(pid=9957): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9957)] 20:15:59.982513 run osmo-stp_10.42.42.5(pid=9957): stdout: | (launched: 2022-12-08_20:15:58.670022) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:00.110544 run osmo-stp_10.42.42.5(pid=9957): stderr: | [0;m[38;5;43m20221208201558837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201558837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201558837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201558838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201558838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201558838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201558838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:00.237102 run osmo-stp_10.42.42.5(pid=9957): stdout: | (launched: 2022-12-08_20:15:58.670022) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:00.356650 run osmo-stp_10.42.42.5(pid=9957): stderr: | [0;m[38;5;43m20221208201558837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201558837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201558837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201558838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201558838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201558838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201558838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:00.500909 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9957): Process ended prematurely: osmo-stp_10.42.42.5(pid=9957) [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9957)] [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 20:16:00.510193 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 20:16:00.536780 run osmo-hlr_10.42.42.2(pid=9954): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9954)] 20:16:00.584630 run osmo-hlr_10.42.42.2(pid=9954): stdout: | (launched: 2022-12-08_20:15:57.739862) 20:16:00.633994 run osmo-hlr_10.42.42.2(pid=9954): stderr: | [0;m[1;31m20221208201557910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201557910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201557910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201557910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201557910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201557910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201557922 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201557931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201557932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201557932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:16:00.702718 run osmo-msc_10.42.42.6(pid=9960): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9960)] 20:16:00.750443 run osmo-msc_10.42.42.6(pid=9960): stdout: | (launched: 2022-12-08_20:15:59.630324) 20:16:00.799726 run osmo-msc_10.42.42.6(pid=9960): stderr: | [0;m[38;5;43m20221208201559897 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208201559897 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f44c12cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208201559898 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208201559898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208201559898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208201559898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208201559900 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208201559900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208201559900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208201559900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:16:00.859213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9953): Terminating (SIGTERM) 20:16:00.922734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9956): Terminating (SIGTERM) 20:16:00.963484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9959): Terminating (SIGTERM) 20:16:01.004151 --- ParallelTerminationStrategy: PID 9953 died... 20:16:01.023454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9953): Terminated: ok {rc=0} 20:16:01.069333 --- ParallelTerminationStrategy: PID 9956 died... 20:16:01.088378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9956): Terminated: ok {rc=0} 20:16:01.133692 --- ParallelTerminationStrategy: PID 9959 died... 20:16:01.152907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9959): Terminated: ok {rc=0} 20:16:01.237879 bus /sierra_3: Setting Powered False 20:16:02.333389 bus /sierra_3: Setting Powered False 20:16:03.448527 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 20:16:04.683954 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:16:04.690694 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 20:16:04.711818 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 20:16:04.740449 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 20:16:04.791333 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 20:16:04.812689 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 20:16:04.840012 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 20:16:05.393312 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 20:16:05.444803 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:05.456314 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:16:05.511856 tst mo_mt_call.py: using LAC 16543 20:16:05.630189 tst mo_mt_call.py: using RAC 223 20:16:05.750331 tst mo_mt_call.py: using CellId 16543 20:16:05.869026 tst mo_mt_call.py: using BVCI 16544 20:16:05.978348 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:05.989379 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:06.000063 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:06.011090 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:06.022280 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:06.033265 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:16:06.153410 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:16:06.272026 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:16:06.737900 run create_hlr_db(pid=9968): Launched 20:16:06.852796 bus /sierra_2: Setting Powered False 20:16:07.913211 run create_hlr_db(pid=9968): Terminated: ok {rc=0} 20:16:08.332584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9970): Launched 20:16:08.634325 run osmo-hlr_10.42.42.2(pid=9971): Launched 20:16:08.748940 run osmo-stp_10.42.42.5: Starting osmo-stp 20:16:09.263658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9973): Launched 20:16:09.565453 run osmo-stp_10.42.42.5(pid=9974): Launched 20:16:09.680816 run osmo-msc_10.42.42.6: Starting osmo-msc 20:16:10.224719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9976): Launched 20:16:10.526835 run osmo-msc_10.42.42.6(pid=9977): Launched 20:16:10.695454 run osmo-stp_10.42.42.5(pid=9974): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9974)] 20:16:10.823147 run osmo-stp_10.42.42.5(pid=9974): stdout: | (launched: 2022-12-08_20:16:09.510294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:10.950938 run osmo-stp_10.42.42.5(pid=9974): stderr: | [0;m[38;5;43m20221208201609677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201609677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201609678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201609678 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201609679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201609679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201609679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:11.077437 run osmo-stp_10.42.42.5(pid=9974): stdout: | (launched: 2022-12-08_20:16:09.510294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:11.196912 run osmo-stp_10.42.42.5(pid=9974): stderr: | [0;m[38;5;43m20221208201609677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201609677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201609678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201609678 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201609679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201609679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201609679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:11.340218 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9974): Process ended prematurely: osmo-stp_10.42.42.5(pid=9974) [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9974)] [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 20:16:11.349015 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 20:16:11.375633 run osmo-hlr_10.42.42.2(pid=9971): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9971)] 20:16:11.423865 run osmo-hlr_10.42.42.2(pid=9971): stdout: | (launched: 2022-12-08_20:16:08.579256) 20:16:11.473629 run osmo-hlr_10.42.42.2(pid=9971): stderr: | [0;m[1;31m20221208201608752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201608752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201608752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201608752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201608752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201608752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201608764 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201608773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201608773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201608773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:16:11.543130 run osmo-msc_10.42.42.6(pid=9977): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9977)] 20:16:11.591034 run osmo-msc_10.42.42.6(pid=9977): stdout: | (launched: 2022-12-08_20:16:10.470973) 20:16:11.640432 run osmo-msc_10.42.42.6(pid=9977): stderr: | [0;m[38;5;43m20221208201610740 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208201610740 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4bdd326c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208201610740 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208201610740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208201610741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208201610741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208201610742 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208201610743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208201610743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208201610743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:16:11.690441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9970): Terminating (SIGTERM) 20:16:11.730402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9973): Terminating (SIGTERM) 20:16:11.770295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9976): Terminating (SIGTERM) 20:16:11.810551 --- ParallelTerminationStrategy: PID 9970 died... 20:16:11.829750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9970): Terminated: ok {rc=0} 20:16:11.874521 --- ParallelTerminationStrategy: PID 9973 died... 20:16:11.893039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9973): Terminated: ok {rc=0} 20:16:11.937658 --- ParallelTerminationStrategy: PID 9976 died... 20:16:11.956263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9976): Terminated: ok {rc=0} 20:16:12.041714 bus /sierra_3: Setting Powered False 20:16:13.140931 bus /sierra_3: Setting Powered False 20:16:14.256248 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 20:16:15.401715 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:15.413303 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:16:15.469459 tst mo_mt_call_osmux.py: using LAC 16544 20:16:15.590026 tst mo_mt_call_osmux.py: using RAC 224 20:16:15.708552 tst mo_mt_call_osmux.py: using CellId 16544 20:16:15.826325 tst mo_mt_call_osmux.py: using BVCI 16545 20:16:15.971545 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:15.983512 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:15.996625 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:16.008528 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:16.020697 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:16.034002 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:16:16.149369 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:16:16.293305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:16:16.892621 run create_hlr_db(pid=9979): Launched 20:16:17.044592 bus /sierra_2: Setting Powered False 20:16:18.104909 run create_hlr_db(pid=9979): Terminated: ok {rc=0} 20:16:18.523528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9981): Launched 20:16:18.848477 run osmo-hlr_10.42.42.2(pid=9982): Launched 20:16:18.971232 run osmo-stp_10.42.42.5: Starting osmo-stp 20:16:19.528031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9984): Launched 20:16:19.852142 run osmo-stp_10.42.42.5(pid=9985): Launched 20:16:19.975051 run osmo-msc_10.42.42.6: Starting osmo-msc 20:16:20.560560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9987): Launched 20:16:20.885061 run osmo-msc_10.42.42.6(pid=9988): Launched 20:16:21.066317 run osmo-stp_10.42.42.5(pid=9985): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9985)] 20:16:21.203357 run osmo-stp_10.42.42.5(pid=9985): stdout: | (launched: 2022-12-08_20:16:19.793363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:21.341256 run osmo-stp_10.42.42.5(pid=9985): stderr: | [0;m[38;5;43m20221208201619979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201619979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201619979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201619980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201619980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201619980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201619980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:21.477286 run osmo-stp_10.42.42.5(pid=9985): stdout: | (launched: 2022-12-08_20:16:19.793363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:21.606560 run osmo-stp_10.42.42.5(pid=9985): stderr: | [0;m[38;5;43m20221208201619979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201619979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201619979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201619980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201619980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201619980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201619980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:21.760867 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9985): Process ended prematurely: osmo-stp_10.42.42.5(pid=9985) [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9985)] [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 20:16:21.770384 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 20:16:21.798409 run osmo-hlr_10.42.42.2(pid=9982): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9982)] 20:16:21.849137 run osmo-hlr_10.42.42.2(pid=9982): stdout: | (launched: 2022-12-08_20:16:18.789580) 20:16:21.901403 run osmo-hlr_10.42.42.2(pid=9982): stderr: | [0;m[1;31m20221208201618983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201618983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201618983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201618983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201618983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201618983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201618996 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201619004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201619005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201619005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:16:21.974122 run osmo-msc_10.42.42.6(pid=9988): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9988)] 20:16:22.024432 run osmo-msc_10.42.42.6(pid=9988): stdout: | (launched: 2022-12-08_20:16:20.825873) 20:16:22.076225 run osmo-msc_10.42.42.6(pid=9988): stderr: | [0;m[38;5;43m20221208201621144 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208201621144 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1999f4ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208201621144 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208201621144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208201621144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208201621144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208201621146 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208201621147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208201621147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208201621147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:16:22.128724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9981): Terminating (SIGTERM) 20:16:22.170524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9984): Terminating (SIGTERM) 20:16:22.212581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9987): Terminating (SIGTERM) 20:16:22.255007 --- ParallelTerminationStrategy: PID 9981 died... 20:16:22.275229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9981): Terminated: ok {rc=0} 20:16:22.321827 --- ParallelTerminationStrategy: PID 9984 died... 20:16:22.341337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9984): Terminated: ok {rc=0} 20:16:22.387608 --- ParallelTerminationStrategy: PID 9987 died... 20:16:22.407265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9987): Terminated: ok {rc=0} 20:16:22.494739 bus /sierra_3: Setting Powered False 20:16:23.594137 bus /sierra_3: Setting Powered False 20:16:24.712084 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 20:16:25.954205 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:16:25.961075 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 20:16:25.982095 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 20:16:26.009499 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 20:16:26.060409 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 20:16:26.081578 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 20:16:26.108729 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 20:16:26.662877 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 20:16:26.714610 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:26.726085 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:16:26.781492 tst mo_mt_call.py: using LAC 16545 20:16:26.906327 tst mo_mt_call.py: using RAC 225 20:16:27.031839 tst mo_mt_call.py: using CellId 16545 20:16:27.158600 tst mo_mt_call.py: using BVCI 16546 20:16:27.276871 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:27.288400 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:27.299690 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:27.311032 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:27.322364 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:27.333719 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:16:27.449254 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:16:27.569900 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:16:28.036152 run create_hlr_db(pid=9993): Launched 20:16:28.151999 bus /sierra_2: Setting Powered False 20:16:29.212586 run create_hlr_db(pid=9993): Terminated: ok {rc=0} 20:16:29.633508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9995): Launched 20:16:29.935365 run osmo-hlr_10.42.42.2(pid=9996): Launched 20:16:30.050475 run osmo-stp_10.42.42.5: Starting osmo-stp 20:16:30.579716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9998): Launched 20:16:30.889734 run osmo-stp_10.42.42.5(pid=9999): Launched 20:16:31.167274 run osmo-msc_10.42.42.6: Starting osmo-msc 20:16:31.790169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10001): Launched 20:16:32.130230 run osmo-msc_10.42.42.6(pid=10002): Launched 20:16:32.382534 run osmo-stp_10.42.42.5(pid=9999): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9999)] 20:16:32.521694 run osmo-stp_10.42.42.5(pid=9999): stdout: | (launched: 2022-12-08_20:16:30.826307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:32.663595 run osmo-stp_10.42.42.5(pid=9999): stderr: | [0;m[38;5;43m20221208201631095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201631095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201631095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201631096 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201631096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201631096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201631096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:32.800246 run osmo-stp_10.42.42.5(pid=9999): stdout: | (launched: 2022-12-08_20:16:30.826307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:32.929207 run osmo-stp_10.42.42.5(pid=9999): stderr: | [0;m[38;5;43m20221208201631095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201631095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201631095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201631096 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201631096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201631096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201631096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:33.083708 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9999): Process ended prematurely: osmo-stp_10.42.42.5(pid=9999) [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9999)] [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 20:16:33.093238 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:16:33.121467 run osmo-hlr_10.42.42.2(pid=9996): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9996)] 20:16:33.172378 run osmo-hlr_10.42.42.2(pid=9996): stdout: | (launched: 2022-12-08_20:16:29.880296) 20:16:33.225361 run osmo-hlr_10.42.42.2(pid=9996): stderr: | [0;m[1;31m20221208201630053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201630053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201630053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201630053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201630053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201630053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201630065 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201630073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201630074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201630074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:16:33.298926 run osmo-msc_10.42.42.6(pid=10002): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10002)] 20:16:33.350390 run osmo-msc_10.42.42.6(pid=10002): stdout: | (launched: 2022-12-08_20:16:32.070806) 20:16:33.402857 run osmo-msc_10.42.42.6(pid=10002): stderr: | [0;m[38;5;43m20221208201632434 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208201632434 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4482136c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208201632434 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208201632434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208201632434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208201632434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208201632436 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208201632436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208201632437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208201632437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:16:33.455774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9995): Terminating (SIGTERM) 20:16:33.498062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9998): Terminating (SIGTERM) 20:16:33.540594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10001): Terminating (SIGTERM) 20:16:33.583786 --- ParallelTerminationStrategy: PID 9995 died... 20:16:33.604037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9995): Terminated: ok {rc=0} 20:16:33.650823 --- ParallelTerminationStrategy: PID 9998 died... 20:16:33.670705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9998): Terminated: ok {rc=0} 20:16:33.717272 --- ParallelTerminationStrategy: PID 10001 died... 20:16:33.736927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10001): Terminated: ok {rc=0} 20:16:33.825854 bus /sierra_3: Setting Powered False 20:16:34.925045 bus /sierra_3: Setting Powered False 20:16:36.040752 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 20:16:37.184043 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:37.195724 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:16:37.251687 tst mo_mt_call_osmux.py: using LAC 16546 20:16:37.371802 tst mo_mt_call_osmux.py: using RAC 226 20:16:37.492628 tst mo_mt_call_osmux.py: using CellId 16546 20:16:37.621384 tst mo_mt_call_osmux.py: using BVCI 16547 20:16:37.739584 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:37.751252 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:37.762728 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:37.774248 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:37.785876 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:37.797416 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:16:37.911799 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:16:38.032759 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:16:38.538798 run create_hlr_db(pid=10004): Launched 20:16:38.672633 bus /sierra_2: Setting Powered False 20:16:39.738172 run create_hlr_db(pid=10004): Terminated: ok {rc=0} 20:16:40.190795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10006): Launched 20:16:40.517495 run osmo-hlr_10.42.42.2(pid=10007): Launched 20:16:40.642061 run osmo-stp_10.42.42.5: Starting osmo-stp 20:16:41.204021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10009): Launched 20:16:41.527481 run osmo-stp_10.42.42.5(pid=10010): Launched 20:16:41.650551 run osmo-msc_10.42.42.6: Starting osmo-msc 20:16:42.235754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10012): Launched 20:16:42.560186 run osmo-msc_10.42.42.6(pid=10013): Launched 20:16:42.740671 run osmo-stp_10.42.42.5(pid=10010): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10010)] 20:16:42.878191 run osmo-stp_10.42.42.5(pid=10010): stdout: | (launched: 2022-12-08_20:16:41.468925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:43.015290 run osmo-stp_10.42.42.5(pid=10010): stderr: | [0;m[38;5;43m20221208201641657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201641657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201641658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201641658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201641658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201641659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201641659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:43.151492 run osmo-stp_10.42.42.5(pid=10010): stdout: | (launched: 2022-12-08_20:16:41.468925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:43.281052 run osmo-stp_10.42.42.5(pid=10010): stderr: | [0;m[38;5;43m20221208201641657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201641657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201641658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201641658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201641658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201641659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201641659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:43.435683 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10010): Process ended prematurely: osmo-stp_10.42.42.5(pid=10010) [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10010)] [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 20:16:43.445326 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:16:43.473153 run osmo-hlr_10.42.42.2(pid=10007): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10007)] 20:16:43.523236 run osmo-hlr_10.42.42.2(pid=10007): stdout: | (launched: 2022-12-08_20:16:40.458913) 20:16:43.574885 run osmo-hlr_10.42.42.2(pid=10007): stderr: | [0;m[1;31m20221208201640654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201640654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201640654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201640654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201640654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201640655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201640668 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201640678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201640678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201640678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:16:43.647171 run osmo-msc_10.42.42.6(pid=10013): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10013)] 20:16:43.697606 run osmo-msc_10.42.42.6(pid=10013): stdout: | (launched: 2022-12-08_20:16:42.501190) 20:16:43.749384 run osmo-msc_10.42.42.6(pid=10013): stderr: | [0;m[38;5;43m20221208201642822 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208201642822 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f55b0582c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208201642822 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208201642822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208201642823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208201642823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208201642824 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208201642825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208201642825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208201642825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:16:43.801367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10006): Terminating (SIGTERM) 20:16:43.843168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10009): Terminating (SIGTERM) 20:16:43.885066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10012): Terminating (SIGTERM) 20:16:43.927319 --- ParallelTerminationStrategy: PID 10006 died... 20:16:43.947158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10006): Terminated: ok {rc=0} 20:16:43.993446 --- ParallelTerminationStrategy: PID 10009 died... 20:16:44.013178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10009): Terminated: ok {rc=0} 20:16:44.059216 --- ParallelTerminationStrategy: PID 10012 died... 20:16:44.078825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10012): Terminated: ok {rc=0} 20:16:44.165863 bus /sierra_3: Setting Powered False 20:16:45.263755 bus /sierra_3: Setting Powered False 20:16:46.386493 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 20:16:47.631330 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:16:47.638195 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 20:16:47.659481 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 20:16:47.687162 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 20:16:47.739288 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 20:16:47.760719 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 20:16:47.788073 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 20:16:48.341376 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 20:16:48.392922 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:16:48.404384 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:16:48.462448 tst mo_mt_call.py: using LAC 16547 20:16:48.592290 tst mo_mt_call.py: using RAC 227 20:16:48.712863 tst mo_mt_call.py: using CellId 16547 20:16:48.832716 tst mo_mt_call.py: using BVCI 16548 20:16:48.942874 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:16:48.954238 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:16:48.965219 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:16:48.976586 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:16:48.988033 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:16:48.999583 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:16:49.121143 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:16:49.238472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:16:49.707986 run create_hlr_db(pid=10018): Launched 20:16:49.823269 bus /sierra_2: Setting Powered False 20:16:50.883229 run create_hlr_db(pid=10018): Terminated: ok {rc=0} 20:16:51.329238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10020): Launched 20:16:51.656208 run osmo-hlr_10.42.42.2(pid=10021): Launched 20:16:51.780134 run osmo-stp_10.42.42.5: Starting osmo-stp 20:16:52.343512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10023): Launched 20:16:52.669662 run osmo-stp_10.42.42.5(pid=10024): Launched 20:16:52.795453 run osmo-msc_10.42.42.6: Starting osmo-msc 20:16:53.386564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10026): Launched 20:16:53.713350 run osmo-msc_10.42.42.6(pid=10027): Launched 20:16:53.896317 run osmo-stp_10.42.42.5(pid=10024): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10024)] 20:16:54.033688 run osmo-stp_10.42.42.5(pid=10024): stdout: | (launched: 2022-12-08_20:16:52.610208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:54.171876 run osmo-stp_10.42.42.5(pid=10024): stderr: | [0;m[38;5;43m20221208201652799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201652799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201652799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201652800 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201652800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201652800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201652800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:54.309409 run osmo-stp_10.42.42.5(pid=10024): stdout: | (launched: 2022-12-08_20:16:52.610208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:54.438799 run osmo-stp_10.42.42.5(pid=10024): stderr: | [0;m[38;5;43m20221208201652799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201652799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201652799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201652800 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201652800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201652800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201652800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:54.593866 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10024): Process ended prematurely: osmo-stp_10.42.42.5(pid=10024) [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10024)] [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 20:16:54.603294 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:16:54.631084 run osmo-hlr_10.42.42.2(pid=10021): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10021)] 20:16:54.681138 run osmo-hlr_10.42.42.2(pid=10021): stdout: | (launched: 2022-12-08_20:16:51.597354) 20:16:54.732562 run osmo-hlr_10.42.42.2(pid=10021): stderr: | [0;m[1;31m20221208201651792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201651792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201651792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201651792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201651792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201651792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201651805 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201651815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201651816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201651816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:16:54.804366 run osmo-msc_10.42.42.6(pid=10027): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10027)] 20:16:54.854751 run osmo-msc_10.42.42.6(pid=10027): stdout: | (launched: 2022-12-08_20:16:53.654349) 20:16:54.906863 run osmo-msc_10.42.42.6(pid=10027): stderr: | [0;m[38;5;43m20221208201653972 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208201653972 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4e4b70fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208201653973 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208201653973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208201653973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208201653973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208201653975 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208201653975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208201653975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208201653975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:16:54.959016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10020): Terminating (SIGTERM) 20:16:55.000796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10023): Terminating (SIGTERM) 20:16:55.042486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10026): Terminating (SIGTERM) 20:16:55.084682 --- ParallelTerminationStrategy: PID 10020 died... 20:16:55.104197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10020): Terminated: ok {rc=0} 20:16:55.150250 --- ParallelTerminationStrategy: PID 10023 died... 20:16:55.169766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10023): Terminated: ok {rc=0} 20:16:55.215761 --- ParallelTerminationStrategy: PID 10026 died... 20:16:55.235540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10026): Terminated: ok {rc=0} 20:16:55.323519 bus /sierra_3: Setting Powered False 20:16:56.422194 bus /sierra_3: Setting Powered False 20:16:57.537707 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 20:16:58.681923 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:16:58.693692 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:16:58.750048 tst mo_mt_call_osmux.py: using LAC 16548 20:16:58.870075 tst mo_mt_call_osmux.py: using RAC 228 20:16:58.991117 tst mo_mt_call_osmux.py: using CellId 16548 20:16:59.111407 tst mo_mt_call_osmux.py: using BVCI 16549 20:16:59.223041 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:16:59.234188 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:16:59.245138 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:16:59.256099 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:16:59.267157 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:16:59.278299 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:16:59.394313 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:16:59.514059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:17:00.021363 run create_hlr_db(pid=10029): Launched 20:17:00.153777 bus /sierra_2: Setting Powered False 20:17:01.232403 run create_hlr_db(pid=10029): Terminated: ok {rc=0} 20:17:01.699948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10044): Launched 20:17:02.043510 run osmo-hlr_10.42.42.2(pid=10047): Launched 20:17:02.351647 run osmo-stp_10.42.42.5: Starting osmo-stp 20:17:02.932688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10050): Launched 20:17:03.259938 run osmo-stp_10.42.42.5(pid=10051): Launched 20:17:03.383254 run osmo-msc_10.42.42.6: Starting osmo-msc 20:17:03.969949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10053): Launched 20:17:04.297233 run osmo-msc_10.42.42.6(pid=10054): Launched 20:17:04.478295 run osmo-stp_10.42.42.5(pid=10051): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10051)] 20:17:04.615828 run osmo-stp_10.42.42.5(pid=10051): stdout: | (launched: 2022-12-08_20:17:03.199978) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:04.753982 run osmo-stp_10.42.42.5(pid=10051): stderr: | [0;m[38;5;43m20221208201703390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201703390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201703390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201703391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201703392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201703392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201703392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:04.890309 run osmo-stp_10.42.42.5(pid=10051): stdout: | (launched: 2022-12-08_20:17:03.199978) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:05.020287 run osmo-stp_10.42.42.5(pid=10051): stderr: | [0;m[38;5;43m20221208201703390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201703390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201703390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201703391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201703392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201703392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201703392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:05.175110 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10051): Process ended prematurely: osmo-stp_10.42.42.5(pid=10051) [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10051)] [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 20:17:05.184337 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 20:17:05.212299 run osmo-hlr_10.42.42.2(pid=10047): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10047)] 20:17:05.262705 run osmo-hlr_10.42.42.2(pid=10047): stdout: | (launched: 2022-12-08_20:17:01.969287) 20:17:05.314761 run osmo-hlr_10.42.42.2(pid=10047): stderr: | [0;m[1;31m20221208201702173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201702173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201702173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201702173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201702173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201702174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201702194 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201702208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201702208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201702208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:17:05.389303 run osmo-msc_10.42.42.6(pid=10054): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10054)] 20:17:05.439354 run osmo-msc_10.42.42.6(pid=10054): stdout: | (launched: 2022-12-08_20:17:04.237806) 20:17:05.490851 run osmo-msc_10.42.42.6(pid=10054): stderr: | [0;m[38;5;43m20221208201704559 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208201704559 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe8b9f21c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208201704559 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208201704559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208201704559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208201704559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208201704561 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208201704562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208201704562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208201704562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:17:05.542877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10044): Terminating (SIGTERM) 20:17:05.584582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10050): Terminating (SIGTERM) 20:17:05.626374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10053): Terminating (SIGTERM) 20:17:05.668359 --- ParallelTerminationStrategy: PID 10044 died... 20:17:05.688390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10044): Terminated: ok {rc=0} 20:17:05.734440 --- ParallelTerminationStrategy: PID 10050 died... 20:17:05.754027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10050): Terminated: ok {rc=0} 20:17:05.800081 --- ParallelTerminationStrategy: PID 10053 died... 20:17:05.819633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10053): Terminated: ok {rc=0} 20:17:05.906727 bus /sierra_3: Setting Powered False 20:17:07.001867 bus /sierra_3: Setting Powered False 20:17:08.116375 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:17:09.357689 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:17:09.364402 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:17:09.385490 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 20:17:09.413796 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:17:09.467307 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:17:09.488618 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 20:17:09.515723 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:17:10.067091 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 20:17:10.118645 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:10.130145 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:17:10.188520 tst mo_mt_call.py: using LAC 16549 20:17:10.318555 tst mo_mt_call.py: using RAC 229 20:17:10.445780 tst mo_mt_call.py: using CellId 16549 20:17:10.575719 tst mo_mt_call.py: using BVCI 16550 20:17:10.695254 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:10.706913 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:10.718270 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:10.729631 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:10.740806 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:10.752275 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:17:10.867200 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:17:10.987063 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:17:11.489458 run create_hlr_db(pid=10059): Launched 20:17:11.622246 bus /sierra_2: Setting Powered False 20:17:12.687695 run create_hlr_db(pid=10059): Terminated: ok {rc=0} 20:17:13.118833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10061): Launched 20:17:13.422799 run osmo-hlr_10.42.42.2(pid=10062): Launched 20:17:13.537754 run osmo-stp_10.42.42.5: Starting osmo-stp 20:17:14.055918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10064): Launched 20:17:14.357388 run osmo-stp_10.42.42.5(pid=10065): Launched 20:17:14.472217 run osmo-msc_10.42.42.6: Starting osmo-msc 20:17:15.019129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10067): Launched 20:17:15.323104 run osmo-msc_10.42.42.6(pid=10068): Launched 20:17:15.491238 run osmo-stp_10.42.42.5(pid=10065): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10065)] 20:17:15.622030 run osmo-stp_10.42.42.5(pid=10065): stdout: | (launched: 2022-12-08_20:17:14.302292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:15.750820 run osmo-stp_10.42.42.5(pid=10065): stderr: | [0;m[38;5;43m20221208201714470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201714470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201714471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201714471 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201714472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201714472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201714472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:15.893776 run osmo-stp_10.42.42.5(pid=10065): stdout: | (launched: 2022-12-08_20:17:14.302292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:16.027031 run osmo-stp_10.42.42.5(pid=10065): stderr: | [0;m[38;5;43m20221208201714470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201714470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201714471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201714471 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201714472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201714472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201714472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:16.185054 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10065): Process ended prematurely: osmo-stp_10.42.42.5(pid=10065) [trial-2349↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10065)] [trial-2349↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 20:17:16.196172 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 20:17:16.225339 run osmo-hlr_10.42.42.2(pid=10062): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10062)] 20:17:16.277210 run osmo-hlr_10.42.42.2(pid=10062): stdout: | (launched: 2022-12-08_20:17:13.367897) 20:17:16.330712 run osmo-hlr_10.42.42.2(pid=10062): stderr: | [0;m[1;31m20221208201713539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201713539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201713539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201713539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201713539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201713539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201713551 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201713561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201713561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201713561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:17:16.405965 run osmo-msc_10.42.42.6(pid=10068): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10068)] 20:17:16.457693 run osmo-msc_10.42.42.6(pid=10068): stdout: | (launched: 2022-12-08_20:17:15.266988) 20:17:16.510802 run osmo-msc_10.42.42.6(pid=10068): stderr: | [0;m[38;5;43m20221208201715537 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208201715537 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9884fc2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208201715537 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208201715537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208201715537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208201715538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208201715539 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208201715540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208201715540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208201715540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:17:16.565624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10061): Terminating (SIGTERM) 20:17:16.610650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10064): Terminating (SIGTERM) 20:17:16.655705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10067): Terminating (SIGTERM) 20:17:16.701549 --- ParallelTerminationStrategy: PID 10061 died... 20:17:16.722258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10061): Terminated: ok {rc=0} 20:17:16.771049 --- ParallelTerminationStrategy: PID 10064 died... 20:17:16.792455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10064): Terminated: ok {rc=0} 20:17:16.840683 --- ParallelTerminationStrategy: PID 10067 died... 20:17:16.861618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10067): Terminated: ok {rc=0} 20:17:16.952479 bus /sierra_3: Setting Powered False 20:17:18.048770 bus /sierra_3: Setting Powered False 20:17:19.163628 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 20:17:20.309811 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:20.321530 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:17:20.378689 tst mo_mt_call_osmux.py: using LAC 16550 20:17:20.500077 tst mo_mt_call_osmux.py: using RAC 230 20:17:20.620661 tst mo_mt_call_osmux.py: using CellId 16550 20:17:20.740503 tst mo_mt_call_osmux.py: using BVCI 16551 20:17:20.852470 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:20.863602 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:20.874446 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:20.885589 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:20.896891 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:20.908141 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:17:21.028258 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:17:21.147452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:17:21.615253 run create_hlr_db(pid=10070): Launched 20:17:21.730310 bus /sierra_2: Setting Powered False 20:17:22.790773 run create_hlr_db(pid=10070): Terminated: ok {rc=0} 20:17:23.212818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10072): Launched 20:17:23.515871 run osmo-hlr_10.42.42.2(pid=10073): Launched 20:17:23.630912 run osmo-stp_10.42.42.5: Starting osmo-stp 20:17:24.165412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10075): Launched 20:17:24.469315 run osmo-stp_10.42.42.5(pid=10076): Launched 20:17:24.584658 run osmo-msc_10.42.42.6: Starting osmo-msc 20:17:25.131374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10078): Launched 20:17:25.434402 run osmo-msc_10.42.42.6(pid=10079): Launched 20:17:25.603852 run osmo-stp_10.42.42.5(pid=10076): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10076)] 20:17:25.731865 run osmo-stp_10.42.42.5(pid=10076): stdout: | (launched: 2022-12-08_20:17:24.414008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:25.860227 run osmo-stp_10.42.42.5(pid=10076): stderr: | [0;m[38;5;43m20221208201724580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201724580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201724581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201724581 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201724582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201724582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201724582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:25.987004 run osmo-stp_10.42.42.5(pid=10076): stdout: | (launched: 2022-12-08_20:17:24.414008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:26.107269 run osmo-stp_10.42.42.5(pid=10076): stderr: | [0;m[38;5;43m20221208201724580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201724580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201724581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201724581 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201724582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201724582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201724582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:26.251338 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10076): Process ended prematurely: osmo-stp_10.42.42.5(pid=10076) [trial-2349↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10076)] [trial-2349↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 20:17:26.260340 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 20:17:26.286919 run osmo-hlr_10.42.42.2(pid=10073): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10073)] 20:17:26.334836 run osmo-hlr_10.42.42.2(pid=10073): stdout: | (launched: 2022-12-08_20:17:23.460658) 20:17:26.383978 run osmo-hlr_10.42.42.2(pid=10073): stderr: | [0;m[1;31m20221208201723635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201723635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201723635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201723635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201723635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201723635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201723647 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201723655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201723655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201723655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:17:26.452632 run osmo-msc_10.42.42.6(pid=10079): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10079)] 20:17:26.499959 run osmo-msc_10.42.42.6(pid=10079): stdout: | (launched: 2022-12-08_20:17:25.378588) 20:17:26.548933 run osmo-msc_10.42.42.6(pid=10079): stderr: | [0;m[38;5;43m20221208201725650 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208201725650 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f04273e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208201725650 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208201725650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208201725650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208201725651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208201725652 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208201725653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208201725653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208201725653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:17:26.598584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10072): Terminating (SIGTERM) 20:17:26.637922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10075): Terminating (SIGTERM) 20:17:26.677488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10078): Terminating (SIGTERM) 20:17:26.717512 --- ParallelTerminationStrategy: PID 10072 died... 20:17:26.736507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10072): Terminated: ok {rc=0} 20:17:26.780826 --- ParallelTerminationStrategy: PID 10075 died... 20:17:26.799482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10075): Terminated: ok {rc=0} 20:17:26.843750 --- ParallelTerminationStrategy: PID 10078 died... 20:17:26.862368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10078): Terminated: ok {rc=0} 20:17:26.947982 bus /sierra_3: Setting Powered False 20:17:28.047174 bus /sierra_3: Setting Powered False 20:17:29.160645 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:17:30.395852 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:17:30.401956 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:17:30.423919 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 20:17:30.451228 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 20:17:30.503458 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:17:30.524937 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 20:17:30.552211 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 20:17:31.126100 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 20:17:31.188307 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:31.201620 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:17:31.261058 tst mo_mt_call.py: using LAC 16551 20:17:31.433897 tst mo_mt_call.py: using RAC 231 20:17:31.559463 tst mo_mt_call.py: using CellId 16551 20:17:31.690285 tst mo_mt_call.py: using BVCI 16552 20:17:31.849458 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:31.862424 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:31.875515 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:31.888201 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:31.901096 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:31.913636 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:17:32.063025 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:17:32.215080 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:17:32.689322 run create_hlr_db(pid=10084): Launched 20:17:32.806677 bus /sierra_2: Setting Powered False 20:17:33.867890 run create_hlr_db(pid=10084): Terminated: ok {rc=0} 20:17:34.288636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10086): Launched 20:17:34.590448 run osmo-hlr_10.42.42.2(pid=10087): Launched 20:17:34.704606 run osmo-stp_10.42.42.5: Starting osmo-stp 20:17:35.226660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10089): Launched 20:17:35.528715 run osmo-stp_10.42.42.5(pid=10090): Launched 20:17:35.643471 run osmo-msc_10.42.42.6: Starting osmo-msc 20:17:36.192663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10093): Launched 20:17:36.494037 run osmo-msc_10.42.42.6(pid=10094): Launched 20:17:36.662332 run osmo-stp_10.42.42.5(pid=10090): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10090)] 20:17:36.790592 run osmo-stp_10.42.42.5(pid=10090): stdout: | (launched: 2022-12-08_20:17:35.473373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:36.920268 run osmo-stp_10.42.42.5(pid=10090): stderr: | [0;m[38;5;43m20221208201735643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201735643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201735644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201735644 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201735645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201735645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201735645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:37.046521 run osmo-stp_10.42.42.5(pid=10090): stdout: | (launched: 2022-12-08_20:17:35.473373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:37.167142 run osmo-stp_10.42.42.5(pid=10090): stderr: | [0;m[38;5;43m20221208201735643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201735643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201735644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201735644 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201735645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201735645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201735645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:37.311175 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10090): Process ended prematurely: osmo-stp_10.42.42.5(pid=10090) [trial-2349↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10090)] [trial-2349↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 20:17:37.319974 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:17:37.347785 run osmo-hlr_10.42.42.2(pid=10087): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10087)] 20:17:37.395734 run osmo-hlr_10.42.42.2(pid=10087): stdout: | (launched: 2022-12-08_20:17:34.534797) 20:17:37.445445 run osmo-hlr_10.42.42.2(pid=10087): stderr: | [0;m[1;31m20221208201734708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201734708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201734708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201734708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201734708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201734708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201734724 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201734734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201734734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201734734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:17:37.515014 run osmo-msc_10.42.42.6(pid=10094): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10094)] 20:17:37.563079 run osmo-msc_10.42.42.6(pid=10094): stdout: | (launched: 2022-12-08_20:17:36.438884) 20:17:37.613358 run osmo-msc_10.42.42.6(pid=10094): stderr: | [0;m[38;5;43m20221208201736709 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208201736709 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcdc6687c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208201736709 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208201736709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208201736709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208201736710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208201736711 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208201736712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208201736712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208201736712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:17:37.663414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10086): Terminating (SIGTERM) 20:17:37.703133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10089): Terminating (SIGTERM) 20:17:37.743306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10093): Terminating (SIGTERM) 20:17:37.783602 --- ParallelTerminationStrategy: PID 10086 died... 20:17:37.802872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10086): Terminated: ok {rc=0} 20:17:37.847940 --- ParallelTerminationStrategy: PID 10089 died... 20:17:37.866770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10089): Terminated: ok {rc=0} 20:17:37.911423 --- ParallelTerminationStrategy: PID 10093 died... 20:17:37.930252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10093): Terminated: ok {rc=0} 20:17:38.013788 bus /sierra_3: Setting Powered False 20:17:39.112603 bus /sierra_3: Setting Powered False 20:17:40.230324 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 20:17:41.374704 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:41.386284 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:17:41.445306 tst mo_mt_call_osmux.py: using LAC 16552 20:17:41.564548 tst mo_mt_call_osmux.py: using RAC 232 20:17:41.683083 tst mo_mt_call_osmux.py: using CellId 16552 20:17:41.803074 tst mo_mt_call_osmux.py: using BVCI 16553 20:17:41.912445 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:41.923444 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:41.934127 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:41.945070 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:41.955919 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:41.966850 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:17:42.081792 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:17:42.203760 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:17:42.709961 run create_hlr_db(pid=10096): Launched 20:17:42.843613 bus /sierra_2: Setting Powered False 20:17:43.908171 run create_hlr_db(pid=10096): Terminated: ok {rc=0} 20:17:44.341551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10098): Launched 20:17:44.646077 run osmo-hlr_10.42.42.2(pid=10099): Launched 20:17:44.762137 run osmo-stp_10.42.42.5: Starting osmo-stp 20:17:45.281612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10101): Launched 20:17:45.584542 run osmo-stp_10.42.42.5(pid=10102): Launched 20:17:45.699291 run osmo-msc_10.42.42.6: Starting osmo-msc 20:17:46.286597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10104): Launched 20:17:46.609915 run osmo-msc_10.42.42.6(pid=10105): Launched 20:17:46.940208 run osmo-stp_10.42.42.5(pid=10102): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10102)] 20:17:47.152757 run osmo-stp_10.42.42.5(pid=10102): stdout: | (launched: 2022-12-08_20:17:45.529196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:47.352171 run osmo-stp_10.42.42.5(pid=10102): stderr: | [0;m[38;5;43m20221208201745696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201745696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201745696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201745696 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201745697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201745697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201745697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:47.521653 run osmo-stp_10.42.42.5(pid=10102): stdout: | (launched: 2022-12-08_20:17:45.529196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:47.641959 run osmo-stp_10.42.42.5(pid=10102): stderr: | [0;m[38;5;43m20221208201745696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201745696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201745696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201745696 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201745697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201745697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201745697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:47.786283 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10102): Process ended prematurely: osmo-stp_10.42.42.5(pid=10102) [trial-2349↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10102)] [trial-2349↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 20:17:47.795438 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 20:17:47.822773 run osmo-hlr_10.42.42.2(pid=10099): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10099)] 20:17:47.871126 run osmo-hlr_10.42.42.2(pid=10099): stdout: | (launched: 2022-12-08_20:17:44.590662) 20:17:47.921222 run osmo-hlr_10.42.42.2(pid=10099): stderr: | [0;m[1;31m20221208201744763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201744763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201744763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201744763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201744763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201744763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201744775 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201744783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201744784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201744784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:17:47.990872 run osmo-msc_10.42.42.6(pid=10105): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10105)] 20:17:48.039136 run osmo-msc_10.42.42.6(pid=10105): stdout: | (launched: 2022-12-08_20:17:46.547079) 20:17:48.088735 run osmo-msc_10.42.42.6(pid=10105): stderr: | [0;m[38;5;43m20221208201747022 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208201747022 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4689c29c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208201747022 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208201747023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208201747024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208201747024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208201747026 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208201747026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208201747026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208201747026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:17:48.138846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10098): Terminating (SIGTERM) 20:17:48.178788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10101): Terminating (SIGTERM) 20:17:48.218649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10104): Terminating (SIGTERM) 20:17:48.258955 --- ParallelTerminationStrategy: PID 10098 died... 20:17:48.278095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10098): Terminated: ok {rc=0} 20:17:48.322848 --- ParallelTerminationStrategy: PID 10101 died... 20:17:48.341804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10101): Terminated: ok {rc=0} 20:17:48.386175 --- ParallelTerminationStrategy: PID 10104 died... 20:17:48.404819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10104): Terminated: ok {rc=0} 20:17:48.491054 bus /sierra_3: Setting Powered False 20:17:49.589723 bus /sierra_3: Setting Powered False 20:17:50.704222 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 emergency:oc2g --------------------------------------------------------------------- 20:17:51.938094 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:17:51.943666 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 20:17:51.966026 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 20:17:51.993423 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 20:17:52.082115 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 20:17:52.103801 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 20:17:52.131163 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 20:17:52.714374 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2349 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 20:17:52.719879 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:17:52.731075 tst emergency:oc2g: Using 1 x bts (candidates: 1) 20:17:52.768005 tst emergency_mo_mt_call.py: using LAC 16553 20:17:52.893812 tst emergency_mo_mt_call.py: using RAC 233 20:17:53.019188 tst emergency_mo_mt_call.py: using CellId 16553 20:17:53.144722 tst emergency_mo_mt_call.py: using BVCI 16554 20:17:53.261219 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:17:53.272160 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:17:53.283165 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:17:53.294475 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:17:53.305853 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:17:53.316905 tst emergency:oc2g: Using 1 x modem (candidates: 4) 20:17:53.432786 tst emergency:oc2g: Using 1 x modem (candidates: 4) 20:17:53.553239 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:17:54.012348 run create_hlr_db(pid=10110): Launched 20:17:54.126808 bus /sierra_2: Setting Powered False 20:17:55.186891 run create_hlr_db(pid=10110): Terminated: ok {rc=0} 20:17:55.625788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10112): Launched 20:17:55.947295 run osmo-hlr_10.42.42.2(pid=10113): Launched 20:17:56.067752 run osmo-stp_10.42.42.5: Starting osmo-stp 20:17:56.619974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10115): Launched 20:17:56.938704 run osmo-stp_10.42.42.5(pid=10116): Launched 20:17:57.067142 tst emergency_mo_mt_call.py: using MSISDN 6839 20:17:57.230040 run osmo-msc_10.42.42.6: Starting osmo-msc 20:17:57.805647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10118): Launched 20:17:58.125397 run osmo-msc_10.42.42.6(pid=10119): Launched 20:17:58.303066 run osmo-stp_10.42.42.5(pid=10116): ERR: Terminated: ERROR {rc=1} [trial-2349↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10116)] 20:17:58.437321 run osmo-stp_10.42.42.5(pid=10116): stdout: | (launched: 2022-12-08_20:17:56.880581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:58.571909 run osmo-stp_10.42.42.5(pid=10116): stderr: | [0;m[38;5;43m20221208201757068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201757068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201757068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201757069 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201757069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201757069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201757069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:58.706084 run osmo-stp_10.42.42.5(pid=10116): stdout: | (launched: 2022-12-08_20:17:56.880581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:58.833296 run osmo-stp_10.42.42.5(pid=10116): stderr: | [0;m[38;5;43m20221208201757068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201757068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201757068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201757069 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201757069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201757069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201757069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:58.985085 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10116): Process ended prematurely: osmo-stp_10.42.42.5(pid=10116) [trial-2349↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10116)] [trial-2349↪emergency:oc2g↪emergency_mo_mt_call.py:19] 20:17:58.994201 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 20:17:59.021731 run osmo-hlr_10.42.42.2(pid=10113): ERR: Terminated: ERROR {rc=237} [trial-2349↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10113)] 20:17:59.071728 run osmo-hlr_10.42.42.2(pid=10113): stdout: | (launched: 2022-12-08_20:17:55.889566) 20:17:59.123235 run osmo-hlr_10.42.42.2(pid=10113): stderr: | [0;m[1;31m20221208201756083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201756083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201756083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201756083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201756083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201756083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201756098 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201756106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201756106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201756106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:17:59.194851 run osmo-msc_10.42.42.6(pid=10119): ERR: Terminated: ERROR {rc=2} [trial-2349↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10119)] 20:17:59.244407 run osmo-msc_10.42.42.6(pid=10119): stdout: | (launched: 2022-12-08_20:17:58.067285) 20:17:59.295538 run osmo-msc_10.42.42.6(pid=10119): stderr: | [0;m[38;5;43m20221208201758387 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208201758387 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd5effd4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208201758387 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208201758387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208201758387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208201758388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208201758389 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208201758390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208201758390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208201758390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:17:59.347179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10112): Terminating (SIGTERM) 20:17:59.388791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10115): Terminating (SIGTERM) 20:17:59.430607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10118): Terminating (SIGTERM) 20:17:59.472900 --- ParallelTerminationStrategy: PID 10112 died... 20:17:59.493174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10112): Terminated: ok {rc=0} 20:17:59.539646 --- ParallelTerminationStrategy: PID 10115 died... 20:17:59.559359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10115): Terminated: ok {rc=0} 20:17:59.605991 --- ParallelTerminationStrategy: PID 10118 died... 20:17:59.625757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10118): Terminated: ok {rc=0} 20:17:59.714135 bus /sierra_3: Setting Powered False 20:18:00.813621 bus /sierra_3: Setting Powered False 20:18:01.931979 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 20:18:03.020140 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:18:03.031911 tst emergency:oc2g: Using 1 x bts (candidates: 1) 20:18:03.070454 tst emergency_preemptive_call.py: using LAC 16554 20:18:03.196135 tst emergency_preemptive_call.py: using RAC 234 20:18:03.323105 tst emergency_preemptive_call.py: using CellId 16554 20:18:03.451071 tst emergency_preemptive_call.py: using BVCI 16555 20:18:03.567143 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:18:03.578390 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:18:03.589512 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:18:03.600736 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:18:03.611974 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:18:03.623124 tst emergency:oc2g: Using 1 x modem (candidates: 4) 20:18:03.742348 tst emergency:oc2g: Using 1 x modem (candidates: 4) 20:18:03.859353 tst emergency:oc2g: Using 1 x modem (candidates: 4) 20:18:03.978137 tst emergency:oc2g: Using 1 x modem (candidates: 4) 20:18:04.093363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:18:04.554537 run create_hlr_db(pid=10121): Launched 20:18:04.670033 bus /sierra_2: Setting Powered False 20:18:05.730214 run create_hlr_db(pid=10121): Terminated: ok {rc=0} 20:18:06.169151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10123): Launched 20:18:06.491496 run osmo-hlr_10.42.42.2(pid=10124): Launched 20:18:06.613463 run osmo-stp_10.42.42.5: Starting osmo-stp 20:18:07.167738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10126): Launched 20:18:07.489935 run osmo-stp_10.42.42.5(pid=10127): Launched 20:18:07.620118 tst emergency_preemptive_call.py: using MSISDN 6840 20:18:07.783395 run osmo-msc_10.42.42.6: Starting osmo-msc 20:18:08.356884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10129): Launched 20:18:08.675967 run osmo-msc_10.42.42.6(pid=10130): Launched 20:18:08.853997 run osmo-stp_10.42.42.5(pid=10127): ERR: Terminated: ERROR {rc=1} [trial-2349↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10127)] 20:18:08.987824 run osmo-stp_10.42.42.5(pid=10127): stdout: | (launched: 2022-12-08_20:18:07.430963) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:09.123219 run osmo-stp_10.42.42.5(pid=10127): stderr: | [0;m[38;5;43m20221208201807620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201807621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201807621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201807621 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201807622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201807622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201807622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:09.257144 run osmo-stp_10.42.42.5(pid=10127): stdout: | (launched: 2022-12-08_20:18:07.430963) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:09.384540 run osmo-stp_10.42.42.5(pid=10127): stderr: | [0;m[38;5;43m20221208201807620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201807621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201807621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201807621 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201807622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201807622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201807622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:09.537456 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10127): Process ended prematurely: osmo-stp_10.42.42.5(pid=10127) [trial-2349↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10127)] [trial-2349↪emergency:oc2g↪emergency_preemptive_call.py:32] 20:18:09.546456 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 20:18:09.573999 run osmo-hlr_10.42.42.2(pid=10124): ERR: Terminated: ERROR {rc=237} [trial-2349↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10124)] 20:18:09.623982 run osmo-hlr_10.42.42.2(pid=10124): stdout: | (launched: 2022-12-08_20:18:06.432614) 20:18:09.675658 run osmo-hlr_10.42.42.2(pid=10124): stderr: | [0;m[1;31m20221208201806627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201806627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201806627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201806627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201806627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201806627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201806642 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201806652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201806652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201806652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:18:09.747771 run osmo-msc_10.42.42.6(pid=10130): ERR: Terminated: ERROR {rc=2} [trial-2349↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10130)] 20:18:09.797239 run osmo-msc_10.42.42.6(pid=10130): stdout: | (launched: 2022-12-08_20:18:08.618001) 20:18:09.848651 run osmo-msc_10.42.42.6(pid=10130): stderr: | [0;m[38;5;43m20221208201808936 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208201808936 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdded036c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208201808936 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208201808936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208201808937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208201808937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208201808939 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208201808939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208201808939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208201808939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:18:09.900668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10123): Terminating (SIGTERM) 20:18:09.942049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10126): Terminating (SIGTERM) 20:18:09.983325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10129): Terminating (SIGTERM) 20:18:10.025094 --- ParallelTerminationStrategy: PID 10123 died... 20:18:10.045134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10123): Terminated: ok {rc=0} 20:18:10.091208 --- ParallelTerminationStrategy: PID 10126 died... 20:18:10.110648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10126): Terminated: ok {rc=0} 20:18:10.156730 --- ParallelTerminationStrategy: PID 10129 died... 20:18:10.176228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10129): Terminated: ok {rc=0} 20:18:10.264361 bus /sierra_9: Setting Powered False 20:18:11.363806 bus /sierra_9: Setting Powered False 20:18:12.479661 bus /sierra_8: Setting Powered False 20:18:13.577117 bus /sierra_8: Setting Powered False 20:18:14.692705 bus /sierra_3: Setting Powered False 20:18:15.788737 bus /sierra_3: Setting Powered False 20:18:16.909482 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:oc2g --------------------------------------------------------------------- 20:18:18.175462 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:18:18.180522 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 20:18:18.202251 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 20:18:18.241341 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 20:18:18.327134 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 20:18:18.347729 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 20:18:18.386571 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 20:18:18.975414 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 20:18:19.024833 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:19.035315 tst gprs:oc2g: Using 1 x bts (candidates: 1) 20:18:19.070222 tst cs_paging_gprs_active.py: using LAC 16555 20:18:19.191219 tst cs_paging_gprs_active.py: using RAC 235 20:18:19.311627 tst cs_paging_gprs_active.py: using CellId 16555 20:18:19.432369 tst cs_paging_gprs_active.py: using BVCI 16556 20:18:19.544223 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:19.554752 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:19.565203 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:19.575833 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:19.586683 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:19.597359 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:19.607978 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:19.618780 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:19.629613 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:18:19.744098 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:18:19.866500 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:18:20.069507 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:18:20.373997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10135): Launched 20:18:20.641332 run iperf3-srv_10.42.42.10(pid=10136): Launched 20:18:20.755564 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:18:20.959641 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:18:21.264141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10137): Launched 20:18:21.528932 run iperf3-srv_10.42.42.10(pid=10138): Launched 20:18:21.643027 tst cs_paging_gprs_active.py:38: start network... 20:18:21.846373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:18:22.314579 run create_hlr_db(pid=10139): Launched 20:18:22.429985 bus /sierra_2: Setting Powered False 20:18:23.490450 run create_hlr_db(pid=10139): Terminated: ok {rc=0} 20:18:23.912224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10141): Launched 20:18:24.216393 run osmo-hlr_10.42.42.2(pid=10142): Launched 20:18:24.331751 run osmo-stp_10.42.42.5: Starting osmo-stp 20:18:24.849710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10144): Launched 20:18:25.153136 run osmo-stp_10.42.42.5(pid=10145): Launched 20:18:25.269484 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:18:25.791276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10147): Launched 20:18:25.907433 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:18:26.163277 run patchelf(pid=10148): Launched 20:18:26.331656 run osmo-stp_10.42.42.5(pid=10145): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10145)] 20:18:26.459847 run osmo-stp_10.42.42.5(pid=10145): stdout: | (launched: 2022-12-08_20:18:25.097111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:26.589823 run osmo-stp_10.42.42.5(pid=10145): stderr: | [0;m[38;5;43m20221208201825264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201825264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201825264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201825265 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201825265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201825265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201825265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:26.720028 run osmo-stp_10.42.42.5(pid=10145): stdout: | (launched: 2022-12-08_20:18:25.097111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:26.844721 run osmo-stp_10.42.42.5(pid=10145): stderr: | [0;m[38;5;43m20221208201825264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201825264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201825264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201825265 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201825265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201825265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201825265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:26.991812 run patchelf(pid=10148): Terminating (SIGINT) 20:18:27.162262 run patchelf(pid=10148): Terminated: ok {rc=0} 20:18:27.285152 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10145): Process ended prematurely: osmo-stp_10.42.42.5(pid=10145) [trial-2349↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10145)] [trial-2349↪gprs:oc2g↪cs_paging_gprs_active.py:38] 20:18:27.294607 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 20:18:27.322248 run osmo-hlr_10.42.42.2(pid=10142): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10142)] 20:18:27.370250 run osmo-hlr_10.42.42.2(pid=10142): stdout: | (launched: 2022-12-08_20:18:24.160620) 20:18:27.419799 run osmo-hlr_10.42.42.2(pid=10142): stderr: | [0;m[1;31m20221208201824333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201824333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201824333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201824333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201824334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201824334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201824370 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201824380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201824381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201824381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:18:27.469880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10135): Terminating (SIGTERM) 20:18:27.509886 run iperf3-srv_10.42.42.10(pid=10136): Terminating (SIGTERM) 20:18:27.549754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10137): Terminating (SIGTERM) 20:18:27.589844 run iperf3-srv_10.42.42.10(pid=10138): Terminating (SIGTERM) 20:18:27.629672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10141): Terminating (SIGTERM) 20:18:27.669674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10144): Terminating (SIGTERM) 20:18:27.709618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10147): Terminating (SIGTERM) 20:18:27.750171 --- ParallelTerminationStrategy: PID 10135 died... 20:18:27.769266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10135): Terminated: ok {rc=0} 20:18:27.814222 --- ParallelTerminationStrategy: PID 10136 died... 20:18:27.832726 run iperf3-srv_10.42.42.10(pid=10136): Terminated {rc=256} 20:18:27.877087 --- ParallelTerminationStrategy: PID 10137 died... 20:18:27.895620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10137): Terminated: ok {rc=0} 20:18:27.940133 --- ParallelTerminationStrategy: PID 10138 died... 20:18:27.958997 run iperf3-srv_10.42.42.10(pid=10138): Terminated {rc=256} 20:18:28.003435 --- ParallelTerminationStrategy: PID 10141 died... 20:18:28.022180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10141): Terminated: ok {rc=0} 20:18:28.066461 --- ParallelTerminationStrategy: PID 10144 died... 20:18:28.085358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10144): Terminated: ok {rc=0} 20:18:28.129651 --- ParallelTerminationStrategy: PID 10147 died... 20:18:28.148340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10147): Terminated: ok {rc=0} 20:18:28.231252 bus /gobi_0: Setting Powered False 20:18:29.327525 bus /gobi_0: Setting Powered False 20:18:30.438731 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:oc2g iperf3.py ---------------------------------------------- 20:18:31.586691 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:31.599580 tst gprs:oc2g: Using 1 x bts (candidates: 1) 20:18:31.637474 tst iperf3.py: using LAC 16556 20:18:31.793841 tst iperf3.py: using RAC 236 20:18:31.916660 tst iperf3.py: using CellId 16556 20:18:32.074262 tst iperf3.py: using BVCI 16557 20:18:32.211216 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:32.223037 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:32.234444 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:32.246661 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:32.258743 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:32.271385 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:32.282791 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:32.294083 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:32.304861 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:18:32.426937 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:18:32.649283 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:18:32.975944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10149): Launched 20:18:33.260194 run iperf3-srv_10.42.42.10(pid=10150): Launched 20:18:33.383232 tst iperf3.py:8: start network... 20:18:33.603117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:18:34.109324 run create_hlr_db(pid=10152): Launched 20:18:34.243919 bus /gobi_6: Setting Powered False 20:18:35.309603 run create_hlr_db(pid=10152): Terminated: ok {rc=0} 20:18:35.745023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10154): Launched 20:18:36.047400 run osmo-hlr_10.42.42.2(pid=10155): Launched 20:18:36.162225 run osmo-stp_10.42.42.5: Starting osmo-stp 20:18:36.694153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10157): Launched 20:18:36.996767 run osmo-stp_10.42.42.5(pid=10158): Launched 20:18:37.112434 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:18:37.635397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10160): Launched 20:18:37.753448 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:18:38.009763 run patchelf(pid=10161): Launched 20:18:38.179394 run osmo-stp_10.42.42.5(pid=10158): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10158)] 20:18:38.308482 run osmo-stp_10.42.42.5(pid=10158): stdout: | (launched: 2022-12-08_20:18:36.941524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:38.438799 run osmo-stp_10.42.42.5(pid=10158): stderr: | [0;m[38;5;43m20221208201837107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201837107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201837107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201837108 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201837108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201837108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201837108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:38.569305 run osmo-stp_10.42.42.5(pid=10158): stdout: | (launched: 2022-12-08_20:18:36.941524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:38.693894 run osmo-stp_10.42.42.5(pid=10158): stderr: | [0;m[38;5;43m20221208201837107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201837107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201837107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201837108 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201837108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201837108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201837108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:38.841313 run patchelf(pid=10161): Terminating (SIGINT) 20:18:39.012529 run patchelf(pid=10161): Terminated: ok {rc=0} 20:18:39.135587 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10158): Process ended prematurely: osmo-stp_10.42.42.5(pid=10158) [trial-2349↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10158)] [trial-2349↪gprs:oc2g↪iperf3.py:8] 20:18:39.145138 tst iperf3.py:8: Test FAILED (7.6 sec) 20:18:39.172388 run osmo-hlr_10.42.42.2(pid=10155): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10155)] 20:18:39.221186 run osmo-hlr_10.42.42.2(pid=10155): stdout: | (launched: 2022-12-08_20:18:35.992186) 20:18:39.271070 run osmo-hlr_10.42.42.2(pid=10155): stderr: | [0;m[1;31m20221208201836165 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201836166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201836166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201836166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201836166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201836166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201836178 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201836188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201836189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201836189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:18:39.321648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10149): Terminating (SIGTERM) 20:18:39.362094 run iperf3-srv_10.42.42.10(pid=10150): Terminating (SIGTERM) 20:18:39.402533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10154): Terminating (SIGTERM) 20:18:39.443039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10157): Terminating (SIGTERM) 20:18:39.483128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10160): Terminating (SIGTERM) 20:18:39.523449 --- ParallelTerminationStrategy: PID 10149 died... 20:18:39.542814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10149): Terminated: ok {rc=0} 20:18:39.587956 --- ParallelTerminationStrategy: PID 10150 died... 20:18:39.606775 run iperf3-srv_10.42.42.10(pid=10150): Terminated {rc=256} 20:18:39.651367 --- ParallelTerminationStrategy: PID 10154 died... 20:18:39.670652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10154): Terminated: ok {rc=0} 20:18:39.715439 --- ParallelTerminationStrategy: PID 10157 died... 20:18:39.734403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10157): Terminated: ok {rc=0} 20:18:39.779209 --- ParallelTerminationStrategy: PID 10160 died... 20:18:39.798014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10160): Terminated: ok {rc=0} 20:18:39.884367 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:oc2g iperf3m4.py ---------------------------------------------- 20:18:41.031312 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:41.042540 tst gprs:oc2g: Using 1 x bts (candidates: 1) 20:18:41.085635 tst iperf3m4.py: using LAC 16557 20:18:41.216905 tst iperf3m4.py: using RAC 237 20:18:41.348409 tst iperf3m4.py: using CellId 16557 20:18:41.478716 tst iperf3m4.py: using BVCI 16558 20:18:41.599476 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:41.610919 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:41.622032 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:41.633341 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:41.644427 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:41.655511 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:41.666730 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:41.677799 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:41.689308 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:18:41.804482 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:18:41.928532 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:18:42.043943 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:18:42.162765 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:18:42.383674 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:18:42.712855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10162): Launched 20:18:42.997374 run iperf3-srv_10.42.42.10(pid=10163): Launched 20:18:43.121339 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:18:43.342347 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:18:43.670306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10164): Launched 20:18:43.954978 run iperf3-srv_10.42.42.10(pid=10165): Launched 20:18:44.078748 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:18:44.299389 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:18:44.627117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10166): Launched 20:18:44.912386 run iperf3-srv_10.42.42.10(pid=10167): Launched 20:18:45.034896 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:18:45.254535 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:18:45.582323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10168): Launched 20:18:45.873753 run iperf3-srv_10.42.42.10(pid=10169): Launched 20:18:46.011610 tst iperf3m4.py:8: start network... 20:18:46.220863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:18:46.737766 run create_hlr_db(pid=10170): Launched 20:18:46.901683 bus /gobi_6: Setting Powered False 20:18:47.966467 run create_hlr_db(pid=10170): Terminated: ok {rc=0} 20:18:48.420859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10172): Launched 20:18:48.746953 run osmo-hlr_10.42.42.2(pid=10173): Launched 20:18:48.871504 run osmo-stp_10.42.42.5: Starting osmo-stp 20:18:49.430056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10175): Launched 20:18:49.757722 run osmo-stp_10.42.42.5(pid=10176): Launched 20:18:49.881579 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:18:50.445998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10178): Launched 20:18:50.571057 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:18:50.846739 run patchelf(pid=10179): Launched 20:18:51.030732 run osmo-stp_10.42.42.5(pid=10176): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10176)] 20:18:51.168638 run osmo-stp_10.42.42.5(pid=10176): stdout: | (launched: 2022-12-08_20:18:49.697726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:51.308374 run osmo-stp_10.42.42.5(pid=10176): stderr: | [0;m[38;5;43m20221208201849886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201849886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201849886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201849886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201849887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201849887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201849887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:51.447840 run osmo-stp_10.42.42.5(pid=10176): stdout: | (launched: 2022-12-08_20:18:49.697726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:51.581874 run osmo-stp_10.42.42.5(pid=10176): stderr: | [0;m[38;5;43m20221208201849886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201849886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201849886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201849886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201849887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201849887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201849887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:51.740405 run patchelf(pid=10179): Terminating (SIGINT) 20:18:51.924573 run patchelf(pid=10179): Terminated: ok {rc=0} 20:18:52.056401 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10176): Process ended prematurely: osmo-stp_10.42.42.5(pid=10176) [trial-2349↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10176)] [trial-2349↪gprs:oc2g↪iperf3m4.py:8] 20:18:52.066850 tst iperf3m4.py:8: Test FAILED (11.1 sec) 20:18:52.095975 run osmo-hlr_10.42.42.2(pid=10173): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10173)] 20:18:52.146166 run osmo-hlr_10.42.42.2(pid=10173): stdout: | (launched: 2022-12-08_20:18:48.687644) 20:18:52.198285 run osmo-hlr_10.42.42.2(pid=10173): stderr: | [0;m[1;31m20221208201848882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201848882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201848882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201848882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201848882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201848882 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201848894 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201848903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201848904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201848904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:18:52.250845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10162): Terminating (SIGTERM) 20:18:52.293315 run iperf3-srv_10.42.42.10(pid=10163): Terminating (SIGTERM) 20:18:52.335561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10164): Terminating (SIGTERM) 20:18:52.377872 run iperf3-srv_10.42.42.10(pid=10165): Terminating (SIGTERM) 20:18:52.419994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10166): Terminating (SIGTERM) 20:18:52.462235 run iperf3-srv_10.42.42.10(pid=10167): Terminating (SIGTERM) 20:18:52.504016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10168): Terminating (SIGTERM) 20:18:52.546143 run iperf3-srv_10.42.42.10(pid=10169): Terminating (SIGTERM) 20:18:52.588083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10172): Terminating (SIGTERM) 20:18:52.630226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10175): Terminating (SIGTERM) 20:18:52.672452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10178): Terminating (SIGTERM) 20:18:52.714862 --- ParallelTerminationStrategy: PID 10162 died... 20:18:52.735181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10162): Terminated: ok {rc=0} 20:18:52.781837 --- ParallelTerminationStrategy: PID 10163 died... 20:18:52.801533 run iperf3-srv_10.42.42.10(pid=10163): Terminated {rc=256} 20:18:52.848136 --- ParallelTerminationStrategy: PID 10164 died... 20:18:52.867954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10164): Terminated: ok {rc=0} 20:18:52.914091 --- ParallelTerminationStrategy: PID 10165 died... 20:18:52.934085 run iperf3-srv_10.42.42.10(pid=10165): Terminated {rc=256} 20:18:52.980340 --- ParallelTerminationStrategy: PID 10166 died... 20:18:53.000059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10166): Terminated: ok {rc=0} 20:18:53.046541 --- ParallelTerminationStrategy: PID 10167 died... 20:18:53.066305 run iperf3-srv_10.42.42.10(pid=10167): Terminated {rc=256} 20:18:53.112782 --- ParallelTerminationStrategy: PID 10168 died... 20:18:53.132528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10168): Terminated: ok {rc=0} 20:18:53.178922 --- ParallelTerminationStrategy: PID 10169 died... 20:18:53.198643 run iperf3-srv_10.42.42.10(pid=10169): Terminated {rc=256} 20:18:53.245134 --- ParallelTerminationStrategy: PID 10172 died... 20:18:53.265126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10172): Terminated: ok {rc=0} 20:18:53.312042 --- ParallelTerminationStrategy: PID 10175 died... 20:18:53.331955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10175): Terminated: ok {rc=0} 20:18:53.378532 --- ParallelTerminationStrategy: PID 10178 died... 20:18:53.398337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10178): Terminated: ok {rc=0} 20:18:53.485762 bus /gobi_4: Setting Powered False 20:18:54.584900 bus /gobi_4: Setting Powered False 20:18:55.699149 bus /gobi_1: Setting Powered False 20:18:56.797598 bus /gobi_1: Setting Powered False 20:18:57.914190 bus /gobi_0: Setting Powered False 20:18:59.011731 bus /gobi_0: Setting Powered False 20:19:00.127687 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:oc2g ping.py ---------------------------------------------- 20:19:01.230941 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:01.242953 tst gprs:oc2g: Using 1 x bts (candidates: 1) 20:19:01.281369 tst ping.py: using LAC 16558 20:19:01.440317 tst ping.py: using RAC 238 20:19:01.594003 tst ping.py: using CellId 16558 20:19:01.758396 tst ping.py: using BVCI 16559 20:19:01.906769 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:01.921958 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:01.938066 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:01.952220 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:01.963817 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:01.975135 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:01.987274 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:01.998749 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:19:02.121759 tst ping.py:19: start network... 20:19:02.324533 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:19:02.782227 run create_hlr_db(pid=10180): Launched 20:19:02.895142 bus /gobi_6: Setting Powered False 20:19:03.955051 run create_hlr_db(pid=10180): Terminated: ok {rc=0} 20:19:04.393405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10182): Launched 20:19:04.716406 run osmo-hlr_10.42.42.2(pid=10183): Launched 20:19:04.838361 run osmo-stp_10.42.42.5: Starting osmo-stp 20:19:05.397074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10185): Launched 20:19:05.717433 run osmo-stp_10.42.42.5(pid=10186): Launched 20:19:05.838540 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:19:06.392733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10188): Launched 20:19:06.515524 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:19:06.785977 run patchelf(pid=10189): Launched 20:19:06.965309 run osmo-stp_10.42.42.5(pid=10186): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10186)] 20:19:07.101173 run osmo-stp_10.42.42.5(pid=10186): stdout: | (launched: 2022-12-08_20:19:05.658628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:07.238147 run osmo-stp_10.42.42.5(pid=10186): stderr: | [0;m[38;5;43m20221208201905847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201905847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201905848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201905848 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201905848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201905849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201905849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:07.375877 run osmo-stp_10.42.42.5(pid=10186): stdout: | (launched: 2022-12-08_20:19:05.658628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:07.507194 run osmo-stp_10.42.42.5(pid=10186): stderr: | [0;m[38;5;43m20221208201905847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201905847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201905848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201905848 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201905848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201905849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201905849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:07.662924 run patchelf(pid=10189): Terminating (SIGINT) 20:19:07.843492 run patchelf(pid=10189): Terminated: ok {rc=0} 20:19:07.973953 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10186): Process ended prematurely: osmo-stp_10.42.42.5(pid=10186) [trial-2349↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10186)] [trial-2349↪gprs:oc2g↪ping.py:22] 20:19:07.983852 tst ping.py:22: Test FAILED (6.7 sec) 20:19:08.012355 run osmo-hlr_10.42.42.2(pid=10183): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10183)] 20:19:08.062793 run osmo-hlr_10.42.42.2(pid=10183): stdout: | (launched: 2022-12-08_20:19:04.657623) 20:19:08.115093 run osmo-hlr_10.42.42.2(pid=10183): stderr: | [0;m[1;31m20221208201904851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201904851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201904851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201904851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201904851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201904851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201904864 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201904872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201904872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201904872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:19:08.167842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10182): Terminating (SIGTERM) 20:19:08.212119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10185): Terminating (SIGTERM) 20:19:08.254479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10188): Terminating (SIGTERM) 20:19:08.297431 --- ParallelTerminationStrategy: PID 10182 died... 20:19:08.317770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10182): Terminated: ok {rc=0} 20:19:08.365030 --- ParallelTerminationStrategy: PID 10185 died... 20:19:08.385003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10185): Terminated: ok {rc=0} 20:19:08.431490 --- ParallelTerminationStrategy: PID 10188 died... 20:19:08.451474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10188): Terminated: ok {rc=0} 20:19:08.539197 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 20:19:09.628025 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:09.640196 tst gprs:oc2g: Using 1 x bts (candidates: 1) 20:19:09.678104 tst ping_idle_ping.py: using LAC 16559 20:19:09.805489 tst ping_idle_ping.py: using RAC 239 20:19:09.925916 tst ping_idle_ping.py: using CellId 16559 20:19:10.049064 tst ping_idle_ping.py: using BVCI 16560 20:19:10.158075 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:10.168674 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:10.179299 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:10.190789 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:10.202110 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:10.213524 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:10.224913 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:10.236148 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:19:10.355956 tst ping_idle_ping.py:24: start network... 20:19:10.562498 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:19:11.026364 run create_hlr_db(pid=10190): Launched 20:19:11.140096 bus /gobi_6: Setting Powered False 20:19:12.198434 run create_hlr_db(pid=10190): Terminated: ok {rc=0} 20:19:12.637687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10192): Launched 20:19:12.960602 run osmo-hlr_10.42.42.2(pid=10193): Launched 20:19:13.082589 run osmo-stp_10.42.42.5: Starting osmo-stp 20:19:13.637107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10195): Launched 20:19:13.960103 run osmo-stp_10.42.42.5(pid=10196): Launched 20:19:14.082229 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:19:14.636808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10198): Launched 20:19:14.759697 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:19:15.031307 run patchelf(pid=10199): Launched 20:19:15.212010 run osmo-stp_10.42.42.5(pid=10196): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10196)] 20:19:15.349518 run osmo-stp_10.42.42.5(pid=10196): stdout: | (launched: 2022-12-08_20:19:13.901247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:15.487455 run osmo-stp_10.42.42.5(pid=10196): stderr: | [0;m[38;5;43m20221208201914090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201914090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201914090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201914090 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201914091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201914091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201914091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:15.625746 run osmo-stp_10.42.42.5(pid=10196): stdout: | (launched: 2022-12-08_20:19:13.901247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:15.757688 run osmo-stp_10.42.42.5(pid=10196): stderr: | [0;m[38;5;43m20221208201914090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201914090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201914090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201914090 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201914091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201914091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201914091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:15.942794 run patchelf(pid=10199): Terminating (SIGINT) 20:19:16.124723 run patchelf(pid=10199): Terminated: ok {rc=0} 20:19:16.251121 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10196): Process ended prematurely: osmo-stp_10.42.42.5(pid=10196) [trial-2349↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10196)] [trial-2349↪gprs:oc2g↪ping_idle_ping.py:27] 20:19:16.261189 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 20:19:16.290548 run osmo-hlr_10.42.42.2(pid=10193): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10193)] 20:19:16.342625 run osmo-hlr_10.42.42.2(pid=10193): stdout: | (launched: 2022-12-08_20:19:12.902146) 20:19:16.395178 run osmo-hlr_10.42.42.2(pid=10193): stderr: | [0;m[1;31m20221208201913095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201913095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201913095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201913095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201913095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201913095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201913108 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201913117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201913117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201913117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:19:16.449165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10192): Terminating (SIGTERM) 20:19:16.492890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10195): Terminating (SIGTERM) 20:19:16.536316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10198): Terminating (SIGTERM) 20:19:16.582229 --- ParallelTerminationStrategy: PID 10192 died... 20:19:16.603434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10192): Terminated: ok {rc=0} 20:19:16.652918 --- ParallelTerminationStrategy: PID 10195 died... 20:19:16.673273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10195): Terminated: ok {rc=0} 20:19:16.721267 --- ParallelTerminationStrategy: PID 10198 died... 20:19:16.741215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10198): Terminated: ok {rc=0} 20:19:16.830701 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 20:19:18.118528 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:19:18.124651 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 20:19:18.145872 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 20:19:18.185562 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 20:19:18.274903 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 20:19:18.296170 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 20:19:18.335895 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 20:19:18.925069 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 20:19:18.974331 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:18.984842 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:19:19.022385 tst cs_paging_gprs_active.py: using LAC 16560 20:19:19.140083 tst cs_paging_gprs_active.py: using RAC 240 20:19:19.258380 tst cs_paging_gprs_active.py: using CellId 16560 20:19:19.375939 tst cs_paging_gprs_active.py: using BVCI 16561 20:19:19.485734 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:19.496440 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:19.507522 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:19.519878 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:19.532257 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:19.543130 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:19.554462 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:19.565616 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:19.576783 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:19:19.692854 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:19:19.807849 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:19:20.011071 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:20.311482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10203): Launched 20:19:20.571824 run iperf3-srv_10.42.42.10(pid=10204): Launched 20:19:20.684676 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:19:20.884472 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:21.183782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10205): Launched 20:19:21.443445 run iperf3-srv_10.42.42.10(pid=10206): Launched 20:19:21.555714 tst cs_paging_gprs_active.py:38: start network... 20:19:21.754647 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:19:22.217620 run create_hlr_db(pid=10207): Launched 20:19:22.331941 bus /gobi_6: Setting Powered False 20:19:23.391256 run create_hlr_db(pid=10207): Terminated: ok {rc=0} 20:19:23.830088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10209): Launched 20:19:24.150562 run osmo-hlr_10.42.42.2(pid=10210): Launched 20:19:24.272649 run osmo-stp_10.42.42.5: Starting osmo-stp 20:19:24.827062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10212): Launched 20:19:25.146530 run osmo-stp_10.42.42.5(pid=10213): Launched 20:19:25.267820 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:19:25.818560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10215): Launched 20:19:25.941773 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:19:26.212209 run patchelf(pid=10216): Launched 20:19:26.390468 run osmo-stp_10.42.42.5(pid=10213): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10213)] 20:19:26.526091 run osmo-stp_10.42.42.5(pid=10213): stdout: | (launched: 2022-12-08_20:19:25.088083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:26.663136 run osmo-stp_10.42.42.5(pid=10213): stderr: | [0;m[38;5;43m20221208201925276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201925276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201925276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201925276 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201925277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201925277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201925277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:26.800234 run osmo-stp_10.42.42.5(pid=10213): stdout: | (launched: 2022-12-08_20:19:25.088083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:26.931802 run osmo-stp_10.42.42.5(pid=10213): stderr: | [0;m[38;5;43m20221208201925276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201925276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201925276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201925276 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201925277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201925277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201925277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:27.087419 run patchelf(pid=10216): Terminating (SIGINT) 20:19:27.266421 run patchelf(pid=10216): Terminated: ok {rc=0} 20:19:27.396170 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10213): Process ended prematurely: osmo-stp_10.42.42.5(pid=10213) [trial-2349↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10213)] [trial-2349↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 20:19:27.406413 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 20:19:27.434590 run osmo-hlr_10.42.42.2(pid=10210): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10210)] 20:19:27.484325 run osmo-hlr_10.42.42.2(pid=10210): stdout: | (launched: 2022-12-08_20:19:24.092043) 20:19:27.536036 run osmo-hlr_10.42.42.2(pid=10210): stderr: | [0;m[1;31m20221208201924286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201924286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201924286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201924286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201924286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201924286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201924299 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201924308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201924308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201924308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:19:27.588207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10203): Terminating (SIGTERM) 20:19:27.630107 run iperf3-srv_10.42.42.10(pid=10204): Terminating (SIGTERM) 20:19:27.671940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10205): Terminating (SIGTERM) 20:19:27.713927 run iperf3-srv_10.42.42.10(pid=10206): Terminating (SIGTERM) 20:19:27.755756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10209): Terminating (SIGTERM) 20:19:27.797715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10212): Terminating (SIGTERM) 20:19:27.839441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10215): Terminating (SIGTERM) 20:19:27.881450 --- ParallelTerminationStrategy: PID 10203 died... 20:19:27.901312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10203): Terminated: ok {rc=0} 20:19:27.947199 --- ParallelTerminationStrategy: PID 10204 died... 20:19:27.966648 run iperf3-srv_10.42.42.10(pid=10204): Terminated {rc=256} 20:19:28.012505 --- ParallelTerminationStrategy: PID 10205 died... 20:19:28.031838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10205): Terminated: ok {rc=0} 20:19:28.078015 --- ParallelTerminationStrategy: PID 10206 died... 20:19:28.097435 run iperf3-srv_10.42.42.10(pid=10206): Terminated {rc=256} 20:19:28.143113 --- ParallelTerminationStrategy: PID 10209 died... 20:19:28.162558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10209): Terminated: ok {rc=0} 20:19:28.208345 --- ParallelTerminationStrategy: PID 10212 died... 20:19:28.227853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10212): Terminated: ok {rc=0} 20:19:28.273820 --- ParallelTerminationStrategy: PID 10215 died... 20:19:28.293554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10215): Terminated: ok {rc=0} 20:19:28.381224 bus /gobi_0: Setting Powered False 20:19:29.479084 bus /gobi_0: Setting Powered False 20:19:30.593240 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 20:19:31.737748 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:31.749988 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:19:31.794446 tst iperf3.py: using LAC 16561 20:19:31.951771 tst iperf3.py: using RAC 241 20:19:32.100740 tst iperf3.py: using CellId 16561 20:19:32.220023 tst iperf3.py: using BVCI 16562 20:19:32.331295 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:32.342350 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:32.353173 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:32.364117 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:32.374977 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:32.385961 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:32.396899 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:32.408326 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:32.419185 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:19:32.539232 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:19:32.752371 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:33.071734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10217): Launched 20:19:33.349334 run iperf3-srv_10.42.42.10(pid=10218): Launched 20:19:33.468311 tst iperf3.py:8: start network... 20:19:33.681775 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:19:34.174278 run create_hlr_db(pid=10219): Launched 20:19:34.303290 bus /gobi_6: Setting Powered False 20:19:35.366320 run create_hlr_db(pid=10219): Terminated: ok {rc=0} 20:19:35.809512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10221): Launched 20:19:36.127299 run osmo-hlr_10.42.42.2(pid=10222): Launched 20:19:36.247448 run osmo-stp_10.42.42.5: Starting osmo-stp 20:19:36.793555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10224): Launched 20:19:37.113346 run osmo-stp_10.42.42.5(pid=10225): Launched 20:19:37.234140 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:19:37.782064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10227): Launched 20:19:37.905913 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:19:38.176035 run patchelf(pid=10228): Launched 20:19:38.354138 run osmo-stp_10.42.42.5(pid=10225): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10225)] 20:19:38.489425 run osmo-stp_10.42.42.5(pid=10225): stdout: | (launched: 2022-12-08_20:19:37.055281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:38.626211 run osmo-stp_10.42.42.5(pid=10225): stderr: | [0;m[38;5;43m20221208201937244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201937244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201937244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201937244 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201937245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201937245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201937245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:38.762695 run osmo-stp_10.42.42.5(pid=10225): stdout: | (launched: 2022-12-08_20:19:37.055281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:38.893814 run osmo-stp_10.42.42.5(pid=10225): stderr: | [0;m[38;5;43m20221208201937244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201937244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201937244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201937244 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201937245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201937245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201937245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:39.049245 run patchelf(pid=10228): Terminating (SIGINT) 20:19:39.228385 run patchelf(pid=10228): Terminated: ok {rc=0} 20:19:39.357999 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10225): Process ended prematurely: osmo-stp_10.42.42.5(pid=10225) [trial-2349↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10225)] [trial-2349↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 20:19:39.368000 tst iperf3.py:8: Test FAILED (7.7 sec) 20:19:39.396019 run osmo-hlr_10.42.42.2(pid=10222): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10222)] 20:19:39.445844 run osmo-hlr_10.42.42.2(pid=10222): stdout: | (launched: 2022-12-08_20:19:36.069057) 20:19:39.497235 run osmo-hlr_10.42.42.2(pid=10222): stderr: | [0;m[1;31m20221208201936262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201936262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201936262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201936262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201936262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201936263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201936275 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201936283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201936283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201936283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:19:39.549305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10217): Terminating (SIGTERM) 20:19:39.590757 run iperf3-srv_10.42.42.10(pid=10218): Terminating (SIGTERM) 20:19:39.632053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10221): Terminating (SIGTERM) 20:19:39.673871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10224): Terminating (SIGTERM) 20:19:39.715577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10227): Terminating (SIGTERM) 20:19:39.757438 --- ParallelTerminationStrategy: PID 10217 died... 20:19:39.777332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10217): Terminated: ok {rc=0} 20:19:39.823244 --- ParallelTerminationStrategy: PID 10218 died... 20:19:39.842682 run iperf3-srv_10.42.42.10(pid=10218): Terminated {rc=256} 20:19:39.889092 --- ParallelTerminationStrategy: PID 10221 died... 20:19:39.908870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10221): Terminated: ok {rc=0} 20:19:39.954473 --- ParallelTerminationStrategy: PID 10224 died... 20:19:39.973766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10224): Terminated: ok {rc=0} 20:19:40.019405 --- ParallelTerminationStrategy: PID 10227 died... 20:19:40.038963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10227): Terminated: ok {rc=0} 20:19:40.126608 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 20:19:41.278481 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:41.290629 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:19:41.326769 tst iperf3m4.py: using LAC 16562 20:19:41.452176 tst iperf3m4.py: using RAC 242 20:19:41.579963 tst iperf3m4.py: using CellId 16562 20:19:41.706175 tst iperf3m4.py: using BVCI 16563 20:19:41.823458 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:41.834753 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:41.845872 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:41.856885 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:41.867831 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:41.878821 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:41.890118 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:41.901033 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:41.912168 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:19:42.033639 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:19:42.153469 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:19:42.270076 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:19:42.384591 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:19:42.584439 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:42.884452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10229): Launched 20:19:43.145443 run iperf3-srv_10.42.42.10(pid=10230): Launched 20:19:43.257725 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:19:43.457391 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:43.758012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10231): Launched 20:19:44.018457 run iperf3-srv_10.42.42.10(pid=10232): Launched 20:19:44.130710 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:19:44.330126 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:44.630457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10233): Launched 20:19:44.890064 run iperf3-srv_10.42.42.10(pid=10234): Launched 20:19:45.001966 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:19:45.200697 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:45.500364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10235): Launched 20:19:45.761337 run iperf3-srv_10.42.42.10(pid=10236): Launched 20:19:45.879776 tst iperf3m4.py:8: start network... 20:19:46.083619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:19:46.555329 run create_hlr_db(pid=10237): Launched 20:19:46.686047 bus /gobi_6: Setting Powered False 20:19:47.745880 run create_hlr_db(pid=10237): Terminated: ok {rc=0} 20:19:48.162140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10239): Launched 20:19:48.460822 run osmo-hlr_10.42.42.2(pid=10240): Launched 20:19:48.574719 run osmo-stp_10.42.42.5: Starting osmo-stp 20:19:49.102240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10242): Launched 20:19:49.399562 run osmo-stp_10.42.42.5(pid=10243): Launched 20:19:49.513211 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:19:50.027957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10245): Launched 20:19:50.143640 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:19:50.396344 run patchelf(pid=10246): Launched 20:19:50.565615 run osmo-stp_10.42.42.5(pid=10243): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10243)] 20:19:50.694444 run osmo-stp_10.42.42.5(pid=10243): stdout: | (launched: 2022-12-08_20:19:49.345536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:50.824343 run osmo-stp_10.42.42.5(pid=10243): stderr: | [0;m[38;5;43m20221208201949513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201949513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201949514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201949514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201949514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201949515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201949515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:50.954681 run osmo-stp_10.42.42.5(pid=10243): stdout: | (launched: 2022-12-08_20:19:49.345536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:51.079763 run osmo-stp_10.42.42.5(pid=10243): stderr: | [0;m[38;5;43m20221208201949513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208201949513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208201949514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208201949514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208201949514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208201949515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208201949515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:51.227782 run patchelf(pid=10246): Terminating (SIGINT) 20:19:51.398641 run patchelf(pid=10246): Terminated: ok {rc=0} 20:19:51.521229 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10243): Process ended prematurely: osmo-stp_10.42.42.5(pid=10243) [trial-2349↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10243)] [trial-2349↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 20:19:51.530694 tst iperf3m4.py:8: Test FAILED (10.3 sec) 20:19:51.558662 run osmo-hlr_10.42.42.2(pid=10240): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10240)] 20:19:51.607042 run osmo-hlr_10.42.42.2(pid=10240): stdout: | (launched: 2022-12-08_20:19:48.405638) 20:19:51.657168 run osmo-hlr_10.42.42.2(pid=10240): stderr: | [0;m[1;31m20221208201948576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208201948576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208201948576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208201948576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208201948576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208201948577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208201948589 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208201948598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208201948598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208201948599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:19:51.707657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10229): Terminating (SIGTERM) 20:19:51.747940 run iperf3-srv_10.42.42.10(pid=10230): Terminating (SIGTERM) 20:19:51.788043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10231): Terminating (SIGTERM) 20:19:51.828383 run iperf3-srv_10.42.42.10(pid=10232): Terminating (SIGTERM) 20:19:51.868741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10233): Terminating (SIGTERM) 20:19:51.909204 run iperf3-srv_10.42.42.10(pid=10234): Terminating (SIGTERM) 20:19:51.949676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10235): Terminating (SIGTERM) 20:19:51.990368 run iperf3-srv_10.42.42.10(pid=10236): Terminating (SIGTERM) 20:19:52.030814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10239): Terminating (SIGTERM) 20:19:52.071346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10242): Terminating (SIGTERM) 20:19:52.112430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10245): Terminating (SIGTERM) 20:19:52.153533 --- ParallelTerminationStrategy: PID 10229 died... 20:19:52.172808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10229): Terminated: ok {rc=0} 20:19:52.218364 --- ParallelTerminationStrategy: PID 10230 died... 20:19:52.237567 run iperf3-srv_10.42.42.10(pid=10230): Terminated {rc=256} 20:19:52.282234 --- ParallelTerminationStrategy: PID 10231 died... 20:19:52.300982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10231): Terminated: ok {rc=0} 20:19:52.345711 --- ParallelTerminationStrategy: PID 10232 died... 20:19:52.364282 run iperf3-srv_10.42.42.10(pid=10232): Terminated {rc=256} 20:19:52.408595 --- ParallelTerminationStrategy: PID 10233 died... 20:19:52.427306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10233): Terminated: ok {rc=0} 20:19:52.472232 --- ParallelTerminationStrategy: PID 10234 died... 20:19:52.491057 run iperf3-srv_10.42.42.10(pid=10234): Terminated {rc=256} 20:19:52.535556 --- ParallelTerminationStrategy: PID 10235 died... 20:19:52.554326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10235): Terminated: ok {rc=0} 20:19:52.598643 --- ParallelTerminationStrategy: PID 10236 died... 20:19:52.617273 run iperf3-srv_10.42.42.10(pid=10236): Terminated {rc=256} 20:19:52.661544 --- ParallelTerminationStrategy: PID 10239 died... 20:19:52.680160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10239): Terminated: ok {rc=0} 20:19:52.724578 --- ParallelTerminationStrategy: PID 10242 died... 20:19:52.743388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10242): Terminated: ok {rc=0} 20:19:52.788250 --- ParallelTerminationStrategy: PID 10245 died... 20:19:52.807265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10245): Terminated: ok {rc=0} 20:19:52.895079 bus /gobi_4: Setting Powered False 20:19:53.995683 bus /gobi_4: Setting Powered False 20:19:55.112786 bus /gobi_1: Setting Powered False 20:19:56.213324 bus /gobi_1: Setting Powered False 20:19:57.329747 bus /gobi_0: Setting Powered False 20:19:58.429141 bus /gobi_0: Setting Powered False 20:19:59.545567 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 20:20:00.651065 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:00.663133 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:20:00.701911 tst ping.py: using LAC 16563 20:20:00.827967 tst ping.py: using RAC 243 20:20:00.988394 tst ping.py: using CellId 16563 20:20:01.132512 tst ping.py: using BVCI 16564 20:20:01.251171 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:01.262959 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:01.274789 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:01.286837 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:01.298677 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:01.310523 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:01.322924 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:01.334825 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:20:01.452074 tst ping.py:19: start network... 20:20:01.675038 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:20:02.174673 run create_hlr_db(pid=10250): Launched 20:20:02.327871 bus /gobi_6: Setting Powered False 20:20:03.391112 run create_hlr_db(pid=10250): Terminated: ok {rc=0} 20:20:03.816836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10252): Launched 20:20:04.117620 run osmo-hlr_10.42.42.2(pid=10253): Launched 20:20:04.230907 run osmo-stp_10.42.42.5: Starting osmo-stp 20:20:04.753952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10255): Launched 20:20:05.051194 run osmo-stp_10.42.42.5(pid=10256): Launched 20:20:05.163281 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:20:05.675123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10258): Launched 20:20:05.788872 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:20:06.039933 run patchelf(pid=10259): Launched 20:20:06.205641 run osmo-stp_10.42.42.5(pid=10256): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10256)] 20:20:06.332388 run osmo-stp_10.42.42.5(pid=10256): stdout: | (launched: 2022-12-08_20:20:04.996492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:06.461197 run osmo-stp_10.42.42.5(pid=10256): stderr: | [0;m[38;5;43m20221208202005164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202005164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202005164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202005165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202005165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202005166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202005166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:06.589223 run osmo-stp_10.42.42.5(pid=10256): stdout: | (launched: 2022-12-08_20:20:04.996492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:06.711269 run osmo-stp_10.42.42.5(pid=10256): stderr: | [0;m[38;5;43m20221208202005164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202005164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202005164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202005165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202005165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202005166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202005166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:06.855686 run patchelf(pid=10259): Terminating (SIGINT) 20:20:07.023840 run patchelf(pid=10259): Terminated: ok {rc=0} 20:20:07.145688 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10256): Process ended prematurely: osmo-stp_10.42.42.5(pid=10256) [trial-2349↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10256)] [trial-2349↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 20:20:07.154465 tst ping.py:22: Test FAILED (6.5 sec) 20:20:07.181775 run osmo-hlr_10.42.42.2(pid=10253): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10253)] 20:20:07.230750 run osmo-hlr_10.42.42.2(pid=10253): stdout: | (launched: 2022-12-08_20:20:04.062968) 20:20:07.281222 run osmo-hlr_10.42.42.2(pid=10253): stderr: | [0;m[1;31m20221208202004234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202004234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202004234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202004234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202004234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202004234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202004246 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202004255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202004255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202004255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:20:07.331952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10252): Terminating (SIGTERM) 20:20:07.372770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10255): Terminating (SIGTERM) 20:20:07.413537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10258): Terminating (SIGTERM) 20:20:07.454700 --- ParallelTerminationStrategy: PID 10252 died... 20:20:07.474148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10252): Terminated: ok {rc=0} 20:20:07.519637 --- ParallelTerminationStrategy: PID 10255 died... 20:20:07.538633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10255): Terminated: ok {rc=0} 20:20:07.583761 --- ParallelTerminationStrategy: PID 10258 died... 20:20:07.602918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10258): Terminated: ok {rc=0} 20:20:07.689723 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 20:20:08.779167 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:08.791059 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:20:08.829787 tst ping_idle_ping.py: using LAC 16564 20:20:08.951129 tst ping_idle_ping.py: using RAC 244 20:20:09.067863 tst ping_idle_ping.py: using CellId 16564 20:20:09.182228 tst ping_idle_ping.py: using BVCI 16565 20:20:09.289636 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:09.300420 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:09.311201 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:09.321965 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:09.333160 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:09.343948 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:09.354956 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:09.365927 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:20:09.479576 tst ping_idle_ping.py:24: start network... 20:20:09.678369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:20:10.140246 run create_hlr_db(pid=10260): Launched 20:20:10.252881 bus /gobi_6: Setting Powered False 20:20:11.313150 run create_hlr_db(pid=10260): Terminated: ok {rc=0} 20:20:11.731327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10262): Launched 20:20:12.030367 run osmo-hlr_10.42.42.2(pid=10263): Launched 20:20:12.143715 run osmo-stp_10.42.42.5: Starting osmo-stp 20:20:12.671596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10265): Launched 20:20:12.969001 run osmo-stp_10.42.42.5(pid=10266): Launched 20:20:13.082425 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:20:13.596459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10268): Launched 20:20:13.711866 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:20:13.964453 run patchelf(pid=10269): Launched 20:20:14.131076 run osmo-stp_10.42.42.5(pid=10266): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10266)] 20:20:14.258076 run osmo-stp_10.42.42.5(pid=10266): stdout: | (launched: 2022-12-08_20:20:12.914460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:14.386933 run osmo-stp_10.42.42.5(pid=10266): stderr: | [0;m[38;5;43m20221208202013079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202013079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202013080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202013080 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202013080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202013081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202013081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:14.515920 run osmo-stp_10.42.42.5(pid=10266): stdout: | (launched: 2022-12-08_20:20:12.914460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:14.638795 run osmo-stp_10.42.42.5(pid=10266): stderr: | [0;m[38;5;43m20221208202013079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202013079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202013080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202013080 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202013080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202013081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202013081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:14.784259 run patchelf(pid=10269): Terminating (SIGINT) 20:20:14.951972 run patchelf(pid=10269): Terminated: ok {rc=0} 20:20:15.072876 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10266): Process ended prematurely: osmo-stp_10.42.42.5(pid=10266) [trial-2349↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10266)] [trial-2349↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 20:20:15.081833 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 20:20:15.108840 run osmo-hlr_10.42.42.2(pid=10263): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10263)] 20:20:15.157803 run osmo-hlr_10.42.42.2(pid=10263): stdout: | (launched: 2022-12-08_20:20:11.975701) 20:20:15.208092 run osmo-hlr_10.42.42.2(pid=10263): stderr: | [0;m[1;31m20221208202012147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202012147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202012148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202012148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202012148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202012148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202012159 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202012168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202012169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202012169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:20:15.258990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10262): Terminating (SIGTERM) 20:20:15.300137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10265): Terminating (SIGTERM) 20:20:15.340833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10268): Terminating (SIGTERM) 20:20:15.381754 --- ParallelTerminationStrategy: PID 10262 died... 20:20:15.401111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10262): Terminated: ok {rc=0} 20:20:15.446494 --- ParallelTerminationStrategy: PID 10265 died... 20:20:15.465520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10265): Terminated: ok {rc=0} 20:20:15.510691 --- ParallelTerminationStrategy: PID 10268 died... 20:20:15.529515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10268): Terminated: ok {rc=0} 20:20:15.616635 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 20:20:16.954562 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:20:16.963172 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 20:20:16.988481 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 20:20:17.030837 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 20:20:17.124934 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 20:20:17.153182 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 20:20:17.195807 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 20:20:17.779817 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 20:20:17.832237 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:17.843716 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:20:17.901433 tst cs_paging_gprs_active.py: using LAC 16565 20:20:18.028740 tst cs_paging_gprs_active.py: using RAC 245 20:20:18.156154 tst cs_paging_gprs_active.py: using CellId 16565 20:20:18.283544 tst cs_paging_gprs_active.py: using BVCI 16566 20:20:18.402427 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:18.413829 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:18.424925 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:18.436157 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:18.447392 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:18.458664 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:18.470054 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:18.481460 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:18.492849 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:20:18.609892 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:20:18.732808 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:20:18.953992 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:19.281075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10273): Launched 20:20:19.565532 run iperf3-srv_10.42.42.10(pid=10274): Launched 20:20:19.688399 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:20:19.909036 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:20.236175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10275): Launched 20:20:20.521066 run iperf3-srv_10.42.42.10(pid=10276): Launched 20:20:20.643183 tst cs_paging_gprs_active.py:38: start network... 20:20:20.862318 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:20:21.366965 run create_hlr_db(pid=10277): Launched 20:20:21.501701 bus /gobi_6: Setting Powered False 20:20:22.565635 run create_hlr_db(pid=10277): Terminated: ok {rc=0} 20:20:23.000660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10279): Launched 20:20:23.305672 run osmo-hlr_10.42.42.2(pid=10280): Launched 20:20:23.424072 run osmo-stp_10.42.42.5: Starting osmo-stp 20:20:23.959161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10282): Launched 20:20:24.263777 run osmo-stp_10.42.42.5(pid=10283): Launched 20:20:24.380139 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:20:24.906314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10285): Launched 20:20:25.023341 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:20:25.280476 run patchelf(pid=10286): Launched 20:20:25.449934 run osmo-stp_10.42.42.5(pid=10283): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10283)] 20:20:25.579118 run osmo-stp_10.42.42.5(pid=10283): stdout: | (launched: 2022-12-08_20:20:24.207557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:25.710148 run osmo-stp_10.42.42.5(pid=10283): stderr: | [0;m[38;5;43m20221208202024376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202024376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202024376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202024377 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202024377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202024377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202024377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:25.840649 run osmo-stp_10.42.42.5(pid=10283): stdout: | (launched: 2022-12-08_20:20:24.207557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:25.965962 run osmo-stp_10.42.42.5(pid=10283): stderr: | [0;m[38;5;43m20221208202024376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202024376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202024376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202024377 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202024377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202024377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202024377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:26.114400 run patchelf(pid=10286): Terminating (SIGINT) 20:20:26.285454 run patchelf(pid=10286): Terminated: ok {rc=0} 20:20:26.408940 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10283): Process ended prematurely: osmo-stp_10.42.42.5(pid=10283) [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10283)] [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 20:20:26.418713 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 20:20:26.446898 run osmo-hlr_10.42.42.2(pid=10280): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10280)] 20:20:26.495839 run osmo-hlr_10.42.42.2(pid=10280): stdout: | (launched: 2022-12-08_20:20:23.250132) 20:20:26.546422 run osmo-hlr_10.42.42.2(pid=10280): stderr: | [0;m[1;31m20221208202023423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202023423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202023423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202023423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202023423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202023423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202023435 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202023445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202023446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202023446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:20:26.597248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10273): Terminating (SIGTERM) 20:20:26.638078 run iperf3-srv_10.42.42.10(pid=10274): Terminating (SIGTERM) 20:20:26.678586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10275): Terminating (SIGTERM) 20:20:26.719262 run iperf3-srv_10.42.42.10(pid=10276): Terminating (SIGTERM) 20:20:26.759607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10279): Terminating (SIGTERM) 20:20:26.800174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10282): Terminating (SIGTERM) 20:20:26.840458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10285): Terminating (SIGTERM) 20:20:26.881159 --- ParallelTerminationStrategy: PID 10273 died... 20:20:26.900251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10273): Terminated: ok {rc=0} 20:20:26.944925 --- ParallelTerminationStrategy: PID 10274 died... 20:20:26.963553 run iperf3-srv_10.42.42.10(pid=10274): Terminated {rc=256} 20:20:27.007831 --- ParallelTerminationStrategy: PID 10275 died... 20:20:27.026450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10275): Terminated: ok {rc=0} 20:20:27.070736 --- ParallelTerminationStrategy: PID 10276 died... 20:20:27.089322 run iperf3-srv_10.42.42.10(pid=10276): Terminated {rc=256} 20:20:27.133793 --- ParallelTerminationStrategy: PID 10279 died... 20:20:27.152514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10279): Terminated: ok {rc=0} 20:20:27.197396 --- ParallelTerminationStrategy: PID 10282 died... 20:20:27.216106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10282): Terminated: ok {rc=0} 20:20:27.260756 --- ParallelTerminationStrategy: PID 10285 died... 20:20:27.279521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10285): Terminated: ok {rc=0} 20:20:27.364185 bus /gobi_0: Setting Powered False 20:20:28.463072 bus /gobi_0: Setting Powered False 20:20:29.580350 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 20:20:30.730328 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:30.742558 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:20:30.804113 tst iperf3.py: using LAC 16566 20:20:30.947234 tst iperf3.py: using RAC 246 20:20:31.070717 tst iperf3.py: using CellId 16566 20:20:31.202013 tst iperf3.py: using BVCI 16567 20:20:31.342662 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:31.354930 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:31.367127 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:31.379378 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:31.391017 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:31.402796 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:31.415890 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:31.427468 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:31.439338 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:20:31.583313 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:20:31.863650 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:32.184439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10287): Launched 20:20:32.461772 run iperf3-srv_10.42.42.10(pid=10288): Launched 20:20:32.578112 tst iperf3.py:8: start network... 20:20:32.782207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:20:33.254446 run create_hlr_db(pid=10289): Launched 20:20:33.369919 bus /gobi_6: Setting Powered False 20:20:34.430110 run create_hlr_db(pid=10289): Terminated: ok {rc=0} 20:20:34.852160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10291): Launched 20:20:35.154898 run osmo-hlr_10.42.42.2(pid=10292): Launched 20:20:35.269767 run osmo-stp_10.42.42.5: Starting osmo-stp 20:20:35.804930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10294): Launched 20:20:36.108811 run osmo-stp_10.42.42.5(pid=10295): Launched 20:20:36.224638 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:20:36.749405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10297): Launched 20:20:36.866353 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:20:37.124103 run patchelf(pid=10298): Launched 20:20:37.293407 run osmo-stp_10.42.42.5(pid=10295): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10295)] 20:20:37.422834 run osmo-stp_10.42.42.5(pid=10295): stdout: | (launched: 2022-12-08_20:20:36.052900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:37.553421 run osmo-stp_10.42.42.5(pid=10295): stderr: | [0;m[38;5;43m20221208202036222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202036222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202036222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202036223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202036223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202036223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202036223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:37.684208 run osmo-stp_10.42.42.5(pid=10295): stdout: | (launched: 2022-12-08_20:20:36.052900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:37.809408 run osmo-stp_10.42.42.5(pid=10295): stderr: | [0;m[38;5;43m20221208202036222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202036222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202036222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202036223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202036223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202036223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202036223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:37.957377 run patchelf(pid=10298): Terminating (SIGINT) 20:20:38.128629 run patchelf(pid=10298): Terminated: ok {rc=0} 20:20:38.251664 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10295): Process ended prematurely: osmo-stp_10.42.42.5(pid=10295) [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10295)] [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 20:20:38.261175 tst iperf3.py:8: Test FAILED (7.6 sec) 20:20:38.288707 run osmo-hlr_10.42.42.2(pid=10292): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10292)] 20:20:38.337374 run osmo-hlr_10.42.42.2(pid=10292): stdout: | (launched: 2022-12-08_20:20:35.099117) 20:20:38.387697 run osmo-hlr_10.42.42.2(pid=10292): stderr: | [0;m[1;31m20221208202035276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202035276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202035276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202035276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202035276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202035276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202035286 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202035295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202035296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202035296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:20:38.438556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10287): Terminating (SIGTERM) 20:20:38.479008 run iperf3-srv_10.42.42.10(pid=10288): Terminating (SIGTERM) 20:20:38.519553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10291): Terminating (SIGTERM) 20:20:38.560248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10294): Terminating (SIGTERM) 20:20:38.600866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10297): Terminating (SIGTERM) 20:20:38.642433 --- ParallelTerminationStrategy: PID 10287 died... 20:20:38.661644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10287): Terminated: ok {rc=0} 20:20:38.707013 --- ParallelTerminationStrategy: PID 10288 died... 20:20:38.725900 run iperf3-srv_10.42.42.10(pid=10288): Terminated {rc=256} 20:20:38.770811 --- ParallelTerminationStrategy: PID 10291 died... 20:20:38.789764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10291): Terminated: ok {rc=0} 20:20:38.834320 --- ParallelTerminationStrategy: PID 10294 died... 20:20:38.853068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10294): Terminated: ok {rc=0} 20:20:38.898074 --- ParallelTerminationStrategy: PID 10297 died... 20:20:38.917018 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10297): Terminated: ok {rc=0} 20:20:39.004189 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 20:20:40.151557 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:40.163576 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:20:40.221098 tst iperf3m4.py: using LAC 16567 20:20:40.339303 tst iperf3m4.py: using RAC 247 20:20:40.458875 tst iperf3m4.py: using CellId 16567 20:20:40.580020 tst iperf3m4.py: using BVCI 16568 20:20:40.692030 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:40.703216 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:40.714162 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:40.725480 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:40.736526 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:40.747701 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:40.759059 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:40.770306 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:40.782275 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:20:40.902888 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:20:41.023864 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:20:41.143677 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:20:41.264423 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:20:41.484788 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:41.812093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10299): Launched 20:20:42.095369 run iperf3-srv_10.42.42.10(pid=10300): Launched 20:20:42.217161 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:20:42.436303 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:42.762067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10301): Launched 20:20:43.045613 run iperf3-srv_10.42.42.10(pid=10302): Launched 20:20:43.167362 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:20:43.386984 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:43.713431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10303): Launched 20:20:43.995686 run iperf3-srv_10.42.42.10(pid=10304): Launched 20:20:44.117314 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:20:44.335981 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:44.661978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10305): Launched 20:20:44.944615 run iperf3-srv_10.42.42.10(pid=10306): Launched 20:20:45.065979 tst iperf3m4.py:8: start network... 20:20:45.284006 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:20:45.789188 run create_hlr_db(pid=10307): Launched 20:20:45.965345 bus /gobi_6: Setting Powered False 20:20:47.029338 run create_hlr_db(pid=10307): Terminated: ok {rc=0} 20:20:47.514117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10309): Launched 20:20:47.819038 run osmo-hlr_10.42.42.2(pid=10310): Launched 20:20:47.934656 run osmo-stp_10.42.42.5: Starting osmo-stp 20:20:48.461753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10312): Launched 20:20:48.765054 run osmo-stp_10.42.42.5(pid=10313): Launched 20:20:48.880506 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:20:49.403697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10315): Launched 20:20:49.520886 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:20:49.778116 run patchelf(pid=10316): Launched 20:20:49.949976 run osmo-stp_10.42.42.5(pid=10313): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10313)] 20:20:50.079595 run osmo-stp_10.42.42.5(pid=10313): stdout: | (launched: 2022-12-08_20:20:48.709170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:50.210489 run osmo-stp_10.42.42.5(pid=10313): stderr: | [0;m[38;5;43m20221208202048874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202048874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202048875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202048875 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202048875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202048876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202048876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:50.341186 run osmo-stp_10.42.42.5(pid=10313): stdout: | (launched: 2022-12-08_20:20:48.709170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:50.466389 run osmo-stp_10.42.42.5(pid=10313): stderr: | [0;m[38;5;43m20221208202048874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202048874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202048875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202048875 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202048875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202048876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202048876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:50.614715 run patchelf(pid=10316): Terminating (SIGINT) 20:20:50.787334 run patchelf(pid=10316): Terminated: ok {rc=0} 20:20:50.910794 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10313): Process ended prematurely: osmo-stp_10.42.42.5(pid=10313) [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10313)] [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 20:20:50.920443 tst iperf3m4.py:8: Test FAILED (10.8 sec) 20:20:50.948826 run osmo-hlr_10.42.42.2(pid=10310): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10310)] 20:20:50.997602 run osmo-hlr_10.42.42.2(pid=10310): stdout: | (launched: 2022-12-08_20:20:47.763479) 20:20:51.047836 run osmo-hlr_10.42.42.2(pid=10310): stderr: | [0;m[1;31m20221208202047936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202047936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202047936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202047936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202047936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202047936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202047948 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202047956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202047957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202047957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:20:51.098326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10299): Terminating (SIGTERM) 20:20:51.139043 run iperf3-srv_10.42.42.10(pid=10300): Terminating (SIGTERM) 20:20:51.179464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10301): Terminating (SIGTERM) 20:20:51.219414 run iperf3-srv_10.42.42.10(pid=10302): Terminating (SIGTERM) 20:20:51.260121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10303): Terminating (SIGTERM) 20:20:51.300485 run iperf3-srv_10.42.42.10(pid=10304): Terminating (SIGTERM) 20:20:51.340818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10305): Terminating (SIGTERM) 20:20:51.381276 run iperf3-srv_10.42.42.10(pid=10306): Terminating (SIGTERM) 20:20:51.421666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10309): Terminating (SIGTERM) 20:20:51.462142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10312): Terminating (SIGTERM) 20:20:51.502123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10315): Terminating (SIGTERM) 20:20:51.542550 --- ParallelTerminationStrategy: PID 10299 died... 20:20:51.561517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10299): Terminated: ok {rc=0} 20:20:51.606470 --- ParallelTerminationStrategy: PID 10300 died... 20:20:51.625109 run iperf3-srv_10.42.42.10(pid=10300): Terminated {rc=256} 20:20:51.669365 --- ParallelTerminationStrategy: PID 10301 died... 20:20:51.687910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10301): Terminated: ok {rc=0} 20:20:51.732816 --- ParallelTerminationStrategy: PID 10302 died... 20:20:51.751808 run iperf3-srv_10.42.42.10(pid=10302): Terminated {rc=256} 20:20:51.796136 --- ParallelTerminationStrategy: PID 10303 died... 20:20:51.814856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10303): Terminated: ok {rc=0} 20:20:51.859166 --- ParallelTerminationStrategy: PID 10304 died... 20:20:51.877875 run iperf3-srv_10.42.42.10(pid=10304): Terminated {rc=256} 20:20:51.922041 --- ParallelTerminationStrategy: PID 10305 died... 20:20:51.940550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10305): Terminated: ok {rc=0} 20:20:51.984724 --- ParallelTerminationStrategy: PID 10306 died... 20:20:52.003609 run iperf3-srv_10.42.42.10(pid=10306): Terminated {rc=256} 20:20:52.048221 --- ParallelTerminationStrategy: PID 10309 died... 20:20:52.066832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10309): Terminated: ok {rc=0} 20:20:52.111061 --- ParallelTerminationStrategy: PID 10312 died... 20:20:52.129772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10312): Terminated: ok {rc=0} 20:20:52.174600 --- ParallelTerminationStrategy: PID 10315 died... 20:20:52.193423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10315): Terminated: ok {rc=0} 20:20:52.279666 bus /gobi_4: Setting Powered False 20:20:53.382022 bus /gobi_4: Setting Powered False 20:20:54.497773 bus /gobi_1: Setting Powered False 20:20:55.596535 bus /gobi_1: Setting Powered False 20:20:56.713425 bus /gobi_0: Setting Powered False 20:20:57.812386 bus /gobi_0: Setting Powered False 20:20:58.928445 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 20:21:00.031560 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:00.043669 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:21:00.102435 tst ping.py: using LAC 16568 20:21:00.227755 tst ping.py: using RAC 248 20:21:00.353359 tst ping.py: using CellId 16568 20:21:00.481417 tst ping.py: using BVCI 16569 20:21:00.598885 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:00.610686 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:00.621916 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:00.633110 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:00.644167 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:00.655293 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:00.666733 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:00.677887 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:21:00.794853 tst ping.py:19: start network... 20:21:01.022790 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:21:01.628604 run create_hlr_db(pid=10319): Launched 20:21:01.823013 bus /gobi_6: Setting Powered False 20:21:02.882328 run create_hlr_db(pid=10319): Terminated: ok {rc=0} 20:21:03.379953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10321): Launched 20:21:03.699346 run osmo-hlr_10.42.42.2(pid=10322): Launched 20:21:03.822097 run osmo-stp_10.42.42.5: Starting osmo-stp 20:21:04.373281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10324): Launched 20:21:04.691195 run osmo-stp_10.42.42.5(pid=10325): Launched 20:21:04.811744 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:21:05.361769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10327): Launched 20:21:05.486047 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:21:05.755440 run patchelf(pid=10328): Launched 20:21:05.934807 run osmo-stp_10.42.42.5(pid=10325): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10325)] 20:21:06.071994 run osmo-stp_10.42.42.5(pid=10325): stdout: | (launched: 2022-12-08_20:21:04.633092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:06.209779 run osmo-stp_10.42.42.5(pid=10325): stderr: | [0;m[38;5;43m20221208202104823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202104824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202104824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202104824 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202104825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202104825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202104825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:06.347518 run osmo-stp_10.42.42.5(pid=10325): stdout: | (launched: 2022-12-08_20:21:04.633092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:06.479030 run osmo-stp_10.42.42.5(pid=10325): stderr: | [0;m[38;5;43m20221208202104823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202104824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202104824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202104824 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202104825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202104825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202104825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:06.634774 run patchelf(pid=10328): Terminating (SIGINT) 20:21:06.813905 run patchelf(pid=10328): Terminated: ok {rc=0} 20:21:06.943794 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10325): Process ended prematurely: osmo-stp_10.42.42.5(pid=10325) [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10325)] [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 20:21:06.953747 tst ping.py:22: Test FAILED (6.9 sec) 20:21:06.982096 run osmo-hlr_10.42.42.2(pid=10322): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10322)] 20:21:07.032558 run osmo-hlr_10.42.42.2(pid=10322): stdout: | (launched: 2022-12-08_20:21:03.641166) 20:21:07.084860 run osmo-hlr_10.42.42.2(pid=10322): stderr: | [0;m[1;31m20221208202103837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202103837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202103837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202103837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202103837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202103837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202103854 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202103864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202103864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202103864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:21:07.137651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10321): Terminating (SIGTERM) 20:21:07.180092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10324): Terminating (SIGTERM) 20:21:07.222704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10327): Terminating (SIGTERM) 20:21:07.265380 --- ParallelTerminationStrategy: PID 10321 died... 20:21:07.285589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10321): Terminated: ok {rc=0} 20:21:07.332632 --- ParallelTerminationStrategy: PID 10324 died... 20:21:07.352787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10324): Terminated: ok {rc=0} 20:21:07.399511 --- ParallelTerminationStrategy: PID 10327 died... 20:21:07.419264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10327): Terminated: ok {rc=0} 20:21:07.507637 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 20:21:08.595118 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:08.607325 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:21:08.667319 tst ping_idle_ping.py: using LAC 16569 20:21:08.794200 tst ping_idle_ping.py: using RAC 249 20:21:08.922227 tst ping_idle_ping.py: using CellId 16569 20:21:09.052752 tst ping_idle_ping.py: using BVCI 16570 20:21:09.170949 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:09.182689 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:09.193909 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:09.205329 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:09.217144 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:09.228542 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:09.240307 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:09.251923 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:21:09.368810 tst ping_idle_ping.py:24: start network... 20:21:09.569059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:21:10.032470 run create_hlr_db(pid=10329): Launched 20:21:10.146545 bus /gobi_6: Setting Powered False 20:21:11.205939 run create_hlr_db(pid=10329): Terminated: ok {rc=0} 20:21:11.643930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10331): Launched 20:21:11.964001 run osmo-hlr_10.42.42.2(pid=10332): Launched 20:21:12.085160 run osmo-stp_10.42.42.5: Starting osmo-stp 20:21:12.635105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10334): Launched 20:21:12.956892 run osmo-stp_10.42.42.5(pid=10335): Launched 20:21:13.079794 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:21:13.631106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10337): Launched 20:21:13.753873 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:21:14.023484 run patchelf(pid=10338): Launched 20:21:14.201822 run osmo-stp_10.42.42.5(pid=10335): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10335)] 20:21:14.337846 run osmo-stp_10.42.42.5(pid=10335): stdout: | (launched: 2022-12-08_20:21:12.898467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:14.475812 run osmo-stp_10.42.42.5(pid=10335): stderr: | [0;m[38;5;43m20221208202113088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202113088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202113089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202113089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202113090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202113090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202113090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:14.613447 run osmo-stp_10.42.42.5(pid=10335): stdout: | (launched: 2022-12-08_20:21:12.898467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:14.744244 run osmo-stp_10.42.42.5(pid=10335): stderr: | [0;m[38;5;43m20221208202113088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202113088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202113089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202113089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202113090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202113090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202113090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:14.899927 run patchelf(pid=10338): Terminating (SIGINT) 20:21:15.080050 run patchelf(pid=10338): Terminated: ok {rc=0} 20:21:15.209582 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10335): Process ended prematurely: osmo-stp_10.42.42.5(pid=10335) [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10335)] [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 20:21:15.219270 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 20:21:15.247098 run osmo-hlr_10.42.42.2(pid=10332): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10332)] 20:21:15.296914 run osmo-hlr_10.42.42.2(pid=10332): stdout: | (launched: 2022-12-08_20:21:11.905569) 20:21:15.349108 run osmo-hlr_10.42.42.2(pid=10332): stderr: | [0;m[1;31m20221208202112101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202112101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202112101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202112101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202112101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202112101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202112113 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202112121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202112122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202112122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:21:15.401566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10331): Terminating (SIGTERM) 20:21:15.443753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10334): Terminating (SIGTERM) 20:21:15.486145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10337): Terminating (SIGTERM) 20:21:15.529177 --- ParallelTerminationStrategy: PID 10331 died... 20:21:15.549521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10331): Terminated: ok {rc=0} 20:21:15.596740 --- ParallelTerminationStrategy: PID 10334 died... 20:21:15.616488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10334): Terminated: ok {rc=0} 20:21:15.663051 --- ParallelTerminationStrategy: PID 10337 died... 20:21:15.683047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10337): Terminated: ok {rc=0} 20:21:15.772072 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:21:17.078498 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:21:17.091258 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:21:17.129959 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 20:21:17.182783 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 20:21:17.271267 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:21:17.293402 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 20:21:17.333222 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 20:21:17.940586 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 20:21:17.992592 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:18.003611 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:21:18.060160 tst cs_paging_gprs_active.py: using LAC 16570 20:21:18.181146 tst cs_paging_gprs_active.py: using RAC 250 20:21:18.308719 tst cs_paging_gprs_active.py: using CellId 16570 20:21:18.435686 tst cs_paging_gprs_active.py: using BVCI 16571 20:21:18.554112 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:18.565643 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:18.576795 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:18.588201 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:18.599327 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:18.610421 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:18.621778 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:18.632800 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:18.644032 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:21:18.761560 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:21:18.879362 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:21:19.084778 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:19.390339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10343): Launched 20:21:19.657742 run iperf3-srv_10.42.42.10(pid=10344): Launched 20:21:19.775344 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:21:19.979545 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:20.285928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10345): Launched 20:21:20.553706 run iperf3-srv_10.42.42.10(pid=10346): Launched 20:21:20.669050 tst cs_paging_gprs_active.py:38: start network... 20:21:20.873639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:21:21.348677 run create_hlr_db(pid=10347): Launched 20:21:21.466570 bus /gobi_6: Setting Powered False 20:21:22.527885 run create_hlr_db(pid=10347): Terminated: ok {rc=0} 20:21:22.975088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10349): Launched 20:21:23.303389 run osmo-hlr_10.42.42.2(pid=10350): Launched 20:21:23.429233 run osmo-stp_10.42.42.5: Starting osmo-stp 20:21:23.992726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10352): Launched 20:21:24.320741 run osmo-stp_10.42.42.5(pid=10353): Launched 20:21:24.445434 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:21:25.010905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10355): Launched 20:21:25.136489 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:21:25.413108 run patchelf(pid=10356): Launched 20:21:25.594624 run osmo-stp_10.42.42.5(pid=10353): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10353)] 20:21:25.732700 run osmo-stp_10.42.42.5(pid=10353): stdout: | (launched: 2022-12-08_20:21:24.260934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:25.872429 run osmo-stp_10.42.42.5(pid=10353): stderr: | [0;m[38;5;43m20221208202124451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202124451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202124452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202124452 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202124453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202124453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202124453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:26.012567 run osmo-stp_10.42.42.5(pid=10353): stdout: | (launched: 2022-12-08_20:21:24.260934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:26.146917 run osmo-stp_10.42.42.5(pid=10353): stderr: | [0;m[38;5;43m20221208202124451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202124451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202124452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202124452 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202124453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202124453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202124453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:26.305800 run patchelf(pid=10356): Terminating (SIGINT) 20:21:26.489043 run patchelf(pid=10356): Terminated: ok {rc=0} 20:21:26.620514 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10353): Process ended prematurely: osmo-stp_10.42.42.5(pid=10353) [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10353)] [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 20:21:26.630741 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 20:21:26.659031 run osmo-hlr_10.42.42.2(pid=10350): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10350)] 20:21:26.709293 run osmo-hlr_10.42.42.2(pid=10350): stdout: | (launched: 2022-12-08_20:21:23.243663) 20:21:26.761297 run osmo-hlr_10.42.42.2(pid=10350): stderr: | [0;m[1;31m20221208202123440 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202123441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202123441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202123441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202123441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202123441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202123453 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202123462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202123462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202123462 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:21:26.813836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10343): Terminating (SIGTERM) 20:21:26.856033 run iperf3-srv_10.42.42.10(pid=10344): Terminating (SIGTERM) 20:21:26.898138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10345): Terminating (SIGTERM) 20:21:26.940560 run iperf3-srv_10.42.42.10(pid=10346): Terminating (SIGTERM) 20:21:26.982929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10349): Terminating (SIGTERM) 20:21:27.025855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10352): Terminating (SIGTERM) 20:21:27.068206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10355): Terminating (SIGTERM) 20:21:27.110743 --- ParallelTerminationStrategy: PID 10343 died... 20:21:27.131054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10343): Terminated: ok {rc=0} 20:21:27.177486 --- ParallelTerminationStrategy: PID 10344 died... 20:21:27.197159 run iperf3-srv_10.42.42.10(pid=10344): Terminated {rc=256} 20:21:27.243200 --- ParallelTerminationStrategy: PID 10345 died... 20:21:27.262857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10345): Terminated: ok {rc=0} 20:21:27.308911 --- ParallelTerminationStrategy: PID 10346 died... 20:21:27.328471 run iperf3-srv_10.42.42.10(pid=10346): Terminated {rc=256} 20:21:27.375026 --- ParallelTerminationStrategy: PID 10349 died... 20:21:27.394465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10349): Terminated: ok {rc=0} 20:21:27.440641 --- ParallelTerminationStrategy: PID 10352 died... 20:21:27.460283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10352): Terminated: ok {rc=0} 20:21:27.506444 --- ParallelTerminationStrategy: PID 10355 died... 20:21:27.526230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10355): Terminated: ok {rc=0} 20:21:27.614295 bus /gobi_0: Setting Powered False 20:21:28.715142 bus /gobi_0: Setting Powered False 20:21:29.831247 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 20:21:30.996918 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:31.011001 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:21:31.074421 tst iperf3.py: using LAC 16571 20:21:31.201911 tst iperf3.py: using RAC 251 20:21:31.330063 tst iperf3.py: using CellId 16571 20:21:31.462781 tst iperf3.py: using BVCI 16572 20:21:31.597757 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:31.609301 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:31.620308 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:31.632765 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:31.646542 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:31.659505 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:31.671720 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:31.683417 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:31.695404 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:21:31.815439 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:21:32.057479 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:32.367763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10357): Launched 20:21:32.633359 run iperf3-srv_10.42.42.10(pid=10358): Launched 20:21:32.747637 tst iperf3.py:8: start network... 20:21:32.950951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:21:33.422658 run create_hlr_db(pid=10359): Launched 20:21:33.542209 bus /gobi_6: Setting Powered False 20:21:34.602384 run create_hlr_db(pid=10359): Terminated: ok {rc=0} 20:21:35.024199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10361): Launched 20:21:35.328610 run osmo-hlr_10.42.42.2(pid=10362): Launched 20:21:35.444374 run osmo-stp_10.42.42.5: Starting osmo-stp 20:21:35.971096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10364): Launched 20:21:36.273749 run osmo-stp_10.42.42.5(pid=10365): Launched 20:21:36.388366 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:21:36.909340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10367): Launched 20:21:37.025437 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:21:37.283273 run patchelf(pid=10368): Launched 20:21:37.453231 run osmo-stp_10.42.42.5(pid=10365): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10365)] 20:21:37.582683 run osmo-stp_10.42.42.5(pid=10365): stdout: | (launched: 2022-12-08_20:21:36.218608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:37.712595 run osmo-stp_10.42.42.5(pid=10365): stderr: | [0;m[38;5;43m20221208202136386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202136386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202136386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202136386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202136387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202136387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202136387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:37.843025 run osmo-stp_10.42.42.5(pid=10365): stdout: | (launched: 2022-12-08_20:21:36.218608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:37.967494 run osmo-stp_10.42.42.5(pid=10365): stderr: | [0;m[38;5;43m20221208202136386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202136386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202136386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202136386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202136387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202136387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202136387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:38.115059 run patchelf(pid=10368): Terminating (SIGINT) 20:21:38.285912 run patchelf(pid=10368): Terminated: ok {rc=0} 20:21:38.408859 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10365): Process ended prematurely: osmo-stp_10.42.42.5(pid=10365) [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10365)] [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 20:21:38.418577 tst iperf3.py:8: Test FAILED (7.5 sec) 20:21:38.445936 run osmo-hlr_10.42.42.2(pid=10362): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10362)] 20:21:38.493844 run osmo-hlr_10.42.42.2(pid=10362): stdout: | (launched: 2022-12-08_20:21:35.272702) 20:21:38.543440 run osmo-hlr_10.42.42.2(pid=10362): stderr: | [0;m[1;31m20221208202135447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202135447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202135447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202135447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202135447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202135447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202135459 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202135468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202135468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202135468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:21:38.593711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10357): Terminating (SIGTERM) 20:21:38.633737 run iperf3-srv_10.42.42.10(pid=10358): Terminating (SIGTERM) 20:21:38.673827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10361): Terminating (SIGTERM) 20:21:38.714099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10364): Terminating (SIGTERM) 20:21:38.754056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10367): Terminating (SIGTERM) 20:21:38.794007 --- ParallelTerminationStrategy: PID 10357 died... 20:21:38.812902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10357): Terminated: ok {rc=0} 20:21:38.857582 --- ParallelTerminationStrategy: PID 10358 died... 20:21:38.876214 run iperf3-srv_10.42.42.10(pid=10358): Terminated {rc=256} 20:21:38.920162 --- ParallelTerminationStrategy: PID 10361 died... 20:21:38.938874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10361): Terminated: ok {rc=0} 20:21:38.983033 --- ParallelTerminationStrategy: PID 10364 died... 20:21:39.001715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10364): Terminated: ok {rc=0} 20:21:39.046032 --- ParallelTerminationStrategy: PID 10367 died... 20:21:39.064838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10367): Terminated: ok {rc=0} 20:21:39.152188 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 20:21:40.299096 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:40.310840 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:21:40.369667 tst iperf3m4.py: using LAC 16572 20:21:40.490145 tst iperf3m4.py: using RAC 252 20:21:40.610965 tst iperf3m4.py: using CellId 16572 20:21:40.730253 tst iperf3m4.py: using BVCI 16573 20:21:40.842634 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:40.853577 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:40.864307 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:40.875291 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:40.886258 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:40.897147 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:40.908078 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:40.918989 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:40.930254 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:21:41.050155 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:21:41.173125 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:21:41.291351 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:21:41.415235 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:21:41.635162 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:41.963317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10369): Launched 20:21:42.246536 run iperf3-srv_10.42.42.10(pid=10370): Launched 20:21:42.370717 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:21:42.590287 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:42.917217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10371): Launched 20:21:43.205891 run iperf3-srv_10.42.42.10(pid=10372): Launched 20:21:43.330248 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:21:43.549425 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:43.875824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10373): Launched 20:21:44.159246 run iperf3-srv_10.42.42.10(pid=10374): Launched 20:21:44.280812 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:21:44.499999 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:44.826240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10375): Launched 20:21:45.110570 run iperf3-srv_10.42.42.10(pid=10376): Launched 20:21:45.233023 tst iperf3m4.py:8: start network... 20:21:45.452180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:21:45.965781 run create_hlr_db(pid=10377): Launched 20:21:46.144306 bus /gobi_6: Setting Powered False 20:21:47.205253 run create_hlr_db(pid=10377): Terminated: ok {rc=0} 20:21:47.641317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10379): Launched 20:21:47.946342 run osmo-hlr_10.42.42.2(pid=10380): Launched 20:21:48.062191 run osmo-stp_10.42.42.5: Starting osmo-stp 20:21:48.604934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10382): Launched 20:21:48.908176 run osmo-stp_10.42.42.5(pid=10383): Launched 20:21:49.023838 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:21:49.548552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10385): Launched 20:21:49.665723 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:21:49.923532 run patchelf(pid=10386): Launched 20:21:50.093310 run osmo-stp_10.42.42.5(pid=10383): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10383)] 20:21:50.222619 run osmo-stp_10.42.42.5(pid=10383): stdout: | (launched: 2022-12-08_20:21:48.852518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:50.353443 run osmo-stp_10.42.42.5(pid=10383): stderr: | [0;m[38;5;43m20221208202149019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202149020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202149020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202149020 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202149021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202149021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202149021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:50.484265 run osmo-stp_10.42.42.5(pid=10383): stdout: | (launched: 2022-12-08_20:21:48.852518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:50.609225 run osmo-stp_10.42.42.5(pid=10383): stderr: | [0;m[38;5;43m20221208202149019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202149020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202149020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202149020 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202149021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202149021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202149021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:50.757547 run patchelf(pid=10386): Terminating (SIGINT) 20:21:50.928200 run patchelf(pid=10386): Terminated: ok {rc=0} 20:21:51.051242 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10383): Process ended prematurely: osmo-stp_10.42.42.5(pid=10383) [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10383)] [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 20:21:51.060684 tst iperf3m4.py:8: Test FAILED (10.8 sec) 20:21:51.088547 run osmo-hlr_10.42.42.2(pid=10380): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10380)] 20:21:51.137083 run osmo-hlr_10.42.42.2(pid=10380): stdout: | (launched: 2022-12-08_20:21:47.890249) 20:21:51.187188 run osmo-hlr_10.42.42.2(pid=10380): stderr: | [0;m[1;31m20221208202148065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202148065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202148065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202148065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202148065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202148065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202148077 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202148086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202148086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202148086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:21:51.237809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10369): Terminating (SIGTERM) 20:21:51.277831 run iperf3-srv_10.42.42.10(pid=10370): Terminating (SIGTERM) 20:21:51.317930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10371): Terminating (SIGTERM) 20:21:51.358072 run iperf3-srv_10.42.42.10(pid=10372): Terminating (SIGTERM) 20:21:51.398284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10373): Terminating (SIGTERM) 20:21:51.438362 run iperf3-srv_10.42.42.10(pid=10374): Terminating (SIGTERM) 20:21:51.478354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10375): Terminating (SIGTERM) 20:21:51.518405 run iperf3-srv_10.42.42.10(pid=10376): Terminating (SIGTERM) 20:21:51.558790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10379): Terminating (SIGTERM) 20:21:51.598840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10382): Terminating (SIGTERM) 20:21:51.639114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10385): Terminating (SIGTERM) 20:21:51.679480 --- ParallelTerminationStrategy: PID 10369 died... 20:21:51.698638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10369): Terminated: ok {rc=0} 20:21:51.743854 --- ParallelTerminationStrategy: PID 10370 died... 20:21:51.762532 run iperf3-srv_10.42.42.10(pid=10370): Terminated {rc=256} 20:21:51.806665 --- ParallelTerminationStrategy: PID 10371 died... 20:21:51.825921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10371): Terminated: ok {rc=0} 20:21:51.870666 --- ParallelTerminationStrategy: PID 10372 died... 20:21:51.889591 run iperf3-srv_10.42.42.10(pid=10372): Terminated {rc=256} 20:21:51.933684 --- ParallelTerminationStrategy: PID 10373 died... 20:21:51.952497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10373): Terminated: ok {rc=0} 20:21:51.997190 --- ParallelTerminationStrategy: PID 10374 died... 20:21:52.015782 run iperf3-srv_10.42.42.10(pid=10374): Terminated {rc=256} 20:21:52.060646 --- ParallelTerminationStrategy: PID 10375 died... 20:21:52.079635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10375): Terminated: ok {rc=0} 20:21:52.124404 --- ParallelTerminationStrategy: PID 10376 died... 20:21:52.143432 run iperf3-srv_10.42.42.10(pid=10376): Terminated {rc=256} 20:21:52.188193 --- ParallelTerminationStrategy: PID 10379 died... 20:21:52.207251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10379): Terminated: ok {rc=0} 20:21:52.252161 --- ParallelTerminationStrategy: PID 10382 died... 20:21:52.271090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10382): Terminated: ok {rc=0} 20:21:52.316205 --- ParallelTerminationStrategy: PID 10385 died... 20:21:52.335364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10385): Terminated: ok {rc=0} 20:21:52.419857 bus /gobi_4: Setting Powered False 20:21:53.515405 bus /gobi_4: Setting Powered False 20:21:54.632410 bus /gobi_1: Setting Powered False 20:21:55.730253 bus /gobi_1: Setting Powered False 20:21:56.847145 bus /gobi_0: Setting Powered False 20:21:57.946038 bus /gobi_0: Setting Powered False 20:21:59.066278 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 20:22:00.169952 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:00.181532 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:22:00.240507 tst ping.py: using LAC 16573 20:22:00.359143 tst ping.py: using RAC 253 20:22:00.478140 tst ping.py: using CellId 16573 20:22:00.596902 tst ping.py: using BVCI 16574 20:22:00.714696 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:00.726369 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:00.737783 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:00.749742 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:00.761658 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:00.773488 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:00.785557 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:00.797467 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:22:00.937792 tst ping.py:19: start network... 20:22:01.185772 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:22:01.661915 run create_hlr_db(pid=10387): Launched 20:22:01.815520 bus /gobi_6: Setting Powered False 20:22:02.875264 run create_hlr_db(pid=10387): Terminated: ok {rc=0} 20:22:03.315556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10389): Launched 20:22:03.637116 run osmo-hlr_10.42.42.2(pid=10390): Launched 20:22:03.759025 run osmo-stp_10.42.42.5: Starting osmo-stp 20:22:04.312284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10392): Launched 20:22:04.631712 run osmo-stp_10.42.42.5(pid=10393): Launched 20:22:04.751911 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:22:05.301602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10395): Launched 20:22:05.425118 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:22:05.694976 run patchelf(pid=10396): Launched 20:22:05.874256 run osmo-stp_10.42.42.5(pid=10393): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10393)] 20:22:06.010022 run osmo-stp_10.42.42.5(pid=10393): stdout: | (launched: 2022-12-08_20:22:04.573683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:06.147073 run osmo-stp_10.42.42.5(pid=10393): stderr: | [0;m[38;5;43m20221208202204763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202204763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202204763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202204764 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202204764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202204764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202204764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:06.284217 run osmo-stp_10.42.42.5(pid=10393): stdout: | (launched: 2022-12-08_20:22:04.573683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:06.415874 run osmo-stp_10.42.42.5(pid=10393): stderr: | [0;m[38;5;43m20221208202204763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202204763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202204763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202204764 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202204764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202204764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202204764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:06.571285 run patchelf(pid=10396): Terminating (SIGINT) 20:22:06.750736 run patchelf(pid=10396): Terminated: ok {rc=0} 20:22:06.880076 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10393): Process ended prematurely: osmo-stp_10.42.42.5(pid=10393) [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10393)] [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 20:22:06.889621 tst ping.py:22: Test FAILED (6.7 sec) 20:22:06.917743 run osmo-hlr_10.42.42.2(pid=10390): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10390)] 20:22:06.968429 run osmo-hlr_10.42.42.2(pid=10390): stdout: | (launched: 2022-12-08_20:22:03.578630) 20:22:07.021172 run osmo-hlr_10.42.42.2(pid=10390): stderr: | [0;m[1;31m20221208202203773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202203773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202203773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202203773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202203773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202203773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202203786 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202203795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202203795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202203795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:22:07.074168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10389): Terminating (SIGTERM) 20:22:07.116715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10392): Terminating (SIGTERM) 20:22:07.159484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10395): Terminating (SIGTERM) 20:22:07.202117 --- ParallelTerminationStrategy: PID 10389 died... 20:22:07.222505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10389): Terminated: ok {rc=0} 20:22:07.269641 --- ParallelTerminationStrategy: PID 10392 died... 20:22:07.289712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10392): Terminated: ok {rc=0} 20:22:07.337090 --- ParallelTerminationStrategy: PID 10395 died... 20:22:07.357173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10395): Terminated: ok {rc=0} 20:22:07.446233 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 20:22:08.532233 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:08.543932 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:22:08.602751 tst ping_idle_ping.py: using LAC 16574 20:22:08.720710 tst ping_idle_ping.py: using RAC 254 20:22:08.839383 tst ping_idle_ping.py: using CellId 16574 20:22:08.961639 tst ping_idle_ping.py: using BVCI 16575 20:22:09.071893 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:09.082983 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:09.093838 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:09.104893 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:09.115886 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:09.126941 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:09.138243 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:09.149597 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:22:09.270580 tst ping_idle_ping.py:24: start network... 20:22:09.488914 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:22:09.992371 run create_hlr_db(pid=10397): Launched 20:22:10.122823 bus /gobi_6: Setting Powered False 20:22:11.186179 run create_hlr_db(pid=10397): Terminated: ok {rc=0} 20:22:11.614157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10399): Launched 20:22:11.911811 run osmo-hlr_10.42.42.2(pid=10400): Launched 20:22:12.024166 run osmo-stp_10.42.42.5: Starting osmo-stp 20:22:12.535310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10402): Launched 20:22:12.832640 run osmo-stp_10.42.42.5(pid=10403): Launched 20:22:12.945192 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:22:13.459730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10405): Launched 20:22:13.574465 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:22:13.826257 run patchelf(pid=10406): Launched 20:22:13.992556 run osmo-stp_10.42.42.5(pid=10403): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10403)] 20:22:14.119435 run osmo-stp_10.42.42.5(pid=10403): stdout: | (launched: 2022-12-08_20:22:12.778295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:14.247296 run osmo-stp_10.42.42.5(pid=10403): stderr: | [0;m[38;5;43m20221208202212944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202212945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202212945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202212945 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202212946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202212946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202212946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:14.375540 run osmo-stp_10.42.42.5(pid=10403): stdout: | (launched: 2022-12-08_20:22:12.778295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:14.498035 run osmo-stp_10.42.42.5(pid=10403): stderr: | [0;m[38;5;43m20221208202212944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202212945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202212945 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202212945 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202212946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202212946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202212946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:14.642851 run patchelf(pid=10406): Terminating (SIGINT) 20:22:14.811104 run patchelf(pid=10406): Terminated: ok {rc=0} 20:22:14.932186 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10403): Process ended prematurely: osmo-stp_10.42.42.5(pid=10403) [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10403)] [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 20:22:14.941182 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 20:22:14.968100 run osmo-hlr_10.42.42.2(pid=10400): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10400)] 20:22:15.015819 run osmo-hlr_10.42.42.2(pid=10400): stdout: | (launched: 2022-12-08_20:22:11.857326) 20:22:15.065675 run osmo-hlr_10.42.42.2(pid=10400): stderr: | [0;m[1;31m20221208202212029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202212030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202212030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202212030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202212030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202212030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202212042 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202212051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202212051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202212051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:22:15.116009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10399): Terminating (SIGTERM) 20:22:15.156348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10402): Terminating (SIGTERM) 20:22:15.196706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10405): Terminating (SIGTERM) 20:22:15.237214 --- ParallelTerminationStrategy: PID 10399 died... 20:22:15.256526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10399): Terminated: ok {rc=0} 20:22:15.301921 --- ParallelTerminationStrategy: PID 10402 died... 20:22:15.320884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10402): Terminated: ok {rc=0} 20:22:15.365655 --- ParallelTerminationStrategy: PID 10405 died... 20:22:15.384504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10405): Terminated: ok {rc=0} 20:22:15.468746 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:22:16.797692 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:22:16.808767 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:22:16.834944 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 20:22:16.878885 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:22:16.944425 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:22:16.971218 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 20:22:17.015387 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:22:17.557232 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2349 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 20:22:17.562781 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:17.574853 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:22:17.633038 tst switch_tch_pdch.py: using LAC 16575 20:22:17.762633 tst switch_tch_pdch.py: using RAC 255 20:22:17.887525 tst switch_tch_pdch.py: using CellId 16575 20:22:18.010581 tst switch_tch_pdch.py: using BVCI 16576 20:22:18.126241 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:18.137944 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:18.149474 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:18.161352 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:18.173167 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:18.185084 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:18.197624 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:18.209520 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:22:18.329244 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:22:18.445820 tst switch_tch_pdch.py:51: start network... 20:22:18.644896 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:22:19.104574 run create_hlr_db(pid=10411): Launched 20:22:19.219552 bus /gobi_6: Setting Powered False 20:22:20.278627 run create_hlr_db(pid=10411): Terminated: ok {rc=0} 20:22:20.717895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10413): Launched 20:22:21.036573 run osmo-hlr_10.42.42.2(pid=10414): Launched 20:22:21.158411 run osmo-stp_10.42.42.5: Starting osmo-stp 20:22:21.716252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10416): Launched 20:22:22.035616 run osmo-stp_10.42.42.5(pid=10417): Launched 20:22:22.157321 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:22:22.708048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10419): Launched 20:22:22.830695 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:22:23.099648 run patchelf(pid=10420): Launched 20:22:23.276867 run osmo-stp_10.42.42.5(pid=10417): ERR: Terminated: ERROR {rc=1} [trial-2349↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10417)] 20:22:23.412781 run osmo-stp_10.42.42.5(pid=10417): stdout: | (launched: 2022-12-08_20:22:21.977453) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:23.550391 run osmo-stp_10.42.42.5(pid=10417): stderr: | [0;m[38;5;43m20221208202222164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202222165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202222165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202222165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202222166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202222166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202222166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:23.687282 run osmo-stp_10.42.42.5(pid=10417): stdout: | (launched: 2022-12-08_20:22:21.977453) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:23.817589 run osmo-stp_10.42.42.5(pid=10417): stderr: | [0;m[38;5;43m20221208202222164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202222165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202222165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202222165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202222166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202222166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202222166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:23.972322 run patchelf(pid=10420): Terminating (SIGINT) 20:22:24.151562 run patchelf(pid=10420): Terminated: ok {rc=0} 20:22:24.280442 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10417): Process ended prematurely: osmo-stp_10.42.42.5(pid=10417) [trial-2349↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10417)] [trial-2349↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 20:22:24.290176 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 20:22:24.318024 run osmo-hlr_10.42.42.2(pid=10414): ERR: Terminated: ERROR {rc=237} [trial-2349↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10414)] 20:22:24.368180 run osmo-hlr_10.42.42.2(pid=10414): stdout: | (launched: 2022-12-08_20:22:20.978675) 20:22:24.420195 run osmo-hlr_10.42.42.2(pid=10414): stderr: | [0;m[1;31m20221208202221171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202221171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202221171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202221171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202221171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202221171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202221184 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202221194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202221194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202221194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:22:24.472416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10413): Terminating (SIGTERM) 20:22:24.514173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10416): Terminating (SIGTERM) 20:22:24.555920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10419): Terminating (SIGTERM) 20:22:24.597873 --- ParallelTerminationStrategy: PID 10413 died... 20:22:24.617830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10413): Terminated: ok {rc=0} 20:22:24.663737 --- ParallelTerminationStrategy: PID 10416 died... 20:22:24.683120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10416): Terminated: ok {rc=0} 20:22:24.729284 --- ParallelTerminationStrategy: PID 10419 died... 20:22:24.748532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10419): Terminated: ok {rc=0} 20:22:24.835678 bus /gobi_0: Setting Powered False 20:22:25.935243 bus /gobi_0: Setting Powered False 20:22:27.051956 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 20:22:28.293239 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:22:28.299579 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 20:22:28.320851 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 20:22:28.357034 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 20:22:28.411115 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 20:22:28.432309 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 20:22:28.467935 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 20:22:29.024876 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2349 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 20:22:29.030133 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:22:29.041557 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 20:22:29.099159 tst switch_tch_pdch.py: using LAC 16576 20:22:29.223194 tst switch_tch_pdch.py: using RAC 1 20:22:29.341546 tst switch_tch_pdch.py: using CellId 16576 20:22:29.467588 tst switch_tch_pdch.py: using BVCI 16577 20:22:29.578199 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:22:29.589411 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:22:29.600314 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:22:29.611511 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:22:29.622600 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:22:29.633597 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:22:29.644835 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:22:29.655833 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:22:29.769619 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:22:29.884313 tst switch_tch_pdch.py:51: start network... 20:22:30.083456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:22:30.518254 run create_hlr_db(pid=10424): Launched 20:22:30.633405 bus /gobi_6: Setting Powered False 20:22:31.695967 run create_hlr_db(pid=10424): Terminated: ok {rc=0} 20:22:32.123969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10426): Launched 20:22:32.455177 run osmo-hlr_10.42.42.2(pid=10427): Launched 20:22:32.577329 run osmo-stp_10.42.42.5: Starting osmo-stp 20:22:33.098598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10429): Launched 20:22:33.418402 run osmo-stp_10.42.42.5(pid=10430): Launched 20:22:33.541516 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:22:34.063156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10432): Launched 20:22:34.185355 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:22:34.455408 run patchelf(pid=10433): Launched 20:22:34.633572 run osmo-stp_10.42.42.5(pid=10430): ERR: Terminated: ERROR {rc=1} [trial-2349↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10430)] 20:22:34.769085 run osmo-stp_10.42.42.5(pid=10430): stdout: | (launched: 2022-12-08_20:22:33.360009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:34.905851 run osmo-stp_10.42.42.5(pid=10430): stderr: | [0;m[38;5;43m20221208202233547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202233547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202233547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202233548 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202233548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202233548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202233548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:35.042608 run osmo-stp_10.42.42.5(pid=10430): stdout: | (launched: 2022-12-08_20:22:33.360009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:35.173270 run osmo-stp_10.42.42.5(pid=10430): stderr: | [0;m[38;5;43m20221208202233547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202233547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202233547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202233548 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202233548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202233548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202233548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:35.328118 run patchelf(pid=10433): Terminating (SIGINT) 20:22:35.507484 run patchelf(pid=10433): Terminated: ok {rc=0} 20:22:35.637180 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10430): Process ended prematurely: osmo-stp_10.42.42.5(pid=10430) [trial-2349↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10430)] [trial-2349↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 20:22:35.646811 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 20:22:35.674922 run osmo-hlr_10.42.42.2(pid=10427): ERR: Terminated: ERROR {rc=237} [trial-2349↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10427)] 20:22:35.725596 run osmo-hlr_10.42.42.2(pid=10427): stdout: | (launched: 2022-12-08_20:22:32.396935) 20:22:35.780382 run osmo-hlr_10.42.42.2(pid=10427): stderr: | [0;m[1;31m20221208202232588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202232588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202232588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202232588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202232588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202232589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202232600 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202232610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202232611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202232611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:22:35.831461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10426): Terminating (SIGTERM) 20:22:35.872291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10429): Terminating (SIGTERM) 20:22:35.913027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10432): Terminating (SIGTERM) 20:22:35.954346 --- ParallelTerminationStrategy: PID 10426 died... 20:22:35.973693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10426): Terminated: ok {rc=0} 20:22:36.019178 --- ParallelTerminationStrategy: PID 10429 died... 20:22:36.037906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10429): Terminated: ok {rc=0} 20:22:36.083586 --- ParallelTerminationStrategy: PID 10432 died... 20:22:36.102367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10432): Terminated: ok {rc=0} 20:22:36.190986 bus /gobi_0: Setting Powered False 20:22:37.290491 bus /gobi_0: Setting Powered False 20:22:38.408800 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 nitb_sms:trx-b200 --------------------------------------------------------------------- 20:22:39.642743 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:22:39.646566 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 20:22:39.680157 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 20:22:39.687017 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 20:22:39.738609 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 20:22:39.771776 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 20:22:39.778674 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 20:22:40.319106 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 20:22:40.324170 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 20:22:40.334930 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 20:22:40.383558 tst mo_mt_sms.py: using LAC 16577 20:22:40.501171 tst mo_mt_sms.py: using RAC 2 20:22:40.619631 tst mo_mt_sms.py: using CellId 16577 20:22:40.737633 tst mo_mt_sms.py: using BVCI 16578 20:22:40.847127 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 20:22:40.966705 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 20:22:41.084136 tst mo_mt_sms.py:9: start nitb and bts... 20:22:41.300188 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:22:41.951571 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10438): Launched 20:22:42.271303 run osmo-nitb_10.42.42.2(pid=10439): Launched 20:22:42.448093 run osmo-nitb_10.42.42.2(pid=10439): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10439)] 20:22:42.592080 run osmo-nitb_10.42.42.2(pid=10439): stdout: | (launched: 2022-12-08_20:22:42.213067) 20:22:42.737429 run osmo-nitb_10.42.42.2(pid=10439): stderr: | (launched: 2022-12-08_20:22:42.260578) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:22:42.882464 run osmo-nitb_10.42.42.2(pid=10439): stdout: | (launched: 2022-12-08_20:22:42.213067) 20:22:43.021120 run osmo-nitb_10.42.42.2(pid=10439): stderr: | (launched: 2022-12-08_20:22:42.260578) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8fda692268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10439): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10439) [trial-2349↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10439)] 20:22:43.391515 tst osmo-nitb_10.42.42.2(pid=10439): stdout: | (launched: 2022-12-08_20:22:42.213067) 20:22:43.520413 tst osmo-nitb_10.42.42.2(pid=10439): stderr: | (launched: 2022-12-08_20:22:42.260578) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:22:43.672561 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=10439): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10439) [trial-2349↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10439)] [trial-2349↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 20:22:43.681680 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 20:22:43.688735 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10438): Terminating (SIGTERM) 20:22:43.899514 --- ParallelTerminationStrategy: PID 10438 died... 20:22:43.921174 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10438): Terminated: ok {rc=0} 20:22:44.010175 bus /sierra_3: Setting Powered False 20:22:45.110469 bus /sierra_3: Setting Powered False 20:22:46.236858 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 sms:trx-b200 --------------------------------------------------------------------- 20:22:47.446706 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:22:47.453390 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 20:22:47.489374 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 20:22:47.518260 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 20:22:47.570279 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 20:22:47.605843 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 20:22:47.635115 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 20:22:48.181116 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 20:22:48.187614 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 20:22:48.199765 tst sms:trx-b200: Using 1 x bts (candidates: 1) 20:22:48.249476 tst mo_mt_sms.py: using LAC 16578 20:22:48.381451 tst mo_mt_sms.py: using RAC 3 20:22:48.509067 tst mo_mt_sms.py: using CellId 16578 20:22:48.635396 tst mo_mt_sms.py: using BVCI 16579 20:22:48.754158 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 20:22:48.766144 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 20:22:48.778020 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 20:22:48.789995 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 20:22:48.802939 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 20:22:48.815884 tst sms:trx-b200: Using 1 x modem (candidates: 2) 20:22:48.939706 tst sms:trx-b200: Using 1 x modem (candidates: 2) 20:22:49.063251 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:22:49.577910 run create_hlr_db(pid=10454): Launched 20:22:49.729996 bus /sierra_2: Setting Powered False 20:22:50.791422 run create_hlr_db(pid=10454): Terminated: ok {rc=0} 20:22:51.225754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10458): Launched 20:22:51.546438 run osmo-hlr_10.42.42.2(pid=10459): Launched 20:22:51.779636 run osmo-stp_10.42.42.5: Starting osmo-stp 20:22:52.474787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10461): Launched 20:22:52.806435 run osmo-stp_10.42.42.5(pid=10462): Launched 20:22:53.045389 run osmo-msc_10.42.42.6: Starting osmo-msc 20:22:53.714641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10464): Launched 20:22:54.049240 run osmo-msc_10.42.42.6(pid=10465): Launched 20:22:54.409359 run osmo-stp_10.42.42.5(pid=10462): ERR: Terminated: ERROR {rc=1} [trial-2349↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10462)] 20:22:54.684209 run osmo-stp_10.42.42.5(pid=10462): stdout: | (launched: 2022-12-08_20:22:52.748526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:54.865894 run osmo-stp_10.42.42.5(pid=10462): stderr: | [0;m[38;5;43m20221208202253033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202253034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202253034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202253034 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202253035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202253035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202253035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:55.024287 run osmo-stp_10.42.42.5(pid=10462): stdout: | (launched: 2022-12-08_20:22:52.748526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:55.176070 run osmo-stp_10.42.42.5(pid=10462): stderr: | [0;m[38;5;43m20221208202253033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202253034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202253034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202253034 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202253035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202253035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202253035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:55.334320 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=10462): Process ended prematurely: osmo-stp_10.42.42.5(pid=10462) [trial-2349↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10462)] [trial-2349↪sms:trx-b200↪mo_mt_sms.py:16] 20:22:55.343823 tst mo_mt_sms.py:16: Test FAILED (7.1 sec) 20:22:55.372228 run osmo-hlr_10.42.42.2(pid=10459): ERR: Terminated: ERROR {rc=237} [trial-2349↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10459)] 20:22:55.424353 run osmo-hlr_10.42.42.2(pid=10459): stdout: | (launched: 2022-12-08_20:22:51.490549) 20:22:55.486235 run osmo-hlr_10.42.42.2(pid=10459): stderr: | [0;m[1;31m20221208202251827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202251827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202251827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202251827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202251828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202251828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202251884 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202251892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202251901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202251901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:22:55.565296 run osmo-msc_10.42.42.6(pid=10465): ERR: Terminated: ERROR {rc=2} [trial-2349↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10465)] 20:22:55.616596 run osmo-msc_10.42.42.6(pid=10465): stdout: | (launched: 2022-12-08_20:22:53.990496) 20:22:55.669484 run osmo-msc_10.42.42.6(pid=10465): stderr: | [0;m[38;5;43m20221208202254488 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202254488 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f440d497c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202254493 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202254493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202254493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202254494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202254495 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202254496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202254496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202254496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:22:55.737233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10458): Terminating (SIGTERM) 20:22:55.787165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10461): Terminating (SIGTERM) 20:22:55.836280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10464): Terminating (SIGTERM) 20:22:55.890665 --- ParallelTerminationStrategy: PID 10458 died... 20:22:55.912386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10458): Terminated: ok {rc=0} 20:22:55.969245 --- ParallelTerminationStrategy: PID 10461 died... 20:22:55.992908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10461): Terminated: ok {rc=0} 20:22:56.045085 --- ParallelTerminationStrategy: PID 10464 died... 20:22:56.065354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10464): Terminated: ok {rc=0} 20:22:56.186064 bus /sierra_3: Setting Powered False 20:22:57.318542 bus /sierra_3: Setting Powered False 20:22:58.439725 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 nitb_ussd:trx-b200 --------------------------------------------------------------------- 20:22:59.681841 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:22:59.686967 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 20:22:59.723215 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 20:22:59.731112 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 20:22:59.767169 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 20:22:59.804165 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 20:22:59.813149 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 20:23:00.329116 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2349 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 20:23:00.336117 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 20:23:00.348449 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 20:23:00.404179 tst assert_extension.py: using LAC 16579 20:23:00.544239 tst assert_extension.py: using RAC 4 20:23:00.675245 tst assert_extension.py: using CellId 16579 20:23:00.802913 tst assert_extension.py: using BVCI 16580 20:23:00.946481 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 20:23:01.083690 tst assert_extension.py:10: start nitb and bts... 20:23:01.315404 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:23:02.120556 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10729): Launched 20:23:02.461709 run osmo-nitb_10.42.42.2(pid=10730): Launched 20:23:02.647843 run osmo-nitb_10.42.42.2(pid=10730): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10730)] 20:23:02.786289 run osmo-nitb_10.42.42.2(pid=10730): stdout: | (launched: 2022-12-08_20:23:02.402310) 20:23:02.926355 run osmo-nitb_10.42.42.2(pid=10730): stderr: | (launched: 2022-12-08_20:23:02.450748) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:23:03.066427 run osmo-nitb_10.42.42.2(pid=10730): stdout: | (launched: 2022-12-08_20:23:02.402310) 20:23:03.200017 run osmo-nitb_10.42.42.2(pid=10730): stderr: | (launched: 2022-12-08_20:23:02.450748) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8fda692268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10730): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10730) [trial-2349↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10730)] 20:23:03.594365 tst osmo-nitb_10.42.42.2(pid=10730): stdout: | (launched: 2022-12-08_20:23:02.402310) 20:23:03.718068 tst osmo-nitb_10.42.42.2(pid=10730): stderr: | (launched: 2022-12-08_20:23:02.450748) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:23:03.864380 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=10730): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10730) [trial-2349↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10730)] [trial-2349↪nitb_ussd:trx-b200↪assert_extension.py:12] 20:23:03.874342 tst assert_extension.py:12: Test FAILED (3.5 sec) 20:23:03.881972 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10729): Terminating (SIGTERM) 20:23:04.096526 --- ParallelTerminationStrategy: PID 10729 died... 20:23:04.118787 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10729): Terminated: ok {rc=0} 20:23:04.210559 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 ussd:trx-b200 --------------------------------------------------------------------- 20:23:05.389980 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:23:05.394997 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 20:23:05.433527 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 20:23:05.461510 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 20:23:05.498040 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 20:23:05.533552 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 20:23:05.562424 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 20:23:06.090831 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2349 ussd:trx-b200 assert_extension.py ---------------------------------------------- 20:23:06.097872 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 20:23:06.109894 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 20:23:06.163933 tst assert_extension.py: using LAC 16580 20:23:06.293952 tst assert_extension.py: using RAC 5 20:23:06.424593 tst assert_extension.py: using CellId 16580 20:23:06.557534 tst assert_extension.py: using BVCI 16581 20:23:06.681616 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 20:23:06.693773 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 20:23:06.706047 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 20:23:06.719694 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 20:23:06.731776 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 20:23:06.744860 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 20:23:06.870501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:23:07.380762 run create_hlr_db(pid=10734): Launched 20:23:07.550904 bus /sierra_2: Setting Powered False 20:23:08.617349 run create_hlr_db(pid=10734): Terminated: ok {rc=0} 20:23:09.079996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10736): Launched 20:23:09.421021 run osmo-hlr_10.42.42.2(pid=10737): Launched 20:23:09.673428 run osmo-stp_10.42.42.5: Starting osmo-stp 20:23:10.342691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10739): Launched 20:23:10.684938 run osmo-stp_10.42.42.5(pid=10740): Launched 20:23:10.931609 run osmo-msc_10.42.42.6: Starting osmo-msc 20:23:11.604840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10742): Launched 20:23:11.925235 run osmo-msc_10.42.42.6(pid=10743): Launched 20:23:12.102328 run osmo-stp_10.42.42.5(pid=10740): ERR: Terminated: ERROR {rc=1} [trial-2349↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10740)] 20:23:12.235595 run osmo-stp_10.42.42.5(pid=10740): stdout: | (launched: 2022-12-08_20:23:10.625251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:12.369815 run osmo-stp_10.42.42.5(pid=10740): stderr: | [0;m[38;5;43m20221208202310913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202310914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202310914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202310914 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202310915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202310915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202310915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:12.504092 run osmo-stp_10.42.42.5(pid=10740): stdout: | (launched: 2022-12-08_20:23:10.625251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:12.630946 run osmo-stp_10.42.42.5(pid=10740): stderr: | [0;m[38;5;43m20221208202310913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202310914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202310914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202310914 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202310915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202310915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202310915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:12.782872 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=10740): Process ended prematurely: osmo-stp_10.42.42.5(pid=10740) [trial-2349↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10740)] [trial-2349↪ussd:trx-b200↪assert_extension.py:17] 20:23:12.791767 tst assert_extension.py:17: Test FAILED (6.7 sec) 20:23:12.819180 run osmo-hlr_10.42.42.2(pid=10737): ERR: Terminated: ERROR {rc=237} [trial-2349↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10737)] 20:23:12.869864 run osmo-hlr_10.42.42.2(pid=10737): stdout: | (launched: 2022-12-08_20:23:09.360438) 20:23:12.922068 run osmo-hlr_10.42.42.2(pid=10737): stderr: | [0;m[1;31m20221208202309665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202309665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202309665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202309665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202309666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202309666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202309685 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202309694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202309694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202309694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:23:12.994941 run osmo-msc_10.42.42.6(pid=10743): ERR: Terminated: ERROR {rc=2} [trial-2349↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10743)] 20:23:13.045341 run osmo-msc_10.42.42.6(pid=10743): stdout: | (launched: 2022-12-08_20:23:11.866577) 20:23:13.097357 run osmo-msc_10.42.42.6(pid=10743): stderr: | [0;m[38;5;43m20221208202312187 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202312187 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f09e7daec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202312187 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202312187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202312188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202312188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202312189 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202312190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202312190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202312190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:23:13.149826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10736): Terminating (SIGTERM) 20:23:13.192136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10739): Terminating (SIGTERM) 20:23:13.234156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10742): Terminating (SIGTERM) 20:23:13.276118 --- ParallelTerminationStrategy: PID 10736 died... 20:23:13.296306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10736): Terminated: ok {rc=0} 20:23:13.342690 --- ParallelTerminationStrategy: PID 10739 died... 20:23:13.362334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10739): Terminated: ok {rc=0} 20:23:13.408693 --- ParallelTerminationStrategy: PID 10742 died... 20:23:13.428255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10742): Terminated: ok {rc=0} 20:23:13.516279 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 20:23:14.734935 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:23:14.742044 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 20:23:14.776094 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 20:23:14.803497 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 20:23:14.858808 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 20:23:14.893649 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 20:23:14.920543 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 20:23:15.467135 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 20:23:15.517946 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:15.529601 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:23:15.600413 tst mo_mt_call.py: using LAC 16581 20:23:15.721508 tst mo_mt_call.py: using RAC 6 20:23:15.855590 tst mo_mt_call.py: using CellId 16581 20:23:15.991400 tst mo_mt_call.py: using BVCI 16582 20:23:16.112777 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:16.125459 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:16.137820 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:16.149798 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:16.162003 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:16.174670 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:23:16.300915 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:23:16.443553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:23:16.983920 run create_hlr_db(pid=10748): Launched 20:23:17.146812 bus /sierra_2: Setting Powered False 20:23:18.210890 run create_hlr_db(pid=10748): Terminated: ok {rc=0} 20:23:18.645692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10750): Launched 20:23:18.950355 run osmo-hlr_10.42.42.2(pid=10751): Launched 20:23:19.065784 run osmo-stp_10.42.42.5: Starting osmo-stp 20:23:19.590477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10753): Launched 20:23:19.894906 run osmo-stp_10.42.42.5(pid=10754): Launched 20:23:20.010548 run osmo-msc_10.42.42.6: Starting osmo-msc 20:23:20.560187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10756): Launched 20:23:20.865418 run osmo-msc_10.42.42.6(pid=10757): Launched 20:23:21.036922 run osmo-stp_10.42.42.5(pid=10754): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10754)] 20:23:21.166795 run osmo-stp_10.42.42.5(pid=10754): stdout: | (launched: 2022-12-08_20:23:19.838840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:21.296313 run osmo-stp_10.42.42.5(pid=10754): stderr: | [0;m[38;5;43m20221208202320007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202320007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202320007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202320008 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202320008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202320008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202320009 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:21.424092 run osmo-stp_10.42.42.5(pid=10754): stdout: | (launched: 2022-12-08_20:23:19.838840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:21.545413 run osmo-stp_10.42.42.5(pid=10754): stderr: | [0;m[38;5;43m20221208202320007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202320007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202320007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202320008 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202320008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202320008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202320009 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:21.690729 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10754): Process ended prematurely: osmo-stp_10.42.42.5(pid=10754) [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10754)] [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 20:23:21.699738 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:23:21.726566 run osmo-hlr_10.42.42.2(pid=10751): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10751)] 20:23:21.774947 run osmo-hlr_10.42.42.2(pid=10751): stdout: | (launched: 2022-12-08_20:23:18.894709) 20:23:21.824779 run osmo-hlr_10.42.42.2(pid=10751): stderr: | [0;m[1;31m20221208202319069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202319069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202319069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202319069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202319069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202319069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202319082 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202319092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202319092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202319092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:23:21.894062 run osmo-msc_10.42.42.6(pid=10757): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10757)] 20:23:21.942607 run osmo-msc_10.42.42.6(pid=10757): stdout: | (launched: 2022-12-08_20:23:20.809614) 20:23:21.992377 run osmo-msc_10.42.42.6(pid=10757): stderr: | [0;m[38;5;43m20221208202321077 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202321078 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa32b9d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202321078 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202321078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202321078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202321078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202321080 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202321080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202321080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202321080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:23:22.042735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10750): Terminating (SIGTERM) 20:23:22.082843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10753): Terminating (SIGTERM) 20:23:22.122928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10756): Terminating (SIGTERM) 20:23:22.163232 --- ParallelTerminationStrategy: PID 10750 died... 20:23:22.182306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10750): Terminated: ok {rc=0} 20:23:22.227053 --- ParallelTerminationStrategy: PID 10753 died... 20:23:22.245639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10753): Terminated: ok {rc=0} 20:23:22.290139 --- ParallelTerminationStrategy: PID 10756 died... 20:23:22.308996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10756): Terminated: ok {rc=0} 20:23:22.395907 bus /sierra_3: Setting Powered False 20:23:23.497312 bus /sierra_3: Setting Powered False 20:23:24.615009 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 20:23:25.760382 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:25.772226 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:23:25.843213 tst mo_mt_call_osmux.py: using LAC 16582 20:23:25.965275 tst mo_mt_call_osmux.py: using RAC 7 20:23:26.088007 tst mo_mt_call_osmux.py: using CellId 16582 20:23:26.209386 tst mo_mt_call_osmux.py: using BVCI 16583 20:23:26.320158 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:26.331419 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:26.342399 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:26.353552 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:26.364724 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:26.376010 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:23:26.492783 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:23:26.617221 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:23:27.088840 run create_hlr_db(pid=10759): Launched 20:23:27.211502 bus /sierra_2: Setting Powered False 20:23:28.275495 run create_hlr_db(pid=10759): Terminated: ok {rc=0} 20:23:28.711883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10761): Launched 20:23:29.016661 run osmo-hlr_10.42.42.2(pid=10762): Launched 20:23:29.134855 run osmo-stp_10.42.42.5: Starting osmo-stp 20:23:29.670182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10764): Launched 20:23:29.975654 run osmo-stp_10.42.42.5(pid=10765): Launched 20:23:30.091311 run osmo-msc_10.42.42.6: Starting osmo-msc 20:23:30.641708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10767): Launched 20:23:30.985835 run osmo-msc_10.42.42.6(pid=10768): Launched 20:23:31.437101 run osmo-stp_10.42.42.5(pid=10765): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10765)] 20:23:31.603407 run osmo-stp_10.42.42.5(pid=10765): stdout: | (launched: 2022-12-08_20:23:29.919282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:31.745677 run osmo-stp_10.42.42.5(pid=10765): stderr: | [0;m[38;5;43m20221208202330091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202330092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202330092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202330092 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202330093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202330093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202330093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:31.893338 run osmo-stp_10.42.42.5(pid=10765): stdout: | (launched: 2022-12-08_20:23:29.919282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:32.036502 run osmo-stp_10.42.42.5(pid=10765): stderr: | [0;m[38;5;43m20221208202330091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202330092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202330092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202330092 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202330093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202330093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202330093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:32.196135 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10765): Process ended prematurely: osmo-stp_10.42.42.5(pid=10765) [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10765)] [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 20:23:32.206807 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 20:23:32.238098 run osmo-hlr_10.42.42.2(pid=10762): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10762)] 20:23:32.290517 run osmo-hlr_10.42.42.2(pid=10762): stdout: | (launched: 2022-12-08_20:23:28.960663) 20:23:32.344425 run osmo-hlr_10.42.42.2(pid=10762): stderr: | [0;m[1;31m20221208202329134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202329134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202329134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202329134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202329134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202329134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202329149 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202329160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202329160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202329160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:23:32.419452 run osmo-msc_10.42.42.6(pid=10768): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10768)] 20:23:32.470809 run osmo-msc_10.42.42.6(pid=10768): stdout: | (launched: 2022-12-08_20:23:30.917539) 20:23:32.523979 run osmo-msc_10.42.42.6(pid=10768): stderr: | [0;m[38;5;43m20221208202331255 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202331255 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f799e570c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202331255 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202331256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202331256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202331256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202331260 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202331261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202331261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202331262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:23:32.577195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10761): Terminating (SIGTERM) 20:23:32.619980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10764): Terminating (SIGTERM) 20:23:32.663369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10767): Terminating (SIGTERM) 20:23:32.706249 --- ParallelTerminationStrategy: PID 10761 died... 20:23:32.726553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10761): Terminated: ok {rc=0} 20:23:32.773795 --- ParallelTerminationStrategy: PID 10764 died... 20:23:32.793844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10764): Terminated: ok {rc=0} 20:23:32.840703 --- ParallelTerminationStrategy: PID 10767 died... 20:23:32.860655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10767): Terminated: ok {rc=0} 20:23:32.950377 bus /sierra_3: Setting Powered False 20:23:34.050240 bus /sierra_3: Setting Powered False 20:23:35.167238 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 20:23:36.420760 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:23:36.427968 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 20:23:36.462576 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 20:23:36.490248 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 20:23:36.543893 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 20:23:36.577646 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 20:23:36.604355 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 20:23:37.158279 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 20:23:37.210401 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:23:37.222053 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:23:37.294643 tst mo_mt_call.py: using LAC 16583 20:23:37.424199 tst mo_mt_call.py: using RAC 8 20:23:37.550220 tst mo_mt_call.py: using CellId 16583 20:23:37.670271 tst mo_mt_call.py: using BVCI 16584 20:23:37.782491 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:23:37.793872 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:23:37.805300 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:23:37.816788 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:23:37.828643 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:23:37.840235 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:23:37.962710 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:23:38.083512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:23:38.589406 run create_hlr_db(pid=10773): Launched 20:23:38.722093 bus /sierra_2: Setting Powered False 20:23:39.786852 run create_hlr_db(pid=10773): Terminated: ok {rc=0} 20:23:40.223395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10775): Launched 20:23:40.528722 run osmo-hlr_10.42.42.2(pid=10776): Launched 20:23:40.645488 run osmo-stp_10.42.42.5: Starting osmo-stp 20:23:41.179817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10778): Launched 20:23:41.484795 run osmo-stp_10.42.42.5(pid=10779): Launched 20:23:41.600735 run osmo-msc_10.42.42.6: Starting osmo-msc 20:23:42.150331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10781): Launched 20:23:42.457086 run osmo-msc_10.42.42.6(pid=10782): Launched 20:23:42.627094 run osmo-stp_10.42.42.5(pid=10779): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10779)] 20:23:42.756166 run osmo-stp_10.42.42.5(pid=10779): stdout: | (launched: 2022-12-08_20:23:41.428745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:42.885733 run osmo-stp_10.42.42.5(pid=10779): stderr: | [0;m[38;5;43m20221208202341599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202341599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202341599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202341600 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202341600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202341600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202341601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:43.013471 run osmo-stp_10.42.42.5(pid=10779): stdout: | (launched: 2022-12-08_20:23:41.428745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:43.134332 run osmo-stp_10.42.42.5(pid=10779): stderr: | [0;m[38;5;43m20221208202341599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202341599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202341599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202341600 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202341600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202341600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202341601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:43.279346 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10779): Process ended prematurely: osmo-stp_10.42.42.5(pid=10779) [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10779)] [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 20:23:43.288480 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 20:23:43.315827 run osmo-hlr_10.42.42.2(pid=10776): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10776)] 20:23:43.364203 run osmo-hlr_10.42.42.2(pid=10776): stdout: | (launched: 2022-12-08_20:23:40.472757) 20:23:43.414949 run osmo-hlr_10.42.42.2(pid=10776): stderr: | [0;m[1;31m20221208202340649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202340649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202340649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202340650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202340650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202340650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202340663 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202340673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202340673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202340673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:23:43.484601 run osmo-msc_10.42.42.6(pid=10782): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10782)] 20:23:43.533293 run osmo-msc_10.42.42.6(pid=10782): stdout: | (launched: 2022-12-08_20:23:42.401176) 20:23:43.583172 run osmo-msc_10.42.42.6(pid=10782): stderr: | [0;m[38;5;43m20221208202342674 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202342674 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcb1248fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202342674 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202342674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202342675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202342675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202342676 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202342677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202342677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202342677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:23:43.633569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10775): Terminating (SIGTERM) 20:23:43.674010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10778): Terminating (SIGTERM) 20:23:43.714507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10781): Terminating (SIGTERM) 20:23:43.755178 --- ParallelTerminationStrategy: PID 10775 died... 20:23:43.774426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10775): Terminated: ok {rc=0} 20:23:43.819690 --- ParallelTerminationStrategy: PID 10778 died... 20:23:43.838644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10778): Terminated: ok {rc=0} 20:23:43.883987 --- ParallelTerminationStrategy: PID 10781 died... 20:23:43.902959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10781): Terminated: ok {rc=0} 20:23:43.991490 bus /sierra_3: Setting Powered False 20:23:45.092293 bus /sierra_3: Setting Powered False 20:23:46.213315 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 20:23:47.372245 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:23:47.384153 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:23:47.454419 tst mo_mt_call_osmux.py: using LAC 16584 20:23:47.575958 tst mo_mt_call_osmux.py: using RAC 9 20:23:47.700243 tst mo_mt_call_osmux.py: using CellId 16584 20:23:47.828879 tst mo_mt_call_osmux.py: using BVCI 16585 20:23:47.947909 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:23:47.959714 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:23:47.971365 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:23:47.983142 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:23:47.995060 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:23:48.006811 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:23:48.127897 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:23:48.249433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:23:48.757293 run create_hlr_db(pid=10785): Launched 20:23:48.891498 bus /sierra_2: Setting Powered False 20:23:49.956375 run create_hlr_db(pid=10785): Terminated: ok {rc=0} 20:23:50.413367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10787): Launched 20:23:50.740541 run osmo-hlr_10.42.42.2(pid=10788): Launched 20:23:50.865183 run osmo-stp_10.42.42.5: Starting osmo-stp 20:23:51.425842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10790): Launched 20:23:51.751854 run osmo-stp_10.42.42.5(pid=10791): Launched 20:23:51.875539 run osmo-msc_10.42.42.6: Starting osmo-msc 20:23:52.472308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10793): Launched 20:23:52.799677 run osmo-msc_10.42.42.6(pid=10794): Launched 20:23:52.981429 run osmo-stp_10.42.42.5(pid=10791): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10791)] 20:23:53.118730 run osmo-stp_10.42.42.5(pid=10791): stdout: | (launched: 2022-12-08_20:23:51.692390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:53.256553 run osmo-stp_10.42.42.5(pid=10791): stderr: | [0;m[38;5;43m20221208202351885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202351885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202351886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202351886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202351887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202351887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202351887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:53.393612 run osmo-stp_10.42.42.5(pid=10791): stdout: | (launched: 2022-12-08_20:23:51.692390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:53.523665 run osmo-stp_10.42.42.5(pid=10791): stderr: | [0;m[38;5;43m20221208202351885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202351885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202351886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202351886 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202351887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202351887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202351887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:53.678506 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10791): Process ended prematurely: osmo-stp_10.42.42.5(pid=10791) [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10791)] [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 20:23:53.688279 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 20:23:53.716486 run osmo-hlr_10.42.42.2(pid=10788): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10788)] 20:23:53.767328 run osmo-hlr_10.42.42.2(pid=10788): stdout: | (launched: 2022-12-08_20:23:50.680920) 20:23:53.819981 run osmo-hlr_10.42.42.2(pid=10788): stderr: | [0;m[1;31m20221208202350879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202350879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202350880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202350880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202350880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202350880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202350923 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202350934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202350934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202350934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:23:53.892910 run osmo-msc_10.42.42.6(pid=10794): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10794)] 20:23:53.943385 run osmo-msc_10.42.42.6(pid=10794): stdout: | (launched: 2022-12-08_20:23:52.739738) 20:23:53.995378 run osmo-msc_10.42.42.6(pid=10794): stderr: | [0;m[38;5;43m20221208202353064 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202353064 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbbaa45cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202353064 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202353064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202353064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202353065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202353066 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202353067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202353067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202353067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:23:54.047822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10787): Terminating (SIGTERM) 20:23:54.089960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10790): Terminating (SIGTERM) 20:23:54.132064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10793): Terminating (SIGTERM) 20:23:54.174811 --- ParallelTerminationStrategy: PID 10787 died... 20:23:54.195328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10787): Terminated: ok {rc=0} 20:23:54.242003 --- ParallelTerminationStrategy: PID 10790 died... 20:23:54.261808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10790): Terminated: ok {rc=0} 20:23:54.308016 --- ParallelTerminationStrategy: PID 10793 died... 20:23:54.327613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10793): Terminated: ok {rc=0} 20:23:54.415814 bus /sierra_3: Setting Powered False 20:23:55.516350 bus /sierra_3: Setting Powered False 20:23:56.633233 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 20:23:57.890660 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:23:57.897899 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 20:23:57.932178 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 20:23:57.959752 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 20:23:58.014808 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 20:23:58.049247 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 20:23:58.076614 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 20:23:58.631138 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 20:23:58.683034 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:23:58.694624 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:23:58.764828 tst mo_mt_call.py: using LAC 16585 20:23:58.891791 tst mo_mt_call.py: using RAC 10 20:23:59.018533 tst mo_mt_call.py: using CellId 16585 20:23:59.150769 tst mo_mt_call.py: using BVCI 16586 20:23:59.270151 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:23:59.281766 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:23:59.293166 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:23:59.304478 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:23:59.316036 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:23:59.327461 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:23:59.444051 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:23:59.561435 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:24:00.032084 run create_hlr_db(pid=10799): Launched 20:24:00.166966 bus /sierra_2: Setting Powered False 20:24:01.226146 run create_hlr_db(pid=10799): Terminated: ok {rc=0} 20:24:01.666355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10801): Launched 20:24:01.989806 run osmo-hlr_10.42.42.2(pid=10802): Launched 20:24:02.153848 run osmo-stp_10.42.42.5: Starting osmo-stp 20:24:02.710497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10804): Launched 20:24:03.016495 run osmo-stp_10.42.42.5(pid=10805): Launched 20:24:03.132407 run osmo-msc_10.42.42.6: Starting osmo-msc 20:24:03.682102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10807): Launched 20:24:03.986675 run osmo-msc_10.42.42.6(pid=10808): Launched 20:24:04.156452 run osmo-stp_10.42.42.5(pid=10805): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10805)] 20:24:04.285883 run osmo-stp_10.42.42.5(pid=10805): stdout: | (launched: 2022-12-08_20:24:02.960649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:04.414894 run osmo-stp_10.42.42.5(pid=10805): stderr: | [0;m[38;5;43m20221208202403132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202403132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202403132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202403133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202403133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202403133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202403133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:04.542295 run osmo-stp_10.42.42.5(pid=10805): stdout: | (launched: 2022-12-08_20:24:02.960649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:04.663448 run osmo-stp_10.42.42.5(pid=10805): stderr: | [0;m[38;5;43m20221208202403132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202403132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202403132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202403133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202403133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202403133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202403133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:04.808246 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10805): Process ended prematurely: osmo-stp_10.42.42.5(pid=10805) [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10805)] [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 20:24:04.817565 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:24:04.844585 run osmo-hlr_10.42.42.2(pid=10802): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10802)] 20:24:04.893201 run osmo-hlr_10.42.42.2(pid=10802): stdout: | (launched: 2022-12-08_20:24:01.933450) 20:24:04.943329 run osmo-hlr_10.42.42.2(pid=10802): stderr: | [0;m[1;31m20221208202402234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202402234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202402234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202402234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202402234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202402234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202402246 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202402254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202402254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202402255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:24:05.013090 run osmo-msc_10.42.42.6(pid=10808): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10808)] 20:24:05.061470 run osmo-msc_10.42.42.6(pid=10808): stdout: | (launched: 2022-12-08_20:24:03.930736) 20:24:05.111550 run osmo-msc_10.42.42.6(pid=10808): stderr: | [0;m[38;5;43m20221208202404200 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202404200 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9581f4bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202404201 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202404201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202404201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202404201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202404203 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202404203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202404203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202404203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:24:05.161818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10801): Terminating (SIGTERM) 20:24:05.202236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10804): Terminating (SIGTERM) 20:24:05.242725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10807): Terminating (SIGTERM) 20:24:05.283282 --- ParallelTerminationStrategy: PID 10801 died... 20:24:05.302382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10801): Terminated: ok {rc=0} 20:24:05.347405 --- ParallelTerminationStrategy: PID 10804 died... 20:24:05.366407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10804): Terminated: ok {rc=0} 20:24:05.411181 --- ParallelTerminationStrategy: PID 10807 died... 20:24:05.430076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10807): Terminated: ok {rc=0} 20:24:05.517042 bus /sierra_3: Setting Powered False 20:24:06.617274 bus /sierra_3: Setting Powered False 20:24:07.733753 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 20:24:08.879008 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:24:08.890814 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:24:08.960808 tst mo_mt_call_osmux.py: using LAC 16586 20:24:09.082189 tst mo_mt_call_osmux.py: using RAC 11 20:24:09.203542 tst mo_mt_call_osmux.py: using CellId 16586 20:24:09.332174 tst mo_mt_call_osmux.py: using BVCI 16587 20:24:09.453151 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:24:09.464916 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:24:09.476381 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:24:09.488106 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:24:09.499839 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:24:09.511282 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:24:09.627586 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:24:09.743454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:24:10.214612 run create_hlr_db(pid=10810): Launched 20:24:10.331344 bus /sierra_2: Setting Powered False 20:24:11.395856 run create_hlr_db(pid=10810): Terminated: ok {rc=0} 20:24:11.850498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10812): Launched 20:24:12.177057 run osmo-hlr_10.42.42.2(pid=10813): Launched 20:24:12.302254 run osmo-stp_10.42.42.5: Starting osmo-stp 20:24:12.862558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10815): Launched 20:24:13.189292 run osmo-stp_10.42.42.5(pid=10816): Launched 20:24:13.314409 run osmo-msc_10.42.42.6: Starting osmo-msc 20:24:13.903918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10818): Launched 20:24:14.230634 run osmo-msc_10.42.42.6(pid=10819): Launched 20:24:14.413787 run osmo-stp_10.42.42.5(pid=10816): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10816)] 20:24:14.551582 run osmo-stp_10.42.42.5(pid=10816): stdout: | (launched: 2022-12-08_20:24:13.129881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:14.689721 run osmo-stp_10.42.42.5(pid=10816): stderr: | [0;m[38;5;43m20221208202413322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202413322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202413322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202413323 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202413323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202413323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202413323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:14.827304 run osmo-stp_10.42.42.5(pid=10816): stdout: | (launched: 2022-12-08_20:24:13.129881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:14.956820 run osmo-stp_10.42.42.5(pid=10816): stderr: | [0;m[38;5;43m20221208202413322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202413322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202413322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202413323 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202413323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202413323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202413323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:15.112256 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10816): Process ended prematurely: osmo-stp_10.42.42.5(pid=10816) [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10816)] [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 20:24:15.122124 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:24:15.150351 run osmo-hlr_10.42.42.2(pid=10813): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10813)] 20:24:15.201124 run osmo-hlr_10.42.42.2(pid=10813): stdout: | (launched: 2022-12-08_20:24:12.117778) 20:24:15.253803 run osmo-hlr_10.42.42.2(pid=10813): stderr: | [0;m[1;31m20221208202412315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202412315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202412315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202412315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202412315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202412315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202412327 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202412336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202412336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202412336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:24:15.327251 run osmo-msc_10.42.42.6(pid=10819): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10819)] 20:24:15.377881 run osmo-msc_10.42.42.6(pid=10819): stdout: | (launched: 2022-12-08_20:24:14.171181) 20:24:15.430363 run osmo-msc_10.42.42.6(pid=10819): stderr: | [0;m[38;5;43m20221208202414493 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202414493 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f126f228c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202414493 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202414493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202414494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202414494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202414495 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202414496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202414496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202414496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:24:15.483088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10812): Terminating (SIGTERM) 20:24:15.525719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10815): Terminating (SIGTERM) 20:24:15.568275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10818): Terminating (SIGTERM) 20:24:15.610628 --- ParallelTerminationStrategy: PID 10812 died... 20:24:15.630660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10812): Terminated: ok {rc=0} 20:24:15.677639 --- ParallelTerminationStrategy: PID 10815 died... 20:24:15.697463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10815): Terminated: ok {rc=0} 20:24:15.744140 --- ParallelTerminationStrategy: PID 10818 died... 20:24:15.763946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10818): Terminated: ok {rc=0} 20:24:15.853348 bus /sierra_3: Setting Powered False 20:24:16.957601 bus /sierra_3: Setting Powered False 20:24:18.072742 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 20:24:19.326557 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:24:19.333859 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 20:24:19.368368 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 20:24:19.395995 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 20:24:19.448842 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 20:24:19.483192 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 20:24:19.510732 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 20:24:20.063018 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 20:24:20.115282 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:20.127143 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:24:20.198502 tst mo_mt_call.py: using LAC 16587 20:24:20.326712 tst mo_mt_call.py: using RAC 12 20:24:20.455506 tst mo_mt_call.py: using CellId 16587 20:24:20.582504 tst mo_mt_call.py: using BVCI 16588 20:24:20.700755 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:20.712528 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:20.723898 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:20.735249 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:20.746762 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:20.758146 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:24:20.876818 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:24:20.992998 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:24:21.464045 run create_hlr_db(pid=10824): Launched 20:24:21.582280 bus /sierra_2: Setting Powered False 20:24:22.642934 run create_hlr_db(pid=10824): Terminated: ok {rc=0} 20:24:23.067291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10826): Launched 20:24:23.371505 run osmo-hlr_10.42.42.2(pid=10827): Launched 20:24:23.487171 run osmo-stp_10.42.42.5: Starting osmo-stp 20:24:24.023464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10829): Launched 20:24:24.329437 run osmo-stp_10.42.42.5(pid=10830): Launched 20:24:24.446571 run osmo-msc_10.42.42.6: Starting osmo-msc 20:24:25.002193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10832): Launched 20:24:25.306943 run osmo-msc_10.42.42.6(pid=10833): Launched 20:24:25.476936 run osmo-stp_10.42.42.5(pid=10830): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10830)] 20:24:25.606351 run osmo-stp_10.42.42.5(pid=10830): stdout: | (launched: 2022-12-08_20:24:24.273804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:25.738751 run osmo-stp_10.42.42.5(pid=10830): stderr: | [0;m[38;5;43m20221208202424443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202424444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202424444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202424444 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202424445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202424445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202424445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:25.866104 run osmo-stp_10.42.42.5(pid=10830): stdout: | (launched: 2022-12-08_20:24:24.273804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:25.987211 run osmo-stp_10.42.42.5(pid=10830): stderr: | [0;m[38;5;43m20221208202424443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202424444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202424444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202424444 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202424445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202424445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202424445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:26.132306 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10830): Process ended prematurely: osmo-stp_10.42.42.5(pid=10830) [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10830)] [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 20:24:26.141373 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 20:24:26.168147 run osmo-hlr_10.42.42.2(pid=10827): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10827)] 20:24:26.217218 run osmo-hlr_10.42.42.2(pid=10827): stdout: | (launched: 2022-12-08_20:24:23.315283) 20:24:26.267356 run osmo-hlr_10.42.42.2(pid=10827): stderr: | [0;m[1;31m20221208202423490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202423490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202423490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202423490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202423490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202423490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202423502 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202423513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202423513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202423513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:24:26.336775 run osmo-msc_10.42.42.6(pid=10833): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10833)] 20:24:26.384877 run osmo-msc_10.42.42.6(pid=10833): stdout: | (launched: 2022-12-08_20:24:25.251069) 20:24:26.434808 run osmo-msc_10.42.42.6(pid=10833): stderr: | [0;m[38;5;43m20221208202425523 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202425523 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f449fea8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202425523 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202425523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202425523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202425523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202425525 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202425526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202425526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202425526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:24:26.485216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10826): Terminating (SIGTERM) 20:24:26.525526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10829): Terminating (SIGTERM) 20:24:26.565898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10832): Terminating (SIGTERM) 20:24:26.606369 --- ParallelTerminationStrategy: PID 10826 died... 20:24:26.625626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10826): Terminated: ok {rc=0} 20:24:26.670604 --- ParallelTerminationStrategy: PID 10829 died... 20:24:26.689354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10829): Terminated: ok {rc=0} 20:24:26.734066 --- ParallelTerminationStrategy: PID 10832 died... 20:24:26.752894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10832): Terminated: ok {rc=0} 20:24:26.840821 bus /sierra_3: Setting Powered False 20:24:27.941404 bus /sierra_3: Setting Powered False 20:24:29.058633 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 20:24:30.204607 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:30.216724 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:24:30.289478 tst mo_mt_call_osmux.py: using LAC 16588 20:24:30.417301 tst mo_mt_call_osmux.py: using RAC 13 20:24:30.544682 tst mo_mt_call_osmux.py: using CellId 16588 20:24:30.671670 tst mo_mt_call_osmux.py: using BVCI 16589 20:24:30.791513 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:30.803287 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:30.814997 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:30.826735 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:30.842599 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:30.855394 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:24:30.986732 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:24:31.136815 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:24:31.708336 run create_hlr_db(pid=10835): Launched 20:24:31.871137 bus /sierra_2: Setting Powered False 20:24:32.935064 run create_hlr_db(pid=10835): Terminated: ok {rc=0} 20:24:33.371585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10837): Launched 20:24:33.676409 run osmo-hlr_10.42.42.2(pid=10838): Launched 20:24:33.791875 run osmo-stp_10.42.42.5: Starting osmo-stp 20:24:34.315525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10840): Launched 20:24:34.621395 run osmo-stp_10.42.42.5(pid=10841): Launched 20:24:34.737145 run osmo-msc_10.42.42.6: Starting osmo-msc 20:24:35.288624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10843): Launched 20:24:35.594745 run osmo-msc_10.42.42.6(pid=10844): Launched 20:24:35.764761 run osmo-stp_10.42.42.5(pid=10841): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10841)] 20:24:35.896544 run osmo-stp_10.42.42.5(pid=10841): stdout: | (launched: 2022-12-08_20:24:34.565418) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:36.026927 run osmo-stp_10.42.42.5(pid=10841): stderr: | [0;m[38;5;43m20221208202434735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202434735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202434735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202434735 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202434736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202434736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202434736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:36.154295 run osmo-stp_10.42.42.5(pid=10841): stdout: | (launched: 2022-12-08_20:24:34.565418) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:36.275090 run osmo-stp_10.42.42.5(pid=10841): stderr: | [0;m[38;5;43m20221208202434735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202434735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202434735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202434735 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202434736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202434736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202434736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:36.419730 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10841): Process ended prematurely: osmo-stp_10.42.42.5(pid=10841) [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10841)] [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 20:24:36.428762 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:24:36.455930 run osmo-hlr_10.42.42.2(pid=10838): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10838)] 20:24:36.504725 run osmo-hlr_10.42.42.2(pid=10838): stdout: | (launched: 2022-12-08_20:24:33.620566) 20:24:36.554933 run osmo-hlr_10.42.42.2(pid=10838): stderr: | [0;m[1;31m20221208202433793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202433793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202433793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202433793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202433793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202433793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202433806 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202433814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202433815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202433815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:24:36.624540 run osmo-msc_10.42.42.6(pid=10844): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10844)] 20:24:36.672840 run osmo-msc_10.42.42.6(pid=10844): stdout: | (launched: 2022-12-08_20:24:35.538238) 20:24:36.722876 run osmo-msc_10.42.42.6(pid=10844): stderr: | [0;m[38;5;43m20221208202435810 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202435810 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f650907cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202435810 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202435810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202435811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202435811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202435812 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202435813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202435813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202435813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:24:36.773193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10837): Terminating (SIGTERM) 20:24:36.813727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10840): Terminating (SIGTERM) 20:24:36.854157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10843): Terminating (SIGTERM) 20:24:36.894784 --- ParallelTerminationStrategy: PID 10837 died... 20:24:36.914061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10837): Terminated: ok {rc=0} 20:24:36.958990 --- ParallelTerminationStrategy: PID 10840 died... 20:24:36.977675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10840): Terminated: ok {rc=0} 20:24:37.022254 --- ParallelTerminationStrategy: PID 10843 died... 20:24:37.041148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10843): Terminated: ok {rc=0} 20:24:37.128508 bus /sierra_3: Setting Powered False 20:24:38.228259 bus /sierra_3: Setting Powered False 20:24:39.343622 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 20:24:40.602232 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:24:40.610826 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 20:24:40.645499 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 20:24:40.673252 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 20:24:40.725028 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 20:24:40.759774 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 20:24:40.787683 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 20:24:41.342565 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 20:24:41.395589 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:24:41.407245 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:24:41.477627 tst mo_mt_call.py: using LAC 16589 20:24:41.606633 tst mo_mt_call.py: using RAC 14 20:24:41.733822 tst mo_mt_call.py: using CellId 16589 20:24:41.856490 tst mo_mt_call.py: using BVCI 16590 20:24:41.977785 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:24:41.989615 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:24:42.001294 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:24:42.013085 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:24:42.025162 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:24:42.036764 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:24:42.159602 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:24:42.277508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:24:42.752930 run create_hlr_db(pid=10849): Launched 20:24:42.870750 bus /sierra_2: Setting Powered False 20:24:43.932013 run create_hlr_db(pid=10849): Terminated: ok {rc=0} 20:24:44.379510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10851): Launched 20:24:44.706993 run osmo-hlr_10.42.42.2(pid=10852): Launched 20:24:44.832773 run osmo-stp_10.42.42.5: Starting osmo-stp 20:24:45.394024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10854): Launched 20:24:45.722114 run osmo-stp_10.42.42.5(pid=10855): Launched 20:24:45.871996 run osmo-msc_10.42.42.6: Starting osmo-msc 20:24:46.547194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10857): Launched 20:24:46.880830 run osmo-msc_10.42.42.6(pid=10858): Launched 20:24:47.256049 run osmo-stp_10.42.42.5(pid=10855): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10855)] 20:24:47.468645 run osmo-stp_10.42.42.5(pid=10855): stdout: | (launched: 2022-12-08_20:24:45.662420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:47.606828 run osmo-stp_10.42.42.5(pid=10855): stderr: | [0;m[38;5;43m20221208202445876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202445876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202445876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202445876 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202445886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202445886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202445886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:47.743587 run osmo-stp_10.42.42.5(pid=10855): stdout: | (launched: 2022-12-08_20:24:45.662420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:47.873485 run osmo-stp_10.42.42.5(pid=10855): stderr: | [0;m[38;5;43m20221208202445876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202445876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202445876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202445876 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202445886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202445886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202445886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:48.029119 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10855): Process ended prematurely: osmo-stp_10.42.42.5(pid=10855) [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10855)] [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 20:24:48.038947 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 20:24:48.067120 run osmo-hlr_10.42.42.2(pid=10852): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10852)] 20:24:48.118048 run osmo-hlr_10.42.42.2(pid=10852): stdout: | (launched: 2022-12-08_20:24:44.647504) 20:24:48.170805 run osmo-hlr_10.42.42.2(pid=10852): stderr: | [0;m[1;31m20221208202444846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202444846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202444846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202444846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202444846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202444846 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202444892 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202444902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202444902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202444902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:24:48.244095 run osmo-msc_10.42.42.6(pid=10858): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10858)] 20:24:48.294930 run osmo-msc_10.42.42.6(pid=10858): stdout: | (launched: 2022-12-08_20:24:46.818937) 20:24:48.347351 run osmo-msc_10.42.42.6(pid=10858): stderr: | [0;m[38;5;43m20221208202447364 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202447364 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f566ee28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202447364 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202447364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202447365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202447365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202447367 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202447367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202447367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202447367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:24:48.400300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10851): Terminating (SIGTERM) 20:24:48.442966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10854): Terminating (SIGTERM) 20:24:48.485690 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10857): Terminating (SIGTERM) 20:24:48.528601 --- ParallelTerminationStrategy: PID 10851 died... 20:24:48.548923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10851): Terminated: ok {rc=0} 20:24:48.596021 --- ParallelTerminationStrategy: PID 10854 died... 20:24:48.615855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10854): Terminated: ok {rc=0} 20:24:48.663151 --- ParallelTerminationStrategy: PID 10857 died... 20:24:48.683172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10857): Terminated: ok {rc=0} 20:24:48.771780 bus /sierra_3: Setting Powered False 20:24:49.871278 bus /sierra_3: Setting Powered False 20:24:50.987378 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 20:24:52.130930 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:24:52.142816 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:24:52.213572 tst mo_mt_call_osmux.py: using LAC 16590 20:24:52.352190 tst mo_mt_call_osmux.py: using RAC 15 20:24:52.481652 tst mo_mt_call_osmux.py: using CellId 16590 20:24:52.602333 tst mo_mt_call_osmux.py: using BVCI 16591 20:24:52.715207 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:24:52.726677 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:24:52.738147 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:24:52.749582 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:24:52.760863 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:24:52.772289 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:24:52.888611 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:24:53.010972 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:24:53.517578 run create_hlr_db(pid=10860): Launched 20:24:53.652334 bus /sierra_2: Setting Powered False 20:24:54.717504 run create_hlr_db(pid=10860): Terminated: ok {rc=0} 20:24:55.155404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10862): Launched 20:24:55.461564 run osmo-hlr_10.42.42.2(pid=10863): Launched 20:24:55.578048 run osmo-stp_10.42.42.5: Starting osmo-stp 20:24:56.117774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10865): Launched 20:24:56.422299 run osmo-stp_10.42.42.5(pid=10866): Launched 20:24:56.537814 run osmo-msc_10.42.42.6: Starting osmo-msc 20:24:57.088764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10868): Launched 20:24:57.394206 run osmo-msc_10.42.42.6(pid=10869): Launched 20:24:57.565534 run osmo-stp_10.42.42.5(pid=10866): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10866)] 20:24:57.695405 run osmo-stp_10.42.42.5(pid=10866): stdout: | (launched: 2022-12-08_20:24:56.366193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:57.825135 run osmo-stp_10.42.42.5(pid=10866): stderr: | [0;m[38;5;43m20221208202456534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202456534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202456535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202456535 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202456536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202456536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202456536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:57.952930 run osmo-stp_10.42.42.5(pid=10866): stdout: | (launched: 2022-12-08_20:24:56.366193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:58.074235 run osmo-stp_10.42.42.5(pid=10866): stderr: | [0;m[38;5;43m20221208202456534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202456534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202456535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202456535 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202456536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202456536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202456536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:58.219626 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10866): Process ended prematurely: osmo-stp_10.42.42.5(pid=10866) [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10866)] [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 20:24:58.228651 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 20:24:58.255772 run osmo-hlr_10.42.42.2(pid=10863): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10863)] 20:24:58.304040 run osmo-hlr_10.42.42.2(pid=10863): stdout: | (launched: 2022-12-08_20:24:55.405200) 20:24:58.354078 run osmo-hlr_10.42.42.2(pid=10863): stderr: | [0;m[1;31m20221208202455580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202455581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202455581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202455581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202455581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202455581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202455594 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202455603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202455603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202455603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:24:58.423471 run osmo-msc_10.42.42.6(pid=10869): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10869)] 20:24:58.471342 run osmo-msc_10.42.42.6(pid=10869): stdout: | (launched: 2022-12-08_20:24:57.338093) 20:24:58.520904 run osmo-msc_10.42.42.6(pid=10869): stderr: | [0;m[38;5;43m20221208202457610 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202457610 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3d93cacc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202457610 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202457610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202457611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202457611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202457612 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202457613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202457613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202457613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:24:58.570645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10862): Terminating (SIGTERM) 20:24:58.611484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10865): Terminating (SIGTERM) 20:24:58.651598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10868): Terminating (SIGTERM) 20:24:58.692211 --- ParallelTerminationStrategy: PID 10862 died... 20:24:58.711559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10862): Terminated: ok {rc=0} 20:24:58.756406 --- ParallelTerminationStrategy: PID 10865 died... 20:24:58.775461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10865): Terminated: ok {rc=0} 20:24:58.819992 --- ParallelTerminationStrategy: PID 10868 died... 20:24:58.838936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10868): Terminated: ok {rc=0} 20:24:58.924657 bus /sierra_3: Setting Powered False 20:25:00.023958 bus /sierra_3: Setting Powered False 20:25:01.142117 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:25:02.406288 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:25:02.413705 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:25:02.448442 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 20:25:02.476323 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:25:02.530409 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:25:02.565338 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 20:25:02.593308 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:25:03.149267 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 20:25:03.201369 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:03.213006 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:25:03.285517 tst mo_mt_call.py: using LAC 16591 20:25:03.413756 tst mo_mt_call.py: using RAC 16 20:25:03.544622 tst mo_mt_call.py: using CellId 16591 20:25:03.674646 tst mo_mt_call.py: using BVCI 16592 20:25:03.793845 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:03.805492 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:03.816861 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:03.828422 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:03.839984 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:03.851504 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:25:03.968236 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:25:04.087910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:25:04.595235 run create_hlr_db(pid=10878): Launched 20:25:04.728262 bus /sierra_2: Setting Powered False 20:25:05.793155 run create_hlr_db(pid=10878): Terminated: ok {rc=0} 20:25:06.246817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10880): Launched 20:25:06.574214 run osmo-hlr_10.42.42.2(pid=10881): Launched 20:25:06.702994 run osmo-stp_10.42.42.5: Starting osmo-stp 20:25:07.267484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10883): Launched 20:25:07.595053 run osmo-stp_10.42.42.5(pid=10884): Launched 20:25:07.720685 run osmo-msc_10.42.42.6: Starting osmo-msc 20:25:08.309241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10886): Launched 20:25:08.635294 run osmo-msc_10.42.42.6(pid=10887): Launched 20:25:08.816778 run osmo-stp_10.42.42.5(pid=10884): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10884)] 20:25:08.954507 run osmo-stp_10.42.42.5(pid=10884): stdout: | (launched: 2022-12-08_20:25:07.535696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:09.092257 run osmo-stp_10.42.42.5(pid=10884): stderr: | [0;m[38;5;43m20221208202507726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202507726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202507726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202507726 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202507727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202507727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202507727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:09.228664 run osmo-stp_10.42.42.5(pid=10884): stdout: | (launched: 2022-12-08_20:25:07.535696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:09.358109 run osmo-stp_10.42.42.5(pid=10884): stderr: | [0;m[38;5;43m20221208202507726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202507726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202507726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202507726 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202507727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202507727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202507727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:09.513083 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10884): Process ended prematurely: osmo-stp_10.42.42.5(pid=10884) [trial-2349↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10884)] [trial-2349↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 20:25:09.522870 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:25:09.550632 run osmo-hlr_10.42.42.2(pid=10881): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10881)] 20:25:09.601119 run osmo-hlr_10.42.42.2(pid=10881): stdout: | (launched: 2022-12-08_20:25:06.514700) 20:25:09.653064 run osmo-hlr_10.42.42.2(pid=10881): stderr: | [0;m[1;31m20221208202506713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202506713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202506713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202506713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202506713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202506713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202506726 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202506735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202506736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202506736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:25:09.725872 run osmo-msc_10.42.42.6(pid=10887): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10887)] 20:25:09.776019 run osmo-msc_10.42.42.6(pid=10887): stdout: | (launched: 2022-12-08_20:25:08.575578) 20:25:09.827980 run osmo-msc_10.42.42.6(pid=10887): stderr: | [0;m[38;5;43m20221208202508896 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202508896 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f12543e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202508896 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202508896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202508896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202508897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202508898 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202508899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202508899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202508899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:25:09.880271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10880): Terminating (SIGTERM) 20:25:09.922340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10883): Terminating (SIGTERM) 20:25:09.964191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10886): Terminating (SIGTERM) 20:25:10.006640 --- ParallelTerminationStrategy: PID 10880 died... 20:25:10.026819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10880): Terminated: ok {rc=0} 20:25:10.073344 --- ParallelTerminationStrategy: PID 10883 died... 20:25:10.092875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10883): Terminated: ok {rc=0} 20:25:10.139100 --- ParallelTerminationStrategy: PID 10886 died... 20:25:10.158758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10886): Terminated: ok {rc=0} 20:25:10.246782 bus /sierra_3: Setting Powered False 20:25:11.345665 bus /sierra_3: Setting Powered False 20:25:12.462296 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 20:25:13.613107 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:13.625333 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:25:13.697735 tst mo_mt_call_osmux.py: using LAC 16592 20:25:13.826981 tst mo_mt_call_osmux.py: using RAC 17 20:25:13.956623 tst mo_mt_call_osmux.py: using CellId 16592 20:25:14.084823 tst mo_mt_call_osmux.py: using BVCI 16593 20:25:14.204706 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:14.216426 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:14.227989 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:14.239478 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:14.251016 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:14.262662 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:25:14.383499 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:25:14.504464 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:25:14.977188 run create_hlr_db(pid=10889): Launched 20:25:15.093472 bus /sierra_2: Setting Powered False 20:25:16.156740 run create_hlr_db(pid=10889): Terminated: ok {rc=0} 20:25:16.643846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10891): Launched 20:25:16.997831 run osmo-hlr_10.42.42.2(pid=10892): Launched 20:25:17.164212 run osmo-stp_10.42.42.5: Starting osmo-stp 20:25:17.690735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10894): Launched 20:25:17.997604 run osmo-stp_10.42.42.5(pid=10895): Launched 20:25:18.114283 run osmo-msc_10.42.42.6: Starting osmo-msc 20:25:18.666752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10897): Launched 20:25:18.972412 run osmo-msc_10.42.42.6(pid=10898): Launched 20:25:19.142531 run osmo-stp_10.42.42.5(pid=10895): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10895)] 20:25:19.272134 run osmo-stp_10.42.42.5(pid=10895): stdout: | (launched: 2022-12-08_20:25:17.941662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:19.402176 run osmo-stp_10.42.42.5(pid=10895): stderr: | [0;m[38;5;43m20221208202518110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202518110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202518110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202518111 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202518111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202518111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202518111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:19.529598 run osmo-stp_10.42.42.5(pid=10895): stdout: | (launched: 2022-12-08_20:25:17.941662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:19.650727 run osmo-stp_10.42.42.5(pid=10895): stderr: | [0;m[38;5;43m20221208202518110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202518110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202518110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202518111 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202518111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202518111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202518111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:19.795829 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10895): Process ended prematurely: osmo-stp_10.42.42.5(pid=10895) [trial-2349↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10895)] [trial-2349↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 20:25:19.804610 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 20:25:19.831646 run osmo-hlr_10.42.42.2(pid=10892): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10892)] 20:25:19.880146 run osmo-hlr_10.42.42.2(pid=10892): stdout: | (launched: 2022-12-08_20:25:16.938159) 20:25:19.930504 run osmo-hlr_10.42.42.2(pid=10892): stderr: | [0;m[1;31m20221208202517208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202517208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202517208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202517208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202517208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202517208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202517220 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202517228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202517228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202517228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:25:20.000303 run osmo-msc_10.42.42.6(pid=10898): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10898)] 20:25:20.048585 run osmo-msc_10.42.42.6(pid=10898): stdout: | (launched: 2022-12-08_20:25:18.916023) 20:25:20.098476 run osmo-msc_10.42.42.6(pid=10898): stderr: | [0;m[38;5;43m20221208202519187 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202519187 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1224cb0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202519187 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202519187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202519188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202519188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202519190 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202519190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202519190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202519190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:25:20.148608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10891): Terminating (SIGTERM) 20:25:20.188645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10894): Terminating (SIGTERM) 20:25:20.228662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10897): Terminating (SIGTERM) 20:25:20.268688 --- ParallelTerminationStrategy: PID 10891 died... 20:25:20.287805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10891): Terminated: ok {rc=0} 20:25:20.332344 --- ParallelTerminationStrategy: PID 10894 died... 20:25:20.350822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10894): Terminated: ok {rc=0} 20:25:20.395253 --- ParallelTerminationStrategy: PID 10897 died... 20:25:20.413861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10897): Terminated: ok {rc=0} 20:25:20.499294 bus /sierra_3: Setting Powered False 20:25:21.598393 bus /sierra_3: Setting Powered False 20:25:22.715094 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:25:23.964155 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:25:23.969885 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:25:24.003465 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 20:25:24.030170 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 20:25:24.083199 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:25:24.116942 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 20:25:24.143713 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 20:25:24.691466 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 20:25:24.740433 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:24.751465 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:25:24.822380 tst mo_mt_call.py: using LAC 16593 20:25:24.943631 tst mo_mt_call.py: using RAC 18 20:25:25.062943 tst mo_mt_call.py: using CellId 16593 20:25:25.184636 tst mo_mt_call.py: using BVCI 16594 20:25:25.295190 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:25.306223 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:25.317085 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:25.327991 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:25.339010 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:25.350146 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:25:25.470741 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:25:25.593944 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:25:26.101251 run create_hlr_db(pid=10904): Launched 20:25:26.236295 bus /sierra_2: Setting Powered False 20:25:27.301278 run create_hlr_db(pid=10904): Terminated: ok {rc=0} 20:25:27.758723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10906): Launched 20:25:28.085060 run osmo-hlr_10.42.42.2(pid=10919): Launched 20:25:28.211212 run osmo-stp_10.42.42.5: Starting osmo-stp 20:25:28.778167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10921): Launched 20:25:29.105146 run osmo-stp_10.42.42.5(pid=10922): Launched 20:25:29.230732 run osmo-msc_10.42.42.6: Starting osmo-msc 20:25:29.820907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10924): Launched 20:25:30.147551 run osmo-msc_10.42.42.6(pid=10925): Launched 20:25:30.330437 run osmo-stp_10.42.42.5(pid=10922): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10922)] 20:25:30.467774 run osmo-stp_10.42.42.5(pid=10922): stdout: | (launched: 2022-12-08_20:25:29.045724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:30.606584 run osmo-stp_10.42.42.5(pid=10922): stderr: | [0;m[38;5;43m20221208202529238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202529238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202529238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202529239 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202529239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202529239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202529239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:30.743624 run osmo-stp_10.42.42.5(pid=10922): stdout: | (launched: 2022-12-08_20:25:29.045724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:30.889284 run osmo-stp_10.42.42.5(pid=10922): stderr: | [0;m[38;5;43m20221208202529238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202529238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202529238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202529239 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202529239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202529239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202529239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:31.047800 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10922): Process ended prematurely: osmo-stp_10.42.42.5(pid=10922) [trial-2349↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10922)] [trial-2349↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 20:25:31.058075 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:25:31.087216 run osmo-hlr_10.42.42.2(pid=10919): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10919)] 20:25:31.138866 run osmo-hlr_10.42.42.2(pid=10919): stdout: | (launched: 2022-12-08_20:25:28.025540) 20:25:31.191979 run osmo-hlr_10.42.42.2(pid=10919): stderr: | [0;m[1;31m20221208202528224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202528224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202528224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202528224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202528224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202528224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202528237 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202528247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202528247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202528247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:25:31.266243 run osmo-msc_10.42.42.6(pid=10925): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10925)] 20:25:31.317762 run osmo-msc_10.42.42.6(pid=10925): stdout: | (launched: 2022-12-08_20:25:30.087928) 20:25:31.370922 run osmo-msc_10.42.42.6(pid=10925): stderr: | [0;m[38;5;43m20221208202530408 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202530409 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5541dfbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202530409 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202530409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202530409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202530409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202530411 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202530411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202530411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202530412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:25:31.424105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10906): Terminating (SIGTERM) 20:25:31.468405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10921): Terminating (SIGTERM) 20:25:31.524349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10924): Terminating (SIGTERM) 20:25:31.577909 --- ParallelTerminationStrategy: PID 10906 died... 20:25:31.603174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10906): Terminated: ok {rc=0} 20:25:31.667215 --- ParallelTerminationStrategy: PID 10921 died... 20:25:31.689418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10921): Terminated: ok {rc=0} 20:25:31.738535 --- ParallelTerminationStrategy: PID 10924 died... 20:25:31.759539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10924): Terminated: ok {rc=0} 20:25:31.859056 bus /sierra_3: Setting Powered False 20:25:32.961105 bus /sierra_3: Setting Powered False 20:25:34.077482 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 20:25:35.228853 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:35.241224 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:25:35.316928 tst mo_mt_call_osmux.py: using LAC 16594 20:25:35.445273 tst mo_mt_call_osmux.py: using RAC 19 20:25:35.574444 tst mo_mt_call_osmux.py: using CellId 16594 20:25:35.702018 tst mo_mt_call_osmux.py: using BVCI 16595 20:25:35.821185 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:35.832673 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:35.843992 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:35.855932 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:35.867683 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:35.879382 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:25:35.995936 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:25:36.115519 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:25:36.590867 run create_hlr_db(pid=10927): Launched 20:25:36.708376 bus /sierra_2: Setting Powered False 20:25:37.769240 run create_hlr_db(pid=10927): Terminated: ok {rc=0} 20:25:38.195484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10929): Launched 20:25:38.499813 run osmo-hlr_10.42.42.2(pid=10930): Launched 20:25:38.615766 run osmo-stp_10.42.42.5: Starting osmo-stp 20:25:39.141944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10932): Launched 20:25:39.447173 run osmo-stp_10.42.42.5(pid=10933): Launched 20:25:39.563850 run osmo-msc_10.42.42.6: Starting osmo-msc 20:25:40.115352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10935): Launched 20:25:40.421226 run osmo-msc_10.42.42.6(pid=10936): Launched 20:25:40.592267 run osmo-stp_10.42.42.5(pid=10933): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10933)] 20:25:40.723328 run osmo-stp_10.42.42.5(pid=10933): stdout: | (launched: 2022-12-08_20:25:39.390969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:40.852917 run osmo-stp_10.42.42.5(pid=10933): stderr: | [0;m[38;5;43m20221208202539559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202539559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202539559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202539559 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202539560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202539560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202539560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:40.980778 run osmo-stp_10.42.42.5(pid=10933): stdout: | (launched: 2022-12-08_20:25:39.390969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:41.102873 run osmo-stp_10.42.42.5(pid=10933): stderr: | [0;m[38;5;43m20221208202539559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202539559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202539559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202539559 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202539560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202539560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202539560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:41.247924 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10933): Process ended prematurely: osmo-stp_10.42.42.5(pid=10933) [trial-2349↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10933)] [trial-2349↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 20:25:41.256845 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 20:25:41.284127 run osmo-hlr_10.42.42.2(pid=10930): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10930)] 20:25:41.332853 run osmo-hlr_10.42.42.2(pid=10930): stdout: | (launched: 2022-12-08_20:25:38.444111) 20:25:41.383012 run osmo-hlr_10.42.42.2(pid=10930): stderr: | [0;m[1;31m20221208202538621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202538621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202538621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202538621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202538621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202538621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202538635 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202538643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202538643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202538643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:25:41.452802 run osmo-msc_10.42.42.6(pid=10936): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10936)] 20:25:41.501353 run osmo-msc_10.42.42.6(pid=10936): stdout: | (launched: 2022-12-08_20:25:40.364580) 20:25:41.551708 run osmo-msc_10.42.42.6(pid=10936): stderr: | [0;m[38;5;43m20221208202540636 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202540637 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9357c4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202540637 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202540637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202540637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202540637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202540639 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202540639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202540639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202540639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:25:41.602432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10929): Terminating (SIGTERM) 20:25:41.642855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10932): Terminating (SIGTERM) 20:25:41.683377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10935): Terminating (SIGTERM) 20:25:41.723879 --- ParallelTerminationStrategy: PID 10929 died... 20:25:41.743074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10929): Terminated: ok {rc=0} 20:25:41.788121 --- ParallelTerminationStrategy: PID 10932 died... 20:25:41.806926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10932): Terminated: ok {rc=0} 20:25:41.852022 --- ParallelTerminationStrategy: PID 10935 died... 20:25:41.871019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10935): Terminated: ok {rc=0} 20:25:41.957778 bus /sierra_3: Setting Powered False 20:25:43.056783 bus /sierra_3: Setting Powered False 20:25:44.176532 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 20:25:45.439488 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:25:45.444836 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 20:25:45.478946 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 20:25:45.506600 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 20:25:45.558314 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 20:25:45.592002 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 20:25:45.619248 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 20:25:46.193966 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 20:25:46.248705 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:25:46.261259 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 20:25:46.313424 tst mo_mt_call.py: using LAC 16595 20:25:46.442332 tst mo_mt_call.py: using RAC 20 20:25:46.566954 tst mo_mt_call.py: using CellId 16595 20:25:46.690863 tst mo_mt_call.py: using BVCI 16596 20:25:46.807650 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:25:46.819969 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:25:46.832120 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:25:46.846030 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:25:46.859132 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:25:46.871052 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 20:25:46.995351 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 20:25:47.117432 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:25:47.628277 run create_hlr_db(pid=10941): Launched 20:25:47.760729 bus /sierra_2: Setting Powered False 20:25:48.825268 run create_hlr_db(pid=10941): Terminated: ok {rc=0} 20:25:49.280021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10943): Launched 20:25:49.606466 run osmo-hlr_10.42.42.2(pid=10944): Launched 20:25:49.731694 run osmo-stp_10.42.42.5: Starting osmo-stp 20:25:50.298408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10946): Launched 20:25:50.627490 run osmo-stp_10.42.42.5(pid=10947): Launched 20:25:50.751307 run osmo-msc_10.42.42.6: Starting osmo-msc 20:25:51.343735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10949): Launched 20:25:51.672672 run osmo-msc_10.42.42.6(pid=10950): Launched 20:25:51.853892 run osmo-stp_10.42.42.5(pid=10947): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10947)] 20:25:51.991906 run osmo-stp_10.42.42.5(pid=10947): stdout: | (launched: 2022-12-08_20:25:50.567435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:52.130457 run osmo-stp_10.42.42.5(pid=10947): stderr: | [0;m[38;5;43m20221208202550759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202550759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202550759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202550760 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202550760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202550760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202550760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:52.267534 run osmo-stp_10.42.42.5(pid=10947): stdout: | (launched: 2022-12-08_20:25:50.567435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:52.397283 run osmo-stp_10.42.42.5(pid=10947): stderr: | [0;m[38;5;43m20221208202550759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202550759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202550759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202550760 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202550760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202550760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202550760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:52.552902 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10947): Process ended prematurely: osmo-stp_10.42.42.5(pid=10947) [trial-2349↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10947)] [trial-2349↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 20:25:52.562599 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:25:52.590519 run osmo-hlr_10.42.42.2(pid=10944): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10944)] 20:25:52.641165 run osmo-hlr_10.42.42.2(pid=10944): stdout: | (launched: 2022-12-08_20:25:49.546993) 20:25:52.693732 run osmo-hlr_10.42.42.2(pid=10944): stderr: | [0;m[1;31m20221208202549746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202549746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202549746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202549746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202549746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202549746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202549758 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202549767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202549767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202549767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:25:52.766700 run osmo-msc_10.42.42.6(pid=10950): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10950)] 20:25:52.817234 run osmo-msc_10.42.42.6(pid=10950): stdout: | (launched: 2022-12-08_20:25:51.612921) 20:25:52.869163 run osmo-msc_10.42.42.6(pid=10950): stderr: | [0;m[38;5;43m20221208202551932 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202551932 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f18845adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202551932 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202551932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202551933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202551933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202551934 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202551935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202551935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202551935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:25:52.921522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10943): Terminating (SIGTERM) 20:25:52.963756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10946): Terminating (SIGTERM) 20:25:53.006420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10949): Terminating (SIGTERM) 20:25:53.049148 --- ParallelTerminationStrategy: PID 10943 died... 20:25:53.069455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10943): Terminated: ok {rc=0} 20:25:53.116898 --- ParallelTerminationStrategy: PID 10946 died... 20:25:53.136806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10946): Terminated: ok {rc=0} 20:25:53.183526 --- ParallelTerminationStrategy: PID 10949 died... 20:25:53.203408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10949): Terminated: ok {rc=0} 20:25:53.292263 bus /sierra_3: Setting Powered False 20:25:54.393227 bus /sierra_3: Setting Powered False 20:25:55.511911 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 20:25:56.660104 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:25:56.671638 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 20:25:56.722868 tst mo_mt_call_osmux.py: using LAC 16596 20:25:56.843156 tst mo_mt_call_osmux.py: using RAC 21 20:25:56.963938 tst mo_mt_call_osmux.py: using CellId 16596 20:25:57.084316 tst mo_mt_call_osmux.py: using BVCI 16597 20:25:57.195024 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:25:57.206160 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:25:57.216909 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:25:57.228373 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:25:57.239409 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:25:57.250531 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 20:25:57.372875 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 20:25:57.490592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:25:57.963225 run create_hlr_db(pid=10952): Launched 20:25:58.079298 bus /sierra_2: Setting Powered False 20:25:59.139827 run create_hlr_db(pid=10952): Terminated: ok {rc=0} 20:25:59.589186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10954): Launched 20:25:59.915625 run osmo-hlr_10.42.42.2(pid=10955): Launched 20:26:00.039727 run osmo-stp_10.42.42.5: Starting osmo-stp 20:26:00.606542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10957): Launched 20:26:00.949669 run osmo-stp_10.42.42.5(pid=10958): Launched 20:26:01.196203 run osmo-msc_10.42.42.6: Starting osmo-msc 20:26:01.841760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10960): Launched 20:26:02.160791 run osmo-msc_10.42.42.6(pid=10961): Launched 20:26:02.442674 run osmo-stp_10.42.42.5(pid=10958): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10958)] 20:26:02.572625 run osmo-stp_10.42.42.5(pid=10958): stdout: | (launched: 2022-12-08_20:26:00.887695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:02.700809 run osmo-stp_10.42.42.5(pid=10958): stderr: | [0;m[38;5;43m20221208202601179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202601179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202601179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202601179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202601180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202601180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202601180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:02.828377 run osmo-stp_10.42.42.5(pid=10958): stdout: | (launched: 2022-12-08_20:26:00.887695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:02.949872 run osmo-stp_10.42.42.5(pid=10958): stderr: | [0;m[38;5;43m20221208202601179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202601179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202601179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202601179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202601180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202601180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202601180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:03.095348 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10958): Process ended prematurely: osmo-stp_10.42.42.5(pid=10958) [trial-2349↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10958)] [trial-2349↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 20:26:03.104224 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 20:26:03.130950 run osmo-hlr_10.42.42.2(pid=10955): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10955)] 20:26:03.179960 run osmo-hlr_10.42.42.2(pid=10955): stdout: | (launched: 2022-12-08_20:25:59.855866) 20:26:03.230053 run osmo-hlr_10.42.42.2(pid=10955): stderr: | [0;m[1;31m20221208202600053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202600053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202600053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202600053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202600053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202600053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202600066 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202600074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202600074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202600074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:26:03.299395 run osmo-msc_10.42.42.6(pid=10961): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10961)] 20:26:03.347592 run osmo-msc_10.42.42.6(pid=10961): stdout: | (launched: 2022-12-08_20:26:02.103978) 20:26:03.397595 run osmo-msc_10.42.42.6(pid=10961): stderr: | [0;m[38;5;43m20221208202602403 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202602403 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8539c82c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202602403 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202602403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202602403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202602403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202602405 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202602406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202602406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202602406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:26:03.447968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10954): Terminating (SIGTERM) 20:26:03.488022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10957): Terminating (SIGTERM) 20:26:03.528224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10960): Terminating (SIGTERM) 20:26:03.568526 --- ParallelTerminationStrategy: PID 10954 died... 20:26:03.587871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10954): Terminated: ok {rc=0} 20:26:03.632508 --- ParallelTerminationStrategy: PID 10957 died... 20:26:03.651254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10957): Terminated: ok {rc=0} 20:26:03.695724 --- ParallelTerminationStrategy: PID 10960 died... 20:26:03.714447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10960): Terminated: ok {rc=0} 20:26:03.800566 bus /sierra_3: Setting Powered False 20:26:04.900306 bus /sierra_3: Setting Powered False 20:26:06.016323 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 20:26:07.264676 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:26:07.271155 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 20:26:07.305269 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 20:26:07.331743 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 20:26:07.383439 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 20:26:07.416716 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 20:26:07.443164 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 20:26:07.996072 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 20:26:08.050520 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:08.062523 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:26:08.117603 tst mo_mt_call.py: using LAC 16597 20:26:08.247045 tst mo_mt_call.py: using RAC 22 20:26:08.375563 tst mo_mt_call.py: using CellId 16597 20:26:08.503478 tst mo_mt_call.py: using BVCI 16598 20:26:08.622641 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:08.634539 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:08.646162 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:08.658020 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:08.670016 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:08.681890 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:26:08.802289 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:26:08.923724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:26:09.433165 run create_hlr_db(pid=10966): Launched 20:26:09.566533 bus /sierra_2: Setting Powered False 20:26:10.631146 run create_hlr_db(pid=10966): Terminated: ok {rc=0} 20:26:11.068826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10968): Launched 20:26:11.377552 run osmo-hlr_10.42.42.2(pid=10969): Launched 20:26:11.494539 run osmo-stp_10.42.42.5: Starting osmo-stp 20:26:12.032806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10971): Launched 20:26:12.339131 run osmo-stp_10.42.42.5(pid=10972): Launched 20:26:12.457367 run osmo-msc_10.42.42.6: Starting osmo-msc 20:26:13.009756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10974): Launched 20:26:13.317395 run osmo-msc_10.42.42.6(pid=10975): Launched 20:26:13.489693 run osmo-stp_10.42.42.5(pid=10972): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10972)] 20:26:13.620802 run osmo-stp_10.42.42.5(pid=10972): stdout: | (launched: 2022-12-08_20:26:12.282953) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:13.751340 run osmo-stp_10.42.42.5(pid=10972): stderr: | [0;m[38;5;43m20221208202612453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202612453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202612453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202612454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202612454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202612454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202612454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:13.879894 run osmo-stp_10.42.42.5(pid=10972): stdout: | (launched: 2022-12-08_20:26:12.282953) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:14.001609 run osmo-stp_10.42.42.5(pid=10972): stderr: | [0;m[38;5;43m20221208202612453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202612453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202612453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202612454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202612454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202612454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202612454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:14.147973 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10972): Process ended prematurely: osmo-stp_10.42.42.5(pid=10972) [trial-2349↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10972)] [trial-2349↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 20:26:14.156852 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 20:26:14.183653 run osmo-hlr_10.42.42.2(pid=10969): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10969)] 20:26:14.232201 run osmo-hlr_10.42.42.2(pid=10969): stdout: | (launched: 2022-12-08_20:26:11.321438) 20:26:14.282052 run osmo-hlr_10.42.42.2(pid=10969): stderr: | [0;m[1;31m20221208202611497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202611498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202611498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202611498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202611498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202611498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202611514 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202611525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202611525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202611525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:26:14.351832 run osmo-msc_10.42.42.6(pid=10975): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10975)] 20:26:14.399909 run osmo-msc_10.42.42.6(pid=10975): stdout: | (launched: 2022-12-08_20:26:13.259997) 20:26:14.449692 run osmo-msc_10.42.42.6(pid=10975): stderr: | [0;m[38;5;43m20221208202613531 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202613531 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efc0e1a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202613531 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202613532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202613532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202613532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202613534 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202613534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202613534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202613534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:26:14.499959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10968): Terminating (SIGTERM) 20:26:14.540149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10971): Terminating (SIGTERM) 20:26:14.580253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10974): Terminating (SIGTERM) 20:26:14.621340 --- ParallelTerminationStrategy: PID 10968 died... 20:26:14.640777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10968): Terminated: ok {rc=0} 20:26:14.685628 --- ParallelTerminationStrategy: PID 10971 died... 20:26:14.704382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10971): Terminated: ok {rc=0} 20:26:14.748921 --- ParallelTerminationStrategy: PID 10974 died... 20:26:14.768144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10974): Terminated: ok {rc=0} 20:26:14.853271 bus /sierra_3: Setting Powered False 20:26:15.958845 bus /sierra_3: Setting Powered False 20:26:17.081538 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 20:26:18.228928 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:18.240884 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:26:18.294921 tst mo_mt_call_osmux.py: using LAC 16598 20:26:18.414272 tst mo_mt_call_osmux.py: using RAC 23 20:26:18.534317 tst mo_mt_call_osmux.py: using CellId 16598 20:26:18.654428 tst mo_mt_call_osmux.py: using BVCI 16599 20:26:18.766454 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:18.777831 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:18.789083 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:18.800508 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:18.812084 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:18.823464 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:26:18.940548 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:26:19.062110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:26:19.535074 run create_hlr_db(pid=10977): Launched 20:26:19.651931 bus /sierra_2: Setting Powered False 20:26:20.712142 run create_hlr_db(pid=10977): Terminated: ok {rc=0} 20:26:21.159719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10979): Launched 20:26:21.486941 run osmo-hlr_10.42.42.2(pid=10980): Launched 20:26:21.612556 run osmo-stp_10.42.42.5: Starting osmo-stp 20:26:22.174911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10982): Launched 20:26:22.501546 run osmo-stp_10.42.42.5(pid=10983): Launched 20:26:22.626972 run osmo-msc_10.42.42.6: Starting osmo-msc 20:26:23.217291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10985): Launched 20:26:23.545456 run osmo-msc_10.42.42.6(pid=10986): Launched 20:26:23.727911 run osmo-stp_10.42.42.5(pid=10983): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10983)] 20:26:23.865781 run osmo-stp_10.42.42.5(pid=10983): stdout: | (launched: 2022-12-08_20:26:22.441884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:24.004068 run osmo-stp_10.42.42.5(pid=10983): stderr: | [0;m[38;5;43m20221208202622633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202622633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202622633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202622633 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202622634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202622634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202622634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:24.142025 run osmo-stp_10.42.42.5(pid=10983): stdout: | (launched: 2022-12-08_20:26:22.441884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:24.272080 run osmo-stp_10.42.42.5(pid=10983): stderr: | [0;m[38;5;43m20221208202622633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202622633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202622633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202622633 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202622634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202622634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202622634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:24.427999 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10983): Process ended prematurely: osmo-stp_10.42.42.5(pid=10983) [trial-2349↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10983)] [trial-2349↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 20:26:24.437806 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 20:26:24.466068 run osmo-hlr_10.42.42.2(pid=10980): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10980)] 20:26:24.516829 run osmo-hlr_10.42.42.2(pid=10980): stdout: | (launched: 2022-12-08_20:26:21.427608) 20:26:24.569429 run osmo-hlr_10.42.42.2(pid=10980): stderr: | [0;m[1;31m20221208202621624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202621624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202621624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202621624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202621624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202621625 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202621641 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202621649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202621649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202621649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:26:24.642641 run osmo-msc_10.42.42.6(pid=10986): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10986)] 20:26:24.693141 run osmo-msc_10.42.42.6(pid=10986): stdout: | (launched: 2022-12-08_20:26:23.485034) 20:26:24.744870 run osmo-msc_10.42.42.6(pid=10986): stderr: | [0;m[38;5;43m20221208202623807 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202623807 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f486f951c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202623807 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202623808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202623808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202623808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202623810 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202623810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202623810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202623810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:26:24.797096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10979): Terminating (SIGTERM) 20:26:24.839037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10982): Terminating (SIGTERM) 20:26:24.881209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10985): Terminating (SIGTERM) 20:26:24.923838 --- ParallelTerminationStrategy: PID 10979 died... 20:26:24.943955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10979): Terminated: ok {rc=0} 20:26:24.990697 --- ParallelTerminationStrategy: PID 10982 died... 20:26:25.010424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10982): Terminated: ok {rc=0} 20:26:25.056889 --- ParallelTerminationStrategy: PID 10985 died... 20:26:25.076884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10985): Terminated: ok {rc=0} 20:26:25.164643 bus /sierra_3: Setting Powered False 20:26:26.265184 bus /sierra_3: Setting Powered False 20:26:27.382694 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 emergency:trx-b200 --------------------------------------------------------------------- 20:26:28.634752 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:26:28.639468 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 20:26:28.673142 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 20:26:28.699654 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 20:26:28.784120 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 20:26:28.817364 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 20:26:28.844057 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 20:26:29.427742 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2349 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 20:26:29.432673 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:29.443456 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 20:26:29.492935 tst emergency_mo_mt_call.py: using LAC 16599 20:26:29.612800 tst emergency_mo_mt_call.py: using RAC 24 20:26:29.731526 tst emergency_mo_mt_call.py: using CellId 16599 20:26:29.854782 tst emergency_mo_mt_call.py: using BVCI 16600 20:26:29.965111 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:29.975767 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:29.986412 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:29.997318 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:30.008017 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:30.018678 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 20:26:30.137907 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 20:26:30.260849 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:26:30.759336 run create_hlr_db(pid=10993): Launched 20:26:30.927793 bus /sierra_2: Setting Powered False 20:26:31.992163 run create_hlr_db(pid=10993): Terminated: ok {rc=0} 20:26:32.422321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10995): Launched 20:26:32.726419 run osmo-hlr_10.42.42.2(pid=10996): Launched 20:26:32.842400 run osmo-stp_10.42.42.5: Starting osmo-stp 20:26:33.371899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10999): Launched 20:26:33.674359 run osmo-stp_10.42.42.5(pid=11000): Launched 20:26:33.801081 tst emergency_mo_mt_call.py: using MSISDN 6841 20:26:33.965408 run osmo-msc_10.42.42.6: Starting osmo-msc 20:26:34.503962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11002): Launched 20:26:34.803039 run osmo-msc_10.42.42.6(pid=11003): Launched 20:26:34.969806 run osmo-stp_10.42.42.5(pid=11000): ERR: Terminated: ERROR {rc=1} [trial-2349↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11000)] 20:26:35.097317 run osmo-stp_10.42.42.5(pid=11000): stdout: | (launched: 2022-12-08_20:26:33.619080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:35.225065 run osmo-stp_10.42.42.5(pid=11000): stderr: | [0;m[38;5;43m20221208202633784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202633784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202633784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202633785 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202633785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202633785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202633786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:35.351304 run osmo-stp_10.42.42.5(pid=11000): stdout: | (launched: 2022-12-08_20:26:33.619080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:35.470888 run osmo-stp_10.42.42.5(pid=11000): stderr: | [0;m[38;5;43m20221208202633784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202633784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202633784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202633785 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202633785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202633785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202633786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:35.613478 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=11000): Process ended prematurely: osmo-stp_10.42.42.5(pid=11000) [trial-2349↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11000)] [trial-2349↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 20:26:35.621837 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 20:26:35.647915 run osmo-hlr_10.42.42.2(pid=10996): ERR: Terminated: ERROR {rc=237} [trial-2349↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10996)] 20:26:35.696123 run osmo-hlr_10.42.42.2(pid=10996): stdout: | (launched: 2022-12-08_20:26:32.671167) 20:26:35.745881 run osmo-hlr_10.42.42.2(pid=10996): stderr: | [0;m[1;31m20221208202632845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202632845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202632845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202632845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202632845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202632845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202632857 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202632866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202632866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202632866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:26:35.815287 run osmo-msc_10.42.42.6(pid=11003): ERR: Terminated: ERROR {rc=2} [trial-2349↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11003)] 20:26:35.863345 run osmo-msc_10.42.42.6(pid=11003): stdout: | (launched: 2022-12-08_20:26:34.747903) 20:26:35.913108 run osmo-msc_10.42.42.6(pid=11003): stderr: | [0;m[38;5;43m20221208202635019 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202635019 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f31eb810c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202635019 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202635020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202635020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202635021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202635022 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202635023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202635023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202635023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:26:35.962784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10995): Terminating (SIGTERM) 20:26:36.002395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10999): Terminating (SIGTERM) 20:26:36.042399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11002): Terminating (SIGTERM) 20:26:36.082566 --- ParallelTerminationStrategy: PID 10995 died... 20:26:36.101715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10995): Terminated: ok {rc=0} 20:26:36.146364 --- ParallelTerminationStrategy: PID 10999 died... 20:26:36.164853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10999): Terminated: ok {rc=0} 20:26:36.209814 --- ParallelTerminationStrategy: PID 11002 died... 20:26:36.228387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11002): Terminated: ok {rc=0} 20:26:36.311964 bus /sierra_3: Setting Powered False 20:26:37.410318 bus /sierra_3: Setting Powered False 20:26:38.526235 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 20:26:39.612606 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:39.624546 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 20:26:39.684503 tst emergency_preemptive_call.py: using LAC 16600 20:26:39.814700 tst emergency_preemptive_call.py: using RAC 25 20:26:39.943282 tst emergency_preemptive_call.py: using CellId 16600 20:26:40.072035 tst emergency_preemptive_call.py: using BVCI 16601 20:26:40.191001 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:40.202345 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:40.213719 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:40.225305 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:40.236761 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:40.248290 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 20:26:40.365452 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 20:26:40.485993 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 20:26:40.609768 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 20:26:40.726978 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:26:41.227119 run create_hlr_db(pid=11005): Launched 20:26:41.358122 bus /sierra_2: Setting Powered False 20:26:42.421384 run create_hlr_db(pid=11005): Terminated: ok {rc=0} 20:26:42.852052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11007): Launched 20:26:43.152609 run osmo-hlr_10.42.42.2(pid=11008): Launched 20:26:43.266142 run osmo-stp_10.42.42.5: Starting osmo-stp 20:26:43.797275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11010): Launched 20:26:44.097178 run osmo-stp_10.42.42.5(pid=11011): Launched 20:26:44.221298 tst emergency_preemptive_call.py: using MSISDN 6842 20:26:44.383319 run osmo-msc_10.42.42.6: Starting osmo-msc 20:26:44.919464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11013): Launched 20:26:45.219384 run osmo-msc_10.42.42.6(pid=11014): Launched 20:26:45.386557 run osmo-stp_10.42.42.5(pid=11011): ERR: Terminated: ERROR {rc=1} [trial-2349↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11011)] 20:26:45.514821 run osmo-stp_10.42.42.5(pid=11011): stdout: | (launched: 2022-12-08_20:26:44.041941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:45.642726 run osmo-stp_10.42.42.5(pid=11011): stderr: | [0;m[38;5;43m20221208202644210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202644210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202644211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202644211 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202644211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202644212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202644212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:45.767988 run osmo-stp_10.42.42.5(pid=11011): stdout: | (launched: 2022-12-08_20:26:44.041941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:45.896462 run osmo-stp_10.42.42.5(pid=11011): stderr: | [0;m[38;5;43m20221208202644210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202644210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202644211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202644211 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202644211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202644212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202644212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:46.067569 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=11011): Process ended prematurely: osmo-stp_10.42.42.5(pid=11011) [trial-2349↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11011)] [trial-2349↪emergency:trx-b200↪emergency_preemptive_call.py:32] 20:26:46.077855 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 20:26:46.107413 run osmo-hlr_10.42.42.2(pid=11008): ERR: Terminated: ERROR {rc=237} [trial-2349↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11008)] 20:26:46.161513 run osmo-hlr_10.42.42.2(pid=11008): stdout: | (launched: 2022-12-08_20:26:43.097318) 20:26:46.221547 run osmo-hlr_10.42.42.2(pid=11008): stderr: | [0;m[1;31m20221208202643272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202643273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202643273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202643273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202643273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202643273 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202643285 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202643294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202643294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202643294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:26:46.310608 run osmo-msc_10.42.42.6(pid=11014): ERR: Terminated: ERROR {rc=2} [trial-2349↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11014)] 20:26:46.371768 run osmo-msc_10.42.42.6(pid=11014): stdout: | (launched: 2022-12-08_20:26:45.164090) 20:26:46.429101 run osmo-msc_10.42.42.6(pid=11014): stderr: | [0;m[38;5;43m20221208202645435 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208202645436 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fba88a1cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208202645436 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208202645436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208202645436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208202645436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208202645438 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208202645438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208202645439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208202645439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:26:46.483477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11007): Terminating (SIGTERM) 20:26:46.528179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11010): Terminating (SIGTERM) 20:26:46.574662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11013): Terminating (SIGTERM) 20:26:46.621056 --- ParallelTerminationStrategy: PID 11007 died... 20:26:46.642941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11007): Terminated: ok {rc=0} 20:26:46.693592 --- ParallelTerminationStrategy: PID 11010 died... 20:26:46.713831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11010): Terminated: ok {rc=0} 20:26:46.761747 --- ParallelTerminationStrategy: PID 11013 died... 20:26:46.782309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11013): Terminated: ok {rc=0} 20:26:46.873921 bus /sierra_9: Setting Powered False 20:26:47.975595 bus /sierra_9: Setting Powered False 20:26:49.093115 bus /sierra_8: Setting Powered False 20:26:50.192799 bus /sierra_8: Setting Powered False 20:26:51.310810 bus /sierra_3: Setting Powered False 20:26:52.410424 bus /sierra_3: Setting Powered False 20:26:53.528761 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-b200 --------------------------------------------------------------------- 20:26:54.811647 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:26:54.816730 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 20:26:54.851205 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 20:26:54.889543 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 20:26:54.979053 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 20:26:55.013681 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 20:26:55.053314 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 20:26:55.644656 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 20:26:55.697925 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:26:55.709100 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 20:26:55.759187 tst cs_paging_gprs_active.py: using LAC 16601 20:26:55.888407 tst cs_paging_gprs_active.py: using RAC 26 20:26:56.016840 tst cs_paging_gprs_active.py: using CellId 16601 20:26:56.145178 tst cs_paging_gprs_active.py: using BVCI 16602 20:26:56.264005 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:26:56.275294 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:26:56.286240 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:26:56.297202 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:26:56.308086 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:26:56.318955 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:26:56.330256 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:26:56.341238 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:26:56.352249 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:26:56.470906 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:26:56.587830 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:26:56.793846 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:26:57.102040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11038): Launched 20:26:57.368580 run iperf3-srv_10.42.42.10(pid=11039): Launched 20:26:57.484046 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:26:57.690284 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:26:57.998432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11040): Launched 20:26:58.266989 run iperf3-srv_10.42.42.10(pid=11041): Launched 20:26:58.382062 tst cs_paging_gprs_active.py:38: start network... 20:26:58.586609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:26:59.061450 run create_hlr_db(pid=11042): Launched 20:26:59.179772 bus /sierra_2: Setting Powered False 20:27:00.240329 run create_hlr_db(pid=11042): Terminated: ok {rc=0} 20:27:00.668238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11045): Launched 20:27:01.010273 run osmo-hlr_10.42.42.2(pid=11046): Launched 20:27:01.252578 run osmo-stp_10.42.42.5: Starting osmo-stp 20:27:01.901281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11048): Launched 20:27:02.249168 run osmo-stp_10.42.42.5(pid=11049): Launched 20:27:02.394954 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:27:02.941261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11051): Launched 20:27:03.059385 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:27:03.317987 run patchelf(pid=11052): Launched 20:27:03.488413 run osmo-stp_10.42.42.5(pid=11049): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11049)] 20:27:03.618669 run osmo-stp_10.42.42.5(pid=11049): stdout: | (launched: 2022-12-08_20:27:02.187517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:03.750595 run osmo-stp_10.42.42.5(pid=11049): stderr: | [0;m[38;5;43m20221208202702393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202702393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202702393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202702394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202702394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202702394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202702394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:03.883049 run osmo-stp_10.42.42.5(pid=11049): stdout: | (launched: 2022-12-08_20:27:02.187517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:04.009293 run osmo-stp_10.42.42.5(pid=11049): stderr: | [0;m[38;5;43m20221208202702393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202702393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202702393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202702394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202702394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202702394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202702394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:04.158834 run patchelf(pid=11052): Terminating (SIGINT) 20:27:04.330309 run patchelf(pid=11052): Terminated: ok {rc=0} 20:27:04.454273 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11049): Process ended prematurely: osmo-stp_10.42.42.5(pid=11049) [trial-2349↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11049)] [trial-2349↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 20:27:04.463892 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 20:27:04.491682 run osmo-hlr_10.42.42.2(pid=11046): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11046)] 20:27:04.539980 run osmo-hlr_10.42.42.2(pid=11046): stdout: | (launched: 2022-12-08_20:27:00.949537) 20:27:04.589937 run osmo-hlr_10.42.42.2(pid=11046): stderr: | [0;m[1;31m20221208202701156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202701156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202701156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202701157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202701157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202701157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202701175 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202701187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202701188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202701188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:27:04.640297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11038): Terminating (SIGTERM) 20:27:04.680892 run iperf3-srv_10.42.42.10(pid=11039): Terminating (SIGTERM) 20:27:04.721323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11040): Terminating (SIGTERM) 20:27:04.761615 run iperf3-srv_10.42.42.10(pid=11041): Terminating (SIGTERM) 20:27:04.801800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11045): Terminating (SIGTERM) 20:27:04.842151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11048): Terminating (SIGTERM) 20:27:04.882675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11051): Terminating (SIGTERM) 20:27:04.923515 --- ParallelTerminationStrategy: PID 11038 died... 20:27:04.942838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11038): Terminated: ok {rc=0} 20:27:04.988565 --- ParallelTerminationStrategy: PID 11039 died... 20:27:05.007467 run iperf3-srv_10.42.42.10(pid=11039): Terminated {rc=256} 20:27:05.051705 --- ParallelTerminationStrategy: PID 11040 died... 20:27:05.070321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11040): Terminated: ok {rc=0} 20:27:05.114622 --- ParallelTerminationStrategy: PID 11041 died... 20:27:05.133166 run iperf3-srv_10.42.42.10(pid=11041): Terminated {rc=256} 20:27:05.178086 --- ParallelTerminationStrategy: PID 11045 died... 20:27:05.196705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11045): Terminated: ok {rc=0} 20:27:05.241096 --- ParallelTerminationStrategy: PID 11048 died... 20:27:05.259764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11048): Terminated: ok {rc=0} 20:27:05.304329 --- ParallelTerminationStrategy: PID 11051 died... 20:27:05.323190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11051): Terminated: ok {rc=0} 20:27:05.409559 bus /gobi_0: Setting Powered False 20:27:06.509630 bus /gobi_0: Setting Powered False 20:27:07.626309 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-b200 iperf3.py ---------------------------------------------- 20:27:08.773168 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:08.784322 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 20:27:08.840794 tst iperf3.py: using LAC 16602 20:27:08.960732 tst iperf3.py: using RAC 27 20:27:09.080600 tst iperf3.py: using CellId 16602 20:27:09.198921 tst iperf3.py: using BVCI 16603 20:27:09.311529 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:09.322319 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:09.332699 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:09.343469 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:09.354286 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:09.364777 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:09.375512 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:09.386081 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:09.396747 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:27:09.512864 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:27:09.719434 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:27:10.027795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11053): Launched 20:27:10.296315 run iperf3-srv_10.42.42.10(pid=11054): Launched 20:27:10.410904 tst iperf3.py:8: start network... 20:27:10.615609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:27:11.087982 run create_hlr_db(pid=11055): Launched 20:27:11.203465 bus /gobi_6: Setting Powered False 20:27:12.263690 run create_hlr_db(pid=11055): Terminated: ok {rc=0} 20:27:12.711176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11057): Launched 20:27:13.038426 run osmo-hlr_10.42.42.2(pid=11058): Launched 20:27:13.163249 run osmo-stp_10.42.42.5: Starting osmo-stp 20:27:13.733171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11060): Launched 20:27:14.060884 run osmo-stp_10.42.42.5(pid=11061): Launched 20:27:14.186414 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:27:14.750346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11063): Launched 20:27:14.876243 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:27:15.152179 run patchelf(pid=11064): Launched 20:27:15.334935 run osmo-stp_10.42.42.5(pid=11061): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11061)] 20:27:15.473473 run osmo-stp_10.42.42.5(pid=11061): stdout: | (launched: 2022-12-08_20:27:14.001104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:15.614117 run osmo-stp_10.42.42.5(pid=11061): stderr: | [0;m[38;5;43m20221208202714193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202714193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202714193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202714194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202714194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202714194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202714194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:15.754186 run osmo-stp_10.42.42.5(pid=11061): stdout: | (launched: 2022-12-08_20:27:14.001104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:15.889401 run osmo-stp_10.42.42.5(pid=11061): stderr: | [0;m[38;5;43m20221208202714193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202714193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202714193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202714194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202714194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202714194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202714194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:16.051203 run patchelf(pid=11064): Terminating (SIGINT) 20:27:16.238569 run patchelf(pid=11064): Terminated: ok {rc=0} 20:27:16.373599 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11061): Process ended prematurely: osmo-stp_10.42.42.5(pid=11061) [trial-2349↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11061)] [trial-2349↪gprs:trx-b200↪iperf3.py:8] 20:27:16.384390 tst iperf3.py:8: Test FAILED (7.6 sec) 20:27:16.413938 run osmo-hlr_10.42.42.2(pid=11058): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11058)] 20:27:16.465332 run osmo-hlr_10.42.42.2(pid=11058): stdout: | (launched: 2022-12-08_20:27:12.978424) 20:27:16.518265 run osmo-hlr_10.42.42.2(pid=11058): stderr: | [0;m[1;31m20221208202713175 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202713175 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202713175 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202713176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202713176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202713176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202713188 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202713198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202713198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202713198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:27:16.572029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11053): Terminating (SIGTERM) 20:27:16.615452 run iperf3-srv_10.42.42.10(pid=11054): Terminating (SIGTERM) 20:27:16.661104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11057): Terminating (SIGTERM) 20:27:16.704888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11060): Terminating (SIGTERM) 20:27:16.749288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11063): Terminating (SIGTERM) 20:27:16.792519 --- ParallelTerminationStrategy: PID 11053 died... 20:27:16.813180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11053): Terminated: ok {rc=0} 20:27:16.860471 --- ParallelTerminationStrategy: PID 11054 died... 20:27:16.880633 run iperf3-srv_10.42.42.10(pid=11054): Terminated {rc=256} 20:27:16.930072 --- ParallelTerminationStrategy: PID 11057 died... 20:27:16.950007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11057): Terminated: ok {rc=0} 20:27:16.998189 --- ParallelTerminationStrategy: PID 11060 died... 20:27:17.019298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11060): Terminated: ok {rc=0} 20:27:17.068619 --- ParallelTerminationStrategy: PID 11063 died... 20:27:17.088706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11063): Terminated: ok {rc=0} 20:27:17.178134 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 20:27:18.330455 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:18.342207 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 20:27:18.393418 tst iperf3m4.py: using LAC 16603 20:27:18.525867 tst iperf3m4.py: using RAC 28 20:27:18.654530 tst iperf3m4.py: using CellId 16603 20:27:18.781270 tst iperf3m4.py: using BVCI 16604 20:27:18.899934 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:18.911124 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:18.922117 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:18.933143 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:18.943953 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:18.954847 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:18.965914 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:18.976794 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:18.988015 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:27:19.109323 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:27:19.230266 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:27:19.351893 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:27:19.471015 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:27:19.678017 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:27:19.986128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11065): Launched 20:27:20.255569 run iperf3-srv_10.42.42.10(pid=11066): Launched 20:27:20.370369 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:27:20.574935 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:27:20.881157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11067): Launched 20:27:21.148140 run iperf3-srv_10.42.42.10(pid=11068): Launched 20:27:21.263027 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:27:21.467660 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:27:21.774369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11069): Launched 20:27:22.043882 run iperf3-srv_10.42.42.10(pid=11070): Launched 20:27:22.158382 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:27:22.362666 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:27:22.669469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11071): Launched 20:27:22.936582 run iperf3-srv_10.42.42.10(pid=11072): Launched 20:27:23.051343 tst iperf3m4.py:8: start network... 20:27:23.255570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:27:23.729030 run create_hlr_db(pid=11073): Launched 20:27:23.847884 bus /gobi_6: Setting Powered False 20:27:24.908580 run create_hlr_db(pid=11073): Terminated: ok {rc=0} 20:27:25.358197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11075): Launched 20:27:25.686301 run osmo-hlr_10.42.42.2(pid=11076): Launched 20:27:25.812234 run osmo-stp_10.42.42.5: Starting osmo-stp 20:27:26.378784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11078): Launched 20:27:26.707746 run osmo-stp_10.42.42.5(pid=11079): Launched 20:27:26.833314 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:27:27.396259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11081): Launched 20:27:27.523378 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:27:27.802366 run patchelf(pid=11082): Launched 20:27:27.986323 run osmo-stp_10.42.42.5(pid=11079): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11079)] 20:27:28.126105 run osmo-stp_10.42.42.5(pid=11079): stdout: | (launched: 2022-12-08_20:27:26.647860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:28.267210 run osmo-stp_10.42.42.5(pid=11079): stderr: | [0;m[38;5;43m20221208202726838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202726838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202726838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202726838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202726839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202726839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202726839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:28.408350 run osmo-stp_10.42.42.5(pid=11079): stdout: | (launched: 2022-12-08_20:27:26.647860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:28.543813 run osmo-stp_10.42.42.5(pid=11079): stderr: | [0;m[38;5;43m20221208202726838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202726838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202726838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202726838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202726839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202726839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202726839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:28.704316 run patchelf(pid=11082): Terminating (SIGINT) 20:27:28.889813 run patchelf(pid=11082): Terminated: ok {rc=0} 20:27:29.022796 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11079): Process ended prematurely: osmo-stp_10.42.42.5(pid=11079) [trial-2349↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11079)] [trial-2349↪gprs:trx-b200↪iperf3m4.py:8] 20:27:29.033157 tst iperf3m4.py:8: Test FAILED (10.7 sec) 20:27:29.062323 run osmo-hlr_10.42.42.2(pid=11076): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11076)] 20:27:29.113224 run osmo-hlr_10.42.42.2(pid=11076): stdout: | (launched: 2022-12-08_20:27:25.626643) 20:27:29.165667 run osmo-hlr_10.42.42.2(pid=11076): stderr: | [0;m[1;31m20221208202725824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202725824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202725824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202725824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202725824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202725824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202725836 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202725845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202725845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202725845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:27:29.218575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11065): Terminating (SIGTERM) 20:27:29.261076 run iperf3-srv_10.42.42.10(pid=11066): Terminating (SIGTERM) 20:27:29.303359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11067): Terminating (SIGTERM) 20:27:29.346282 run iperf3-srv_10.42.42.10(pid=11068): Terminating (SIGTERM) 20:27:29.388807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11069): Terminating (SIGTERM) 20:27:29.431522 run iperf3-srv_10.42.42.10(pid=11070): Terminating (SIGTERM) 20:27:29.473985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11071): Terminating (SIGTERM) 20:27:29.516604 run iperf3-srv_10.42.42.10(pid=11072): Terminating (SIGTERM) 20:27:29.559420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11075): Terminating (SIGTERM) 20:27:29.602187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11078): Terminating (SIGTERM) 20:27:29.644722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11081): Terminating (SIGTERM) 20:27:29.687527 --- ParallelTerminationStrategy: PID 11065 died... 20:27:29.707790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11065): Terminated: ok {rc=0} 20:27:29.755213 --- ParallelTerminationStrategy: PID 11066 died... 20:27:29.774990 run iperf3-srv_10.42.42.10(pid=11066): Terminated {rc=256} 20:27:29.821802 --- ParallelTerminationStrategy: PID 11067 died... 20:27:29.841794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11067): Terminated: ok {rc=0} 20:27:29.889527 --- ParallelTerminationStrategy: PID 11068 died... 20:27:29.909490 run iperf3-srv_10.42.42.10(pid=11068): Terminated {rc=256} 20:27:29.956351 --- ParallelTerminationStrategy: PID 11069 died... 20:27:29.977131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11069): Terminated: ok {rc=0} 20:27:30.023881 --- ParallelTerminationStrategy: PID 11070 died... 20:27:30.043918 run iperf3-srv_10.42.42.10(pid=11070): Terminated {rc=256} 20:27:30.090551 --- ParallelTerminationStrategy: PID 11071 died... 20:27:30.110604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11071): Terminated: ok {rc=0} 20:27:30.157312 --- ParallelTerminationStrategy: PID 11072 died... 20:27:30.177264 run iperf3-srv_10.42.42.10(pid=11072): Terminated {rc=256} 20:27:30.223895 --- ParallelTerminationStrategy: PID 11075 died... 20:27:30.243865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11075): Terminated: ok {rc=0} 20:27:30.290553 --- ParallelTerminationStrategy: PID 11078 died... 20:27:30.310550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11078): Terminated: ok {rc=0} 20:27:30.357345 --- ParallelTerminationStrategy: PID 11081 died... 20:27:30.377269 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11081): Terminated: ok {rc=0} 20:27:30.464900 bus /gobi_4: Setting Powered False 20:27:31.561590 bus /gobi_4: Setting Powered False 20:27:32.681588 bus /gobi_1: Setting Powered False 20:27:33.781158 bus /gobi_1: Setting Powered False 20:27:34.897106 bus /gobi_0: Setting Powered False 20:27:35.995099 bus /gobi_0: Setting Powered False 20:27:37.113553 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-b200 ping.py ---------------------------------------------- 20:27:38.217520 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:38.228724 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 20:27:38.278276 tst ping.py: using LAC 16604 20:27:38.397950 tst ping.py: using RAC 29 20:27:38.515041 tst ping.py: using CellId 16604 20:27:38.645651 tst ping.py: using BVCI 16605 20:27:38.765157 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:38.776306 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:38.787608 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:38.799271 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:38.810849 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:38.822435 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:38.834000 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:38.845508 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:27:38.963105 tst ping.py:19: start network... 20:27:39.165485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:27:39.630121 run create_hlr_db(pid=11083): Launched 20:27:39.747908 bus /gobi_6: Setting Powered False 20:27:40.807513 run create_hlr_db(pid=11083): Terminated: ok {rc=0} 20:27:41.227606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11085): Launched 20:27:41.528771 run osmo-hlr_10.42.42.2(pid=11086): Launched 20:27:41.642946 run osmo-stp_10.42.42.5: Starting osmo-stp 20:27:42.171191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11088): Launched 20:27:42.471811 run osmo-stp_10.42.42.5(pid=11089): Launched 20:27:42.586398 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:27:43.104118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11091): Launched 20:27:43.226643 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:27:43.481212 run patchelf(pid=11092): Launched 20:27:43.649296 run osmo-stp_10.42.42.5(pid=11089): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11089)] 20:27:43.777908 run osmo-stp_10.42.42.5(pid=11089): stdout: | (launched: 2022-12-08_20:27:42.416539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:43.908309 run osmo-stp_10.42.42.5(pid=11089): stderr: | [0;m[38;5;43m20221208202742585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202742585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202742585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202742586 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202742586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202742586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202742587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:44.039068 run osmo-stp_10.42.42.5(pid=11089): stdout: | (launched: 2022-12-08_20:27:42.416539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:44.162845 run osmo-stp_10.42.42.5(pid=11089): stderr: | [0;m[38;5;43m20221208202742585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202742585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202742585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202742586 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202742586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202742586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202742587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:44.309556 run patchelf(pid=11092): Terminating (SIGINT) 20:27:44.478686 run patchelf(pid=11092): Terminated: ok {rc=0} 20:27:44.600813 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11089): Process ended prematurely: osmo-stp_10.42.42.5(pid=11089) [trial-2349↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11089)] [trial-2349↪gprs:trx-b200↪ping.py:22] 20:27:44.609873 tst ping.py:22: Test FAILED (6.4 sec) 20:27:44.637981 run osmo-hlr_10.42.42.2(pid=11086): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11086)] 20:27:44.686833 run osmo-hlr_10.42.42.2(pid=11086): stdout: | (launched: 2022-12-08_20:27:41.473552) 20:27:44.737384 run osmo-hlr_10.42.42.2(pid=11086): stderr: | [0;m[1;31m20221208202741649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202741649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202741649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202741649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202741650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202741650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202741662 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202741673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202741674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202741674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:27:44.788543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11085): Terminating (SIGTERM) 20:27:44.829754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11088): Terminating (SIGTERM) 20:27:44.870766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11091): Terminating (SIGTERM) 20:27:44.911996 --- ParallelTerminationStrategy: PID 11085 died... 20:27:44.931266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11085): Terminated: ok {rc=0} 20:27:44.977308 --- ParallelTerminationStrategy: PID 11088 died... 20:27:44.996021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11088): Terminated: ok {rc=0} 20:27:45.042260 --- ParallelTerminationStrategy: PID 11091 died... 20:27:45.061211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11091): Terminated: ok {rc=0} 20:27:45.149482 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 20:27:46.245232 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:46.260144 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 20:27:46.312128 tst ping_idle_ping.py: using LAC 16605 20:27:46.433551 tst ping_idle_ping.py: using RAC 30 20:27:46.586349 tst ping_idle_ping.py: using CellId 16605 20:27:46.743832 tst ping_idle_ping.py: using BVCI 16606 20:27:46.858550 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:46.870083 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:46.881814 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:46.893136 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:46.904857 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:46.916350 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:46.927918 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:46.939508 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:27:47.059757 tst ping_idle_ping.py:24: start network... 20:27:47.272689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:27:47.740476 run create_hlr_db(pid=11093): Launched 20:27:47.855662 bus /gobi_6: Setting Powered False 20:27:48.915558 run create_hlr_db(pid=11093): Terminated: ok {rc=0} 20:27:49.336325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11095): Launched 20:27:49.637942 run osmo-hlr_10.42.42.2(pid=11096): Launched 20:27:49.751962 run osmo-stp_10.42.42.5: Starting osmo-stp 20:27:50.271377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11098): Launched 20:27:50.573909 run osmo-stp_10.42.42.5(pid=11099): Launched 20:27:50.690477 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:27:51.210210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11101): Launched 20:27:51.327756 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:27:51.582369 run patchelf(pid=11102): Launched 20:27:51.751842 run osmo-stp_10.42.42.5(pid=11099): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11099)] 20:27:51.879908 run osmo-stp_10.42.42.5(pid=11099): stdout: | (launched: 2022-12-08_20:27:50.518155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:52.010616 run osmo-stp_10.42.42.5(pid=11099): stderr: | [0;m[38;5;43m20221208202750687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202750687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202750687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202750687 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202750688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202750688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202750688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:52.140809 run osmo-stp_10.42.42.5(pid=11099): stdout: | (launched: 2022-12-08_20:27:50.518155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:52.264298 run osmo-stp_10.42.42.5(pid=11099): stderr: | [0;m[38;5;43m20221208202750687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202750687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202750687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202750687 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202750688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202750688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202750688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:52.411150 run patchelf(pid=11102): Terminating (SIGINT) 20:27:52.580503 run patchelf(pid=11102): Terminated: ok {rc=0} 20:27:52.702365 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11099): Process ended prematurely: osmo-stp_10.42.42.5(pid=11099) [trial-2349↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11099)] [trial-2349↪gprs:trx-b200↪ping_idle_ping.py:27] 20:27:52.711253 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 20:27:52.738462 run osmo-hlr_10.42.42.2(pid=11096): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11096)] 20:27:52.787090 run osmo-hlr_10.42.42.2(pid=11096): stdout: | (launched: 2022-12-08_20:27:49.582477) 20:27:52.837643 run osmo-hlr_10.42.42.2(pid=11096): stderr: | [0;m[1;31m20221208202749757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202749757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202749757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202749757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202749757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202749757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202749768 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202749777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202749777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202749777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:27:52.888243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11095): Terminating (SIGTERM) 20:27:52.929064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11098): Terminating (SIGTERM) 20:27:52.969575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11101): Terminating (SIGTERM) 20:27:53.010482 --- ParallelTerminationStrategy: PID 11095 died... 20:27:53.030075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11095): Terminated: ok {rc=0} 20:27:53.075219 --- ParallelTerminationStrategy: PID 11098 died... 20:27:53.094118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11098): Terminated: ok {rc=0} 20:27:53.139013 --- ParallelTerminationStrategy: PID 11101 died... 20:27:53.157929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11101): Terminated: ok {rc=0} 20:27:53.244843 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 20:27:54.552177 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:27:54.557460 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 20:27:54.590959 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 20:27:54.629558 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 20:27:54.722103 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 20:27:54.757105 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 20:27:54.796873 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 20:27:55.386452 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 20:27:55.439724 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:27:55.450995 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:27:55.501790 tst cs_paging_gprs_active.py: using LAC 16606 20:27:55.632228 tst cs_paging_gprs_active.py: using RAC 31 20:27:55.751694 tst cs_paging_gprs_active.py: using CellId 16606 20:27:55.870199 tst cs_paging_gprs_active.py: using BVCI 16607 20:27:55.983067 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:27:55.994031 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:27:56.004648 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:27:56.015656 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:27:56.026552 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:27:56.037378 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:27:56.048392 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:27:56.059228 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:27:56.070241 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:27:56.193059 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:27:56.311477 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:27:56.518596 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:27:56.827892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11106): Launched 20:27:57.095630 run iperf3-srv_10.42.42.10(pid=11107): Launched 20:27:57.211132 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:27:57.416310 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:27:57.725737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11108): Launched 20:27:57.995022 run iperf3-srv_10.42.42.10(pid=11109): Launched 20:27:58.111260 tst cs_paging_gprs_active.py:38: start network... 20:27:58.317407 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:27:58.791670 run create_hlr_db(pid=11110): Launched 20:27:58.909572 bus /gobi_6: Setting Powered False 20:27:59.970736 run create_hlr_db(pid=11110): Terminated: ok {rc=0} 20:28:00.420446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11112): Launched 20:28:00.750463 run osmo-hlr_10.42.42.2(pid=11113): Launched 20:28:00.953562 run osmo-stp_10.42.42.5: Starting osmo-stp 20:28:01.568222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11115): Launched 20:28:01.902155 run osmo-stp_10.42.42.5(pid=11116): Launched 20:28:02.141880 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:28:02.740451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11118): Launched 20:28:02.866578 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:28:03.144066 run patchelf(pid=11119): Launched 20:28:03.326494 run osmo-stp_10.42.42.5(pid=11116): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11116)] 20:28:03.465172 run osmo-stp_10.42.42.5(pid=11116): stdout: | (launched: 2022-12-08_20:28:01.844492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:03.606172 run osmo-stp_10.42.42.5(pid=11116): stderr: | [0;m[38;5;43m20221208202802178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202802178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202802178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202802179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202802179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202802179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202802179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:03.746676 run osmo-stp_10.42.42.5(pid=11116): stdout: | (launched: 2022-12-08_20:28:01.844492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:03.881229 run osmo-stp_10.42.42.5(pid=11116): stderr: | [0;m[38;5;43m20221208202802178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202802178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202802178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202802179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202802179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202802179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202802179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:04.040603 run patchelf(pid=11119): Terminating (SIGINT) 20:28:04.225091 run patchelf(pid=11119): Terminated: ok {rc=0} 20:28:04.358059 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11116): Process ended prematurely: osmo-stp_10.42.42.5(pid=11116) [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11116)] [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 20:28:04.368350 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 20:28:04.396996 run osmo-hlr_10.42.42.2(pid=11113): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11113)] 20:28:04.447344 run osmo-hlr_10.42.42.2(pid=11113): stdout: | (launched: 2022-12-08_20:28:00.690488) 20:28:04.499494 run osmo-hlr_10.42.42.2(pid=11113): stderr: | [0;m[1;31m20221208202800904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202800904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202800904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202800904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202800904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202800904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202800922 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202800939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202800939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202800939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:28:04.552093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11106): Terminating (SIGTERM) 20:28:04.594523 run iperf3-srv_10.42.42.10(pid=11107): Terminating (SIGTERM) 20:28:04.636625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11108): Terminating (SIGTERM) 20:28:04.678762 run iperf3-srv_10.42.42.10(pid=11109): Terminating (SIGTERM) 20:28:04.720618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11112): Terminating (SIGTERM) 20:28:04.763111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11115): Terminating (SIGTERM) 20:28:04.805118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11118): Terminating (SIGTERM) 20:28:04.847450 --- ParallelTerminationStrategy: PID 11106 died... 20:28:04.867630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11106): Terminated: ok {rc=0} 20:28:04.913885 --- ParallelTerminationStrategy: PID 11107 died... 20:28:04.933218 run iperf3-srv_10.42.42.10(pid=11107): Terminated {rc=256} 20:28:04.979342 --- ParallelTerminationStrategy: PID 11108 died... 20:28:04.998919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11108): Terminated: ok {rc=0} 20:28:05.045098 --- ParallelTerminationStrategy: PID 11109 died... 20:28:05.064574 run iperf3-srv_10.42.42.10(pid=11109): Terminated {rc=256} 20:28:05.110788 --- ParallelTerminationStrategy: PID 11112 died... 20:28:05.130357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11112): Terminated: ok {rc=0} 20:28:05.176424 --- ParallelTerminationStrategy: PID 11115 died... 20:28:05.196102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11115): Terminated: ok {rc=0} 20:28:05.242802 --- ParallelTerminationStrategy: PID 11118 died... 20:28:05.262429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11118): Terminated: ok {rc=0} 20:28:05.350998 bus /gobi_0: Setting Powered False 20:28:06.449011 bus /gobi_0: Setting Powered False 20:28:07.565948 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 20:28:08.710332 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:08.721744 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:28:08.774561 tst iperf3.py: using LAC 16607 20:28:08.901238 tst iperf3.py: using RAC 32 20:28:09.021373 tst iperf3.py: using CellId 16607 20:28:09.139694 tst iperf3.py: using BVCI 16608 20:28:09.250385 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:09.261377 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:09.271998 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:09.282988 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:09.293930 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:09.304694 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:09.315713 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:09.327115 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:09.338179 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:28:09.453412 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:28:09.658956 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:28:09.965721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11120): Launched 20:28:10.234549 run iperf3-srv_10.42.42.10(pid=11121): Launched 20:28:10.349940 tst iperf3.py:8: start network... 20:28:10.554869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:28:11.029627 run create_hlr_db(pid=11122): Launched 20:28:11.146392 bus /gobi_6: Setting Powered False 20:28:12.206942 run create_hlr_db(pid=11122): Terminated: ok {rc=0} 20:28:12.655408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11124): Launched 20:28:12.985787 run osmo-hlr_10.42.42.2(pid=11125): Launched 20:28:13.111752 run osmo-stp_10.42.42.5: Starting osmo-stp 20:28:13.677727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11127): Launched 20:28:14.006252 run osmo-stp_10.42.42.5(pid=11128): Launched 20:28:14.133405 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:28:14.700033 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11130): Launched 20:28:14.824885 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:28:15.102462 run patchelf(pid=11131): Launched 20:28:15.286819 run osmo-stp_10.42.42.5(pid=11128): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11128)] 20:28:15.425831 run osmo-stp_10.42.42.5(pid=11128): stdout: | (launched: 2022-12-08_20:28:13.946205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:15.566745 run osmo-stp_10.42.42.5(pid=11128): stderr: | [0;m[38;5;43m20221208202814136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202814137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202814137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202814137 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202814138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202814138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202814138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:15.707931 run osmo-stp_10.42.42.5(pid=11128): stdout: | (launched: 2022-12-08_20:28:13.946205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:15.849930 run osmo-stp_10.42.42.5(pid=11128): stderr: | [0;m[38;5;43m20221208202814136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202814137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202814137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202814137 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202814138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202814138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202814138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:16.015658 run patchelf(pid=11131): Terminating (SIGINT) 20:28:16.207624 run patchelf(pid=11131): Terminated: ok {rc=0} 20:28:16.344182 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11128): Process ended prematurely: osmo-stp_10.42.42.5(pid=11128) [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11128)] [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 20:28:16.355080 tst iperf3.py:8: Test FAILED (7.7 sec) 20:28:16.385197 run osmo-hlr_10.42.42.2(pid=11125): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11125)] 20:28:16.436694 run osmo-hlr_10.42.42.2(pid=11125): stdout: | (launched: 2022-12-08_20:28:12.926140) 20:28:16.490611 run osmo-hlr_10.42.42.2(pid=11125): stderr: | [0;m[1;31m20221208202813124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202813124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202813124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202813124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202813124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202813124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202813137 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202813145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202813145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202813145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:28:16.544430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11120): Terminating (SIGTERM) 20:28:16.588833 run iperf3-srv_10.42.42.10(pid=11121): Terminating (SIGTERM) 20:28:16.635196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11124): Terminating (SIGTERM) 20:28:16.679085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11127): Terminating (SIGTERM) 20:28:16.722786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11130): Terminating (SIGTERM) 20:28:16.768083 --- ParallelTerminationStrategy: PID 11120 died... 20:28:16.788671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11120): Terminated: ok {rc=0} 20:28:16.836524 --- ParallelTerminationStrategy: PID 11121 died... 20:28:16.856856 run iperf3-srv_10.42.42.10(pid=11121): Terminated {rc=256} 20:28:16.904842 --- ParallelTerminationStrategy: PID 11124 died... 20:28:16.925339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11124): Terminated: ok {rc=0} 20:28:16.972814 --- ParallelTerminationStrategy: PID 11127 died... 20:28:16.993711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11127): Terminated: ok {rc=0} 20:28:17.041490 --- ParallelTerminationStrategy: PID 11130 died... 20:28:17.062091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11130): Terminated: ok {rc=0} 20:28:17.152766 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 20:28:18.302585 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:18.314345 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:28:18.364797 tst iperf3m4.py: using LAC 16608 20:28:18.486064 tst iperf3m4.py: using RAC 33 20:28:18.607380 tst iperf3m4.py: using CellId 16608 20:28:18.726882 tst iperf3m4.py: using BVCI 16609 20:28:18.839264 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:18.850320 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:18.861299 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:18.872123 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:18.883104 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:18.894173 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:18.905422 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:18.916298 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:18.927492 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:28:19.044129 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:28:19.168045 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:28:19.286732 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:28:19.408080 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:28:19.630038 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:28:19.959309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11132): Launched 20:28:20.245468 run iperf3-srv_10.42.42.10(pid=11133): Launched 20:28:20.370765 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:28:20.593171 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:28:20.923511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11134): Launched 20:28:21.210522 run iperf3-srv_10.42.42.10(pid=11135): Launched 20:28:21.333502 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:28:21.554491 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:28:21.884835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11136): Launched 20:28:22.170424 run iperf3-srv_10.42.42.10(pid=11137): Launched 20:28:22.293273 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:28:22.514856 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:28:22.845460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11138): Launched 20:28:23.131165 run iperf3-srv_10.42.42.10(pid=11139): Launched 20:28:23.255293 tst iperf3m4.py:8: start network... 20:28:23.476085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:28:23.986304 run create_hlr_db(pid=11140): Launched 20:28:24.119157 bus /gobi_6: Setting Powered False 20:28:25.183959 run create_hlr_db(pid=11140): Terminated: ok {rc=0} 20:28:25.621539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11142): Launched 20:28:25.929780 run osmo-hlr_10.42.42.2(pid=11143): Launched 20:28:26.047074 run osmo-stp_10.42.42.5: Starting osmo-stp 20:28:26.580906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11145): Launched 20:28:26.889259 run osmo-stp_10.42.42.5(pid=11146): Launched 20:28:27.006094 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:28:27.533922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11148): Launched 20:28:27.651453 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:28:27.911159 run patchelf(pid=11149): Launched 20:28:28.082413 run osmo-stp_10.42.42.5(pid=11146): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11146)] 20:28:28.213293 run osmo-stp_10.42.42.5(pid=11146): stdout: | (launched: 2022-12-08_20:28:26.832719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:28.345489 run osmo-stp_10.42.42.5(pid=11146): stderr: | [0;m[38;5;43m20221208202827000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202827000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202827000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202827001 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202827001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202827001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202827001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:28.478259 run osmo-stp_10.42.42.5(pid=11146): stdout: | (launched: 2022-12-08_20:28:26.832719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:28.604397 run osmo-stp_10.42.42.5(pid=11146): stderr: | [0;m[38;5;43m20221208202827000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202827000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202827000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202827001 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202827001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202827001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202827001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:28.754497 run patchelf(pid=11149): Terminating (SIGINT) 20:28:28.927676 run patchelf(pid=11149): Terminated: ok {rc=0} 20:28:29.052068 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11146): Process ended prematurely: osmo-stp_10.42.42.5(pid=11146) [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11146)] [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 20:28:29.061896 tst iperf3m4.py:8: Test FAILED (10.8 sec) 20:28:29.090179 run osmo-hlr_10.42.42.2(pid=11143): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11143)] 20:28:29.138753 run osmo-hlr_10.42.42.2(pid=11143): stdout: | (launched: 2022-12-08_20:28:25.873112) 20:28:29.188883 run osmo-hlr_10.42.42.2(pid=11143): stderr: | [0;m[1;31m20221208202826050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202826051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202826051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202826051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202826051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202826051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202826062 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202826072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202826072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202826072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:28:29.239430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11132): Terminating (SIGTERM) 20:28:29.280009 run iperf3-srv_10.42.42.10(pid=11133): Terminating (SIGTERM) 20:28:29.320008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11134): Terminating (SIGTERM) 20:28:29.361762 run iperf3-srv_10.42.42.10(pid=11135): Terminating (SIGTERM) 20:28:29.402555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11136): Terminating (SIGTERM) 20:28:29.443400 run iperf3-srv_10.42.42.10(pid=11137): Terminating (SIGTERM) 20:28:29.483921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11138): Terminating (SIGTERM) 20:28:29.524619 run iperf3-srv_10.42.42.10(pid=11139): Terminating (SIGTERM) 20:28:29.565328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11142): Terminating (SIGTERM) 20:28:29.606078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11145): Terminating (SIGTERM) 20:28:29.646703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11148): Terminating (SIGTERM) 20:28:29.688047 --- ParallelTerminationStrategy: PID 11132 died... 20:28:29.707650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11132): Terminated: ok {rc=0} 20:28:29.753603 --- ParallelTerminationStrategy: PID 11133 died... 20:28:29.772510 run iperf3-srv_10.42.42.10(pid=11133): Terminated {rc=256} 20:28:29.817629 --- ParallelTerminationStrategy: PID 11134 died... 20:28:29.836708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11134): Terminated: ok {rc=0} 20:28:29.881603 --- ParallelTerminationStrategy: PID 11135 died... 20:28:29.900850 run iperf3-srv_10.42.42.10(pid=11135): Terminated {rc=256} 20:28:29.946194 --- ParallelTerminationStrategy: PID 11136 died... 20:28:29.965313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11136): Terminated: ok {rc=0} 20:28:30.011061 --- ParallelTerminationStrategy: PID 11137 died... 20:28:30.030027 run iperf3-srv_10.42.42.10(pid=11137): Terminated {rc=256} 20:28:30.075174 --- ParallelTerminationStrategy: PID 11138 died... 20:28:30.094204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11138): Terminated: ok {rc=0} 20:28:30.139129 --- ParallelTerminationStrategy: PID 11139 died... 20:28:30.158071 run iperf3-srv_10.42.42.10(pid=11139): Terminated {rc=256} 20:28:30.203073 --- ParallelTerminationStrategy: PID 11142 died... 20:28:30.222170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11142): Terminated: ok {rc=0} 20:28:30.267189 --- ParallelTerminationStrategy: PID 11145 died... 20:28:30.286801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11145): Terminated: ok {rc=0} 20:28:30.332599 --- ParallelTerminationStrategy: PID 11148 died... 20:28:30.351920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11148): Terminated: ok {rc=0} 20:28:30.440222 bus /gobi_4: Setting Powered False 20:28:31.542524 bus /gobi_4: Setting Powered False 20:28:32.662058 bus /gobi_1: Setting Powered False 20:28:33.762484 bus /gobi_1: Setting Powered False 20:28:34.879805 bus /gobi_0: Setting Powered False 20:28:35.980014 bus /gobi_0: Setting Powered False 20:28:37.098025 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 20:28:38.203000 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:38.214524 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:28:38.268406 tst ping.py: using LAC 16609 20:28:38.385708 tst ping.py: using RAC 34 20:28:38.502324 tst ping.py: using CellId 16609 20:28:38.621261 tst ping.py: using BVCI 16610 20:28:38.730120 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:38.741142 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:38.751871 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:38.762938 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:38.773904 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:38.784743 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:38.796362 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:38.807443 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:28:38.925873 tst ping.py:19: start network... 20:28:39.143108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:28:39.642232 run create_hlr_db(pid=11150): Launched 20:28:39.772938 bus /gobi_6: Setting Powered False 20:28:40.837421 run create_hlr_db(pid=11150): Terminated: ok {rc=0} 20:28:41.270049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11152): Launched 20:28:41.572521 run osmo-hlr_10.42.42.2(pid=11153): Launched 20:28:41.687759 run osmo-stp_10.42.42.5: Starting osmo-stp 20:28:42.221029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11155): Launched 20:28:42.522675 run osmo-stp_10.42.42.5(pid=11156): Launched 20:28:42.637476 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:28:43.154362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11158): Launched 20:28:43.269905 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:28:43.524077 run patchelf(pid=11159): Launched 20:28:43.692193 run osmo-stp_10.42.42.5(pid=11156): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11156)] 20:28:43.819977 run osmo-stp_10.42.42.5(pid=11156): stdout: | (launched: 2022-12-08_20:28:42.467094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:43.949718 run osmo-stp_10.42.42.5(pid=11156): stderr: | [0;m[38;5;43m20221208202842637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202842637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202842638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202842638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202842638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202842638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202842639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:44.078833 run osmo-stp_10.42.42.5(pid=11156): stdout: | (launched: 2022-12-08_20:28:42.467094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:44.202823 run osmo-stp_10.42.42.5(pid=11156): stderr: | [0;m[38;5;43m20221208202842637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202842637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202842638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202842638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202842638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202842638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202842639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:44.348596 run patchelf(pid=11159): Terminating (SIGINT) 20:28:44.518555 run patchelf(pid=11159): Terminated: ok {rc=0} 20:28:44.641284 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11156): Process ended prematurely: osmo-stp_10.42.42.5(pid=11156) [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11156)] [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 20:28:44.650164 tst ping.py:22: Test FAILED (6.4 sec) 20:28:44.677681 run osmo-hlr_10.42.42.2(pid=11153): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11153)] 20:28:44.726369 run osmo-hlr_10.42.42.2(pid=11153): stdout: | (launched: 2022-12-08_20:28:41.516882) 20:28:44.776538 run osmo-hlr_10.42.42.2(pid=11153): stderr: | [0;m[1;31m20221208202841693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202841693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202841693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202841693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202841693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202841693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202841703 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202841712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202841713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202841713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:28:44.827286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11152): Terminating (SIGTERM) 20:28:44.867886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11155): Terminating (SIGTERM) 20:28:44.908544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11158): Terminating (SIGTERM) 20:28:44.949470 --- ParallelTerminationStrategy: PID 11152 died... 20:28:44.968856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11152): Terminated: ok {rc=0} 20:28:45.013976 --- ParallelTerminationStrategy: PID 11155 died... 20:28:45.032883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11155): Terminated: ok {rc=0} 20:28:45.077699 --- ParallelTerminationStrategy: PID 11158 died... 20:28:45.096385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11158): Terminated: ok {rc=0} 20:28:45.184032 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 20:28:46.270817 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:46.283504 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:28:46.336594 tst ping_idle_ping.py: using LAC 16610 20:28:46.479174 tst ping_idle_ping.py: using RAC 35 20:28:46.599989 tst ping_idle_ping.py: using CellId 16610 20:28:46.731433 tst ping_idle_ping.py: using BVCI 16611 20:28:46.877836 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:46.890079 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:46.902283 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:46.914686 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:46.927103 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:46.939356 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:46.952598 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:46.964498 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:28:47.087773 tst ping_idle_ping.py:24: start network... 20:28:47.311282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:28:47.815473 run create_hlr_db(pid=11160): Launched 20:28:47.946683 bus /gobi_6: Setting Powered False 20:28:49.011788 run create_hlr_db(pid=11160): Terminated: ok {rc=0} 20:28:49.444842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11162): Launched 20:28:49.749555 run osmo-hlr_10.42.42.2(pid=11163): Launched 20:28:49.867293 run osmo-stp_10.42.42.5: Starting osmo-stp 20:28:50.390657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11165): Launched 20:28:50.693104 run osmo-stp_10.42.42.5(pid=11166): Launched 20:28:50.807931 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:28:51.327848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11168): Launched 20:28:51.444355 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:28:51.699839 run patchelf(pid=11169): Launched 20:28:51.868596 run osmo-stp_10.42.42.5(pid=11166): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11166)] 20:28:51.997601 run osmo-stp_10.42.42.5(pid=11166): stdout: | (launched: 2022-12-08_20:28:50.637398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:52.127464 run osmo-stp_10.42.42.5(pid=11166): stderr: | [0;m[38;5;43m20221208202850806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202850807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202850807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202850807 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202850808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202850808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202850808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:52.257837 run osmo-stp_10.42.42.5(pid=11166): stdout: | (launched: 2022-12-08_20:28:50.637398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:52.381987 run osmo-stp_10.42.42.5(pid=11166): stderr: | [0;m[38;5;43m20221208202850806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202850807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202850807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202850807 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202850808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202850808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202850808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:52.529494 run patchelf(pid=11169): Terminating (SIGINT) 20:28:52.700102 run patchelf(pid=11169): Terminated: ok {rc=0} 20:28:52.822984 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11166): Process ended prematurely: osmo-stp_10.42.42.5(pid=11166) [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11166)] [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 20:28:52.831894 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 20:28:52.859046 run osmo-hlr_10.42.42.2(pid=11163): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11163)] 20:28:52.907669 run osmo-hlr_10.42.42.2(pid=11163): stdout: | (launched: 2022-12-08_20:28:49.693959) 20:28:52.957664 run osmo-hlr_10.42.42.2(pid=11163): stderr: | [0;m[1;31m20221208202849867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202849867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202849867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202849867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202849867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202849868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202849891 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202849900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202849901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202849901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:28:53.008443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11162): Terminating (SIGTERM) 20:28:53.048705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11165): Terminating (SIGTERM) 20:28:53.089250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11168): Terminating (SIGTERM) 20:28:53.130658 --- ParallelTerminationStrategy: PID 11162 died... 20:28:53.150271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11162): Terminated: ok {rc=0} 20:28:53.195671 --- ParallelTerminationStrategy: PID 11165 died... 20:28:53.214607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11165): Terminated: ok {rc=0} 20:28:53.259831 --- ParallelTerminationStrategy: PID 11168 died... 20:28:53.278923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11168): Terminated: ok {rc=0} 20:28:53.364778 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 20:28:54.667435 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:28:54.673326 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 20:28:54.706932 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 20:28:54.745516 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 20:28:54.833034 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 20:28:54.866742 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 20:28:54.905089 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 20:28:55.497620 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 20:28:55.547080 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:28:55.557986 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:28:55.626921 tst cs_paging_gprs_active.py: using LAC 16611 20:28:55.746889 tst cs_paging_gprs_active.py: using RAC 36 20:28:55.868084 tst cs_paging_gprs_active.py: using CellId 16611 20:28:55.989374 tst cs_paging_gprs_active.py: using BVCI 16612 20:28:56.100159 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:28:56.111127 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:28:56.121994 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:28:56.132919 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:28:56.143810 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:28:56.154763 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:28:56.165803 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:28:56.176640 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:28:56.187785 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:28:56.309633 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:28:56.433336 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:28:56.657580 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:28:56.987646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11175): Launched 20:28:57.273782 run iperf3-srv_10.42.42.10(pid=11176): Launched 20:28:57.398552 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:28:57.620403 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:28:57.950343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11177): Launched 20:28:58.237503 run iperf3-srv_10.42.42.10(pid=11178): Launched 20:28:58.360889 tst cs_paging_gprs_active.py:38: start network... 20:28:58.582096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:28:59.091252 run create_hlr_db(pid=11179): Launched 20:28:59.226517 bus /gobi_6: Setting Powered False 20:29:00.291281 run create_hlr_db(pid=11179): Terminated: ok {rc=0} 20:29:00.729782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11181): Launched 20:29:01.070768 run osmo-hlr_10.42.42.2(pid=11182): Launched 20:29:01.233277 run osmo-stp_10.42.42.5: Starting osmo-stp 20:29:02.004349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11184): Launched 20:29:02.354415 run osmo-stp_10.42.42.5(pid=11185): Launched 20:29:02.558268 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:29:03.133356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11187): Launched 20:29:03.259768 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:29:03.537711 run patchelf(pid=11188): Launched 20:29:03.720655 run osmo-stp_10.42.42.5(pid=11185): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11185)] 20:29:03.859696 run osmo-stp_10.42.42.5(pid=11185): stdout: | (launched: 2022-12-08_20:29:02.293123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:04.000213 run osmo-stp_10.42.42.5(pid=11185): stderr: | [0;m[38;5;43m20221208202902641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202902641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202902641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202902642 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202902642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202902642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202902642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:04.140892 run osmo-stp_10.42.42.5(pid=11185): stdout: | (launched: 2022-12-08_20:29:02.293123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:04.275814 run osmo-stp_10.42.42.5(pid=11185): stderr: | [0;m[38;5;43m20221208202902641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202902641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202902641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202902642 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202902642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202902642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202902642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:04.435791 run patchelf(pid=11188): Terminating (SIGINT) 20:29:04.620625 run patchelf(pid=11188): Terminated: ok {rc=0} 20:29:04.753999 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11185): Process ended prematurely: osmo-stp_10.42.42.5(pid=11185) [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11185)] [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 20:29:04.764238 tst cs_paging_gprs_active.py:38: Test FAILED (9.3 sec) 20:29:04.792748 run osmo-hlr_10.42.42.2(pid=11182): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11182)] 20:29:04.843065 run osmo-hlr_10.42.42.2(pid=11182): stdout: | (launched: 2022-12-08_20:29:01.007911) 20:29:04.895340 run osmo-hlr_10.42.42.2(pid=11182): stderr: | [0;m[1;31m20221208202901398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202901398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202901398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202901398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202901398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202901398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202901417 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202901428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202901428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202901428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:29:04.947946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11175): Terminating (SIGTERM) 20:29:04.990344 run iperf3-srv_10.42.42.10(pid=11176): Terminating (SIGTERM) 20:29:05.032403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11177): Terminating (SIGTERM) 20:29:05.074387 run iperf3-srv_10.42.42.10(pid=11178): Terminating (SIGTERM) 20:29:05.116355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11181): Terminating (SIGTERM) 20:29:05.158371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11184): Terminating (SIGTERM) 20:29:05.200477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11187): Terminating (SIGTERM) 20:29:05.242741 --- ParallelTerminationStrategy: PID 11175 died... 20:29:05.262395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11175): Terminated: ok {rc=0} 20:29:05.308763 --- ParallelTerminationStrategy: PID 11176 died... 20:29:05.328376 run iperf3-srv_10.42.42.10(pid=11176): Terminated {rc=256} 20:29:05.374487 --- ParallelTerminationStrategy: PID 11177 died... 20:29:05.394169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11177): Terminated: ok {rc=0} 20:29:05.440251 --- ParallelTerminationStrategy: PID 11178 died... 20:29:05.459822 run iperf3-srv_10.42.42.10(pid=11178): Terminated {rc=256} 20:29:05.506438 --- ParallelTerminationStrategy: PID 11181 died... 20:29:05.526025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11181): Terminated: ok {rc=0} 20:29:05.572135 --- ParallelTerminationStrategy: PID 11184 died... 20:29:05.592200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11184): Terminated: ok {rc=0} 20:29:05.638455 --- ParallelTerminationStrategy: PID 11187 died... 20:29:05.658243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11187): Terminated: ok {rc=0} 20:29:05.746304 bus /gobi_0: Setting Powered False 20:29:06.845828 bus /gobi_0: Setting Powered False 20:29:07.960813 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 20:29:09.111409 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:09.123579 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:29:09.199030 tst iperf3.py: using LAC 16612 20:29:09.327846 tst iperf3.py: using RAC 37 20:29:09.455642 tst iperf3.py: using CellId 16612 20:29:09.582902 tst iperf3.py: using BVCI 16613 20:29:09.704232 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:09.715706 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:09.726900 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:09.738139 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:09.749238 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:09.760385 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:09.771690 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:09.782800 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:09.794136 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:29:09.915274 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:29:10.128840 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:29:10.430948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11189): Launched 20:29:10.694099 run iperf3-srv_10.42.42.10(pid=11190): Launched 20:29:10.807324 tst iperf3.py:8: start network... 20:29:11.009260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:29:11.474600 run create_hlr_db(pid=11191): Launched 20:29:11.589486 bus /gobi_6: Setting Powered False 20:29:12.649223 run create_hlr_db(pid=11191): Terminated: ok {rc=0} 20:29:13.089910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11193): Launched 20:29:13.413101 run osmo-hlr_10.42.42.2(pid=11194): Launched 20:29:13.536050 run osmo-stp_10.42.42.5: Starting osmo-stp 20:29:14.097209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11196): Launched 20:29:14.419561 run osmo-stp_10.42.42.5(pid=11197): Launched 20:29:14.542118 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:29:15.099136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11199): Launched 20:29:15.223170 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:29:15.495958 run patchelf(pid=11200): Launched 20:29:15.676019 run osmo-stp_10.42.42.5(pid=11197): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11197)] 20:29:15.812702 run osmo-stp_10.42.42.5(pid=11197): stdout: | (launched: 2022-12-08_20:29:14.360569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:15.960607 run osmo-stp_10.42.42.5(pid=11197): stderr: | [0;m[38;5;43m20221208202914549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202914549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202914549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202914550 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202914550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202914550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202914550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:16.101759 run osmo-stp_10.42.42.5(pid=11197): stdout: | (launched: 2022-12-08_20:29:14.360569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:16.236817 run osmo-stp_10.42.42.5(pid=11197): stderr: | [0;m[38;5;43m20221208202914549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202914549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202914549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202914550 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202914550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202914550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202914550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:16.397382 run patchelf(pid=11200): Terminating (SIGINT) 20:29:16.582422 run patchelf(pid=11200): Terminated: ok {rc=0} 20:29:16.715723 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11197): Process ended prematurely: osmo-stp_10.42.42.5(pid=11197) [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11197)] [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 20:29:16.726645 tst iperf3.py:8: Test FAILED (7.7 sec) 20:29:16.756410 run osmo-hlr_10.42.42.2(pid=11194): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11194)] 20:29:16.807672 run osmo-hlr_10.42.42.2(pid=11194): stdout: | (launched: 2022-12-08_20:29:13.354277) 20:29:16.860770 run osmo-hlr_10.42.42.2(pid=11194): stderr: | [0;m[1;31m20221208202913549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202913549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202913549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202913549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202913549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202913549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202913562 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202913570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202913570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202913570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:29:16.914358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11189): Terminating (SIGTERM) 20:29:16.957739 run iperf3-srv_10.42.42.10(pid=11190): Terminating (SIGTERM) 20:29:17.003473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11193): Terminating (SIGTERM) 20:29:17.046762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11196): Terminating (SIGTERM) 20:29:17.089372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11199): Terminating (SIGTERM) 20:29:17.132360 --- ParallelTerminationStrategy: PID 11189 died... 20:29:17.152481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11189): Terminated: ok {rc=0} 20:29:17.199637 --- ParallelTerminationStrategy: PID 11190 died... 20:29:17.219847 run iperf3-srv_10.42.42.10(pid=11190): Terminated {rc=256} 20:29:17.265948 --- ParallelTerminationStrategy: PID 11193 died... 20:29:17.285478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11193): Terminated: ok {rc=0} 20:29:17.331518 --- ParallelTerminationStrategy: PID 11196 died... 20:29:17.351088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11196): Terminated: ok {rc=0} 20:29:17.397106 --- ParallelTerminationStrategy: PID 11199 died... 20:29:17.416633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11199): Terminated: ok {rc=0} 20:29:17.505291 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 20:29:18.650179 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:18.661653 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:29:18.735051 tst iperf3m4.py: using LAC 16613 20:29:18.852211 tst iperf3m4.py: using RAC 38 20:29:18.968889 tst iperf3m4.py: using CellId 16613 20:29:19.085389 tst iperf3m4.py: using BVCI 16614 20:29:19.194894 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:19.205792 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:19.216366 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:19.227793 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:19.239208 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:19.250487 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:19.262015 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:19.273400 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:19.284716 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:29:19.403906 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:29:19.523363 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:29:19.644591 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:29:19.763745 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:29:19.966258 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:29:20.268655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11201): Launched 20:29:20.532596 run iperf3-srv_10.42.42.10(pid=11202): Launched 20:29:20.646074 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:29:20.847828 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:29:21.149913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11203): Launched 20:29:21.412208 run iperf3-srv_10.42.42.10(pid=11204): Launched 20:29:21.525413 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:29:21.727012 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:29:22.029660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11205): Launched 20:29:22.291453 run iperf3-srv_10.42.42.10(pid=11206): Launched 20:29:22.404821 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:29:22.606132 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:29:22.909304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11207): Launched 20:29:23.172095 run iperf3-srv_10.42.42.10(pid=11208): Launched 20:29:23.284615 tst iperf3m4.py:8: start network... 20:29:23.485846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:29:23.951995 run create_hlr_db(pid=11209): Launched 20:29:24.066995 bus /gobi_6: Setting Powered False 20:29:25.127285 run create_hlr_db(pid=11209): Terminated: ok {rc=0} 20:29:25.547058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11211): Launched 20:29:25.847875 run osmo-hlr_10.42.42.2(pid=11212): Launched 20:29:25.961880 run osmo-stp_10.42.42.5: Starting osmo-stp 20:29:26.497216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11214): Launched 20:29:26.798786 run osmo-stp_10.42.42.5(pid=11215): Launched 20:29:26.913428 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:29:27.431531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11217): Launched 20:29:27.546852 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:29:27.802154 run patchelf(pid=11218): Launched 20:29:27.971026 run osmo-stp_10.42.42.5(pid=11215): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11215)] 20:29:28.099303 run osmo-stp_10.42.42.5(pid=11215): stdout: | (launched: 2022-12-08_20:29:26.743041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:28.228916 run osmo-stp_10.42.42.5(pid=11215): stderr: | [0;m[38;5;43m20221208202926911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202926911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202926912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202926912 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202926913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202926913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202926913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:28.358423 run osmo-stp_10.42.42.5(pid=11215): stdout: | (launched: 2022-12-08_20:29:26.743041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:28.485261 run osmo-stp_10.42.42.5(pid=11215): stderr: | [0;m[38;5;43m20221208202926911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202926911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202926912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202926912 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202926913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202926913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202926913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:28.632612 run patchelf(pid=11218): Terminating (SIGINT) 20:29:28.804145 run patchelf(pid=11218): Terminated: ok {rc=0} 20:29:28.927807 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11215): Process ended prematurely: osmo-stp_10.42.42.5(pid=11215) [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11215)] [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 20:29:28.937399 tst iperf3m4.py:8: Test FAILED (10.3 sec) 20:29:28.965298 run osmo-hlr_10.42.42.2(pid=11212): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11212)] 20:29:29.013239 run osmo-hlr_10.42.42.2(pid=11212): stdout: | (launched: 2022-12-08_20:29:25.792542) 20:29:29.062830 run osmo-hlr_10.42.42.2(pid=11212): stderr: | [0;m[1;31m20221208202925965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202925966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202925966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202925966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202925966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202925966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202925978 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202925989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202925989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202925989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:29:29.113168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11201): Terminating (SIGTERM) 20:29:29.153182 run iperf3-srv_10.42.42.10(pid=11202): Terminating (SIGTERM) 20:29:29.193174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11203): Terminating (SIGTERM) 20:29:29.233152 run iperf3-srv_10.42.42.10(pid=11204): Terminating (SIGTERM) 20:29:29.273080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11205): Terminating (SIGTERM) 20:29:29.313052 run iperf3-srv_10.42.42.10(pid=11206): Terminating (SIGTERM) 20:29:29.352916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11207): Terminating (SIGTERM) 20:29:29.392880 run iperf3-srv_10.42.42.10(pid=11208): Terminating (SIGTERM) 20:29:29.432702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11211): Terminating (SIGTERM) 20:29:29.472628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11214): Terminating (SIGTERM) 20:29:29.512610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11217): Terminating (SIGTERM) 20:29:29.552710 --- ParallelTerminationStrategy: PID 11201 died... 20:29:29.571910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11201): Terminated: ok {rc=0} 20:29:29.616786 --- ParallelTerminationStrategy: PID 11202 died... 20:29:29.635443 run iperf3-srv_10.42.42.10(pid=11202): Terminated {rc=256} 20:29:29.680203 --- ParallelTerminationStrategy: PID 11203 died... 20:29:29.698795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11203): Terminated: ok {rc=0} 20:29:29.743174 --- ParallelTerminationStrategy: PID 11204 died... 20:29:29.761866 run iperf3-srv_10.42.42.10(pid=11204): Terminated {rc=256} 20:29:29.806429 --- ParallelTerminationStrategy: PID 11205 died... 20:29:29.825114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11205): Terminated: ok {rc=0} 20:29:29.869509 --- ParallelTerminationStrategy: PID 11206 died... 20:29:29.888066 run iperf3-srv_10.42.42.10(pid=11206): Terminated {rc=256} 20:29:29.932413 --- ParallelTerminationStrategy: PID 11207 died... 20:29:29.951222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11207): Terminated: ok {rc=0} 20:29:29.995803 --- ParallelTerminationStrategy: PID 11208 died... 20:29:30.014468 run iperf3-srv_10.42.42.10(pid=11208): Terminated {rc=256} 20:29:30.058883 --- ParallelTerminationStrategy: PID 11211 died... 20:29:30.077565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11211): Terminated: ok {rc=0} 20:29:30.122033 --- ParallelTerminationStrategy: PID 11214 died... 20:29:30.140773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11214): Terminated: ok {rc=0} 20:29:30.185278 --- ParallelTerminationStrategy: PID 11217 died... 20:29:30.203873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11217): Terminated: ok {rc=0} 20:29:30.291183 bus /gobi_4: Setting Powered False 20:29:31.392274 bus /gobi_4: Setting Powered False 20:29:32.504818 bus /gobi_1: Setting Powered False 20:29:33.603279 bus /gobi_1: Setting Powered False 20:29:34.717893 bus /gobi_0: Setting Powered False 20:29:35.816747 bus /gobi_0: Setting Powered False 20:29:36.934285 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 20:29:38.037329 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:38.048711 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:29:38.123376 tst ping.py: using LAC 16614 20:29:38.238613 tst ping.py: using RAC 39 20:29:38.351291 tst ping.py: using CellId 16614 20:29:38.464124 tst ping.py: using BVCI 16615 20:29:38.569420 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:38.580295 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:38.590913 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:38.601899 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:38.612690 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:38.623595 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:38.634747 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:38.645536 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:29:38.762318 tst ping.py:19: start network... 20:29:38.974509 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:29:39.459754 run create_hlr_db(pid=11226): Launched 20:29:39.587168 bus /gobi_6: Setting Powered False 20:29:40.649777 run create_hlr_db(pid=11226): Terminated: ok {rc=0} 20:29:41.093619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11228): Launched 20:29:41.406564 run osmo-hlr_10.42.42.2(pid=11229): Launched 20:29:41.523936 run osmo-stp_10.42.42.5: Starting osmo-stp 20:29:42.063603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11231): Launched 20:29:42.376223 run osmo-stp_10.42.42.5(pid=11232): Launched 20:29:42.494312 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:29:43.033187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11234): Launched 20:29:43.153764 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:29:43.418006 run patchelf(pid=11235): Launched 20:29:43.591575 run osmo-stp_10.42.42.5(pid=11232): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11232)] 20:29:43.724755 run osmo-stp_10.42.42.5(pid=11232): stdout: | (launched: 2022-12-08_20:29:42.319030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:43.858976 run osmo-stp_10.42.42.5(pid=11232): stderr: | [0;m[38;5;43m20221208202942505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202942506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202942506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202942506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202942507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202942507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202942507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:43.993132 run osmo-stp_10.42.42.5(pid=11232): stdout: | (launched: 2022-12-08_20:29:42.319030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:44.121463 run osmo-stp_10.42.42.5(pid=11232): stderr: | [0;m[38;5;43m20221208202942505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202942506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202942506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202942506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202942507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202942507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202942507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:44.273016 run patchelf(pid=11235): Terminating (SIGINT) 20:29:44.448595 run patchelf(pid=11235): Terminated: ok {rc=0} 20:29:44.575045 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11232): Process ended prematurely: osmo-stp_10.42.42.5(pid=11232) [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11232)] [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 20:29:44.584335 tst ping.py:22: Test FAILED (6.5 sec) 20:29:44.612422 run osmo-hlr_10.42.42.2(pid=11229): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11229)] 20:29:44.662341 run osmo-hlr_10.42.42.2(pid=11229): stdout: | (launched: 2022-12-08_20:29:41.349712) 20:29:44.713449 run osmo-hlr_10.42.42.2(pid=11229): stderr: | [0;m[1;31m20221208202941541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202941541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202941541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202941541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202941542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202941542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202941554 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202941563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202941563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202941563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:29:44.765362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11228): Terminating (SIGTERM) 20:29:44.806725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11231): Terminating (SIGTERM) 20:29:44.848276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11234): Terminating (SIGTERM) 20:29:44.890086 --- ParallelTerminationStrategy: PID 11228 died... 20:29:44.909906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11228): Terminated: ok {rc=0} 20:29:44.956006 --- ParallelTerminationStrategy: PID 11231 died... 20:29:44.975431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11231): Terminated: ok {rc=0} 20:29:45.021356 --- ParallelTerminationStrategy: PID 11234 died... 20:29:45.040708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11234): Terminated: ok {rc=0} 20:29:45.127522 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 20:29:46.219685 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:46.235894 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:29:46.328677 tst ping_idle_ping.py: using LAC 16615 20:29:46.458116 tst ping_idle_ping.py: using RAC 40 20:29:46.629241 tst ping_idle_ping.py: using CellId 16615 20:29:46.785308 tst ping_idle_ping.py: using BVCI 16616 20:29:46.896019 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:46.907915 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:46.919630 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:46.932395 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:46.944655 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:46.957902 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:46.971391 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:46.982961 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:29:47.100236 tst ping_idle_ping.py:24: start network... 20:29:47.305123 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:29:47.799311 run create_hlr_db(pid=11236): Launched 20:29:47.926708 bus /gobi_6: Setting Powered False 20:29:48.988322 run create_hlr_db(pid=11236): Terminated: ok {rc=0} 20:29:49.407825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11238): Launched 20:29:49.699554 run osmo-hlr_10.42.42.2(pid=11239): Launched 20:29:49.809556 run osmo-stp_10.42.42.5: Starting osmo-stp 20:29:50.321204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11241): Launched 20:29:50.612582 run osmo-stp_10.42.42.5(pid=11242): Launched 20:29:50.723286 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:29:51.226845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11244): Launched 20:29:51.338305 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:29:51.584706 run patchelf(pid=11245): Launched 20:29:51.747201 run osmo-stp_10.42.42.5(pid=11242): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11242)] 20:29:51.871546 run osmo-stp_10.42.42.5(pid=11242): stdout: | (launched: 2022-12-08_20:29:50.559169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:51.997829 run osmo-stp_10.42.42.5(pid=11242): stderr: | [0;m[38;5;43m20221208202950726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202950726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202950727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202950727 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202950727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202950728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202950728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:52.124118 run osmo-stp_10.42.42.5(pid=11242): stdout: | (launched: 2022-12-08_20:29:50.559169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:52.244196 run osmo-stp_10.42.42.5(pid=11242): stderr: | [0;m[38;5;43m20221208202950726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208202950726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208202950727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208202950727 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208202950727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208202950728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208202950728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:52.386480 run patchelf(pid=11245): Terminating (SIGINT) 20:29:52.551184 run patchelf(pid=11245): Terminated: ok {rc=0} 20:29:52.670101 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11242): Process ended prematurely: osmo-stp_10.42.42.5(pid=11242) [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11242)] [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 20:29:52.678736 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 20:29:52.705232 run osmo-hlr_10.42.42.2(pid=11239): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11239)] 20:29:52.753168 run osmo-hlr_10.42.42.2(pid=11239): stdout: | (launched: 2022-12-08_20:29:49.646198) 20:29:52.802279 run osmo-hlr_10.42.42.2(pid=11239): stderr: | [0;m[1;31m20221208202949817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208202949817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208202949817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208202949817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208202949817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208202949817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208202949829 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208202949838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208202949838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208202949839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:29:52.851973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11238): Terminating (SIGTERM) 20:29:52.891585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11241): Terminating (SIGTERM) 20:29:52.931324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11244): Terminating (SIGTERM) 20:29:52.971394 --- ParallelTerminationStrategy: PID 11238 died... 20:29:52.990334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11238): Terminated: ok {rc=0} 20:29:53.035056 --- ParallelTerminationStrategy: PID 11241 died... 20:29:53.053782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11241): Terminated: ok {rc=0} 20:29:53.097835 --- ParallelTerminationStrategy: PID 11244 died... 20:29:53.116401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11244): Terminated: ok {rc=0} 20:29:53.201414 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:29:54.509164 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:29:54.515549 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:29:54.549475 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 20:29:54.588487 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 20:29:54.677571 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:29:54.711121 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 20:29:54.750161 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 20:29:55.347266 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 20:29:55.398284 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:29:55.409577 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:29:55.480825 tst cs_paging_gprs_active.py: using LAC 16616 20:29:55.606199 tst cs_paging_gprs_active.py: using RAC 41 20:29:55.732807 tst cs_paging_gprs_active.py: using CellId 16616 20:29:55.859753 tst cs_paging_gprs_active.py: using BVCI 16617 20:29:55.977247 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:29:55.988516 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:29:55.999599 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:29:56.010705 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:29:56.021702 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:29:56.033293 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:29:56.044376 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:29:56.055439 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:29:56.066694 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:29:56.181503 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:29:56.300902 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:29:56.517373 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:29:56.838669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11249): Launched 20:29:57.117215 run iperf3-srv_10.42.42.10(pid=11250): Launched 20:29:57.237150 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:29:57.452474 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:29:57.773784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11251): Launched 20:29:58.051622 run iperf3-srv_10.42.42.10(pid=11252): Launched 20:29:58.171062 tst cs_paging_gprs_active.py:38: start network... 20:29:58.386008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:29:58.881737 run create_hlr_db(pid=11253): Launched 20:29:59.011029 bus /gobi_6: Setting Powered False 20:30:00.074690 run create_hlr_db(pid=11253): Terminated: ok {rc=0} 20:30:00.501854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11255): Launched 20:30:00.799508 run osmo-hlr_10.42.42.2(pid=11256): Launched 20:30:00.919126 run osmo-stp_10.42.42.5: Starting osmo-stp 20:30:01.618632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11261): Launched 20:30:01.981671 run osmo-stp_10.42.42.5(pid=11262): Launched 20:30:02.220152 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:30:02.822701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11264): Launched 20:30:02.945563 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:30:03.216610 run patchelf(pid=11265): Launched 20:30:03.394374 run osmo-stp_10.42.42.5(pid=11262): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11262)] 20:30:03.529603 run osmo-stp_10.42.42.5(pid=11262): stdout: | (launched: 2022-12-08_20:30:01.917745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:03.667533 run osmo-stp_10.42.42.5(pid=11262): stderr: | [0;m[38;5;43m20221208203002200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203002200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203002200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203002201 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203002201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203002202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203002202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:03.804609 run osmo-stp_10.42.42.5(pid=11262): stdout: | (launched: 2022-12-08_20:30:01.917745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:03.935975 run osmo-stp_10.42.42.5(pid=11262): stderr: | [0;m[38;5;43m20221208203002200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203002200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203002200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203002201 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203002201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203002202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203002202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:04.091687 run patchelf(pid=11265): Terminating (SIGINT) 20:30:04.271424 run patchelf(pid=11265): Terminated: ok {rc=0} 20:30:04.400720 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11262): Process ended prematurely: osmo-stp_10.42.42.5(pid=11262) [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11262)] [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 20:30:04.410806 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 20:30:04.438966 run osmo-hlr_10.42.42.2(pid=11256): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11256)] 20:30:04.489104 run osmo-hlr_10.42.42.2(pid=11256): stdout: | (launched: 2022-12-08_20:30:00.744907) 20:30:04.540560 run osmo-hlr_10.42.42.2(pid=11256): stderr: | [0;m[1;31m20221208203001029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203001029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203001029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203001029 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203001030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203001030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203001058 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203001067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203001067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203001068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:30:04.592607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11249): Terminating (SIGTERM) 20:30:04.634916 run iperf3-srv_10.42.42.10(pid=11250): Terminating (SIGTERM) 20:30:04.676631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11251): Terminating (SIGTERM) 20:30:04.718924 run iperf3-srv_10.42.42.10(pid=11252): Terminating (SIGTERM) 20:30:04.760444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11255): Terminating (SIGTERM) 20:30:04.802178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11261): Terminating (SIGTERM) 20:30:04.843746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11264): Terminating (SIGTERM) 20:30:04.885866 --- ParallelTerminationStrategy: PID 11249 died... 20:30:04.905608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11249): Terminated: ok {rc=0} 20:30:04.951801 --- ParallelTerminationStrategy: PID 11250 died... 20:30:04.971222 run iperf3-srv_10.42.42.10(pid=11250): Terminated {rc=256} 20:30:05.017125 --- ParallelTerminationStrategy: PID 11251 died... 20:30:05.036587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11251): Terminated: ok {rc=0} 20:30:05.082960 --- ParallelTerminationStrategy: PID 11252 died... 20:30:05.102624 run iperf3-srv_10.42.42.10(pid=11252): Terminated {rc=256} 20:30:05.149103 --- ParallelTerminationStrategy: PID 11255 died... 20:30:05.168476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11255): Terminated: ok {rc=0} 20:30:05.214438 --- ParallelTerminationStrategy: PID 11261 died... 20:30:05.234006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11261): Terminated: ok {rc=0} 20:30:05.280046 --- ParallelTerminationStrategy: PID 11264 died... 20:30:05.299482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11264): Terminated: ok {rc=0} 20:30:05.385719 bus /gobi_0: Setting Powered False 20:30:06.482569 bus /gobi_0: Setting Powered False 20:30:07.597696 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 20:30:08.741458 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:08.752701 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:30:08.824900 tst iperf3.py: using LAC 16617 20:30:08.942297 tst iperf3.py: using RAC 42 20:30:09.060248 tst iperf3.py: using CellId 16617 20:30:09.179722 tst iperf3.py: using BVCI 16618 20:30:09.297386 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:09.308833 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:09.320159 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:09.331483 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:09.342654 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:09.353970 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:09.365147 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:09.376197 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:09.387405 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:30:09.506176 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:30:09.722803 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:30:10.042846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11266): Launched 20:30:10.320182 run iperf3-srv_10.42.42.10(pid=11267): Launched 20:30:10.439482 tst iperf3.py:8: start network... 20:30:10.654091 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:30:11.147132 run create_hlr_db(pid=11268): Launched 20:30:11.275585 bus /gobi_6: Setting Powered False 20:30:12.337876 run create_hlr_db(pid=11268): Terminated: ok {rc=0} 20:30:12.760922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11270): Launched 20:30:13.057331 run osmo-hlr_10.42.42.2(pid=11271): Launched 20:30:13.170276 run osmo-stp_10.42.42.5: Starting osmo-stp 20:30:13.684861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11273): Launched 20:30:13.979832 run osmo-stp_10.42.42.5(pid=11274): Launched 20:30:14.093370 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:30:14.603957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11276): Launched 20:30:14.717093 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:30:14.966659 run patchelf(pid=11277): Launched 20:30:15.131587 run osmo-stp_10.42.42.5(pid=11274): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11274)] 20:30:15.257309 run osmo-stp_10.42.42.5(pid=11274): stdout: | (launched: 2022-12-08_20:30:13.925704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:15.384087 run osmo-stp_10.42.42.5(pid=11274): stderr: | [0;m[38;5;43m20221208203014090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203014090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203014090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203014091 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203014091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203014091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203014091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:15.511308 run osmo-stp_10.42.42.5(pid=11274): stdout: | (launched: 2022-12-08_20:30:13.925704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:15.632635 run osmo-stp_10.42.42.5(pid=11274): stderr: | [0;m[38;5;43m20221208203014090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203014090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203014090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203014091 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203014091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203014091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203014091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:15.776745 run patchelf(pid=11277): Terminating (SIGINT) 20:30:15.967002 run patchelf(pid=11277): Terminated: ok {rc=0} 20:30:16.091796 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11274): Process ended prematurely: osmo-stp_10.42.42.5(pid=11274) [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11274)] [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 20:30:16.102354 tst iperf3.py:8: Test FAILED (7.4 sec) 20:30:16.132688 run osmo-hlr_10.42.42.2(pid=11271): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11271)] 20:30:16.182627 run osmo-hlr_10.42.42.2(pid=11271): stdout: | (launched: 2022-12-08_20:30:13.002889) 20:30:16.234083 run osmo-hlr_10.42.42.2(pid=11271): stderr: | [0;m[1;31m20221208203013173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203013173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203013173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203013173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203013173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203013173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203013185 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203013194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203013194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203013194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:30:16.287073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11266): Terminating (SIGTERM) 20:30:16.330087 run iperf3-srv_10.42.42.10(pid=11267): Terminating (SIGTERM) 20:30:16.373339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11270): Terminating (SIGTERM) 20:30:16.417332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11273): Terminating (SIGTERM) 20:30:16.463008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11276): Terminating (SIGTERM) 20:30:16.508792 --- ParallelTerminationStrategy: PID 11266 died... 20:30:16.529598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11266): Terminated: ok {rc=0} 20:30:16.579286 --- ParallelTerminationStrategy: PID 11267 died... 20:30:16.599449 run iperf3-srv_10.42.42.10(pid=11267): Terminated {rc=256} 20:30:16.648047 --- ParallelTerminationStrategy: PID 11270 died... 20:30:16.668740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11270): Terminated: ok {rc=0} 20:30:16.716083 --- ParallelTerminationStrategy: PID 11273 died... 20:30:16.736131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11273): Terminated: ok {rc=0} 20:30:16.784052 --- ParallelTerminationStrategy: PID 11276 died... 20:30:16.804325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11276): Terminated: ok {rc=0} 20:30:16.893832 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 20:30:18.056035 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:18.068025 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:30:18.142843 tst iperf3m4.py: using LAC 16618 20:30:18.268558 tst iperf3m4.py: using RAC 43 20:30:18.392373 tst iperf3m4.py: using CellId 16618 20:30:18.517766 tst iperf3m4.py: using BVCI 16619 20:30:18.634579 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:18.645956 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:18.657565 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:18.668686 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:18.680011 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:18.691572 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:18.703029 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:18.714164 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:18.725549 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:30:18.842243 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:30:18.963462 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:30:19.079070 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:30:19.199839 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:30:19.416741 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:30:19.737310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11278): Launched 20:30:20.016028 run iperf3-srv_10.42.42.10(pid=11279): Launched 20:30:20.135555 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:30:20.351116 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:30:20.671713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11280): Launched 20:30:20.949653 run iperf3-srv_10.42.42.10(pid=11281): Launched 20:30:21.069058 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:30:21.284090 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:30:21.604598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11282): Launched 20:30:21.882358 run iperf3-srv_10.42.42.10(pid=11283): Launched 20:30:22.001277 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:30:22.215743 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:30:22.535227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11284): Launched 20:30:22.813184 run iperf3-srv_10.42.42.10(pid=11285): Launched 20:30:22.932176 tst iperf3m4.py:8: start network... 20:30:23.146676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:30:23.644445 run create_hlr_db(pid=11286): Launched 20:30:23.774603 bus /gobi_6: Setting Powered False 20:30:24.838063 run create_hlr_db(pid=11286): Terminated: ok {rc=0} 20:30:25.264336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11288): Launched 20:30:25.562032 run osmo-hlr_10.42.42.2(pid=11289): Launched 20:30:25.675287 run osmo-stp_10.42.42.5: Starting osmo-stp 20:30:26.188651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11291): Launched 20:30:26.484538 run osmo-stp_10.42.42.5(pid=11292): Launched 20:30:26.599085 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:30:27.119275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11294): Launched 20:30:27.235085 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:30:27.491517 run patchelf(pid=11295): Launched 20:30:27.662749 run osmo-stp_10.42.42.5(pid=11292): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11292)] 20:30:27.792838 run osmo-stp_10.42.42.5(pid=11292): stdout: | (launched: 2022-12-08_20:30:26.430284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:27.924615 run osmo-stp_10.42.42.5(pid=11292): stderr: | [0;m[38;5;43m20221208203026595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203026595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203026596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203026596 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203026596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203026597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203026597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:28.056159 run osmo-stp_10.42.42.5(pid=11292): stdout: | (launched: 2022-12-08_20:30:26.430284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:28.182274 run osmo-stp_10.42.42.5(pid=11292): stderr: | [0;m[38;5;43m20221208203026595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203026595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203026596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203026596 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203026596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203026597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203026597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:28.331539 run patchelf(pid=11295): Terminating (SIGINT) 20:30:28.503737 run patchelf(pid=11295): Terminated: ok {rc=0} 20:30:28.627109 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11292): Process ended prematurely: osmo-stp_10.42.42.5(pid=11292) [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11292)] [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 20:30:28.636518 tst iperf3m4.py:8: Test FAILED (10.6 sec) 20:30:28.664782 run osmo-hlr_10.42.42.2(pid=11289): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11289)] 20:30:28.713701 run osmo-hlr_10.42.42.2(pid=11289): stdout: | (launched: 2022-12-08_20:30:25.507221) 20:30:28.764100 run osmo-hlr_10.42.42.2(pid=11289): stderr: | [0;m[1;31m20221208203025681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203025681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203025681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203025681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203025681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203025681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203025693 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203025702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203025702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203025703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:30:28.815251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11278): Terminating (SIGTERM) 20:30:28.856218 run iperf3-srv_10.42.42.10(pid=11279): Terminating (SIGTERM) 20:30:28.897073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11280): Terminating (SIGTERM) 20:30:28.937923 run iperf3-srv_10.42.42.10(pid=11281): Terminating (SIGTERM) 20:30:28.978098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11282): Terminating (SIGTERM) 20:30:29.018285 run iperf3-srv_10.42.42.10(pid=11283): Terminating (SIGTERM) 20:30:29.058332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11284): Terminating (SIGTERM) 20:30:29.098362 run iperf3-srv_10.42.42.10(pid=11285): Terminating (SIGTERM) 20:30:29.138436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11288): Terminating (SIGTERM) 20:30:29.178632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11291): Terminating (SIGTERM) 20:30:29.218910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11294): Terminating (SIGTERM) 20:30:29.259843 --- ParallelTerminationStrategy: PID 11278 died... 20:30:29.279413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11278): Terminated: ok {rc=0} 20:30:29.325449 --- ParallelTerminationStrategy: PID 11279 died... 20:30:29.344535 run iperf3-srv_10.42.42.10(pid=11279): Terminated {rc=256} 20:30:29.389804 --- ParallelTerminationStrategy: PID 11280 died... 20:30:29.408817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11280): Terminated: ok {rc=0} 20:30:29.453916 --- ParallelTerminationStrategy: PID 11281 died... 20:30:29.473096 run iperf3-srv_10.42.42.10(pid=11281): Terminated {rc=256} 20:30:29.517843 --- ParallelTerminationStrategy: PID 11282 died... 20:30:29.536880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11282): Terminated: ok {rc=0} 20:30:29.582086 --- ParallelTerminationStrategy: PID 11283 died... 20:30:29.601170 run iperf3-srv_10.42.42.10(pid=11283): Terminated {rc=256} 20:30:29.646589 --- ParallelTerminationStrategy: PID 11284 died... 20:30:29.665550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11284): Terminated: ok {rc=0} 20:30:29.710863 --- ParallelTerminationStrategy: PID 11285 died... 20:30:29.729923 run iperf3-srv_10.42.42.10(pid=11285): Terminated {rc=256} 20:30:29.775034 --- ParallelTerminationStrategy: PID 11288 died... 20:30:29.793922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11288): Terminated: ok {rc=0} 20:30:29.838808 --- ParallelTerminationStrategy: PID 11291 died... 20:30:29.857758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11291): Terminated: ok {rc=0} 20:30:29.903317 --- ParallelTerminationStrategy: PID 11294 died... 20:30:29.922443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11294): Terminated: ok {rc=0} 20:30:30.007930 bus /gobi_4: Setting Powered False 20:30:31.120076 bus /gobi_4: Setting Powered False 20:30:32.257088 bus /gobi_1: Setting Powered False 20:30:33.360389 bus /gobi_1: Setting Powered False 20:30:34.478023 bus /gobi_0: Setting Powered False 20:30:35.577267 bus /gobi_0: Setting Powered False 20:30:36.694899 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 20:30:37.800858 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:37.812902 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:30:37.887758 tst ping.py: using LAC 16619 20:30:38.014287 tst ping.py: using RAC 44 20:30:38.139659 tst ping.py: using CellId 16619 20:30:38.269456 tst ping.py: using BVCI 16620 20:30:38.388114 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:38.399702 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:38.411162 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:38.422528 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:38.433757 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:38.445033 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:38.456357 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:38.467686 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:30:38.583552 tst ping.py:19: start network... 20:30:38.784797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:30:39.247001 run create_hlr_db(pid=11296): Launched 20:30:39.362418 bus /gobi_6: Setting Powered False 20:30:40.422716 run create_hlr_db(pid=11296): Terminated: ok {rc=0} 20:30:40.865512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11298): Launched 20:30:41.188322 run osmo-hlr_10.42.42.2(pid=11299): Launched 20:30:41.310752 run osmo-stp_10.42.42.5: Starting osmo-stp 20:30:41.873052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11301): Launched 20:30:42.193700 run osmo-stp_10.42.42.5(pid=11302): Launched 20:30:42.315507 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:30:42.873551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11304): Launched 20:30:42.996651 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:30:43.268683 run patchelf(pid=11305): Launched 20:30:43.448287 run osmo-stp_10.42.42.5(pid=11302): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11302)] 20:30:43.584378 run osmo-stp_10.42.42.5(pid=11302): stdout: | (launched: 2022-12-08_20:30:42.135383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:43.723001 run osmo-stp_10.42.42.5(pid=11302): stderr: | [0;m[38;5;43m20221208203042325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203042326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203042326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203042326 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203042327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203042327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203042327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:43.861149 run osmo-stp_10.42.42.5(pid=11302): stdout: | (launched: 2022-12-08_20:30:42.135383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:43.992860 run osmo-stp_10.42.42.5(pid=11302): stderr: | [0;m[38;5;43m20221208203042325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203042326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203042326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203042326 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203042327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203042327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203042327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:44.148794 run patchelf(pid=11305): Terminating (SIGINT) 20:30:44.328914 run patchelf(pid=11305): Terminated: ok {rc=0} 20:30:44.459123 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11302): Process ended prematurely: osmo-stp_10.42.42.5(pid=11302) [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11302)] [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 20:30:44.468734 tst ping.py:22: Test FAILED (6.7 sec) 20:30:44.496883 run osmo-hlr_10.42.42.2(pid=11299): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11299)] 20:30:44.547703 run osmo-hlr_10.42.42.2(pid=11299): stdout: | (launched: 2022-12-08_20:30:41.129699) 20:30:44.599997 run osmo-hlr_10.42.42.2(pid=11299): stderr: | [0;m[1;31m20221208203041326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203041326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203041327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203041327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203041327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203041327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203041339 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203041347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203041347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203041347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:30:44.652917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11298): Terminating (SIGTERM) 20:30:44.695338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11301): Terminating (SIGTERM) 20:30:44.737862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11304): Terminating (SIGTERM) 20:30:44.780547 --- ParallelTerminationStrategy: PID 11298 died... 20:30:44.800797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11298): Terminated: ok {rc=0} 20:30:44.847466 --- ParallelTerminationStrategy: PID 11301 died... 20:30:44.867546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11301): Terminated: ok {rc=0} 20:30:44.914357 --- ParallelTerminationStrategy: PID 11304 died... 20:30:44.933904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11304): Terminated: ok {rc=0} 20:30:45.022131 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 20:30:46.107733 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:46.121070 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:30:46.197123 tst ping_idle_ping.py: using LAC 16620 20:30:46.326873 tst ping_idle_ping.py: using RAC 45 20:30:46.475335 tst ping_idle_ping.py: using CellId 16620 20:30:46.602128 tst ping_idle_ping.py: using BVCI 16621 20:30:46.727525 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:46.739234 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:46.750736 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:46.762447 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:46.774148 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:46.785751 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:46.797482 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:46.808798 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:30:46.929395 tst ping_idle_ping.py:24: start network... 20:30:47.190735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:30:47.695891 run create_hlr_db(pid=11306): Launched 20:30:47.826816 bus /gobi_6: Setting Powered False 20:30:48.890892 run create_hlr_db(pid=11306): Terminated: ok {rc=0} 20:30:49.321959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11308): Launched 20:30:49.623408 run osmo-hlr_10.42.42.2(pid=11309): Launched 20:30:49.738532 run osmo-stp_10.42.42.5: Starting osmo-stp 20:30:50.267551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11311): Launched 20:30:50.567052 run osmo-stp_10.42.42.5(pid=11312): Launched 20:30:50.680201 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:30:51.195646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11314): Launched 20:30:51.310765 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:30:51.563668 run patchelf(pid=11315): Launched 20:30:51.730927 run osmo-stp_10.42.42.5(pid=11312): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11312)] 20:30:51.858708 run osmo-stp_10.42.42.5(pid=11312): stdout: | (launched: 2022-12-08_20:30:50.512389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:51.987583 run osmo-stp_10.42.42.5(pid=11312): stderr: | [0;m[38;5;43m20221208203050679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203050679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203050679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203050679 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203050680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203050680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203050680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:52.116736 run osmo-stp_10.42.42.5(pid=11312): stdout: | (launched: 2022-12-08_20:30:50.512389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:52.240605 run osmo-stp_10.42.42.5(pid=11312): stderr: | [0;m[38;5;43m20221208203050679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203050679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203050679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203050679 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203050680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203050680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203050680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:52.386679 run patchelf(pid=11315): Terminating (SIGINT) 20:30:52.555764 run patchelf(pid=11315): Terminated: ok {rc=0} 20:30:52.677599 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11312): Process ended prematurely: osmo-stp_10.42.42.5(pid=11312) [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11312)] [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 20:30:52.686446 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 20:30:52.713637 run osmo-hlr_10.42.42.2(pid=11309): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11309)] 20:30:52.761758 run osmo-hlr_10.42.42.2(pid=11309): stdout: | (launched: 2022-12-08_20:30:49.568500) 20:30:52.811779 run osmo-hlr_10.42.42.2(pid=11309): stderr: | [0;m[1;31m20221208203049743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203049743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203049743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203049744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203049744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203049744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203049756 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203049767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203049767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203049767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:30:52.861962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11308): Terminating (SIGTERM) 20:30:52.902109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11311): Terminating (SIGTERM) 20:30:52.942213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11314): Terminating (SIGTERM) 20:30:52.982599 --- ParallelTerminationStrategy: PID 11308 died... 20:30:53.001720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11308): Terminated: ok {rc=0} 20:30:53.046553 --- ParallelTerminationStrategy: PID 11311 died... 20:30:53.065421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11311): Terminated: ok {rc=0} 20:30:53.110114 --- ParallelTerminationStrategy: PID 11314 died... 20:30:53.128734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11314): Terminated: ok {rc=0} 20:30:53.215394 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 20:30:54.525396 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:30:54.532442 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 20:30:54.568463 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 20:30:54.609123 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 20:30:54.699689 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 20:30:54.734439 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 20:30:54.772906 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 20:30:55.376355 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 20:30:55.430742 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:30:55.442759 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:30:55.498022 tst cs_paging_gprs_active.py: using LAC 16621 20:30:55.627903 tst cs_paging_gprs_active.py: using RAC 46 20:30:55.754232 tst cs_paging_gprs_active.py: using CellId 16621 20:30:55.874328 tst cs_paging_gprs_active.py: using BVCI 16622 20:30:55.987933 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:30:55.999387 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:30:56.010674 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:30:56.022194 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:30:56.033573 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:30:56.044846 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:30:56.056335 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:30:56.067612 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:30:56.079339 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:30:56.200734 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:30:56.321639 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:30:56.528690 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:30:56.835701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11319): Launched 20:30:57.102285 run iperf3-srv_10.42.42.10(pid=11320): Launched 20:30:57.219172 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:30:57.423513 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:30:57.730470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11321): Launched 20:30:57.998449 run iperf3-srv_10.42.42.10(pid=11322): Launched 20:30:58.115091 tst cs_paging_gprs_active.py:38: start network... 20:30:58.320232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:30:58.793981 run create_hlr_db(pid=11323): Launched 20:30:58.913390 bus /gobi_6: Setting Powered False 20:30:59.973730 run create_hlr_db(pid=11323): Terminated: ok {rc=0} 20:31:00.399248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11325): Launched 20:31:00.705472 run osmo-hlr_10.42.42.2(pid=11326): Launched 20:31:00.822690 run osmo-stp_10.42.42.5: Starting osmo-stp 20:31:01.605900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11328): Launched 20:31:01.956068 run osmo-stp_10.42.42.5(pid=11329): Launched 20:31:02.289750 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:31:02.871574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11331): Launched 20:31:02.998455 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:31:03.277130 run patchelf(pid=11332): Launched 20:31:03.460149 run osmo-stp_10.42.42.5(pid=11329): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11329)] 20:31:03.599781 run osmo-stp_10.42.42.5(pid=11329): stdout: | (launched: 2022-12-08_20:31:01.895289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:03.740871 run osmo-stp_10.42.42.5(pid=11329): stderr: | [0;m[38;5;43m20221208203102201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203102201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203102202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203102203 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203102203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203102203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203102203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:03.881296 run osmo-stp_10.42.42.5(pid=11329): stdout: | (launched: 2022-12-08_20:31:01.895289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:04.016343 run osmo-stp_10.42.42.5(pid=11329): stderr: | [0;m[38;5;43m20221208203102201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203102201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203102202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203102203 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203102203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203102203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203102203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:04.176317 run patchelf(pid=11332): Terminating (SIGINT) 20:31:04.360478 run patchelf(pid=11332): Terminated: ok {rc=0} 20:31:04.493216 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11329): Process ended prematurely: osmo-stp_10.42.42.5(pid=11329) [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11329)] [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 20:31:04.503379 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 20:31:04.532158 run osmo-hlr_10.42.42.2(pid=11326): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11326)] 20:31:04.582944 run osmo-hlr_10.42.42.2(pid=11326): stdout: | (launched: 2022-12-08_20:31:00.649357) 20:31:04.635555 run osmo-hlr_10.42.42.2(pid=11326): stderr: | [0;m[1;31m20221208203100822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203100822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203100822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203100822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203100822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203100823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203100846 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203100867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203100868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203100868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:31:04.688923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11319): Terminating (SIGTERM) 20:31:04.731428 run iperf3-srv_10.42.42.10(pid=11320): Terminating (SIGTERM) 20:31:04.773921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11321): Terminating (SIGTERM) 20:31:04.816828 run iperf3-srv_10.42.42.10(pid=11322): Terminating (SIGTERM) 20:31:04.859277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11325): Terminating (SIGTERM) 20:31:04.901807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11328): Terminating (SIGTERM) 20:31:04.944311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11331): Terminating (SIGTERM) 20:31:04.986912 --- ParallelTerminationStrategy: PID 11319 died... 20:31:05.007434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11319): Terminated: ok {rc=0} 20:31:05.054551 --- ParallelTerminationStrategy: PID 11320 died... 20:31:05.074327 run iperf3-srv_10.42.42.10(pid=11320): Terminated {rc=256} 20:31:05.121204 --- ParallelTerminationStrategy: PID 11321 died... 20:31:05.141080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11321): Terminated: ok {rc=0} 20:31:05.187962 --- ParallelTerminationStrategy: PID 11322 died... 20:31:05.207848 run iperf3-srv_10.42.42.10(pid=11322): Terminated {rc=256} 20:31:05.254615 --- ParallelTerminationStrategy: PID 11325 died... 20:31:05.274365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11325): Terminated: ok {rc=0} 20:31:05.321433 --- ParallelTerminationStrategy: PID 11328 died... 20:31:05.341279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11328): Terminated: ok {rc=0} 20:31:05.387747 --- ParallelTerminationStrategy: PID 11331 died... 20:31:05.407576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11331): Terminated: ok {rc=0} 20:31:05.497122 bus /gobi_0: Setting Powered False 20:31:06.599228 bus /gobi_0: Setting Powered False 20:31:07.717497 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 20:31:08.867756 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:08.880153 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:31:08.937416 tst iperf3.py: using LAC 16622 20:31:09.066710 tst iperf3.py: using RAC 47 20:31:09.196317 tst iperf3.py: using CellId 16622 20:31:09.324419 tst iperf3.py: using BVCI 16623 20:31:09.443870 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:09.455760 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:09.467401 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:09.479068 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:09.490726 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:09.502395 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:09.514190 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:09.525776 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:09.537585 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:31:09.659437 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:31:09.881571 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:31:10.211658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11333): Launched 20:31:10.498100 run iperf3-srv_10.42.42.10(pid=11334): Launched 20:31:10.622763 tst iperf3.py:8: start network... 20:31:10.844486 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:31:11.353912 run create_hlr_db(pid=11335): Launched 20:31:11.488397 bus /gobi_6: Setting Powered False 20:31:12.553805 run create_hlr_db(pid=11335): Terminated: ok {rc=0} 20:31:12.991775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11337): Launched 20:31:13.298858 run osmo-hlr_10.42.42.2(pid=11338): Launched 20:31:13.415124 run osmo-stp_10.42.42.5: Starting osmo-stp 20:31:13.954059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11340): Launched 20:31:14.259057 run osmo-stp_10.42.42.5(pid=11341): Launched 20:31:14.375797 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:31:14.902730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11343): Launched 20:31:15.019919 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:31:15.279276 run patchelf(pid=11344): Launched 20:31:15.450840 run osmo-stp_10.42.42.5(pid=11341): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11341)] 20:31:15.580710 run osmo-stp_10.42.42.5(pid=11341): stdout: | (launched: 2022-12-08_20:31:14.203062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:15.712419 run osmo-stp_10.42.42.5(pid=11341): stderr: | [0;m[38;5;43m20221208203114368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203114369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203114369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203114369 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203114370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203114370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203114370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:15.860914 run osmo-stp_10.42.42.5(pid=11341): stdout: | (launched: 2022-12-08_20:31:14.203062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:16.005095 run osmo-stp_10.42.42.5(pid=11341): stderr: | [0;m[38;5;43m20221208203114368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203114369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203114369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203114369 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203114370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203114370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203114370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:16.169335 run patchelf(pid=11344): Terminating (SIGINT) 20:31:16.360915 run patchelf(pid=11344): Terminated: ok {rc=0} 20:31:16.498643 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11341): Process ended prematurely: osmo-stp_10.42.42.5(pid=11341) [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11341)] [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 20:31:16.509953 tst iperf3.py:8: Test FAILED (7.7 sec) 20:31:16.540509 run osmo-hlr_10.42.42.2(pid=11338): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11338)] 20:31:16.593083 run osmo-hlr_10.42.42.2(pid=11338): stdout: | (launched: 2022-12-08_20:31:13.242881) 20:31:16.647076 run osmo-hlr_10.42.42.2(pid=11338): stderr: | [0;m[1;31m20221208203113417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203113417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203113417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203113418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203113418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203113418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203113430 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203113441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203113441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203113441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:31:16.703876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11333): Terminating (SIGTERM) 20:31:16.748188 run iperf3-srv_10.42.42.10(pid=11334): Terminating (SIGTERM) 20:31:16.792123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11337): Terminating (SIGTERM) 20:31:16.835906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11340): Terminating (SIGTERM) 20:31:16.883242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11343): Terminating (SIGTERM) 20:31:16.929565 --- ParallelTerminationStrategy: PID 11333 died... 20:31:16.950372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11333): Terminated: ok {rc=0} 20:31:16.999900 --- ParallelTerminationStrategy: PID 11334 died... 20:31:17.020347 run iperf3-srv_10.42.42.10(pid=11334): Terminated {rc=256} 20:31:17.069315 --- ParallelTerminationStrategy: PID 11337 died... 20:31:17.089776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11337): Terminated: ok {rc=0} 20:31:17.137827 --- ParallelTerminationStrategy: PID 11340 died... 20:31:17.158526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11340): Terminated: ok {rc=0} 20:31:17.206164 --- ParallelTerminationStrategy: PID 11343 died... 20:31:17.226830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11343): Terminated: ok {rc=0} 20:31:17.318969 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 20:31:18.470817 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:18.483453 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:31:18.537900 tst iperf3m4.py: using LAC 16623 20:31:18.666605 tst iperf3m4.py: using RAC 48 20:31:18.795778 tst iperf3m4.py: using CellId 16623 20:31:18.926449 tst iperf3m4.py: using BVCI 16624 20:31:19.047639 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:19.059602 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:19.071318 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:19.083093 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:19.094808 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:19.106435 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:19.118324 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:19.130026 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:19.141850 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:31:19.260929 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:31:19.386524 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:31:19.504702 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:31:19.628239 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:31:19.852537 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:31:20.182674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11345): Launched 20:31:20.469069 run iperf3-srv_10.42.42.10(pid=11346): Launched 20:31:20.592220 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:31:20.814315 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:31:21.143827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11347): Launched 20:31:21.429610 run iperf3-srv_10.42.42.10(pid=11348): Launched 20:31:21.552451 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:31:21.774395 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:31:22.104671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11349): Launched 20:31:22.390171 run iperf3-srv_10.42.42.10(pid=11350): Launched 20:31:22.514578 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:31:22.736376 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:31:23.066279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11351): Launched 20:31:23.352302 run iperf3-srv_10.42.42.10(pid=11352): Launched 20:31:23.476843 tst iperf3m4.py:8: start network... 20:31:23.698491 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:31:24.208129 run create_hlr_db(pid=11353): Launched 20:31:24.342131 bus /gobi_6: Setting Powered False 20:31:25.407025 run create_hlr_db(pid=11353): Terminated: ok {rc=0} 20:31:25.845716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11355): Launched 20:31:26.154124 run osmo-hlr_10.42.42.2(pid=11356): Launched 20:31:26.270374 run osmo-stp_10.42.42.5: Starting osmo-stp 20:31:26.801461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11358): Launched 20:31:27.107911 run osmo-stp_10.42.42.5(pid=11359): Launched 20:31:27.223471 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:31:27.749425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11361): Launched 20:31:27.867176 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:31:28.126209 run patchelf(pid=11362): Launched 20:31:28.296714 run osmo-stp_10.42.42.5(pid=11359): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11359)] 20:31:28.426282 run osmo-stp_10.42.42.5(pid=11359): stdout: | (launched: 2022-12-08_20:31:27.051395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:28.557597 run osmo-stp_10.42.42.5(pid=11359): stderr: | [0;m[38;5;43m20221208203127220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203127221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203127221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203127221 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203127222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203127222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203127222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:28.688637 run osmo-stp_10.42.42.5(pid=11359): stdout: | (launched: 2022-12-08_20:31:27.051395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:28.814114 run osmo-stp_10.42.42.5(pid=11359): stderr: | [0;m[38;5;43m20221208203127220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203127221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203127221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203127221 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203127222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203127222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203127222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:28.962378 run patchelf(pid=11362): Terminating (SIGINT) 20:31:29.134301 run patchelf(pid=11362): Terminated: ok {rc=0} 20:31:29.257814 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11359): Process ended prematurely: osmo-stp_10.42.42.5(pid=11359) [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11359)] [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 20:31:29.267333 tst iperf3m4.py:8: Test FAILED (10.8 sec) 20:31:29.295278 run osmo-hlr_10.42.42.2(pid=11356): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11356)] 20:31:29.343318 run osmo-hlr_10.42.42.2(pid=11356): stdout: | (launched: 2022-12-08_20:31:26.097565) 20:31:29.393787 run osmo-hlr_10.42.42.2(pid=11356): stderr: | [0;m[1;31m20221208203126274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203126274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203126274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203126274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203126274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203126274 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203126290 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203126299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203126299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203126299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:31:29.444221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11345): Terminating (SIGTERM) 20:31:29.484188 run iperf3-srv_10.42.42.10(pid=11346): Terminating (SIGTERM) 20:31:29.523868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11347): Terminating (SIGTERM) 20:31:29.563708 run iperf3-srv_10.42.42.10(pid=11348): Terminating (SIGTERM) 20:31:29.603713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11349): Terminating (SIGTERM) 20:31:29.643614 run iperf3-srv_10.42.42.10(pid=11350): Terminating (SIGTERM) 20:31:29.684165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11351): Terminating (SIGTERM) 20:31:29.724163 run iperf3-srv_10.42.42.10(pid=11352): Terminating (SIGTERM) 20:31:29.763773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11355): Terminating (SIGTERM) 20:31:29.804024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11358): Terminating (SIGTERM) 20:31:29.844037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11361): Terminating (SIGTERM) 20:31:29.884113 --- ParallelTerminationStrategy: PID 11345 died... 20:31:29.903196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11345): Terminated: ok {rc=0} 20:31:29.947979 --- ParallelTerminationStrategy: PID 11346 died... 20:31:29.966618 run iperf3-srv_10.42.42.10(pid=11346): Terminated {rc=256} 20:31:30.010791 --- ParallelTerminationStrategy: PID 11347 died... 20:31:30.029554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11347): Terminated: ok {rc=0} 20:31:30.074022 --- ParallelTerminationStrategy: PID 11348 died... 20:31:30.092629 run iperf3-srv_10.42.42.10(pid=11348): Terminated {rc=256} 20:31:30.137250 --- ParallelTerminationStrategy: PID 11349 died... 20:31:30.155775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11349): Terminated: ok {rc=0} 20:31:30.200262 --- ParallelTerminationStrategy: PID 11350 died... 20:31:30.218861 run iperf3-srv_10.42.42.10(pid=11350): Terminated {rc=256} 20:31:30.263115 --- ParallelTerminationStrategy: PID 11351 died... 20:31:30.281882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11351): Terminated: ok {rc=0} 20:31:30.326147 --- ParallelTerminationStrategy: PID 11352 died... 20:31:30.344741 run iperf3-srv_10.42.42.10(pid=11352): Terminated {rc=256} 20:31:30.388762 --- ParallelTerminationStrategy: PID 11355 died... 20:31:30.407391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11355): Terminated: ok {rc=0} 20:31:30.451868 --- ParallelTerminationStrategy: PID 11358 died... 20:31:30.470619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11358): Terminated: ok {rc=0} 20:31:30.514756 --- ParallelTerminationStrategy: PID 11361 died... 20:31:30.533334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11361): Terminated: ok {rc=0} 20:31:30.617503 bus /gobi_4: Setting Powered False 20:31:31.725074 bus /gobi_4: Setting Powered False 20:31:32.861314 bus /gobi_1: Setting Powered False 20:31:33.961226 bus /gobi_1: Setting Powered False 20:31:35.077510 bus /gobi_0: Setting Powered False 20:31:36.176260 bus /gobi_0: Setting Powered False 20:31:37.294393 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 20:31:38.398089 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:38.410006 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:31:38.463449 tst ping.py: using LAC 16624 20:31:38.581907 tst ping.py: using RAC 49 20:31:38.701048 tst ping.py: using CellId 16624 20:31:38.818299 tst ping.py: using BVCI 16625 20:31:38.928634 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:38.940137 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:38.951333 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:38.962737 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:38.974080 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:38.985584 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:38.996903 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:39.008341 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:31:39.130659 tst ping.py:19: start network... 20:31:39.348366 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:31:39.846969 run create_hlr_db(pid=11363): Launched 20:31:39.972088 bus /gobi_6: Setting Powered False 20:31:41.036573 run create_hlr_db(pid=11363): Terminated: ok {rc=0} 20:31:41.467676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11365): Launched 20:31:41.768678 run osmo-hlr_10.42.42.2(pid=11366): Launched 20:31:41.883821 run osmo-stp_10.42.42.5: Starting osmo-stp 20:31:42.402509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11368): Launched 20:31:42.704830 run osmo-stp_10.42.42.5(pid=11369): Launched 20:31:42.819367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:31:43.335655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11371): Launched 20:31:43.451164 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:31:43.705241 run patchelf(pid=11372): Launched 20:31:43.872922 run osmo-stp_10.42.42.5(pid=11369): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11369)] 20:31:44.001320 run osmo-stp_10.42.42.5(pid=11369): stdout: | (launched: 2022-12-08_20:31:42.649068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:44.130483 run osmo-stp_10.42.42.5(pid=11369): stderr: | [0;m[38;5;43m20221208203142816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203142816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203142816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203142817 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203142817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203142817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203142817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:44.259578 run osmo-stp_10.42.42.5(pid=11369): stdout: | (launched: 2022-12-08_20:31:42.649068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:44.383222 run osmo-stp_10.42.42.5(pid=11369): stderr: | [0;m[38;5;43m20221208203142816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203142816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203142816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203142817 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203142817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203142817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203142817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:44.529212 run patchelf(pid=11372): Terminating (SIGINT) 20:31:44.698648 run patchelf(pid=11372): Terminated: ok {rc=0} 20:31:44.820525 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11369): Process ended prematurely: osmo-stp_10.42.42.5(pid=11369) [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11369)] [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 20:31:44.829633 tst ping.py:22: Test FAILED (6.4 sec) 20:31:44.856827 run osmo-hlr_10.42.42.2(pid=11366): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11366)] 20:31:44.904784 run osmo-hlr_10.42.42.2(pid=11366): stdout: | (launched: 2022-12-08_20:31:41.713127) 20:31:44.954531 run osmo-hlr_10.42.42.2(pid=11366): stderr: | [0;m[1;31m20221208203141886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203141886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203141886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203141886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203141886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203141886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203141899 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203141909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203141909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203141909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:31:45.004618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11365): Terminating (SIGTERM) 20:31:45.044576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11368): Terminating (SIGTERM) 20:31:45.084619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11371): Terminating (SIGTERM) 20:31:45.124817 --- ParallelTerminationStrategy: PID 11365 died... 20:31:45.144075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11365): Terminated: ok {rc=0} 20:31:45.188727 --- ParallelTerminationStrategy: PID 11368 died... 20:31:45.207481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11368): Terminated: ok {rc=0} 20:31:45.251785 --- ParallelTerminationStrategy: PID 11371 died... 20:31:45.270524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11371): Terminated: ok {rc=0} 20:31:45.357104 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 20:31:46.446739 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:46.462216 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:31:46.522404 tst ping_idle_ping.py: using LAC 16625 20:31:46.643106 tst ping_idle_ping.py: using RAC 50 20:31:46.799099 tst ping_idle_ping.py: using CellId 16625 20:31:46.951085 tst ping_idle_ping.py: using BVCI 16626 20:31:47.072454 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:47.084936 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:47.097312 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:47.110875 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:47.123670 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:47.136113 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:47.149135 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:47.161884 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:31:47.287414 tst ping_idle_ping.py:24: start network... 20:31:47.506537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:31:48.009239 run create_hlr_db(pid=11373): Launched 20:31:48.141745 bus /gobi_6: Setting Powered False 20:31:49.206504 run create_hlr_db(pid=11373): Terminated: ok {rc=0} 20:31:49.636501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11375): Launched 20:31:49.961222 run osmo-hlr_10.42.42.2(pid=11376): Launched 20:31:50.083074 run osmo-stp_10.42.42.5: Starting osmo-stp 20:31:50.636299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11378): Launched 20:31:50.957682 run osmo-stp_10.42.42.5(pid=11379): Launched 20:31:51.080002 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:31:51.637661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11381): Launched 20:31:51.763108 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:31:52.035880 run patchelf(pid=11382): Launched 20:31:52.215329 run osmo-stp_10.42.42.5(pid=11379): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11379)] 20:31:52.352277 run osmo-stp_10.42.42.5(pid=11379): stdout: | (launched: 2022-12-08_20:31:50.899210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:52.490919 run osmo-stp_10.42.42.5(pid=11379): stderr: | [0;m[38;5;43m20221208203151087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203151088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203151088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203151088 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203151089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203151089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203151089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:52.629584 run osmo-stp_10.42.42.5(pid=11379): stdout: | (launched: 2022-12-08_20:31:50.899210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:52.762221 run osmo-stp_10.42.42.5(pid=11379): stderr: | [0;m[38;5;43m20221208203151087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203151088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203151088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203151088 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203151089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203151089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203151089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:52.918705 run patchelf(pid=11382): Terminating (SIGINT) 20:31:53.099945 run patchelf(pid=11382): Terminated: ok {rc=0} 20:31:53.230077 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11379): Process ended prematurely: osmo-stp_10.42.42.5(pid=11379) [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11379)] [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 20:31:53.239731 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 20:31:53.268020 run osmo-hlr_10.42.42.2(pid=11376): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11376)] 20:31:53.318647 run osmo-hlr_10.42.42.2(pid=11376): stdout: | (launched: 2022-12-08_20:31:49.901671) 20:31:53.370883 run osmo-hlr_10.42.42.2(pid=11376): stderr: | [0;m[1;31m20221208203150098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203150098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203150098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203150098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203150098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203150098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203150111 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203150119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203150119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203150119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:31:53.423213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11375): Terminating (SIGTERM) 20:31:53.465389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11378): Terminating (SIGTERM) 20:31:53.507562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11381): Terminating (SIGTERM) 20:31:53.549886 --- ParallelTerminationStrategy: PID 11375 died... 20:31:53.570134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11375): Terminated: ok {rc=0} 20:31:53.616518 --- ParallelTerminationStrategy: PID 11378 died... 20:31:53.636308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11378): Terminated: ok {rc=0} 20:31:53.682926 --- ParallelTerminationStrategy: PID 11381 died... 20:31:53.702545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11381): Terminated: ok {rc=0} 20:31:53.791255 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:31:55.104798 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:31:55.112096 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:31:55.146278 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 20:31:55.181825 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:31:55.238537 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:31:55.273898 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 20:31:55.308358 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:31:55.861147 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2349 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 20:31:55.866342 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:31:55.877768 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:31:55.947319 tst switch_tch_pdch.py: using LAC 16626 20:31:56.066323 tst switch_tch_pdch.py: using RAC 51 20:31:56.182990 tst switch_tch_pdch.py: using CellId 16626 20:31:56.302272 tst switch_tch_pdch.py: using BVCI 16627 20:31:56.411676 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:31:56.422916 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:31:56.434059 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:31:56.445499 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:31:56.456711 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:31:56.468247 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:31:56.479896 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:31:56.491353 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:31:56.614748 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:31:56.732677 tst switch_tch_pdch.py:51: start network... 20:31:56.932759 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:31:57.392830 run create_hlr_db(pid=11387): Launched 20:31:57.507281 bus /gobi_6: Setting Powered False 20:31:58.566862 run create_hlr_db(pid=11387): Terminated: ok {rc=0} 20:31:59.008709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11389): Launched 20:31:59.330122 run osmo-hlr_10.42.42.2(pid=11390): Launched 20:31:59.452362 run osmo-stp_10.42.42.5: Starting osmo-stp 20:32:00.005296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11392): Launched 20:32:00.328154 run osmo-stp_10.42.42.5(pid=11393): Launched 20:32:00.449762 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:32:01.024838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11395): Launched 20:32:01.160217 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:32:01.439167 run patchelf(pid=11396): Launched 20:32:01.637649 run osmo-stp_10.42.42.5(pid=11393): ERR: Terminated: ERROR {rc=1} [trial-2349↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11393)] 20:32:01.777146 run osmo-stp_10.42.42.5(pid=11393): stdout: | (launched: 2022-12-08_20:32:00.268726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:01.917911 run osmo-stp_10.42.42.5(pid=11393): stderr: | [0;m[38;5;43m20221208203200458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203200458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203200459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203200459 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203200460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203200460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203200460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:02.058688 run osmo-stp_10.42.42.5(pid=11393): stdout: | (launched: 2022-12-08_20:32:00.268726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:02.193132 run osmo-stp_10.42.42.5(pid=11393): stderr: | [0;m[38;5;43m20221208203200458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203200458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203200459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203200459 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203200460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203200460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203200460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:02.364049 run patchelf(pid=11396): Terminating (SIGINT) 20:32:02.544421 run patchelf(pid=11396): Terminated: ok {rc=0} 20:32:02.674429 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11393): Process ended prematurely: osmo-stp_10.42.42.5(pid=11393) [trial-2349↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11393)] [trial-2349↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 20:32:02.684398 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 20:32:02.712503 run osmo-hlr_10.42.42.2(pid=11390): ERR: Terminated: ERROR {rc=237} [trial-2349↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11390)] 20:32:02.762982 run osmo-hlr_10.42.42.2(pid=11390): stdout: | (launched: 2022-12-08_20:31:59.271480) 20:32:02.814869 run osmo-hlr_10.42.42.2(pid=11390): stderr: | [0;m[1;31m20221208203159467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203159467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203159467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203159467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203159467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203159467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203159479 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203159488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203159488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203159488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:32:02.867393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11389): Terminating (SIGTERM) 20:32:02.909571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11392): Terminating (SIGTERM) 20:32:02.951695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11395): Terminating (SIGTERM) 20:32:02.994026 --- ParallelTerminationStrategy: PID 11389 died... 20:32:03.014099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11389): Terminated: ok {rc=0} 20:32:03.060451 --- ParallelTerminationStrategy: PID 11392 died... 20:32:03.080125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11392): Terminated: ok {rc=0} 20:32:03.126180 --- ParallelTerminationStrategy: PID 11395 died... 20:32:03.145818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11395): Terminated: ok {rc=0} 20:32:03.234608 bus /gobi_0: Setting Powered False 20:32:04.330305 bus /gobi_0: Setting Powered False 20:32:05.446270 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 20:32:06.706203 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:32:06.712522 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 20:32:06.746683 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 20:32:06.782161 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 20:32:06.834767 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 20:32:06.868798 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 20:32:06.904260 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 20:32:07.462967 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2349 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 20:32:07.468286 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:32:07.479683 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 20:32:07.549291 tst switch_tch_pdch.py: using LAC 16627 20:32:07.675327 tst switch_tch_pdch.py: using RAC 52 20:32:07.799482 tst switch_tch_pdch.py: using CellId 16627 20:32:07.922987 tst switch_tch_pdch.py: using BVCI 16628 20:32:08.040608 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:32:08.052158 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:32:08.063457 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:32:08.075092 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:32:08.086384 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:32:08.097936 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:32:08.109372 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:32:08.120697 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:32:08.242651 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:32:08.361395 tst switch_tch_pdch.py:51: start network... 20:32:08.562501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:32:08.999511 run create_hlr_db(pid=11401): Launched 20:32:09.114587 bus /gobi_6: Setting Powered False 20:32:10.174309 run create_hlr_db(pid=11401): Terminated: ok {rc=0} 20:32:10.587268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11403): Launched 20:32:10.911200 run osmo-hlr_10.42.42.2(pid=11404): Launched 20:32:11.033438 run osmo-stp_10.42.42.5: Starting osmo-stp 20:32:11.557085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11406): Launched 20:32:11.879513 run osmo-stp_10.42.42.5(pid=11407): Launched 20:32:12.001101 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:32:12.526975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11409): Launched 20:32:12.651432 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:32:12.923054 run patchelf(pid=11410): Launched 20:32:13.101666 run osmo-stp_10.42.42.5(pid=11407): ERR: Terminated: ERROR {rc=1} [trial-2349↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11407)] 20:32:13.237147 run osmo-stp_10.42.42.5(pid=11407): stdout: | (launched: 2022-12-08_20:32:11.821233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:13.374431 run osmo-stp_10.42.42.5(pid=11407): stderr: | [0;m[38;5;43m20221208203212008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203212009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203212009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203212009 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203212010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203212010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203212010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:13.511986 run osmo-stp_10.42.42.5(pid=11407): stdout: | (launched: 2022-12-08_20:32:11.821233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:13.643515 run osmo-stp_10.42.42.5(pid=11407): stderr: | [0;m[38;5;43m20221208203212008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203212009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203212009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203212009 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203212010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203212010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203212010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:13.799984 run patchelf(pid=11410): Terminating (SIGINT) 20:32:13.979689 run patchelf(pid=11410): Terminated: ok {rc=0} 20:32:14.108704 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11407): Process ended prematurely: osmo-stp_10.42.42.5(pid=11407) [trial-2349↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11407)] [trial-2349↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 20:32:14.118389 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 20:32:14.146832 run osmo-hlr_10.42.42.2(pid=11404): ERR: Terminated: ERROR {rc=237} [trial-2349↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11404)] 20:32:14.197114 run osmo-hlr_10.42.42.2(pid=11404): stdout: | (launched: 2022-12-08_20:32:10.852310) 20:32:14.248900 run osmo-hlr_10.42.42.2(pid=11404): stderr: | [0;m[1;31m20221208203211049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203211049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203211049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203211049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203211049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203211049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203211062 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203211070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203211070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203211070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:32:14.301436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11403): Terminating (SIGTERM) 20:32:14.343434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11406): Terminating (SIGTERM) 20:32:14.385476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11409): Terminating (SIGTERM) 20:32:14.427546 --- ParallelTerminationStrategy: PID 11403 died... 20:32:14.447571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11403): Terminated: ok {rc=0} 20:32:14.494118 --- ParallelTerminationStrategy: PID 11406 died... 20:32:14.513795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11406): Terminated: ok {rc=0} 20:32:14.559736 --- ParallelTerminationStrategy: PID 11409 died... 20:32:14.579392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11409): Terminated: ok {rc=0} 20:32:14.667421 bus /gobi_0: Setting Powered False 20:32:15.766721 bus /gobi_0: Setting Powered False 20:32:16.898462 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 20:32:18.167933 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:32:18.171823 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 20:32:18.206907 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 20:32:18.213645 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 20:32:18.264147 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 20:32:18.299168 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 20:32:18.306449 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 20:32:18.847061 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 20:32:18.852397 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 20:32:18.863853 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:32:18.913384 tst mo_mt_sms.py: using LAC 16628 20:32:19.037695 tst mo_mt_sms.py: using RAC 53 20:32:19.156616 tst mo_mt_sms.py: using CellId 16628 20:32:19.271997 tst mo_mt_sms.py: using BVCI 16629 20:32:19.380521 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:32:19.500265 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:32:19.615445 tst mo_mt_sms.py:9: start nitb and bts... 20:32:19.818510 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:32:20.429465 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11414): Launched 20:32:20.730202 run osmo-nitb_10.42.42.2(pid=11415): Launched 20:32:20.896395 run osmo-nitb_10.42.42.2(pid=11415): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11415)] 20:32:21.031711 run osmo-nitb_10.42.42.2(pid=11415): stdout: | (launched: 2022-12-08_20:32:20.675147) 20:32:21.168134 run osmo-nitb_10.42.42.2(pid=11415): stderr: | (launched: 2022-12-08_20:32:20.719864) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:32:21.305109 run osmo-nitb_10.42.42.2(pid=11415): stdout: | (launched: 2022-12-08_20:32:20.675147) 20:32:21.435355 run osmo-nitb_10.42.42.2(pid=11415): stderr: | (launched: 2022-12-08_20:32:20.719864) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8fda692268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11415): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11415) [trial-2349↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11415)] 20:32:21.842877 tst osmo-nitb_10.42.42.2(pid=11415): stdout: | (launched: 2022-12-08_20:32:20.675147) 20:32:21.963630 tst osmo-nitb_10.42.42.2(pid=11415): stderr: | (launched: 2022-12-08_20:32:20.719864) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:32:22.105813 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=11415): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11415) [trial-2349↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11415)] [trial-2349↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 20:32:22.114306 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 20:32:22.121070 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11414): Terminating (SIGTERM) 20:32:22.330630 --- ParallelTerminationStrategy: PID 11414 died... 20:32:22.351694 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11414): Terminated: ok {rc=0} 20:32:22.438751 bus /sierra_3: Setting Powered False 20:32:23.540383 bus /sierra_3: Setting Powered False 20:32:24.655751 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 sms:trx-sysmocell5000 --------------------------------------------------------------------- 20:32:25.857379 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:32:25.861869 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 20:32:25.896572 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 20:32:25.924075 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 20:32:25.978630 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 20:32:26.013717 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 20:32:26.041039 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 20:32:26.588499 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 20:32:26.593642 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:26.604632 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:32:26.654299 tst mo_mt_sms.py: using LAC 16629 20:32:26.779987 tst mo_mt_sms.py: using RAC 54 20:32:26.898338 tst mo_mt_sms.py: using CellId 16629 20:32:27.018457 tst mo_mt_sms.py: using BVCI 16630 20:32:27.126805 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:27.137882 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:27.148569 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:27.159770 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:27.171027 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:27.182213 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:32:27.302337 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:32:27.418687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:32:27.884296 run create_hlr_db(pid=11419): Launched 20:32:27.998494 bus /sierra_2: Setting Powered False 20:32:29.059028 run create_hlr_db(pid=11419): Terminated: ok {rc=0} 20:32:29.479675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11421): Launched 20:32:29.779850 run osmo-hlr_10.42.42.2(pid=11422): Launched 20:32:29.892906 run osmo-stp_10.42.42.5: Starting osmo-stp 20:32:30.420679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11424): Launched 20:32:30.721479 run osmo-stp_10.42.42.5(pid=11425): Launched 20:32:30.844864 run osmo-msc_10.42.42.6: Starting osmo-msc 20:32:31.513696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11427): Launched 20:32:31.832377 run osmo-msc_10.42.42.6(pid=11428): Launched 20:32:32.050313 run osmo-stp_10.42.42.5(pid=11425): ERR: Terminated: ERROR {rc=1} [trial-2349↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11425)] 20:32:32.317321 run osmo-stp_10.42.42.5(pid=11425): stdout: | (launched: 2022-12-08_20:32:30.665934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:32.456887 run osmo-stp_10.42.42.5(pid=11425): stderr: | [0;m[38;5;43m20221208203230831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203230834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203230835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203230835 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203230836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203230836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203230837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:32.591496 run osmo-stp_10.42.42.5(pid=11425): stdout: | (launched: 2022-12-08_20:32:30.665934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:32.719798 run osmo-stp_10.42.42.5(pid=11425): stderr: | [0;m[38;5;43m20221208203230831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203230834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203230835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203230835 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203230836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203230836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203230837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:32.873076 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=11425): Process ended prematurely: osmo-stp_10.42.42.5(pid=11425) [trial-2349↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11425)] [trial-2349↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 20:32:32.882195 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 20:32:32.909593 run osmo-hlr_10.42.42.2(pid=11422): ERR: Terminated: ERROR {rc=237} [trial-2349↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11422)] 20:32:32.960301 run osmo-hlr_10.42.42.2(pid=11422): stdout: | (launched: 2022-12-08_20:32:29.724936) 20:32:33.012541 run osmo-hlr_10.42.42.2(pid=11422): stderr: | [0;m[1;31m20221208203229895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203229895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203229895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203229895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203229895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203229895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203229907 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203229918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203229918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203229918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:32:33.085494 run osmo-msc_10.42.42.6(pid=11428): ERR: Terminated: ERROR {rc=2} [trial-2349↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11428)] 20:32:33.135946 run osmo-msc_10.42.42.6(pid=11428): stdout: | (launched: 2022-12-08_20:32:31.776221) 20:32:33.188107 run osmo-msc_10.42.42.6(pid=11428): stderr: | [0;m[38;5;43m20221208203232280 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208203232280 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff748db3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208203232280 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208203232280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208203232289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208203232289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208203232291 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208203232291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208203232291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208203232291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:32:33.240584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11421): Terminating (SIGTERM) 20:32:33.282714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11424): Terminating (SIGTERM) 20:32:33.324852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11427): Terminating (SIGTERM) 20:32:33.367347 --- ParallelTerminationStrategy: PID 11421 died... 20:32:33.387720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11421): Terminated: ok {rc=0} 20:32:33.435019 --- ParallelTerminationStrategy: PID 11424 died... 20:32:33.455094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11424): Terminated: ok {rc=0} 20:32:33.501590 --- ParallelTerminationStrategy: PID 11427 died... 20:32:33.521434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11427): Terminated: ok {rc=0} 20:32:33.609862 bus /sierra_3: Setting Powered False 20:32:34.711071 bus /sierra_3: Setting Powered False 20:32:35.827216 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 20:32:37.061735 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:32:37.065931 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 20:32:37.100627 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 20:32:37.107697 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 20:32:37.142457 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 20:32:37.177528 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 20:32:37.184458 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 20:32:37.705623 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2349 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 20:32:37.710859 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 20:32:37.722434 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:32:37.774492 tst assert_extension.py: using LAC 16630 20:32:37.891846 tst assert_extension.py: using RAC 55 20:32:38.007483 tst assert_extension.py: using CellId 16630 20:32:38.132365 tst assert_extension.py: using BVCI 16631 20:32:38.248318 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 20:32:38.364487 tst assert_extension.py:10: start nitb and bts... 20:32:38.566403 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:32:39.179403 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11433): Launched 20:32:39.480378 run osmo-nitb_10.42.42.2(pid=11434): Launched 20:32:39.646583 run osmo-nitb_10.42.42.2(pid=11434): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11434)] 20:32:39.782104 run osmo-nitb_10.42.42.2(pid=11434): stdout: | (launched: 2022-12-08_20:32:39.425475) 20:32:39.919278 run osmo-nitb_10.42.42.2(pid=11434): stderr: | (launched: 2022-12-08_20:32:39.470079) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:32:40.057457 run osmo-nitb_10.42.42.2(pid=11434): stdout: | (launched: 2022-12-08_20:32:39.425475) 20:32:40.188175 run osmo-nitb_10.42.42.2(pid=11434): stderr: | (launched: 2022-12-08_20:32:39.470079) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8fda692268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11434): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11434) [trial-2349↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11434)] 20:32:40.593238 tst osmo-nitb_10.42.42.2(pid=11434): stdout: | (launched: 2022-12-08_20:32:39.425475) 20:32:40.714612 tst osmo-nitb_10.42.42.2(pid=11434): stderr: | (launched: 2022-12-08_20:32:39.470079) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:32:40.857596 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=11434): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11434) [trial-2349↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11434)] [trial-2349↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 20:32:40.866189 tst assert_extension.py:12: Test FAILED (3.1 sec) 20:32:40.872739 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11433): Terminating (SIGTERM) 20:32:41.082427 --- ParallelTerminationStrategy: PID 11433 died... 20:32:41.103481 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11433): Terminated: ok {rc=0} 20:32:41.189018 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 20:32:42.371435 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:32:42.375693 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 20:32:42.410704 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 20:32:42.438303 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 20:32:42.474859 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 20:32:42.509969 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 20:32:42.537634 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 20:32:43.070529 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2349 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 20:32:43.076008 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:43.087401 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:32:43.136706 tst assert_extension.py: using LAC 16631 20:32:43.263322 tst assert_extension.py: using RAC 56 20:32:43.380639 tst assert_extension.py: using CellId 16631 20:32:43.498425 tst assert_extension.py: using BVCI 16632 20:32:43.608717 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:43.619581 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:43.630221 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:43.641146 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:43.651866 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:43.662775 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 20:32:43.782045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:32:44.279610 run create_hlr_db(pid=11438): Launched 20:32:44.412249 bus /sierra_2: Setting Powered False 20:32:45.476124 run create_hlr_db(pid=11438): Terminated: ok {rc=0} 20:32:45.935622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11440): Launched 20:32:46.256351 run osmo-hlr_10.42.42.2(pid=11441): Launched 20:32:46.541372 run osmo-stp_10.42.42.5: Starting osmo-stp 20:32:47.229720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11443): Launched 20:32:47.552903 run osmo-stp_10.42.42.5(pid=11444): Launched 20:32:47.673697 run osmo-msc_10.42.42.6: Starting osmo-msc 20:32:48.245281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11446): Launched 20:32:48.562616 run osmo-msc_10.42.42.6(pid=11447): Launched 20:32:48.738951 run osmo-stp_10.42.42.5(pid=11444): ERR: Terminated: ERROR {rc=1} [trial-2349↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11444)] 20:32:48.872572 run osmo-stp_10.42.42.5(pid=11444): stdout: | (launched: 2022-12-08_20:32:47.494688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:49.006426 run osmo-stp_10.42.42.5(pid=11444): stderr: | [0;m[38;5;43m20221208203247685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203247685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203247685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203247686 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203247686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203247686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203247686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:49.139685 run osmo-stp_10.42.42.5(pid=11444): stdout: | (launched: 2022-12-08_20:32:47.494688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:49.266381 run osmo-stp_10.42.42.5(pid=11444): stderr: | [0;m[38;5;43m20221208203247685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203247685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203247685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203247686 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203247686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203247686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203247686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:49.417309 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=11444): Process ended prematurely: osmo-stp_10.42.42.5(pid=11444) [trial-2349↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11444)] [trial-2349↪ussd:trx-sysmocell5000↪assert_extension.py:17] 20:32:49.426408 tst assert_extension.py:17: Test FAILED (6.3 sec) 20:32:49.454116 run osmo-hlr_10.42.42.2(pid=11441): ERR: Terminated: ERROR {rc=237} [trial-2349↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11441)] 20:32:49.505119 run osmo-hlr_10.42.42.2(pid=11441): stdout: | (launched: 2022-12-08_20:32:46.199079) 20:32:49.557506 run osmo-hlr_10.42.42.2(pid=11441): stderr: | [0;m[1;31m20221208203246449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203246449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203246449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203246449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203246449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203246449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203246466 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203246474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203246474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203246475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:32:49.629902 run osmo-msc_10.42.42.6(pid=11447): ERR: Terminated: ERROR {rc=2} [trial-2349↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11447)] 20:32:49.680443 run osmo-msc_10.42.42.6(pid=11447): stdout: | (launched: 2022-12-08_20:32:48.504297) 20:32:49.732903 run osmo-msc_10.42.42.6(pid=11447): stderr: | [0;m[38;5;43m20221208203248823 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208203248823 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0dd11ebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208203248823 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208203248823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208203248823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208203248824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208203248825 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208203248826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208203248826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208203248826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:32:49.785720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11440): Terminating (SIGTERM) 20:32:49.827756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11443): Terminating (SIGTERM) 20:32:49.870020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11446): Terminating (SIGTERM) 20:32:49.912298 --- ParallelTerminationStrategy: PID 11440 died... 20:32:49.932325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11440): Terminated: ok {rc=0} 20:32:49.978978 --- ParallelTerminationStrategy: PID 11443 died... 20:32:49.998626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11443): Terminated: ok {rc=0} 20:32:50.044921 --- ParallelTerminationStrategy: PID 11446 died... 20:32:50.064870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11446): Terminated: ok {rc=0} 20:32:50.153260 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 20:32:51.368552 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:32:51.375811 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 20:32:51.410945 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 20:32:51.438595 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 20:32:51.490899 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 20:32:51.525769 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 20:32:51.553092 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 20:32:52.107854 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 20:32:52.160479 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:32:52.172437 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:32:52.244633 tst mo_mt_call.py: using LAC 16632 20:32:52.370750 tst mo_mt_call.py: using RAC 57 20:32:52.497414 tst mo_mt_call.py: using CellId 16632 20:32:52.622463 tst mo_mt_call.py: using BVCI 16633 20:32:52.733608 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:32:52.744882 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:32:52.755997 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:32:52.767234 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:32:52.778351 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:32:52.789555 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:32:52.909380 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:32:53.028358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:32:53.530283 run create_hlr_db(pid=11452): Launched 20:32:53.661844 bus /sierra_2: Setting Powered False 20:32:54.726215 run create_hlr_db(pid=11452): Terminated: ok {rc=0} 20:32:55.160107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11454): Launched 20:32:55.464124 run osmo-hlr_10.42.42.2(pid=11455): Launched 20:32:55.579434 run osmo-stp_10.42.42.5: Starting osmo-stp 20:32:56.103457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11457): Launched 20:32:56.405562 run osmo-stp_10.42.42.5(pid=11458): Launched 20:32:56.520766 run osmo-msc_10.42.42.6: Starting osmo-msc 20:32:57.068856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11460): Launched 20:32:57.371414 run osmo-msc_10.42.42.6(pid=11461): Launched 20:32:57.541802 run osmo-stp_10.42.42.5(pid=11458): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11458)] 20:32:57.670587 run osmo-stp_10.42.42.5(pid=11458): stdout: | (launched: 2022-12-08_20:32:56.350012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:57.799456 run osmo-stp_10.42.42.5(pid=11458): stderr: | [0;m[38;5;43m20221208203256516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203256516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203256516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203256517 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203256517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203256517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203256517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:57.925702 run osmo-stp_10.42.42.5(pid=11458): stdout: | (launched: 2022-12-08_20:32:56.350012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:58.045944 run osmo-stp_10.42.42.5(pid=11458): stderr: | [0;m[38;5;43m20221208203256516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203256516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203256516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203256517 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203256517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203256517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203256517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:58.190138 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11458): Process ended prematurely: osmo-stp_10.42.42.5(pid=11458) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11458)] [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 20:32:58.199013 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 20:32:58.226216 run osmo-hlr_10.42.42.2(pid=11455): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11455)] 20:32:58.274568 run osmo-hlr_10.42.42.2(pid=11455): stdout: | (launched: 2022-12-08_20:32:55.408079) 20:32:58.324308 run osmo-hlr_10.42.42.2(pid=11455): stderr: | [0;m[1;31m20221208203255581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203255581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203255581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203255581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203255581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203255581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203255593 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203255602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203255602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203255602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:32:58.393418 run osmo-msc_10.42.42.6(pid=11461): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11461)] 20:32:58.441522 run osmo-msc_10.42.42.6(pid=11461): stdout: | (launched: 2022-12-08_20:32:57.316058) 20:32:58.491708 run osmo-msc_10.42.42.6(pid=11461): stderr: | [0;m[38;5;43m20221208203257584 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208203257584 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7facff481c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208203257585 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208203257585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208203257585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208203257585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208203257587 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208203257587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208203257587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208203257587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:32:58.541989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11454): Terminating (SIGTERM) 20:32:58.581782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11457): Terminating (SIGTERM) 20:32:58.621863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11460): Terminating (SIGTERM) 20:32:58.662219 --- ParallelTerminationStrategy: PID 11454 died... 20:32:58.681422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11454): Terminated: ok {rc=0} 20:32:58.726086 --- ParallelTerminationStrategy: PID 11457 died... 20:32:58.744683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11457): Terminated: ok {rc=0} 20:32:58.789165 --- ParallelTerminationStrategy: PID 11460 died... 20:32:58.807619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11460): Terminated: ok {rc=0} 20:32:58.892033 bus /sierra_3: Setting Powered False 20:32:59.990304 bus /sierra_3: Setting Powered False 20:33:01.129090 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 20:33:02.283422 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:33:02.295336 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:33:02.365690 tst mo_mt_call_osmux.py: using LAC 16633 20:33:02.490933 tst mo_mt_call_osmux.py: using RAC 58 20:33:02.610504 tst mo_mt_call_osmux.py: using CellId 16633 20:33:02.726961 tst mo_mt_call_osmux.py: using BVCI 16634 20:33:02.836600 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:33:02.847912 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:33:02.858995 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:33:02.870362 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:33:02.881834 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:33:02.893182 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:33:03.013641 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:33:03.135759 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:33:03.639520 run create_hlr_db(pid=11464): Launched 20:33:03.771988 bus /sierra_2: Setting Powered False 20:33:04.836692 run create_hlr_db(pid=11464): Terminated: ok {rc=0} 20:33:05.270382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11466): Launched 20:33:05.573685 run osmo-hlr_10.42.42.2(pid=11467): Launched 20:33:05.689807 run osmo-stp_10.42.42.5: Starting osmo-stp 20:33:06.215788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11469): Launched 20:33:06.519586 run osmo-stp_10.42.42.5(pid=11470): Launched 20:33:06.635003 run osmo-msc_10.42.42.6: Starting osmo-msc 20:33:07.181732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11472): Launched 20:33:07.483933 run osmo-msc_10.42.42.6(pid=11473): Launched 20:33:07.653324 run osmo-stp_10.42.42.5(pid=11470): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11470)] 20:33:07.782061 run osmo-stp_10.42.42.5(pid=11470): stdout: | (launched: 2022-12-08_20:33:06.463535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:07.910449 run osmo-stp_10.42.42.5(pid=11470): stderr: | [0;m[38;5;43m20221208203306632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203306632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203306632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203306633 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203306633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203306633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203306633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:08.037214 run osmo-stp_10.42.42.5(pid=11470): stdout: | (launched: 2022-12-08_20:33:06.463535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:08.157226 run osmo-stp_10.42.42.5(pid=11470): stderr: | [0;m[38;5;43m20221208203306632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203306632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203306632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203306633 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203306633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203306633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203306633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:08.300843 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11470): Process ended prematurely: osmo-stp_10.42.42.5(pid=11470) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11470)] [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 20:33:08.309852 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 20:33:08.336319 run osmo-hlr_10.42.42.2(pid=11467): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11467)] 20:33:08.384628 run osmo-hlr_10.42.42.2(pid=11467): stdout: | (launched: 2022-12-08_20:33:05.518305) 20:33:08.434413 run osmo-hlr_10.42.42.2(pid=11467): stderr: | [0;m[1;31m20221208203305690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203305690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203305690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203305690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203305690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203305690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203305703 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203305714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203305714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203305714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:33:08.504086 run osmo-msc_10.42.42.6(pid=11473): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11473)] 20:33:08.552098 run osmo-msc_10.42.42.6(pid=11473): stdout: | (launched: 2022-12-08_20:33:07.428516) 20:33:08.602328 run osmo-msc_10.42.42.6(pid=11473): stderr: | [0;m[38;5;43m20221208203307697 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208203307697 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f130c3d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208203307697 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208203307698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208203307698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208203307698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208203307700 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208203307700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208203307700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208203307700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:33:08.652213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11466): Terminating (SIGTERM) 20:33:08.692503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11469): Terminating (SIGTERM) 20:33:08.732824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11472): Terminating (SIGTERM) 20:33:08.773438 --- ParallelTerminationStrategy: PID 11466 died... 20:33:08.792507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11466): Terminated: ok {rc=0} 20:33:08.837235 --- ParallelTerminationStrategy: PID 11469 died... 20:33:08.855756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11469): Terminated: ok {rc=0} 20:33:08.900501 --- ParallelTerminationStrategy: PID 11472 died... 20:33:08.919268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11472): Terminated: ok {rc=0} 20:33:09.003816 bus /sierra_3: Setting Powered False 20:33:10.099305 bus /sierra_3: Setting Powered False 20:33:11.216160 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 20:33:12.471723 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:33:12.479118 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 20:33:12.514489 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 20:33:12.542280 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 20:33:12.595497 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 20:33:12.629168 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 20:33:12.655711 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 20:33:13.215058 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 20:33:13.267297 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:13.279115 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:33:13.349779 tst mo_mt_call.py: using LAC 16634 20:33:13.479771 tst mo_mt_call.py: using RAC 59 20:33:13.605860 tst mo_mt_call.py: using CellId 16634 20:33:13.732060 tst mo_mt_call.py: using BVCI 16635 20:33:13.850033 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:13.861776 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:13.873312 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:13.885048 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:13.896886 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:13.908640 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:33:14.027318 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:33:14.148368 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:33:14.650229 run create_hlr_db(pid=11478): Launched 20:33:14.781591 bus /sierra_2: Setting Powered False 20:33:15.863776 run create_hlr_db(pid=11478): Terminated: ok {rc=0} 20:33:16.328880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11480): Launched 20:33:16.772174 run osmo-hlr_10.42.42.2(pid=11481): Launched 20:33:16.924048 run osmo-stp_10.42.42.5: Starting osmo-stp 20:33:17.716761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11483): Launched 20:33:18.042838 run osmo-stp_10.42.42.5(pid=11484): Launched 20:33:18.166282 run osmo-msc_10.42.42.6: Starting osmo-msc 20:33:18.757607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11486): Launched 20:33:19.082494 run osmo-msc_10.42.42.6(pid=11487): Launched 20:33:19.262784 run osmo-stp_10.42.42.5(pid=11484): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11484)] 20:33:19.400106 run osmo-stp_10.42.42.5(pid=11484): stdout: | (launched: 2022-12-08_20:33:17.983097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:19.537457 run osmo-stp_10.42.42.5(pid=11484): stderr: | [0;m[38;5;43m20221208203318174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203318174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203318174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203318175 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203318175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203318175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203318175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:19.673571 run osmo-stp_10.42.42.5(pid=11484): stdout: | (launched: 2022-12-08_20:33:17.983097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:19.803490 run osmo-stp_10.42.42.5(pid=11484): stderr: | [0;m[38;5;43m20221208203318174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203318174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203318174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203318175 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203318175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203318175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203318175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:19.957723 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11484): Process ended prematurely: osmo-stp_10.42.42.5(pid=11484) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11484)] [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 20:33:19.967326 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 20:33:19.995253 run osmo-hlr_10.42.42.2(pid=11481): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11481)] 20:33:20.045683 run osmo-hlr_10.42.42.2(pid=11481): stdout: | (launched: 2022-12-08_20:33:16.695113) 20:33:20.098046 run osmo-hlr_10.42.42.2(pid=11481): stderr: | [0;m[1;31m20221208203317093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203317093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203317093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203317093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203317093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203317093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203317110 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203317135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203317136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203317136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:33:20.170940 run osmo-msc_10.42.42.6(pid=11487): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11487)] 20:33:20.221343 run osmo-msc_10.42.42.6(pid=11487): stdout: | (launched: 2022-12-08_20:33:19.023416) 20:33:20.273637 run osmo-msc_10.42.42.6(pid=11487): stderr: | [0;m[38;5;43m20221208203319342 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208203319342 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6210ffec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208203319342 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208203319342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208203319342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208203319342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208203319344 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208203319345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208203319345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208203319345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:33:20.326128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11480): Terminating (SIGTERM) 20:33:20.367942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11483): Terminating (SIGTERM) 20:33:20.409946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11486): Terminating (SIGTERM) 20:33:20.452170 --- ParallelTerminationStrategy: PID 11480 died... 20:33:20.472336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11480): Terminated: ok {rc=0} 20:33:20.519142 --- ParallelTerminationStrategy: PID 11483 died... 20:33:20.538767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11483): Terminated: ok {rc=0} 20:33:20.584857 --- ParallelTerminationStrategy: PID 11486 died... 20:33:20.604778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11486): Terminated: ok {rc=0} 20:33:20.693528 bus /sierra_3: Setting Powered False 20:33:21.793452 bus /sierra_3: Setting Powered False 20:33:22.910784 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 20:33:24.061214 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:24.073618 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:33:24.146449 tst mo_mt_call_osmux.py: using LAC 16635 20:33:24.275849 tst mo_mt_call_osmux.py: using RAC 60 20:33:24.403832 tst mo_mt_call_osmux.py: using CellId 16635 20:33:24.531498 tst mo_mt_call_osmux.py: using BVCI 16636 20:33:24.649918 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:24.661742 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:24.673350 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:24.685117 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:24.696821 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:24.708552 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:33:24.830602 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:33:24.946266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:33:25.415985 run create_hlr_db(pid=11489): Launched 20:33:25.531476 bus /sierra_2: Setting Powered False 20:33:26.591215 run create_hlr_db(pid=11489): Terminated: ok {rc=0} 20:33:27.034907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11491): Launched 20:33:27.362283 run osmo-hlr_10.42.42.2(pid=11492): Launched 20:33:27.487866 run osmo-stp_10.42.42.5: Starting osmo-stp 20:33:28.047413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11494): Launched 20:33:28.371784 run osmo-stp_10.42.42.5(pid=11495): Launched 20:33:28.495258 run osmo-msc_10.42.42.6: Starting osmo-msc 20:33:29.084822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11497): Launched 20:33:29.411073 run osmo-msc_10.42.42.6(pid=11498): Launched 20:33:29.594711 run osmo-stp_10.42.42.5(pid=11495): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11495)] 20:33:29.731991 run osmo-stp_10.42.42.5(pid=11495): stdout: | (launched: 2022-12-08_20:33:28.312623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:29.869990 run osmo-stp_10.42.42.5(pid=11495): stderr: | [0;m[38;5;43m20221208203328501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203328502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203328502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203328502 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203328503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203328503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203328503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:30.006297 run osmo-stp_10.42.42.5(pid=11495): stdout: | (launched: 2022-12-08_20:33:28.312623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:30.135240 run osmo-stp_10.42.42.5(pid=11495): stderr: | [0;m[38;5;43m20221208203328501 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203328502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203328502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203328502 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203328503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203328503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203328503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:30.289876 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11495): Process ended prematurely: osmo-stp_10.42.42.5(pid=11495) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11495)] [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 20:33:30.299358 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:33:30.327083 run osmo-hlr_10.42.42.2(pid=11492): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11492)] 20:33:30.377189 run osmo-hlr_10.42.42.2(pid=11492): stdout: | (launched: 2022-12-08_20:33:27.301880) 20:33:30.428861 run osmo-hlr_10.42.42.2(pid=11492): stderr: | [0;m[1;31m20221208203327498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203327498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203327498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203327498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203327498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203327498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203327510 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203327519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203327520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203327520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:33:30.501084 run osmo-msc_10.42.42.6(pid=11498): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11498)] 20:33:30.551036 run osmo-msc_10.42.42.6(pid=11498): stdout: | (launched: 2022-12-08_20:33:29.352060) 20:33:30.603154 run osmo-msc_10.42.42.6(pid=11498): stderr: | [0;m[38;5;43m20221208203329672 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208203329672 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa283479c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208203329672 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208203329672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208203329672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208203329672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208203329674 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208203329674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208203329675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208203329675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:33:30.655024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11491): Terminating (SIGTERM) 20:33:30.696631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11494): Terminating (SIGTERM) 20:33:30.738960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11497): Terminating (SIGTERM) 20:33:30.781256 --- ParallelTerminationStrategy: PID 11491 died... 20:33:30.801119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11491): Terminated: ok {rc=0} 20:33:30.854409 --- ParallelTerminationStrategy: PID 11494 died... 20:33:30.874664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11494): Terminated: ok {rc=0} 20:33:30.939375 --- ParallelTerminationStrategy: PID 11497 died... 20:33:30.959159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11497): Terminated: ok {rc=0} 20:33:31.051224 bus /sierra_3: Setting Powered False 20:33:32.157975 bus /sierra_3: Setting Powered False 20:33:33.276827 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 20:33:34.523048 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:33:34.529682 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 20:33:34.564457 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 20:33:34.591524 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 20:33:34.641733 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 20:33:34.675557 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 20:33:34.702567 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 20:33:35.254868 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 20:33:35.303677 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:35.315119 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:33:35.383684 tst mo_mt_call.py: using LAC 16636 20:33:35.501273 tst mo_mt_call.py: using RAC 61 20:33:35.619016 tst mo_mt_call.py: using CellId 16636 20:33:35.736682 tst mo_mt_call.py: using BVCI 16637 20:33:35.846537 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:35.857852 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:35.868822 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:35.880159 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:35.891610 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:35.902674 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:33:36.023439 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:33:36.141824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:33:36.611848 run create_hlr_db(pid=11503): Launched 20:33:36.726859 bus /sierra_2: Setting Powered False 20:33:37.787844 run create_hlr_db(pid=11503): Terminated: ok {rc=0} 20:33:38.232783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11505): Launched 20:33:38.558921 run osmo-hlr_10.42.42.2(pid=11506): Launched 20:33:38.686257 run osmo-stp_10.42.42.5: Starting osmo-stp 20:33:39.251567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11508): Launched 20:33:39.576661 run osmo-stp_10.42.42.5(pid=11509): Launched 20:33:39.702591 run osmo-msc_10.42.42.6: Starting osmo-msc 20:33:40.290601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11511): Launched 20:33:40.617593 run osmo-msc_10.42.42.6(pid=11512): Launched 20:33:40.799669 run osmo-stp_10.42.42.5(pid=11509): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11509)] 20:33:40.937423 run osmo-stp_10.42.42.5(pid=11509): stdout: | (launched: 2022-12-08_20:33:39.517240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:41.075289 run osmo-stp_10.42.42.5(pid=11509): stderr: | [0;m[38;5;43m20221208203339709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203339709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203339709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203339710 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203339710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203339710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203339710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:41.211697 run osmo-stp_10.42.42.5(pid=11509): stdout: | (launched: 2022-12-08_20:33:39.517240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:41.341263 run osmo-stp_10.42.42.5(pid=11509): stderr: | [0;m[38;5;43m20221208203339709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203339709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203339709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203339710 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203339710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203339710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203339710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:41.495939 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11509): Process ended prematurely: osmo-stp_10.42.42.5(pid=11509) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11509)] [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 20:33:41.505622 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:33:41.533314 run osmo-hlr_10.42.42.2(pid=11506): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11506)] 20:33:41.583874 run osmo-hlr_10.42.42.2(pid=11506): stdout: | (launched: 2022-12-08_20:33:38.499323) 20:33:41.635739 run osmo-hlr_10.42.42.2(pid=11506): stderr: | [0;m[1;31m20221208203338695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203338695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203338695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203338695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203338695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203338695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203338713 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203338722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203338722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203338722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:33:41.708164 run osmo-msc_10.42.42.6(pid=11512): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11512)] 20:33:41.758838 run osmo-msc_10.42.42.6(pid=11512): stdout: | (launched: 2022-12-08_20:33:40.558177) 20:33:41.811367 run osmo-msc_10.42.42.6(pid=11512): stderr: | [0;m[38;5;43m20221208203340881 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208203340881 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3dc4e67c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208203340881 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208203340882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208203340882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208203340882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208203340884 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208203340884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208203340884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208203340884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:33:41.863592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11505): Terminating (SIGTERM) 20:33:41.905935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11508): Terminating (SIGTERM) 20:33:41.947973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11511): Terminating (SIGTERM) 20:33:41.990328 --- ParallelTerminationStrategy: PID 11505 died... 20:33:42.010352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11505): Terminated: ok {rc=0} 20:33:42.056552 --- ParallelTerminationStrategy: PID 11508 died... 20:33:42.076182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11508): Terminated: ok {rc=0} 20:33:42.122200 --- ParallelTerminationStrategy: PID 11511 died... 20:33:42.141742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11511): Terminated: ok {rc=0} 20:33:42.229839 bus /sierra_3: Setting Powered False 20:33:43.328395 bus /sierra_3: Setting Powered False 20:33:44.444425 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 20:33:45.589752 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:45.601762 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:33:45.673414 tst mo_mt_call_osmux.py: using LAC 16637 20:33:45.794293 tst mo_mt_call_osmux.py: using RAC 62 20:33:45.931382 tst mo_mt_call_osmux.py: using CellId 16637 20:33:46.067026 tst mo_mt_call_osmux.py: using BVCI 16638 20:33:46.180059 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:46.192547 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:46.204870 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:46.217848 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:46.231048 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:46.243896 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:33:46.372873 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:33:46.496573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:33:47.017846 run create_hlr_db(pid=11514): Launched 20:33:47.175643 bus /sierra_2: Setting Powered False 20:33:48.235740 run create_hlr_db(pid=11514): Terminated: ok {rc=0} 20:33:48.682284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11516): Launched 20:33:49.009723 run osmo-hlr_10.42.42.2(pid=11517): Launched 20:33:49.133679 run osmo-stp_10.42.42.5: Starting osmo-stp 20:33:49.698328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11519): Launched 20:33:50.023965 run osmo-stp_10.42.42.5(pid=11520): Launched 20:33:50.147435 run osmo-msc_10.42.42.6: Starting osmo-msc 20:33:50.735780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11522): Launched 20:33:51.062266 run osmo-msc_10.42.42.6(pid=11523): Launched 20:33:51.244323 run osmo-stp_10.42.42.5(pid=11520): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11520)] 20:33:51.383022 run osmo-stp_10.42.42.5(pid=11520): stdout: | (launched: 2022-12-08_20:33:49.964703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:51.522393 run osmo-stp_10.42.42.5(pid=11520): stderr: | [0;m[38;5;43m20221208203350153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203350153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203350154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203350154 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203350155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203350155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203350155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:51.659329 run osmo-stp_10.42.42.5(pid=11520): stdout: | (launched: 2022-12-08_20:33:49.964703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:51.789335 run osmo-stp_10.42.42.5(pid=11520): stderr: | [0;m[38;5;43m20221208203350153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203350153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203350154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203350154 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203350155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203350155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203350155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:51.944866 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11520): Process ended prematurely: osmo-stp_10.42.42.5(pid=11520) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11520)] [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 20:33:51.954689 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 20:33:51.982584 run osmo-hlr_10.42.42.2(pid=11517): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11517)] 20:33:52.033144 run osmo-hlr_10.42.42.2(pid=11517): stdout: | (launched: 2022-12-08_20:33:48.950393) 20:33:52.085445 run osmo-hlr_10.42.42.2(pid=11517): stderr: | [0;m[1;31m20221208203349147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203349147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203349147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203349147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203349147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203349147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203349160 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203349170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203349170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203349170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:33:52.158164 run osmo-msc_10.42.42.6(pid=11523): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11523)] 20:33:52.208539 run osmo-msc_10.42.42.6(pid=11523): stdout: | (launched: 2022-12-08_20:33:51.002968) 20:33:52.260411 run osmo-msc_10.42.42.6(pid=11523): stderr: | [0;m[38;5;43m20221208203351321 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208203351322 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fed29225c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208203351322 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208203351322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208203351322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208203351322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208203351324 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208203351324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208203351324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208203351324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:33:52.312764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11516): Terminating (SIGTERM) 20:33:52.354709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11519): Terminating (SIGTERM) 20:33:52.396483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11522): Terminating (SIGTERM) 20:33:52.438622 --- ParallelTerminationStrategy: PID 11516 died... 20:33:52.458721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11516): Terminated: ok {rc=0} 20:33:52.505057 --- ParallelTerminationStrategy: PID 11519 died... 20:33:52.524682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11519): Terminated: ok {rc=0} 20:33:52.570651 --- ParallelTerminationStrategy: PID 11522 died... 20:33:52.590210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11522): Terminated: ok {rc=0} 20:33:52.678396 bus /sierra_3: Setting Powered False 20:33:53.776848 bus /sierra_3: Setting Powered False 20:33:54.894484 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 20:33:56.152589 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:33:56.159633 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 20:33:56.194251 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 20:33:56.221587 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 20:33:56.274613 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 20:33:56.309475 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 20:33:56.337150 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 20:33:56.895302 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 20:33:56.947026 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:33:56.958858 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:33:57.031205 tst mo_mt_call.py: using LAC 16638 20:33:57.160320 tst mo_mt_call.py: using RAC 63 20:33:57.293740 tst mo_mt_call.py: using CellId 16638 20:33:57.420392 tst mo_mt_call.py: using BVCI 16639 20:33:57.538443 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:33:57.550188 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:33:57.561818 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:33:57.573358 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:33:57.584924 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:33:57.596536 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:33:57.712255 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:33:57.833340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:33:58.302891 run create_hlr_db(pid=11530): Launched 20:33:58.419358 bus /sierra_2: Setting Powered False 20:33:59.479388 run create_hlr_db(pid=11530): Terminated: ok {rc=0} 20:33:59.902184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11532): Launched 20:34:00.204754 run osmo-hlr_10.42.42.2(pid=11533): Launched 20:34:00.320620 run osmo-stp_10.42.42.5: Starting osmo-stp 20:34:00.860192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11535): Launched 20:34:01.207408 run osmo-stp_10.42.42.5(pid=11536): Launched 20:34:01.371116 run osmo-msc_10.42.42.6: Starting osmo-msc 20:34:02.109842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11538): Launched 20:34:02.430923 run osmo-msc_10.42.42.6(pid=11539): Launched 20:34:02.600388 run osmo-stp_10.42.42.5(pid=11536): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11536)] 20:34:02.729175 run osmo-stp_10.42.42.5(pid=11536): stdout: | (launched: 2022-12-08_20:34:01.148139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:02.858357 run osmo-stp_10.42.42.5(pid=11536): stderr: | [0;m[38;5;43m20221208203401456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203401456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203401457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203401457 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203401458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203401458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203401458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:02.985450 run osmo-stp_10.42.42.5(pid=11536): stdout: | (launched: 2022-12-08_20:34:01.148139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:03.106396 run osmo-stp_10.42.42.5(pid=11536): stderr: | [0;m[38;5;43m20221208203401456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203401456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203401457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203401457 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203401458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203401458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203401458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:03.251200 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11536): Process ended prematurely: osmo-stp_10.42.42.5(pid=11536) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11536)] [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 20:34:03.259941 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:34:03.286768 run osmo-hlr_10.42.42.2(pid=11533): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11533)] 20:34:03.334893 run osmo-hlr_10.42.42.2(pid=11533): stdout: | (launched: 2022-12-08_20:34:00.149403) 20:34:03.384667 run osmo-hlr_10.42.42.2(pid=11533): stderr: | [0;m[1;31m20221208203400322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203400322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203400322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203400322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203400322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203400322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203400335 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203400344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203400344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203400344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:34:03.454012 run osmo-msc_10.42.42.6(pid=11539): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11539)] 20:34:03.502355 run osmo-msc_10.42.42.6(pid=11539): stdout: | (launched: 2022-12-08_20:34:02.375046) 20:34:03.552211 run osmo-msc_10.42.42.6(pid=11539): stderr: | [0;m[38;5;43m20221208203402644 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208203402644 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe87c918c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208203402644 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208203402644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208203402644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208203402645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208203402646 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208203402647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208203402647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208203402647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:34:03.602439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11532): Terminating (SIGTERM) 20:34:03.642387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11535): Terminating (SIGTERM) 20:34:03.682394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11538): Terminating (SIGTERM) 20:34:03.722776 --- ParallelTerminationStrategy: PID 11532 died... 20:34:03.741903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11532): Terminated: ok {rc=0} 20:34:03.786305 --- ParallelTerminationStrategy: PID 11535 died... 20:34:03.804758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11535): Terminated: ok {rc=0} 20:34:03.849243 --- ParallelTerminationStrategy: PID 11538 died... 20:34:03.867817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11538): Terminated: ok {rc=0} 20:34:03.953742 bus /sierra_3: Setting Powered False 20:34:05.054399 bus /sierra_3: Setting Powered False 20:34:06.172038 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 20:34:07.318480 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:34:07.330423 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:34:07.401449 tst mo_mt_call_osmux.py: using LAC 16639 20:34:07.522038 tst mo_mt_call_osmux.py: using RAC 64 20:34:07.643525 tst mo_mt_call_osmux.py: using CellId 16639 20:34:07.764236 tst mo_mt_call_osmux.py: using BVCI 16640 20:34:07.874212 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:34:07.885644 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:34:07.896604 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:34:07.907917 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:34:07.919303 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:34:07.930720 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:34:08.051363 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:34:08.172580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:34:08.678555 run create_hlr_db(pid=11542): Launched 20:34:08.811595 bus /sierra_2: Setting Powered False 20:34:09.876796 run create_hlr_db(pid=11542): Terminated: ok {rc=0} 20:34:10.330287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11544): Launched 20:34:10.657056 run osmo-hlr_10.42.42.2(pid=11545): Launched 20:34:10.781284 run osmo-stp_10.42.42.5: Starting osmo-stp 20:34:11.347491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11547): Launched 20:34:11.673979 run osmo-stp_10.42.42.5(pid=11548): Launched 20:34:11.799742 run osmo-msc_10.42.42.6: Starting osmo-msc 20:34:12.425416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11550): Launched 20:34:12.751742 run osmo-msc_10.42.42.6(pid=11551): Launched 20:34:12.933324 run osmo-stp_10.42.42.5(pid=11548): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11548)] 20:34:13.071008 run osmo-stp_10.42.42.5(pid=11548): stdout: | (launched: 2022-12-08_20:34:11.614736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:13.210139 run osmo-stp_10.42.42.5(pid=11548): stderr: | [0;m[38;5;43m20221208203411803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203411803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203411804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203411804 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203411805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203411805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203411805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:13.347052 run osmo-stp_10.42.42.5(pid=11548): stdout: | (launched: 2022-12-08_20:34:11.614736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:13.476414 run osmo-stp_10.42.42.5(pid=11548): stderr: | [0;m[38;5;43m20221208203411803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203411803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203411804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203411804 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203411805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203411805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203411805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:13.631509 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11548): Process ended prematurely: osmo-stp_10.42.42.5(pid=11548) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11548)] [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 20:34:13.641122 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 20:34:13.668792 run osmo-hlr_10.42.42.2(pid=11545): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11545)] 20:34:13.718906 run osmo-hlr_10.42.42.2(pid=11545): stdout: | (launched: 2022-12-08_20:34:10.597311) 20:34:13.771284 run osmo-hlr_10.42.42.2(pid=11545): stderr: | [0;m[1;31m20221208203410794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203410794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203410794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203410794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203410794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203410794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203410807 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203410817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203410818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203410818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:34:13.844004 run osmo-msc_10.42.42.6(pid=11551): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11551)] 20:34:13.894198 run osmo-msc_10.42.42.6(pid=11551): stdout: | (launched: 2022-12-08_20:34:12.691917) 20:34:13.946052 run osmo-msc_10.42.42.6(pid=11551): stderr: | [0;m[38;5;43m20221208203413012 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208203413013 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9f2352ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208203413013 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208203413013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208203413013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208203413013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208203413015 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208203413015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208203413015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208203413015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:34:13.998271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11544): Terminating (SIGTERM) 20:34:14.039962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11547): Terminating (SIGTERM) 20:34:14.081945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11550): Terminating (SIGTERM) 20:34:14.124183 --- ParallelTerminationStrategy: PID 11544 died... 20:34:14.144211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11544): Terminated: ok {rc=0} 20:34:14.190833 --- ParallelTerminationStrategy: PID 11547 died... 20:34:14.210356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11547): Terminated: ok {rc=0} 20:34:14.256417 --- ParallelTerminationStrategy: PID 11550 died... 20:34:14.275929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11550): Terminated: ok {rc=0} 20:34:14.364244 bus /sierra_3: Setting Powered False 20:34:15.462666 bus /sierra_3: Setting Powered False 20:34:16.582904 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 20:34:17.839847 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:34:17.847752 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 20:34:17.882168 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 20:34:17.908651 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 20:34:17.958654 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 20:34:17.992427 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 20:34:18.019261 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 20:34:18.573600 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 20:34:18.622435 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:18.633793 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:34:18.702701 tst mo_mt_call.py: using LAC 16640 20:34:18.821919 tst mo_mt_call.py: using RAC 65 20:34:18.941222 tst mo_mt_call.py: using CellId 16640 20:34:19.058256 tst mo_mt_call.py: using BVCI 16641 20:34:19.170626 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:19.182053 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:19.193169 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:19.204453 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:19.215920 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:19.227377 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:34:19.348263 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:34:19.468726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:34:19.976453 run create_hlr_db(pid=11557): Launched 20:34:20.109682 bus /sierra_2: Setting Powered False 20:34:21.174546 run create_hlr_db(pid=11557): Terminated: ok {rc=0} 20:34:21.627893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11559): Launched 20:34:21.954380 run osmo-hlr_10.42.42.2(pid=11560): Launched 20:34:22.079087 run osmo-stp_10.42.42.5: Starting osmo-stp 20:34:22.638683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11562): Launched 20:34:22.965428 run osmo-stp_10.42.42.5(pid=11563): Launched 20:34:23.090446 run osmo-msc_10.42.42.6: Starting osmo-msc 20:34:23.679208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11565): Launched 20:34:24.005746 run osmo-msc_10.42.42.6(pid=11566): Launched 20:34:24.187649 run osmo-stp_10.42.42.5(pid=11563): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11563)] 20:34:24.324686 run osmo-stp_10.42.42.5(pid=11563): stdout: | (launched: 2022-12-08_20:34:22.906066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:24.461831 run osmo-stp_10.42.42.5(pid=11563): stderr: | [0;m[38;5;43m20221208203423095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203423095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203423096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203423096 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203423096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203423097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203423097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:24.597974 run osmo-stp_10.42.42.5(pid=11563): stdout: | (launched: 2022-12-08_20:34:22.906066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:24.727309 run osmo-stp_10.42.42.5(pid=11563): stderr: | [0;m[38;5;43m20221208203423095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203423095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203423096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203423096 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203423096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203423097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203423097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:24.882206 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11563): Process ended prematurely: osmo-stp_10.42.42.5(pid=11563) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11563)] [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 20:34:24.891817 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:34:24.919985 run osmo-hlr_10.42.42.2(pid=11560): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11560)] 20:34:24.970189 run osmo-hlr_10.42.42.2(pid=11560): stdout: | (launched: 2022-12-08_20:34:21.895077) 20:34:25.021848 run osmo-hlr_10.42.42.2(pid=11560): stderr: | [0;m[1;31m20221208203422091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203422091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203422091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203422091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203422091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203422091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203422103 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203422112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203422112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203422112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:34:25.093959 run osmo-msc_10.42.42.6(pid=11566): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11566)] 20:34:25.144029 run osmo-msc_10.42.42.6(pid=11566): stdout: | (launched: 2022-12-08_20:34:23.946443) 20:34:25.196186 run osmo-msc_10.42.42.6(pid=11566): stderr: | [0;m[38;5;43m20221208203424267 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208203424267 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe5b0debc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208203424267 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208203424267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208203424267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208203424268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208203424269 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208203424270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208203424270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208203424270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:34:25.248468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11559): Terminating (SIGTERM) 20:34:25.290446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11562): Terminating (SIGTERM) 20:34:25.332589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11565): Terminating (SIGTERM) 20:34:25.375421 --- ParallelTerminationStrategy: PID 11559 died... 20:34:25.395636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11559): Terminated: ok {rc=0} 20:34:25.441799 --- ParallelTerminationStrategy: PID 11562 died... 20:34:25.461376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11562): Terminated: ok {rc=0} 20:34:25.507638 --- ParallelTerminationStrategy: PID 11565 died... 20:34:25.527264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11565): Terminated: ok {rc=0} 20:34:25.615022 bus /sierra_3: Setting Powered False 20:34:26.714220 bus /sierra_3: Setting Powered False 20:34:27.831326 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 20:34:28.979754 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:28.992112 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:34:29.064827 tst mo_mt_call_osmux.py: using LAC 16641 20:34:29.185368 tst mo_mt_call_osmux.py: using RAC 66 20:34:29.306429 tst mo_mt_call_osmux.py: using CellId 16641 20:34:29.425429 tst mo_mt_call_osmux.py: using BVCI 16642 20:34:29.544881 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:29.556860 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:29.568703 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:29.580558 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:29.592514 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:29.604347 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:34:29.725881 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:34:29.845634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:34:30.318504 run create_hlr_db(pid=11568): Launched 20:34:30.436634 bus /sierra_2: Setting Powered False 20:34:31.504887 run create_hlr_db(pid=11568): Terminated: ok {rc=0} 20:34:31.936159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11570): Launched 20:34:32.261158 run osmo-hlr_10.42.42.2(pid=11571): Launched 20:34:32.378066 run osmo-stp_10.42.42.5: Starting osmo-stp 20:34:32.904834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11573): Launched 20:34:33.209655 run osmo-stp_10.42.42.5(pid=11574): Launched 20:34:33.327169 run osmo-msc_10.42.42.6: Starting osmo-msc 20:34:33.880797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11576): Launched 20:34:34.186853 run osmo-msc_10.42.42.6(pid=11577): Launched 20:34:34.358312 run osmo-stp_10.42.42.5(pid=11574): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11574)] 20:34:34.488199 run osmo-stp_10.42.42.5(pid=11574): stdout: | (launched: 2022-12-08_20:34:33.153952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:34.617527 run osmo-stp_10.42.42.5(pid=11574): stderr: | [0;m[38;5;43m20221208203433321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203433321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203433321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203433322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203433322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203433322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203433322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:34.744916 run osmo-stp_10.42.42.5(pid=11574): stdout: | (launched: 2022-12-08_20:34:33.153952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:34.866632 run osmo-stp_10.42.42.5(pid=11574): stderr: | [0;m[38;5;43m20221208203433321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203433321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203433321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203433322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203433322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203433322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203433322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:35.011682 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11574): Process ended prematurely: osmo-stp_10.42.42.5(pid=11574) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11574)] [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 20:34:35.020732 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 20:34:35.047707 run osmo-hlr_10.42.42.2(pid=11571): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11571)] 20:34:35.095685 run osmo-hlr_10.42.42.2(pid=11571): stdout: | (launched: 2022-12-08_20:34:32.204210) 20:34:35.145593 run osmo-hlr_10.42.42.2(pid=11571): stderr: | [0;m[1;31m20221208203432378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203432378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203432378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203432378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203432378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203432378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203432390 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203432398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203432398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203432398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:34:35.215392 run osmo-msc_10.42.42.6(pid=11577): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11577)] 20:34:35.263914 run osmo-msc_10.42.42.6(pid=11577): stdout: | (launched: 2022-12-08_20:34:34.130853) 20:34:35.313605 run osmo-msc_10.42.42.6(pid=11577): stderr: | [0;m[38;5;43m20221208203434402 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208203434402 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb80022ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208203434403 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208203434403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208203434403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208203434403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208203434405 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208203434405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208203434405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208203434405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:34:35.363808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11570): Terminating (SIGTERM) 20:34:35.403570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11573): Terminating (SIGTERM) 20:34:35.443403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11576): Terminating (SIGTERM) 20:34:35.483338 --- ParallelTerminationStrategy: PID 11570 died... 20:34:35.502422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11570): Terminated: ok {rc=0} 20:34:35.546728 --- ParallelTerminationStrategy: PID 11573 died... 20:34:35.565246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11573): Terminated: ok {rc=0} 20:34:35.609559 --- ParallelTerminationStrategy: PID 11576 died... 20:34:35.628033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11576): Terminated: ok {rc=0} 20:34:35.713642 bus /sierra_3: Setting Powered False 20:34:36.813217 bus /sierra_3: Setting Powered False 20:34:37.928458 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:34:39.187398 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:34:39.195812 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:34:39.230605 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 20:34:39.257913 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:34:39.310502 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:34:39.344940 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 20:34:39.372233 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:34:39.928143 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 20:34:39.981054 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:34:39.992724 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:34:40.064598 tst mo_mt_call.py: using LAC 16642 20:34:40.191463 tst mo_mt_call.py: using RAC 67 20:34:40.320439 tst mo_mt_call.py: using CellId 16642 20:34:40.452146 tst mo_mt_call.py: using BVCI 16643 20:34:40.571676 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:34:40.583457 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:34:40.595008 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:34:40.606595 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:34:40.618292 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:34:40.629897 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:34:40.747060 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:34:40.865362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:34:41.336674 run create_hlr_db(pid=11582): Launched 20:34:41.454639 bus /sierra_2: Setting Powered False 20:34:42.515190 run create_hlr_db(pid=11582): Terminated: ok {rc=0} 20:34:42.939485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11584): Launched 20:34:43.243329 run osmo-hlr_10.42.42.2(pid=11585): Launched 20:34:43.359681 run osmo-stp_10.42.42.5: Starting osmo-stp 20:34:43.895119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11587): Launched 20:34:44.200585 run osmo-stp_10.42.42.5(pid=11588): Launched 20:34:44.315976 run osmo-msc_10.42.42.6: Starting osmo-msc 20:34:44.865477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11590): Launched 20:34:45.172676 run osmo-msc_10.42.42.6(pid=11591): Launched 20:34:45.342705 run osmo-stp_10.42.42.5(pid=11588): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11588)] 20:34:45.472049 run osmo-stp_10.42.42.5(pid=11588): stdout: | (launched: 2022-12-08_20:34:44.145080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:45.601547 run osmo-stp_10.42.42.5(pid=11588): stderr: | [0;m[38;5;43m20221208203444312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203444312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203444312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203444313 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203444313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203444313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203444313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:45.729441 run osmo-stp_10.42.42.5(pid=11588): stdout: | (launched: 2022-12-08_20:34:44.145080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:45.851219 run osmo-stp_10.42.42.5(pid=11588): stderr: | [0;m[38;5;43m20221208203444312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203444312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203444312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203444313 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203444313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203444313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203444313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:46.002800 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11588): Process ended prematurely: osmo-stp_10.42.42.5(pid=11588) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11588)] [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 20:34:46.013053 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 20:34:46.041753 run osmo-hlr_10.42.42.2(pid=11585): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11585)] 20:34:46.091611 run osmo-hlr_10.42.42.2(pid=11585): stdout: | (launched: 2022-12-08_20:34:43.187745) 20:34:46.143283 run osmo-hlr_10.42.42.2(pid=11585): stderr: | [0;m[1;31m20221208203443362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203443362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203443362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203443362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203443362 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203443363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203443374 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203443382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203443383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203443383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:34:46.214894 run osmo-msc_10.42.42.6(pid=11591): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11591)] 20:34:46.264910 run osmo-msc_10.42.42.6(pid=11591): stdout: | (launched: 2022-12-08_20:34:45.114758) 20:34:46.316527 run osmo-msc_10.42.42.6(pid=11591): stderr: | [0;m[38;5;43m20221208203445386 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208203445386 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f89fdae0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208203445386 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208203445386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208203445386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208203445387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208203445388 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208203445389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208203445389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208203445389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:34:46.382805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11584): Terminating (SIGTERM) 20:34:46.439260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11587): Terminating (SIGTERM) 20:34:46.497804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11590): Terminating (SIGTERM) 20:34:46.555242 --- ParallelTerminationStrategy: PID 11584 died... 20:34:46.581831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11584): Terminated: ok {rc=0} 20:34:46.643822 --- ParallelTerminationStrategy: PID 11587 died... 20:34:46.671076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11587): Terminated: ok {rc=0} 20:34:46.732017 --- ParallelTerminationStrategy: PID 11590 died... 20:34:46.755217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11590): Terminated: ok {rc=0} 20:34:46.871651 bus /sierra_3: Setting Powered False 20:34:47.987014 bus /sierra_3: Setting Powered False 20:34:49.102246 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 20:34:50.249864 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:34:50.262302 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:34:50.335024 tst mo_mt_call_osmux.py: using LAC 16643 20:34:50.463991 tst mo_mt_call_osmux.py: using RAC 68 20:34:50.591583 tst mo_mt_call_osmux.py: using CellId 16643 20:34:50.719229 tst mo_mt_call_osmux.py: using BVCI 16644 20:34:50.840026 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:34:50.851848 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:34:50.863568 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:34:50.875174 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:34:50.886938 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:34:50.898584 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:34:51.016918 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:34:51.139042 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:34:51.644810 run create_hlr_db(pid=11593): Launched 20:34:51.777104 bus /sierra_2: Setting Powered False 20:34:52.842080 run create_hlr_db(pid=11593): Terminated: ok {rc=0} 20:34:53.276594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11595): Launched 20:34:53.582362 run osmo-hlr_10.42.42.2(pid=11596): Launched 20:34:53.698719 run osmo-stp_10.42.42.5: Starting osmo-stp 20:34:54.238995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11598): Launched 20:34:54.543859 run osmo-stp_10.42.42.5(pid=11599): Launched 20:34:54.660546 run osmo-msc_10.42.42.6: Starting osmo-msc 20:34:55.213294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11601): Launched 20:34:55.518886 run osmo-msc_10.42.42.6(pid=11602): Launched 20:34:55.689970 run osmo-stp_10.42.42.5(pid=11599): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11599)] 20:34:55.819953 run osmo-stp_10.42.42.5(pid=11599): stdout: | (launched: 2022-12-08_20:34:54.487763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:55.949310 run osmo-stp_10.42.42.5(pid=11599): stderr: | [0;m[38;5;43m20221208203454654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203454654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203454655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203454655 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203454655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203454655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203454656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:56.076888 run osmo-stp_10.42.42.5(pid=11599): stdout: | (launched: 2022-12-08_20:34:54.487763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:56.197597 run osmo-stp_10.42.42.5(pid=11599): stderr: | [0;m[38;5;43m20221208203454654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203454654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203454655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203454655 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203454655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203454655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203454656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:56.342613 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11599): Process ended prematurely: osmo-stp_10.42.42.5(pid=11599) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11599)] [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 20:34:56.351500 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 20:34:56.377986 run osmo-hlr_10.42.42.2(pid=11596): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11596)] 20:34:56.426139 run osmo-hlr_10.42.42.2(pid=11596): stdout: | (launched: 2022-12-08_20:34:53.526554) 20:34:56.475774 run osmo-hlr_10.42.42.2(pid=11596): stderr: | [0;m[1;31m20221208203453700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203453700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203453700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203453700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203453700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203453700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203453712 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203453720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203453721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203453721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:34:56.544818 run osmo-msc_10.42.42.6(pid=11602): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11602)] 20:34:56.592633 run osmo-msc_10.42.42.6(pid=11602): stdout: | (launched: 2022-12-08_20:34:55.462615) 20:34:56.641880 run osmo-msc_10.42.42.6(pid=11602): stderr: | [0;m[38;5;43m20221208203455733 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208203455733 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7385ed6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208203455733 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208203455733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208203455734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208203455734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208203455735 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208203455736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208203455736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208203455736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:34:56.691679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11595): Terminating (SIGTERM) 20:34:56.731698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11598): Terminating (SIGTERM) 20:34:56.771557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11601): Terminating (SIGTERM) 20:34:56.811599 --- ParallelTerminationStrategy: PID 11595 died... 20:34:56.830513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11595): Terminated: ok {rc=0} 20:34:56.874842 --- ParallelTerminationStrategy: PID 11598 died... 20:34:56.893195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11598): Terminated: ok {rc=0} 20:34:56.937359 --- ParallelTerminationStrategy: PID 11601 died... 20:34:56.955904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11601): Terminated: ok {rc=0} 20:34:57.042332 bus /sierra_3: Setting Powered False 20:34:58.140986 bus /sierra_3: Setting Powered False 20:34:59.256459 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:35:00.513479 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:35:00.519632 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:35:00.555656 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 20:35:00.583414 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 20:35:00.638975 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:35:00.674056 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 20:35:00.701486 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 20:35:01.254872 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 20:35:01.309197 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:01.325081 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:35:01.413055 tst mo_mt_call.py: using LAC 16644 20:35:01.536835 tst mo_mt_call.py: using RAC 69 20:35:01.671238 tst mo_mt_call.py: using CellId 16644 20:35:01.805297 tst mo_mt_call.py: using BVCI 16645 20:35:01.931866 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:01.944175 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:01.956379 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:01.968575 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:01.980907 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:01.993716 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:35:02.126281 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:35:02.243414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:35:02.718743 run create_hlr_db(pid=11610): Launched 20:35:02.834900 bus /sierra_2: Setting Powered False 20:35:03.895101 run create_hlr_db(pid=11610): Terminated: ok {rc=0} 20:35:04.340850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11612): Launched 20:35:04.670236 run osmo-hlr_10.42.42.2(pid=11613): Launched 20:35:04.796631 run osmo-stp_10.42.42.5: Starting osmo-stp 20:35:05.365283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11615): Launched 20:35:05.691900 run osmo-stp_10.42.42.5(pid=11616): Launched 20:35:05.815816 run osmo-msc_10.42.42.6: Starting osmo-msc 20:35:06.406832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11618): Launched 20:35:06.734569 run osmo-msc_10.42.42.6(pid=11619): Launched 20:35:06.917269 run osmo-stp_10.42.42.5(pid=11616): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11616)] 20:35:07.055297 run osmo-stp_10.42.42.5(pid=11616): stdout: | (launched: 2022-12-08_20:35:05.632129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:35:07.194604 run osmo-stp_10.42.42.5(pid=11616): stderr: | [0;m[38;5;43m20221208203505822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203505822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203505823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203505823 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203505823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203505824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203505824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:35:07.331216 run osmo-stp_10.42.42.5(pid=11616): stdout: | (launched: 2022-12-08_20:35:05.632129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:35:07.460763 run osmo-stp_10.42.42.5(pid=11616): stderr: | [0;m[38;5;43m20221208203505822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203505822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203505823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203505823 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203505823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203505824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203505824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:35:07.616736 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11616): Process ended prematurely: osmo-stp_10.42.42.5(pid=11616) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11616)] [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 20:35:07.626434 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:35:07.654075 run osmo-hlr_10.42.42.2(pid=11613): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11613)] 20:35:07.704666 run osmo-hlr_10.42.42.2(pid=11613): stdout: | (launched: 2022-12-08_20:35:04.610103) 20:35:07.756766 run osmo-hlr_10.42.42.2(pid=11613): stderr: | [0;m[1;31m20221208203504805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203504805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203504805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203504805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203504805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203504805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203504817 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203504826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203504827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203504827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:35:07.829958 run osmo-msc_10.42.42.6(pid=11619): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11619)] 20:35:07.880600 run osmo-msc_10.42.42.6(pid=11619): stdout: | (launched: 2022-12-08_20:35:06.674689) 20:35:07.932812 run osmo-msc_10.42.42.6(pid=11619): stderr: | [0;m[38;5;43m20221208203506995 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208203506995 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff341d63c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208203506995 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208203506995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208203506995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208203506995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208203506997 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208203506997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208203506998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208203506998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:35:07.985695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11612): Terminating (SIGTERM) 20:35:08.027504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11615): Terminating (SIGTERM) 20:35:08.069700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11618): Terminating (SIGTERM) 20:35:08.111897 --- ParallelTerminationStrategy: PID 11612 died... 20:35:08.131843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11612): Terminated: ok {rc=0} 20:35:08.178506 --- ParallelTerminationStrategy: PID 11615 died... 20:35:08.198155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11615): Terminated: ok {rc=0} 20:35:08.244214 --- ParallelTerminationStrategy: PID 11618 died... 20:35:08.263909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11618): Terminated: ok {rc=0} 20:35:08.352515 bus /sierra_3: Setting Powered False 20:35:09.450953 bus /sierra_3: Setting Powered False 20:35:10.569048 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 20:35:11.716503 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:11.728448 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:35:11.801433 tst mo_mt_call_osmux.py: using LAC 16645 20:35:11.923900 tst mo_mt_call_osmux.py: using RAC 70 20:35:12.045636 tst mo_mt_call_osmux.py: using CellId 16645 20:35:12.168409 tst mo_mt_call_osmux.py: using BVCI 16646 20:35:12.282025 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:12.293280 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:12.304661 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:12.316096 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:12.327596 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:12.338940 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:35:12.454583 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:35:12.580425 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:35:13.086522 run create_hlr_db(pid=11621): Launched 20:35:13.219363 bus /sierra_2: Setting Powered False 20:35:14.283251 run create_hlr_db(pid=11621): Terminated: ok {rc=0} 20:35:14.718210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11623): Launched 20:35:15.024342 run osmo-hlr_10.42.42.2(pid=11624): Launched 20:35:15.139885 run osmo-stp_10.42.42.5: Starting osmo-stp 20:35:15.675529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11626): Launched 20:35:15.994195 run osmo-stp_10.42.42.5(pid=11627): Launched 20:35:16.336556 run osmo-msc_10.42.42.6: Starting osmo-msc 20:35:17.014616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11629): Launched 20:35:17.357987 run osmo-msc_10.42.42.6(pid=11630): Launched 20:35:17.541364 run osmo-stp_10.42.42.5(pid=11627): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11627)] 20:35:17.680810 run osmo-stp_10.42.42.5(pid=11627): stdout: | (launched: 2022-12-08_20:35:15.937200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:35:17.819952 run osmo-stp_10.42.42.5(pid=11627): stderr: | [0;m[38;5;43m20221208203516214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203516215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203516216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203516217 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203516218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203516218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203516218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:35:17.957568 run osmo-stp_10.42.42.5(pid=11627): stdout: | (launched: 2022-12-08_20:35:15.937200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:35:18.087446 run osmo-stp_10.42.42.5(pid=11627): stderr: | [0;m[38;5;43m20221208203516214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203516215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203516216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203516217 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203516218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203516218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203516218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:35:18.243103 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11627): Process ended prematurely: osmo-stp_10.42.42.5(pid=11627) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11627)] [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 20:35:18.253044 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 20:35:18.280742 run osmo-hlr_10.42.42.2(pid=11624): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11624)] 20:35:18.331132 run osmo-hlr_10.42.42.2(pid=11624): stdout: | (launched: 2022-12-08_20:35:14.968847) 20:35:18.383342 run osmo-hlr_10.42.42.2(pid=11624): stderr: | [0;m[1;31m20221208203515142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203515142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203515142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203515142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203515142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203515142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203515154 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203515163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203515163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203515163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:35:18.456037 run osmo-msc_10.42.42.6(pid=11630): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11630)] 20:35:18.506150 run osmo-msc_10.42.42.6(pid=11630): stdout: | (launched: 2022-12-08_20:35:17.297806) 20:35:18.557909 run osmo-msc_10.42.42.6(pid=11630): stderr: | [0;m[38;5;43m20221208203517621 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208203517621 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6501a27c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208203517621 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208203517621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208203517622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208203517622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208203517623 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208203517624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208203517624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208203517624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:35:18.610029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11623): Terminating (SIGTERM) 20:35:18.651970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11626): Terminating (SIGTERM) 20:35:18.694166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11629): Terminating (SIGTERM) 20:35:18.736144 --- ParallelTerminationStrategy: PID 11623 died... 20:35:18.756064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11623): Terminated: ok {rc=0} 20:35:18.802976 --- ParallelTerminationStrategy: PID 11626 died... 20:35:18.822547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11626): Terminated: ok {rc=0} 20:35:18.868702 --- ParallelTerminationStrategy: PID 11629 died... 20:35:18.888280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11629): Terminated: ok {rc=0} 20:35:18.976459 bus /sierra_3: Setting Powered False 20:35:20.076737 bus /sierra_3: Setting Powered False 20:35:21.193066 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 20:35:22.448080 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:35:22.453108 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 20:35:22.487997 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 20:35:22.515412 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 20:35:22.602423 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 20:35:22.637349 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 20:35:22.665091 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 20:35:23.251922 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2349 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 20:35:23.258053 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:23.269689 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:35:23.324756 tst emergency_mo_mt_call.py: using LAC 16646 20:35:23.445586 tst emergency_mo_mt_call.py: using RAC 71 20:35:23.570792 tst emergency_mo_mt_call.py: using CellId 16646 20:35:23.694883 tst emergency_mo_mt_call.py: using BVCI 16647 20:35:23.812527 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:23.824050 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:23.835129 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:23.846324 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:23.857519 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:23.868581 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:35:23.984188 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:35:24.099393 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:35:24.562398 run create_hlr_db(pid=11635): Launched 20:35:24.691217 bus /sierra_2: Setting Powered False 20:35:25.750866 run create_hlr_db(pid=11635): Terminated: ok {rc=0} 20:35:26.190559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11637): Launched 20:35:26.512515 run osmo-hlr_10.42.42.2(pid=11638): Launched 20:35:26.634275 run osmo-stp_10.42.42.5: Starting osmo-stp 20:35:27.187363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11640): Launched 20:35:27.509644 run osmo-stp_10.42.42.5(pid=11641): Launched 20:35:27.641593 tst emergency_mo_mt_call.py: using MSISDN 6843 20:35:27.806603 run osmo-msc_10.42.42.6: Starting osmo-msc 20:35:28.384005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11643): Launched 20:35:28.705364 run osmo-msc_10.42.42.6(pid=11644): Launched 20:35:28.883981 run osmo-stp_10.42.42.5(pid=11641): ERR: Terminated: ERROR {rc=1} [trial-2349↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11641)] 20:35:29.019472 run osmo-stp_10.42.42.5(pid=11641): stdout: | (launched: 2022-12-08_20:35:27.450642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:35:29.155228 run osmo-stp_10.42.42.5(pid=11641): stderr: | [0;m[38;5;43m20221208203527646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203527646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203527646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203527647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203527647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203527647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203527647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:35:29.289929 run osmo-stp_10.42.42.5(pid=11641): stdout: | (launched: 2022-12-08_20:35:27.450642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:35:29.417826 run osmo-stp_10.42.42.5(pid=11641): stderr: | [0;m[38;5;43m20221208203527646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203527646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203527646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203527647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203527647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203527647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203527647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:35:29.570145 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=11641): Process ended prematurely: osmo-stp_10.42.42.5(pid=11641) [trial-2349↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11641)] [trial-2349↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 20:35:29.579269 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 20:35:29.606720 run osmo-hlr_10.42.42.2(pid=11638): ERR: Terminated: ERROR {rc=237} [trial-2349↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11638)] 20:35:29.657441 run osmo-hlr_10.42.42.2(pid=11638): stdout: | (launched: 2022-12-08_20:35:26.453975) 20:35:29.710232 run osmo-hlr_10.42.42.2(pid=11638): stderr: | [0;m[1;31m20221208203526652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203526652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203526652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203526652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203526652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203526652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203526666 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203526674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203526674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203526674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:35:29.783207 run osmo-msc_10.42.42.6(pid=11644): ERR: Terminated: ERROR {rc=2} [trial-2349↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11644)] 20:35:29.834175 run osmo-msc_10.42.42.6(pid=11644): stdout: | (launched: 2022-12-08_20:35:28.646244) 20:35:29.886729 run osmo-msc_10.42.42.6(pid=11644): stderr: | [0;m[38;5;43m20221208203528967 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208203528967 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fab0a2b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208203528967 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208203528967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208203528967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208203528968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208203528970 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208203528970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208203528970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208203528970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:35:29.939320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11637): Terminating (SIGTERM) 20:35:29.981698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11640): Terminating (SIGTERM) 20:35:30.023860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11643): Terminating (SIGTERM) 20:35:30.066382 --- ParallelTerminationStrategy: PID 11637 died... 20:35:30.086511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11637): Terminated: ok {rc=0} 20:35:30.133253 --- ParallelTerminationStrategy: PID 11640 died... 20:35:30.153120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11640): Terminated: ok {rc=0} 20:35:30.199663 --- ParallelTerminationStrategy: PID 11643 died... 20:35:30.219423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11643): Terminated: ok {rc=0} 20:35:30.307832 bus /sierra_3: Setting Powered False 20:35:31.411627 bus /sierra_3: Setting Powered False 20:35:32.538880 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 20:35:33.627003 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:33.639445 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:35:33.692581 tst emergency_preemptive_call.py: using LAC 16647 20:35:33.819157 tst emergency_preemptive_call.py: using RAC 72 20:35:33.944641 tst emergency_preemptive_call.py: using CellId 16647 20:35:34.068251 tst emergency_preemptive_call.py: using BVCI 16648 20:35:34.184031 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:34.195392 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:34.206787 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:34.217988 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:34.229208 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:34.240283 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:35:34.359619 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:35:34.479403 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:35:34.594725 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:35:34.713558 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:35:35.211146 run create_hlr_db(pid=11646): Launched 20:35:35.341169 bus /sierra_2: Setting Powered False 20:35:36.405819 run create_hlr_db(pid=11646): Terminated: ok {rc=0} 20:35:36.836053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11648): Launched 20:35:37.134622 run osmo-hlr_10.42.42.2(pid=11649): Launched 20:35:37.247918 run osmo-stp_10.42.42.5: Starting osmo-stp 20:35:37.775509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11651): Launched 20:35:38.073692 run osmo-stp_10.42.42.5(pid=11652): Launched 20:35:38.195877 tst emergency_preemptive_call.py: using MSISDN 6844 20:35:38.363601 run osmo-msc_10.42.42.6: Starting osmo-msc 20:35:38.900794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11654): Launched 20:35:39.199171 run osmo-msc_10.42.42.6(pid=11655): Launched 20:35:39.365252 run osmo-stp_10.42.42.5(pid=11652): ERR: Terminated: ERROR {rc=1} [trial-2349↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11652)] 20:35:39.492271 run osmo-stp_10.42.42.5(pid=11652): stdout: | (launched: 2022-12-08_20:35:38.019030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:35:39.619752 run osmo-stp_10.42.42.5(pid=11652): stderr: | [0;m[38;5;43m20221208203538188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203538189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203538189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203538189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203538190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203538190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203538190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:35:39.744765 run osmo-stp_10.42.42.5(pid=11652): stdout: | (launched: 2022-12-08_20:35:38.019030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:35:39.864200 run osmo-stp_10.42.42.5(pid=11652): stderr: | [0;m[38;5;43m20221208203538188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203538189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203538189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203538189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203538190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203538190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203538190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:35:40.006637 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=11652): Process ended prematurely: osmo-stp_10.42.42.5(pid=11652) [trial-2349↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11652)] [trial-2349↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 20:35:40.015110 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 20:35:40.041845 run osmo-hlr_10.42.42.2(pid=11649): ERR: Terminated: ERROR {rc=237} [trial-2349↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11649)] 20:35:40.090686 run osmo-hlr_10.42.42.2(pid=11649): stdout: | (launched: 2022-12-08_20:35:37.079952) 20:35:40.141072 run osmo-hlr_10.42.42.2(pid=11649): stderr: | [0;m[1;31m20221208203537255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203537255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203537255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203537255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203537255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203537255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203537267 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203537276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203537276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203537276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:35:40.211425 run osmo-msc_10.42.42.6(pid=11655): ERR: Terminated: ERROR {rc=2} [trial-2349↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11655)] 20:35:40.259974 run osmo-msc_10.42.42.6(pid=11655): stdout: | (launched: 2022-12-08_20:35:39.144289) 20:35:40.310175 run osmo-msc_10.42.42.6(pid=11655): stderr: | [0;m[38;5;43m20221208203539416 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208203539417 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8e59a63c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208203539417 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208203539417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208203539417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208203539417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208203539419 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208203539419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208203539420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208203539420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:35:40.360765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11648): Terminating (SIGTERM) 20:35:40.401339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11651): Terminating (SIGTERM) 20:35:40.441819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11654): Terminating (SIGTERM) 20:35:40.482598 --- ParallelTerminationStrategy: PID 11648 died... 20:35:40.501945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11648): Terminated: ok {rc=0} 20:35:40.547006 --- ParallelTerminationStrategy: PID 11651 died... 20:35:40.565781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11651): Terminated: ok {rc=0} 20:35:40.610257 --- ParallelTerminationStrategy: PID 11654 died... 20:35:40.628917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11654): Terminated: ok {rc=0} 20:35:40.713031 bus /sierra_9: Setting Powered False 20:35:41.812878 bus /sierra_9: Setting Powered False 20:35:42.930224 bus /sierra_8: Setting Powered False 20:35:44.029130 bus /sierra_8: Setting Powered False 20:35:45.147465 bus /sierra_3: Setting Powered False 20:35:46.247961 bus /sierra_3: Setting Powered False 20:35:47.367113 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 20:35:48.655034 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:35:48.659816 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 20:35:48.694501 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 20:35:48.734127 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 20:35:48.823353 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 20:35:48.857908 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 20:35:48.897334 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 20:35:49.492440 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 20:35:49.545579 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:35:49.556718 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:35:49.608073 tst cs_paging_gprs_active.py: using LAC 16648 20:35:49.737670 tst cs_paging_gprs_active.py: using RAC 73 20:35:49.866438 tst cs_paging_gprs_active.py: using CellId 16648 20:35:50.001265 tst cs_paging_gprs_active.py: using BVCI 16649 20:35:50.113568 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:35:50.124457 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:35:50.135205 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:35:50.146484 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:35:50.157508 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:35:50.168371 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:35:50.179349 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:35:50.190199 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:35:50.201208 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:35:50.323993 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:35:50.445874 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:35:50.667486 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:35:50.997174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11660): Launched 20:35:51.282559 run iperf3-srv_10.42.42.10(pid=11661): Launched 20:35:51.406992 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:35:51.627092 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:35:51.957441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11662): Launched 20:35:52.242259 run iperf3-srv_10.42.42.10(pid=11663): Launched 20:35:52.366386 tst cs_paging_gprs_active.py:38: start network... 20:35:52.586526 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:35:53.093127 run create_hlr_db(pid=11664): Launched 20:35:53.228367 bus /sierra_2: Setting Powered False 20:35:54.289343 run create_hlr_db(pid=11664): Terminated: ok {rc=0} 20:35:54.746614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11666): Launched 20:35:55.075208 run osmo-hlr_10.42.42.2(pid=11667): Launched 20:35:55.200226 run osmo-stp_10.42.42.5: Starting osmo-stp 20:35:55.762804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11669): Launched 20:35:56.093203 run osmo-stp_10.42.42.5(pid=11670): Launched 20:35:56.219251 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:35:56.784150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11672): Launched 20:35:56.910772 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:35:57.187539 run patchelf(pid=11673): Launched 20:35:57.369206 run osmo-stp_10.42.42.5(pid=11670): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11670)] 20:35:57.507764 run osmo-stp_10.42.42.5(pid=11670): stdout: | (launched: 2022-12-08_20:35:56.033464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:35:57.647857 run osmo-stp_10.42.42.5(pid=11670): stderr: | [0;m[38;5;43m20221208203556226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203556226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203556226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203556227 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203556227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203556227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203556227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:35:57.787960 run osmo-stp_10.42.42.5(pid=11670): stdout: | (launched: 2022-12-08_20:35:56.033464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:35:57.923128 run osmo-stp_10.42.42.5(pid=11670): stderr: | [0;m[38;5;43m20221208203556226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203556226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203556226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203556227 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203556227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203556227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203556227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:35:58.082455 run patchelf(pid=11673): Terminating (SIGINT) 20:35:58.266011 run patchelf(pid=11673): Terminated: ok {rc=0} 20:35:58.398204 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11670): Process ended prematurely: osmo-stp_10.42.42.5(pid=11670) [trial-2349↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11670)] [trial-2349↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 20:35:58.408430 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 20:35:58.437031 run osmo-hlr_10.42.42.2(pid=11667): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11667)] 20:35:58.487280 run osmo-hlr_10.42.42.2(pid=11667): stdout: | (launched: 2022-12-08_20:35:55.015375) 20:35:58.539281 run osmo-hlr_10.42.42.2(pid=11667): stderr: | [0;m[1;31m20221208203555213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203555213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203555213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203555213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203555213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203555213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203555228 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203555237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203555237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203555237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:35:58.591671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11660): Terminating (SIGTERM) 20:35:58.633516 run iperf3-srv_10.42.42.10(pid=11661): Terminating (SIGTERM) 20:35:58.675361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11662): Terminating (SIGTERM) 20:35:58.717256 run iperf3-srv_10.42.42.10(pid=11663): Terminating (SIGTERM) 20:35:58.758960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11666): Terminating (SIGTERM) 20:35:58.800746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11669): Terminating (SIGTERM) 20:35:58.842970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11672): Terminating (SIGTERM) 20:35:58.885703 --- ParallelTerminationStrategy: PID 11660 died... 20:35:58.905742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11660): Terminated: ok {rc=0} 20:35:58.952203 --- ParallelTerminationStrategy: PID 11661 died... 20:35:58.971786 run iperf3-srv_10.42.42.10(pid=11661): Terminated {rc=256} 20:35:59.017844 --- ParallelTerminationStrategy: PID 11662 died... 20:35:59.037433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11662): Terminated: ok {rc=0} 20:35:59.084090 --- ParallelTerminationStrategy: PID 11663 died... 20:35:59.103523 run iperf3-srv_10.42.42.10(pid=11663): Terminated {rc=256} 20:35:59.149888 --- ParallelTerminationStrategy: PID 11666 died... 20:35:59.169443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11666): Terminated: ok {rc=0} 20:35:59.215599 --- ParallelTerminationStrategy: PID 11669 died... 20:35:59.235122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11669): Terminated: ok {rc=0} 20:35:59.281406 --- ParallelTerminationStrategy: PID 11672 died... 20:35:59.301230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11672): Terminated: ok {rc=0} 20:35:59.389838 bus /gobi_0: Setting Powered False 20:36:00.490450 bus /gobi_0: Setting Powered False 20:36:01.623321 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 20:36:02.791747 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:02.803580 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:36:02.857867 tst iperf3.py: using LAC 16649 20:36:02.979703 tst iperf3.py: using RAC 74 20:36:03.101370 tst iperf3.py: using CellId 16649 20:36:03.223672 tst iperf3.py: using BVCI 16650 20:36:03.334817 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:03.345912 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:03.356653 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:03.367961 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:03.378795 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:03.389879 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:03.401085 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:03.411944 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:03.423174 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:36:03.543968 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:36:03.765633 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:36:04.094652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11674): Launched 20:36:04.380060 run iperf3-srv_10.42.42.10(pid=11675): Launched 20:36:04.502641 tst iperf3.py:8: start network... 20:36:04.723101 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:36:05.231345 run create_hlr_db(pid=11676): Launched 20:36:05.364650 bus /gobi_6: Setting Powered False 20:36:06.429189 run create_hlr_db(pid=11676): Terminated: ok {rc=0} 20:36:06.866252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11678): Launched 20:36:07.172829 run osmo-hlr_10.42.42.2(pid=11679): Launched 20:36:07.289614 run osmo-stp_10.42.42.5: Starting osmo-stp 20:36:07.837679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11681): Launched 20:36:08.144624 run osmo-stp_10.42.42.5(pid=11682): Launched 20:36:08.261827 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:36:08.787421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11684): Launched 20:36:08.905048 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:36:09.163679 run patchelf(pid=11685): Launched 20:36:09.334497 run osmo-stp_10.42.42.5(pid=11682): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11682)] 20:36:09.464469 run osmo-stp_10.42.42.5(pid=11682): stdout: | (launched: 2022-12-08_20:36:08.088466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:36:09.595572 run osmo-stp_10.42.42.5(pid=11682): stderr: | [0;m[38;5;43m20221208203608257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203608257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203608257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203608258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203608258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203608258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203608258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:36:09.726744 run osmo-stp_10.42.42.5(pid=11682): stdout: | (launched: 2022-12-08_20:36:08.088466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:36:09.852445 run osmo-stp_10.42.42.5(pid=11682): stderr: | [0;m[38;5;43m20221208203608257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203608257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203608257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203608258 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203608258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203608258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203608258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:36:10.001590 run patchelf(pid=11685): Terminating (SIGINT) 20:36:10.174453 run patchelf(pid=11685): Terminated: ok {rc=0} 20:36:10.298761 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11682): Process ended prematurely: osmo-stp_10.42.42.5(pid=11682) [trial-2349↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11682)] [trial-2349↪gprs:trx-sysmocell5000↪iperf3.py:8] 20:36:10.308490 tst iperf3.py:8: Test FAILED (7.6 sec) 20:36:10.336686 run osmo-hlr_10.42.42.2(pid=11679): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11679)] 20:36:10.385287 run osmo-hlr_10.42.42.2(pid=11679): stdout: | (launched: 2022-12-08_20:36:07.116511) 20:36:10.435544 run osmo-hlr_10.42.42.2(pid=11679): stderr: | [0;m[1;31m20221208203607295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203607295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203607296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203607296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203607296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203607296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203607307 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203607317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203607317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203607317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:36:10.486356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11674): Terminating (SIGTERM) 20:36:10.526983 run iperf3-srv_10.42.42.10(pid=11675): Terminating (SIGTERM) 20:36:10.567166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11678): Terminating (SIGTERM) 20:36:10.607830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11681): Terminating (SIGTERM) 20:36:10.648659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11684): Terminating (SIGTERM) 20:36:10.689587 --- ParallelTerminationStrategy: PID 11674 died... 20:36:10.708854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11674): Terminated: ok {rc=0} 20:36:10.754095 --- ParallelTerminationStrategy: PID 11675 died... 20:36:10.772842 run iperf3-srv_10.42.42.10(pid=11675): Terminated {rc=256} 20:36:10.817697 --- ParallelTerminationStrategy: PID 11678 died... 20:36:10.836445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11678): Terminated: ok {rc=0} 20:36:10.881497 --- ParallelTerminationStrategy: PID 11681 died... 20:36:10.900432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11681): Terminated: ok {rc=0} 20:36:10.945411 --- ParallelTerminationStrategy: PID 11684 died... 20:36:10.964304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11684): Terminated: ok {rc=0} 20:36:11.048907 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 20:36:12.193632 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:12.205272 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:36:12.254401 tst iperf3m4.py: using LAC 16650 20:36:12.375450 tst iperf3m4.py: using RAC 75 20:36:12.500090 tst iperf3m4.py: using CellId 16650 20:36:12.628130 tst iperf3m4.py: using BVCI 16651 20:36:12.746955 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:12.758409 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:12.769662 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:12.780736 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:12.791844 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:12.803015 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:12.814743 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:12.825867 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:12.837139 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:36:12.954097 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:36:13.071733 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:36:13.191924 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:36:13.310693 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:36:13.515004 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:36:13.820413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11686): Launched 20:36:14.086557 run iperf3-srv_10.42.42.10(pid=11687): Launched 20:36:14.202897 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:36:14.406371 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:36:14.711924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11688): Launched 20:36:14.978622 run iperf3-srv_10.42.42.10(pid=11689): Launched 20:36:15.092845 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:36:15.296009 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:36:15.601766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11690): Launched 20:36:15.877789 run iperf3-srv_10.42.42.10(pid=11691): Launched 20:36:16.043868 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:36:16.320339 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:36:16.633803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11692): Launched 20:36:16.937944 run iperf3-srv_10.42.42.10(pid=11693): Launched 20:36:17.075648 tst iperf3m4.py:8: start network... 20:36:17.299323 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:36:17.807380 run create_hlr_db(pid=11694): Launched 20:36:17.941732 bus /gobi_6: Setting Powered False 20:36:19.002235 run create_hlr_db(pid=11694): Terminated: ok {rc=0} 20:36:19.436507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11696): Launched 20:36:19.742372 run osmo-hlr_10.42.42.2(pid=11697): Launched 20:36:19.858736 run osmo-stp_10.42.42.5: Starting osmo-stp 20:36:20.386175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11699): Launched 20:36:20.691410 run osmo-stp_10.42.42.5(pid=11700): Launched 20:36:20.808618 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:36:21.338085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11702): Launched 20:36:21.454973 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:36:21.714224 run patchelf(pid=11703): Launched 20:36:21.898786 run osmo-stp_10.42.42.5(pid=11700): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11700)] 20:36:22.041422 run osmo-stp_10.42.42.5(pid=11700): stdout: | (launched: 2022-12-08_20:36:20.635154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:36:22.173263 run osmo-stp_10.42.42.5(pid=11700): stderr: | [0;m[38;5;43m20221208203620806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203620806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203620807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203620807 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203620807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203620807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203620808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:36:22.304354 run osmo-stp_10.42.42.5(pid=11700): stdout: | (launched: 2022-12-08_20:36:20.635154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:36:22.430596 run osmo-stp_10.42.42.5(pid=11700): stderr: | [0;m[38;5;43m20221208203620806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203620806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203620807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203620807 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203620807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203620807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203620808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:36:22.579929 run patchelf(pid=11703): Terminating (SIGINT) 20:36:22.752527 run patchelf(pid=11703): Terminated: ok {rc=0} 20:36:22.877289 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11700): Process ended prematurely: osmo-stp_10.42.42.5(pid=11700) [trial-2349↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11700)] [trial-2349↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 20:36:22.886873 tst iperf3m4.py:8: Test FAILED (10.7 sec) 20:36:22.915219 run osmo-hlr_10.42.42.2(pid=11697): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11697)] 20:36:22.964112 run osmo-hlr_10.42.42.2(pid=11697): stdout: | (launched: 2022-12-08_20:36:19.686123) 20:36:23.014703 run osmo-hlr_10.42.42.2(pid=11697): stderr: | [0;m[1;31m20221208203619861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203619862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203619862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203619862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203619862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203619862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203619875 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203619886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203619886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203619886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:36:23.065730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11686): Terminating (SIGTERM) 20:36:23.106001 run iperf3-srv_10.42.42.10(pid=11687): Terminating (SIGTERM) 20:36:23.146225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11688): Terminating (SIGTERM) 20:36:23.186160 run iperf3-srv_10.42.42.10(pid=11689): Terminating (SIGTERM) 20:36:23.226539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11690): Terminating (SIGTERM) 20:36:23.266753 run iperf3-srv_10.42.42.10(pid=11691): Terminating (SIGTERM) 20:36:23.306740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11692): Terminating (SIGTERM) 20:36:23.346838 run iperf3-srv_10.42.42.10(pid=11693): Terminating (SIGTERM) 20:36:23.387024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11696): Terminating (SIGTERM) 20:36:23.427302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11699): Terminating (SIGTERM) 20:36:23.467360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11702): Terminating (SIGTERM) 20:36:23.507808 --- ParallelTerminationStrategy: PID 11686 died... 20:36:23.527102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11686): Terminated: ok {rc=0} 20:36:23.571995 --- ParallelTerminationStrategy: PID 11687 died... 20:36:23.590687 run iperf3-srv_10.42.42.10(pid=11687): Terminated {rc=256} 20:36:23.635110 --- ParallelTerminationStrategy: PID 11688 died... 20:36:23.653885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11688): Terminated: ok {rc=0} 20:36:23.698463 --- ParallelTerminationStrategy: PID 11689 died... 20:36:23.717508 run iperf3-srv_10.42.42.10(pid=11689): Terminated {rc=256} 20:36:23.762044 --- ParallelTerminationStrategy: PID 11690 died... 20:36:23.780838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11690): Terminated: ok {rc=0} 20:36:23.825508 --- ParallelTerminationStrategy: PID 11691 died... 20:36:23.844012 run iperf3-srv_10.42.42.10(pid=11691): Terminated {rc=256} 20:36:23.888640 --- ParallelTerminationStrategy: PID 11692 died... 20:36:23.907505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11692): Terminated: ok {rc=0} 20:36:23.952042 --- ParallelTerminationStrategy: PID 11693 died... 20:36:23.970902 run iperf3-srv_10.42.42.10(pid=11693): Terminated {rc=256} 20:36:24.015414 --- ParallelTerminationStrategy: PID 11696 died... 20:36:24.034147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11696): Terminated: ok {rc=0} 20:36:24.078841 --- ParallelTerminationStrategy: PID 11699 died... 20:36:24.097627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11699): Terminated: ok {rc=0} 20:36:24.142580 --- ParallelTerminationStrategy: PID 11702 died... 20:36:24.161504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11702): Terminated: ok {rc=0} 20:36:24.248436 bus /gobi_4: Setting Powered False 20:36:25.348783 bus /gobi_4: Setting Powered False 20:36:26.464941 bus /gobi_1: Setting Powered False 20:36:27.564218 bus /gobi_1: Setting Powered False 20:36:28.680105 bus /gobi_0: Setting Powered False 20:36:29.777818 bus /gobi_0: Setting Powered False 20:36:30.914404 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 20:36:32.028040 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:32.039736 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:36:32.092744 tst ping.py: using LAC 16651 20:36:32.229395 tst ping.py: using RAC 76 20:36:32.348113 tst ping.py: using CellId 16651 20:36:32.474322 tst ping.py: using BVCI 16652 20:36:32.592559 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:32.604129 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:32.615457 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:32.626737 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:32.637762 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:32.648693 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:32.659974 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:32.671323 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:36:32.787929 tst ping.py:19: start network... 20:36:32.987623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:36:33.447020 run create_hlr_db(pid=11704): Launched 20:36:33.560763 bus /gobi_6: Setting Powered False 20:36:34.620460 run create_hlr_db(pid=11704): Terminated: ok {rc=0} 20:36:35.060179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11706): Launched 20:36:35.383213 run osmo-hlr_10.42.42.2(pid=11707): Launched 20:36:35.505075 run osmo-stp_10.42.42.5: Starting osmo-stp 20:36:36.065295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11709): Launched 20:36:36.385576 run osmo-stp_10.42.42.5(pid=11710): Launched 20:36:36.508541 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:36:37.063663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11712): Launched 20:36:37.186868 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:36:37.457953 run patchelf(pid=11713): Launched 20:36:37.637905 run osmo-stp_10.42.42.5(pid=11710): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11710)] 20:36:37.774086 run osmo-stp_10.42.42.5(pid=11710): stdout: | (launched: 2022-12-08_20:36:36.327222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:36:37.912791 run osmo-stp_10.42.42.5(pid=11710): stderr: | [0;m[38;5;43m20221208203636522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203636523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203636523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203636523 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203636524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203636524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203636524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:36:38.050658 run osmo-stp_10.42.42.5(pid=11710): stdout: | (launched: 2022-12-08_20:36:36.327222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:36:38.181852 run osmo-stp_10.42.42.5(pid=11710): stderr: | [0;m[38;5;43m20221208203636522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203636523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203636523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203636523 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203636524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203636524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203636524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:36:38.338678 run patchelf(pid=11713): Terminating (SIGINT) 20:36:38.518489 run patchelf(pid=11713): Terminated: ok {rc=0} 20:36:38.647832 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11710): Process ended prematurely: osmo-stp_10.42.42.5(pid=11710) [trial-2349↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11710)] [trial-2349↪gprs:trx-sysmocell5000↪ping.py:22] 20:36:38.657481 tst ping.py:22: Test FAILED (6.6 sec) 20:36:38.685504 run osmo-hlr_10.42.42.2(pid=11707): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11707)] 20:36:38.735706 run osmo-hlr_10.42.42.2(pid=11707): stdout: | (launched: 2022-12-08_20:36:35.324801) 20:36:38.787637 run osmo-hlr_10.42.42.2(pid=11707): stderr: | [0;m[1;31m20221208203635526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203635526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203635526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203635526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203635526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203635526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203635538 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203635546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203635546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203635546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:36:38.840283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11706): Terminating (SIGTERM) 20:36:38.882595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11709): Terminating (SIGTERM) 20:36:38.924729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11712): Terminating (SIGTERM) 20:36:38.967072 --- ParallelTerminationStrategy: PID 11706 died... 20:36:38.987521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11706): Terminated: ok {rc=0} 20:36:39.034177 --- ParallelTerminationStrategy: PID 11709 died... 20:36:39.054040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11709): Terminated: ok {rc=0} 20:36:39.100358 --- ParallelTerminationStrategy: PID 11712 died... 20:36:39.120047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11712): Terminated: ok {rc=0} 20:36:39.209138 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 20:36:40.298269 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:40.310962 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:36:40.362063 tst ping_idle_ping.py: using LAC 16652 20:36:40.480483 tst ping_idle_ping.py: using RAC 77 20:36:40.598169 tst ping_idle_ping.py: using CellId 16652 20:36:40.717109 tst ping_idle_ping.py: using BVCI 16653 20:36:40.827057 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:40.837985 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:40.848603 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:40.859694 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:40.870563 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:40.881379 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:40.892484 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:40.903320 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:36:41.018993 tst ping_idle_ping.py:24: start network... 20:36:41.219537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:36:41.684728 run create_hlr_db(pid=11714): Launched 20:36:41.798951 bus /gobi_6: Setting Powered False 20:36:42.859498 run create_hlr_db(pid=11714): Terminated: ok {rc=0} 20:36:43.279178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11716): Launched 20:36:43.579921 run osmo-hlr_10.42.42.2(pid=11717): Launched 20:36:43.696342 run osmo-stp_10.42.42.5: Starting osmo-stp 20:36:44.216354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11719): Launched 20:36:44.518321 run osmo-stp_10.42.42.5(pid=11720): Launched 20:36:44.633206 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:36:45.150500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11722): Launched 20:36:45.266257 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:36:45.519578 run patchelf(pid=11723): Launched 20:36:45.687369 run osmo-stp_10.42.42.5(pid=11720): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11720)] 20:36:45.815414 run osmo-stp_10.42.42.5(pid=11720): stdout: | (launched: 2022-12-08_20:36:44.463018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:36:45.954705 run osmo-stp_10.42.42.5(pid=11720): stderr: | [0;m[38;5;43m20221208203644634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203644634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203644634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203644635 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203644635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203644635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203644635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:36:46.086547 run osmo-stp_10.42.42.5(pid=11720): stdout: | (launched: 2022-12-08_20:36:44.463018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:36:46.212396 run osmo-stp_10.42.42.5(pid=11720): stderr: | [0;m[38;5;43m20221208203644634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203644634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203644634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203644635 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203644635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203644635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203644635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:36:46.361875 run patchelf(pid=11723): Terminating (SIGINT) 20:36:46.534202 run patchelf(pid=11723): Terminated: ok {rc=0} 20:36:46.659024 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11720): Process ended prematurely: osmo-stp_10.42.42.5(pid=11720) [trial-2349↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11720)] [trial-2349↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 20:36:46.668620 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 20:36:46.696895 run osmo-hlr_10.42.42.2(pid=11717): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11717)] 20:36:46.746423 run osmo-hlr_10.42.42.2(pid=11717): stdout: | (launched: 2022-12-08_20:36:43.524347) 20:36:46.797487 run osmo-hlr_10.42.42.2(pid=11717): stderr: | [0;m[1;31m20221208203643701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203643701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203643701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203643701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203643701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203643702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203643713 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203643721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203643722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203643722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:36:46.849387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11716): Terminating (SIGTERM) 20:36:46.890961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11719): Terminating (SIGTERM) 20:36:46.933235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11722): Terminating (SIGTERM) 20:36:46.976661 --- ParallelTerminationStrategy: PID 11716 died... 20:36:46.996424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11716): Terminated: ok {rc=0} 20:36:47.042748 --- ParallelTerminationStrategy: PID 11719 died... 20:36:47.062415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11719): Terminated: ok {rc=0} 20:36:47.108150 --- ParallelTerminationStrategy: PID 11722 died... 20:36:47.127793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11722): Terminated: ok {rc=0} 20:36:47.215527 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 20:36:48.523222 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:36:48.528874 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 20:36:48.563770 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 20:36:48.602276 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 20:36:48.688573 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 20:36:48.722369 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 20:36:48.760484 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 20:36:49.355487 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 20:36:49.404683 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:36:49.415649 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:36:49.466189 tst cs_paging_gprs_active.py: using LAC 16653 20:36:49.586270 tst cs_paging_gprs_active.py: using RAC 78 20:36:49.715895 tst cs_paging_gprs_active.py: using CellId 16653 20:36:49.846626 tst cs_paging_gprs_active.py: using BVCI 16654 20:36:49.966619 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:36:49.978392 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:36:49.989674 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:36:50.001660 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:36:50.013553 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:36:50.025617 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:36:50.037473 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:36:50.049561 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:36:50.061742 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:36:50.182314 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:36:50.305093 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:36:50.527909 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:36:50.861805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11727): Launched 20:36:51.149604 run iperf3-srv_10.42.42.10(pid=11728): Launched 20:36:51.274382 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:36:51.495804 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:36:51.826294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11729): Launched 20:36:52.112225 run iperf3-srv_10.42.42.10(pid=11730): Launched 20:36:52.235269 tst cs_paging_gprs_active.py:38: start network... 20:36:52.456867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:36:52.966397 run create_hlr_db(pid=11731): Launched 20:36:53.099824 bus /gobi_6: Setting Powered False 20:36:54.164016 run create_hlr_db(pid=11731): Terminated: ok {rc=0} 20:36:54.622093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11733): Launched 20:36:54.950883 run osmo-hlr_10.42.42.2(pid=11734): Launched 20:36:55.076397 run osmo-stp_10.42.42.5: Starting osmo-stp 20:36:55.643752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11736): Launched 20:36:55.973427 run osmo-stp_10.42.42.5(pid=11737): Launched 20:36:56.099747 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:36:56.667802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11739): Launched 20:36:56.795213 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:36:57.074086 run patchelf(pid=11740): Launched 20:36:57.258569 run osmo-stp_10.42.42.5(pid=11737): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11737)] 20:36:57.397611 run osmo-stp_10.42.42.5(pid=11737): stdout: | (launched: 2022-12-08_20:36:55.913510) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:36:57.538119 run osmo-stp_10.42.42.5(pid=11737): stderr: | [0;m[38;5;43m20221208203656106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203656106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203656106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203656107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203656107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203656107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203656107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:36:57.679100 run osmo-stp_10.42.42.5(pid=11737): stdout: | (launched: 2022-12-08_20:36:55.913510) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:36:57.814089 run osmo-stp_10.42.42.5(pid=11737): stderr: | [0;m[38;5;43m20221208203656106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203656106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203656106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203656107 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203656107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203656107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203656107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:36:57.974881 run patchelf(pid=11740): Terminating (SIGINT) 20:36:58.158917 run patchelf(pid=11740): Terminated: ok {rc=0} 20:36:58.291533 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11737): Process ended prematurely: osmo-stp_10.42.42.5(pid=11737) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11737)] [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 20:36:58.301870 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 20:36:58.330606 run osmo-hlr_10.42.42.2(pid=11734): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11734)] 20:36:58.381662 run osmo-hlr_10.42.42.2(pid=11734): stdout: | (launched: 2022-12-08_20:36:54.891258) 20:36:58.434276 run osmo-hlr_10.42.42.2(pid=11734): stderr: | [0;m[1;31m20221208203655093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203655093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203655093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203655093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203655093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203655093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203655106 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203655114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203655114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203655115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:36:58.487115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11727): Terminating (SIGTERM) 20:36:58.529159 run iperf3-srv_10.42.42.10(pid=11728): Terminating (SIGTERM) 20:36:58.571219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11729): Terminating (SIGTERM) 20:36:58.613355 run iperf3-srv_10.42.42.10(pid=11730): Terminating (SIGTERM) 20:36:58.655375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11733): Terminating (SIGTERM) 20:36:58.697761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11736): Terminating (SIGTERM) 20:36:58.740114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11739): Terminating (SIGTERM) 20:36:58.782783 --- ParallelTerminationStrategy: PID 11727 died... 20:36:58.802936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11727): Terminated: ok {rc=0} 20:36:58.849850 --- ParallelTerminationStrategy: PID 11728 died... 20:36:58.869646 run iperf3-srv_10.42.42.10(pid=11728): Terminated {rc=256} 20:36:58.916078 --- ParallelTerminationStrategy: PID 11729 died... 20:36:58.935772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11729): Terminated: ok {rc=0} 20:36:58.981841 --- ParallelTerminationStrategy: PID 11730 died... 20:36:59.001533 run iperf3-srv_10.42.42.10(pid=11730): Terminated {rc=256} 20:36:59.047501 --- ParallelTerminationStrategy: PID 11733 died... 20:36:59.067157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11733): Terminated: ok {rc=0} 20:36:59.113350 --- ParallelTerminationStrategy: PID 11736 died... 20:36:59.132868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11736): Terminated: ok {rc=0} 20:36:59.179129 --- ParallelTerminationStrategy: PID 11739 died... 20:36:59.198875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11739): Terminated: ok {rc=0} 20:36:59.286468 bus /gobi_0: Setting Powered False 20:37:00.386963 bus /gobi_0: Setting Powered False 20:37:01.512079 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 20:37:02.670793 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:02.682456 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:37:02.736098 tst iperf3.py: using LAC 16654 20:37:02.856152 tst iperf3.py: using RAC 79 20:37:02.975250 tst iperf3.py: using CellId 16654 20:37:03.096414 tst iperf3.py: using BVCI 16655 20:37:03.206642 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:03.217746 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:03.228544 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:03.239679 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:03.250659 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:03.261654 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:03.272640 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:03.283696 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:03.294959 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:37:03.414265 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:37:03.617876 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:37:03.922289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11741): Launched 20:37:04.189062 run iperf3-srv_10.42.42.10(pid=11742): Launched 20:37:04.302751 tst iperf3.py:8: start network... 20:37:04.506750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:37:04.977924 run create_hlr_db(pid=11743): Launched 20:37:05.093192 bus /gobi_6: Setting Powered False 20:37:06.153318 run create_hlr_db(pid=11743): Terminated: ok {rc=0} 20:37:06.577465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11745): Launched 20:37:06.882311 run osmo-hlr_10.42.42.2(pid=11746): Launched 20:37:06.998741 run osmo-stp_10.42.42.5: Starting osmo-stp 20:37:07.538336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11748): Launched 20:37:07.843286 run osmo-stp_10.42.42.5(pid=11749): Launched 20:37:07.959615 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:37:08.483848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11751): Launched 20:37:08.600874 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:37:08.858051 run patchelf(pid=11752): Launched 20:37:09.027741 run osmo-stp_10.42.42.5(pid=11749): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11749)] 20:37:09.157094 run osmo-stp_10.42.42.5(pid=11749): stdout: | (launched: 2022-12-08_20:37:07.786827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:37:09.287634 run osmo-stp_10.42.42.5(pid=11749): stderr: | [0;m[38;5;43m20221208203707959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203707959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203707959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203707960 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203707960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203707960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203707960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:37:09.418472 run osmo-stp_10.42.42.5(pid=11749): stdout: | (launched: 2022-12-08_20:37:07.786827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:37:09.543311 run osmo-stp_10.42.42.5(pid=11749): stderr: | [0;m[38;5;43m20221208203707959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203707959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203707959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203707960 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203707960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203707960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203707960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:37:09.691488 run patchelf(pid=11752): Terminating (SIGINT) 20:37:09.862857 run patchelf(pid=11752): Terminated: ok {rc=0} 20:37:09.985991 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11749): Process ended prematurely: osmo-stp_10.42.42.5(pid=11749) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11749)] [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 20:37:09.995519 tst iperf3.py:8: Test FAILED (7.4 sec) 20:37:10.022961 run osmo-hlr_10.42.42.2(pid=11746): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11746)] 20:37:10.070747 run osmo-hlr_10.42.42.2(pid=11746): stdout: | (launched: 2022-12-08_20:37:06.826535) 20:37:10.120263 run osmo-hlr_10.42.42.2(pid=11746): stderr: | [0;m[1;31m20221208203707002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203707002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203707002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203707002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203707002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203707002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203707014 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203707022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203707023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203707023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:37:10.170347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11741): Terminating (SIGTERM) 20:37:10.210176 run iperf3-srv_10.42.42.10(pid=11742): Terminating (SIGTERM) 20:37:10.249982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11745): Terminating (SIGTERM) 20:37:10.289856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11748): Terminating (SIGTERM) 20:37:10.329896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11751): Terminating (SIGTERM) 20:37:10.370127 --- ParallelTerminationStrategy: PID 11741 died... 20:37:10.389215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11741): Terminated: ok {rc=0} 20:37:10.433586 --- ParallelTerminationStrategy: PID 11742 died... 20:37:10.452157 run iperf3-srv_10.42.42.10(pid=11742): Terminated {rc=256} 20:37:10.496687 --- ParallelTerminationStrategy: PID 11745 died... 20:37:10.515322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11745): Terminated: ok {rc=0} 20:37:10.559986 --- ParallelTerminationStrategy: PID 11748 died... 20:37:10.578554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11748): Terminated: ok {rc=0} 20:37:10.622751 --- ParallelTerminationStrategy: PID 11751 died... 20:37:10.641290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11751): Terminated: ok {rc=0} 20:37:10.726640 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 20:37:11.872843 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:11.884535 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:37:11.947615 tst iperf3m4.py: using LAC 16655 20:37:12.076342 tst iperf3m4.py: using RAC 80 20:37:12.197564 tst iperf3m4.py: using CellId 16655 20:37:12.317338 tst iperf3m4.py: using BVCI 16656 20:37:12.427837 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:12.439158 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:12.450092 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:12.461262 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:12.472251 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:12.483395 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:12.494879 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:12.506160 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:12.517542 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:37:12.638934 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:37:12.762862 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:37:12.879294 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:37:12.998577 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:37:13.221335 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:37:13.549782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11754): Launched 20:37:13.838098 run iperf3-srv_10.42.42.10(pid=11755): Launched 20:37:13.961866 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:37:14.183130 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:37:14.511316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11756): Launched 20:37:14.798575 run iperf3-srv_10.42.42.10(pid=11757): Launched 20:37:14.923785 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:37:15.145026 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:37:15.473882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11758): Launched 20:37:15.758942 run iperf3-srv_10.42.42.10(pid=11759): Launched 20:37:15.899431 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:37:16.112788 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:37:16.429278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11760): Launched 20:37:16.721680 run iperf3-srv_10.42.42.10(pid=11761): Launched 20:37:16.853416 tst iperf3m4.py:8: start network... 20:37:17.063803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:37:17.543684 run create_hlr_db(pid=11762): Launched 20:37:17.660530 bus /gobi_6: Setting Powered False 20:37:18.721693 run create_hlr_db(pid=11762): Terminated: ok {rc=0} 20:37:19.169639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11764): Launched 20:37:19.498008 run osmo-hlr_10.42.42.2(pid=11765): Launched 20:37:19.624863 run osmo-stp_10.42.42.5: Starting osmo-stp 20:37:20.169924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11768): Launched 20:37:20.475878 run osmo-stp_10.42.42.5(pid=11769): Launched 20:37:20.593462 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:37:21.121778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11771): Launched 20:37:21.239099 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:37:21.498019 run patchelf(pid=11772): Launched 20:37:21.669354 run osmo-stp_10.42.42.5(pid=11769): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11769)] 20:37:21.799159 run osmo-stp_10.42.42.5(pid=11769): stdout: | (launched: 2022-12-08_20:37:20.419739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:37:21.930016 run osmo-stp_10.42.42.5(pid=11769): stderr: | [0;m[38;5;43m20221208203720590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203720590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203720591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203720591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203720591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203720592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203720592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:37:22.060935 run osmo-stp_10.42.42.5(pid=11769): stdout: | (launched: 2022-12-08_20:37:20.419739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:37:22.186532 run osmo-stp_10.42.42.5(pid=11769): stderr: | [0;m[38;5;43m20221208203720590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203720590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203720591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203720591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203720591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203720592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203720592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:37:22.335251 run patchelf(pid=11772): Terminating (SIGINT) 20:37:22.507462 run patchelf(pid=11772): Terminated: ok {rc=0} 20:37:22.631626 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11769): Process ended prematurely: osmo-stp_10.42.42.5(pid=11769) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11769)] [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 20:37:22.641180 tst iperf3m4.py:8: Test FAILED (10.8 sec) 20:37:22.669415 run osmo-hlr_10.42.42.2(pid=11765): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11765)] 20:37:22.717686 run osmo-hlr_10.42.42.2(pid=11765): stdout: | (launched: 2022-12-08_20:37:19.438384) 20:37:22.767748 run osmo-hlr_10.42.42.2(pid=11765): stderr: | [0;m[1;31m20221208203719636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203719636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203719636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203719636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203719636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203719636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203719647 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203719655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203719656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203719656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:37:22.818709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11754): Terminating (SIGTERM) 20:37:22.858872 run iperf3-srv_10.42.42.10(pid=11755): Terminating (SIGTERM) 20:37:22.899133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11756): Terminating (SIGTERM) 20:37:22.939531 run iperf3-srv_10.42.42.10(pid=11757): Terminating (SIGTERM) 20:37:22.979794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11758): Terminating (SIGTERM) 20:37:23.020023 run iperf3-srv_10.42.42.10(pid=11759): Terminating (SIGTERM) 20:37:23.060197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11760): Terminating (SIGTERM) 20:37:23.100496 run iperf3-srv_10.42.42.10(pid=11761): Terminating (SIGTERM) 20:37:23.140560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11764): Terminating (SIGTERM) 20:37:23.180808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11768): Terminating (SIGTERM) 20:37:23.221077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11771): Terminating (SIGTERM) 20:37:23.261623 --- ParallelTerminationStrategy: PID 11754 died... 20:37:23.280904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11754): Terminated: ok {rc=0} 20:37:23.325727 --- ParallelTerminationStrategy: PID 11755 died... 20:37:23.344348 run iperf3-srv_10.42.42.10(pid=11755): Terminated {rc=256} 20:37:23.388723 --- ParallelTerminationStrategy: PID 11756 died... 20:37:23.407349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11756): Terminated: ok {rc=0} 20:37:23.452731 --- ParallelTerminationStrategy: PID 11757 died... 20:37:23.471612 run iperf3-srv_10.42.42.10(pid=11757): Terminated {rc=256} 20:37:23.516229 --- ParallelTerminationStrategy: PID 11758 died... 20:37:23.535002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11758): Terminated: ok {rc=0} 20:37:23.580259 --- ParallelTerminationStrategy: PID 11759 died... 20:37:23.598997 run iperf3-srv_10.42.42.10(pid=11759): Terminated {rc=256} 20:37:23.643370 --- ParallelTerminationStrategy: PID 11760 died... 20:37:23.662070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11760): Terminated: ok {rc=0} 20:37:23.706266 --- ParallelTerminationStrategy: PID 11761 died... 20:37:23.724823 run iperf3-srv_10.42.42.10(pid=11761): Terminated {rc=256} 20:37:23.769179 --- ParallelTerminationStrategy: PID 11764 died... 20:37:23.787673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11764): Terminated: ok {rc=0} 20:37:23.832117 --- ParallelTerminationStrategy: PID 11768 died... 20:37:23.850732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11768): Terminated: ok {rc=0} 20:37:23.895179 --- ParallelTerminationStrategy: PID 11771 died... 20:37:23.914110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11771): Terminated: ok {rc=0} 20:37:23.999356 bus /gobi_4: Setting Powered False 20:37:25.095549 bus /gobi_4: Setting Powered False 20:37:26.212316 bus /gobi_1: Setting Powered False 20:37:27.311976 bus /gobi_1: Setting Powered False 20:37:28.429151 bus /gobi_0: Setting Powered False 20:37:29.528100 bus /gobi_0: Setting Powered False 20:37:30.645356 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 20:37:31.751950 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:31.765314 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:37:31.818685 tst ping.py: using LAC 16656 20:37:31.976101 tst ping.py: using RAC 81 20:37:32.116360 tst ping.py: using CellId 16656 20:37:32.258901 tst ping.py: using BVCI 16657 20:37:32.374476 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:32.385929 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:32.397036 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:32.408388 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:32.419815 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:32.431073 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:32.442636 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:32.454015 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:37:32.575225 tst ping.py:19: start network... 20:37:32.793248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:37:33.290355 run create_hlr_db(pid=11773): Launched 20:37:33.422165 bus /gobi_6: Setting Powered False 20:37:34.486117 run create_hlr_db(pid=11773): Terminated: ok {rc=0} 20:37:34.917051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11775): Launched 20:37:35.217486 run osmo-hlr_10.42.42.2(pid=11776): Launched 20:37:35.332097 run osmo-stp_10.42.42.5: Starting osmo-stp 20:37:35.870903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11780): Launched 20:37:36.170235 run osmo-stp_10.42.42.5(pid=11781): Launched 20:37:36.283198 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:37:36.800873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11783): Launched 20:37:36.916152 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:37:37.169293 run patchelf(pid=11784): Launched 20:37:37.335948 run osmo-stp_10.42.42.5(pid=11781): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11781)] 20:37:37.463246 run osmo-stp_10.42.42.5(pid=11781): stdout: | (launched: 2022-12-08_20:37:36.115281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:37:37.592132 run osmo-stp_10.42.42.5(pid=11781): stderr: | [0;m[38;5;43m20221208203736288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203736288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203736289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203736289 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203736290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203736290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203736290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:37:37.721275 run osmo-stp_10.42.42.5(pid=11781): stdout: | (launched: 2022-12-08_20:37:36.115281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:37:37.844248 run osmo-stp_10.42.42.5(pid=11781): stderr: | [0;m[38;5;43m20221208203736288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203736288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203736289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203736289 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203736290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203736290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203736290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:37:37.990175 run patchelf(pid=11784): Terminating (SIGINT) 20:37:38.158707 run patchelf(pid=11784): Terminated: ok {rc=0} 20:37:38.280334 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11781): Process ended prematurely: osmo-stp_10.42.42.5(pid=11781) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11781)] [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 20:37:38.289407 tst ping.py:22: Test FAILED (6.5 sec) 20:37:38.316452 run osmo-hlr_10.42.42.2(pid=11776): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11776)] 20:37:38.364908 run osmo-hlr_10.42.42.2(pid=11776): stdout: | (launched: 2022-12-08_20:37:35.162347) 20:37:38.414951 run osmo-hlr_10.42.42.2(pid=11776): stderr: | [0;m[1;31m20221208203735338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203735338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203735338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203735338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203735338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203735338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203735354 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203735364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203735364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203735364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:37:38.465676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11775): Terminating (SIGTERM) 20:37:38.506091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11780): Terminating (SIGTERM) 20:37:38.546760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11783): Terminating (SIGTERM) 20:37:38.587715 --- ParallelTerminationStrategy: PID 11775 died... 20:37:38.607114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11775): Terminated: ok {rc=0} 20:37:38.652392 --- ParallelTerminationStrategy: PID 11780 died... 20:37:38.671446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11780): Terminated: ok {rc=0} 20:37:38.716928 --- ParallelTerminationStrategy: PID 11783 died... 20:37:38.736054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11783): Terminated: ok {rc=0} 20:37:38.824102 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 20:37:39.913797 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:39.925913 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:37:39.977667 tst ping_idle_ping.py: using LAC 16657 20:37:40.104746 tst ping_idle_ping.py: using RAC 82 20:37:40.229488 tst ping_idle_ping.py: using CellId 16657 20:37:40.354562 tst ping_idle_ping.py: using BVCI 16658 20:37:40.473361 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:40.485198 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:40.496663 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:40.508086 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:40.519439 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:40.530960 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:40.542579 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:40.553974 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:37:40.671991 tst ping_idle_ping.py:24: start network... 20:37:40.873742 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:37:41.341067 run create_hlr_db(pid=11785): Launched 20:37:41.458097 bus /gobi_6: Setting Powered False 20:37:42.518182 run create_hlr_db(pid=11785): Terminated: ok {rc=0} 20:37:42.962232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11787): Launched 20:37:43.286707 run osmo-hlr_10.42.42.2(pid=11788): Launched 20:37:43.409555 run osmo-stp_10.42.42.5: Starting osmo-stp 20:37:43.964804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11790): Launched 20:37:44.285698 run osmo-stp_10.42.42.5(pid=11791): Launched 20:37:44.411205 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:37:44.969366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11793): Launched 20:37:45.094782 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:37:45.366614 run patchelf(pid=11794): Launched 20:37:45.547592 run osmo-stp_10.42.42.5(pid=11791): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11791)] 20:37:45.684555 run osmo-stp_10.42.42.5(pid=11791): stdout: | (launched: 2022-12-08_20:37:44.227034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:37:45.823047 run osmo-stp_10.42.42.5(pid=11791): stderr: | [0;m[38;5;43m20221208203744419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203744419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203744419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203744419 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203744420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203744420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203744420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:37:45.975528 run osmo-stp_10.42.42.5(pid=11791): stdout: | (launched: 2022-12-08_20:37:44.227034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:37:46.105587 run osmo-stp_10.42.42.5(pid=11791): stderr: | [0;m[38;5;43m20221208203744419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203744419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203744419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203744419 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203744420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203744420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203744420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:37:46.257690 run patchelf(pid=11794): Terminating (SIGINT) 20:37:46.433634 run patchelf(pid=11794): Terminated: ok {rc=0} 20:37:46.561297 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11791): Process ended prematurely: osmo-stp_10.42.42.5(pid=11791) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11791)] [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 20:37:46.571293 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 20:37:46.602346 run osmo-hlr_10.42.42.2(pid=11788): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11788)] 20:37:46.653592 run osmo-hlr_10.42.42.2(pid=11788): stdout: | (launched: 2022-12-08_20:37:43.227568) 20:37:46.707920 run osmo-hlr_10.42.42.2(pid=11788): stderr: | [0;m[1;31m20221208203743426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203743426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203743426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203743426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203743426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203743426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203743438 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203743447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203743447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203743447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:37:46.760825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11787): Terminating (SIGTERM) 20:37:46.804262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11790): Terminating (SIGTERM) 20:37:46.849478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11793): Terminating (SIGTERM) 20:37:46.895235 --- ParallelTerminationStrategy: PID 11787 died... 20:37:46.915324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11787): Terminated: ok {rc=0} 20:37:46.964398 --- ParallelTerminationStrategy: PID 11790 died... 20:37:46.984081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11790): Terminated: ok {rc=0} 20:37:47.031530 --- ParallelTerminationStrategy: PID 11793 died... 20:37:47.051368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11793): Terminated: ok {rc=0} 20:37:47.141637 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 20:37:48.451265 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:37:48.457598 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 20:37:48.492163 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 20:37:48.530613 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 20:37:48.618103 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 20:37:48.651925 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 20:37:48.690224 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 20:37:49.285723 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 20:37:49.334839 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:37:49.345879 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:37:49.415544 tst cs_paging_gprs_active.py: using LAC 16658 20:37:49.535580 tst cs_paging_gprs_active.py: using RAC 83 20:37:49.664410 tst cs_paging_gprs_active.py: using CellId 16658 20:37:49.785343 tst cs_paging_gprs_active.py: using BVCI 16659 20:37:49.905563 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:37:49.917268 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:37:49.928654 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:37:49.940225 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:37:49.951697 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:37:49.963125 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:37:49.974653 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:37:49.985983 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:37:49.997498 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:37:50.117078 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:37:50.239282 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:37:50.460935 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:37:50.789825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11799): Launched 20:37:51.078487 run iperf3-srv_10.42.42.10(pid=11800): Launched 20:37:51.203197 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:37:51.423901 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:37:51.752918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11801): Launched 20:37:52.038652 run iperf3-srv_10.42.42.10(pid=11802): Launched 20:37:52.163430 tst cs_paging_gprs_active.py:38: start network... 20:37:52.384226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:37:52.891984 run create_hlr_db(pid=11803): Launched 20:37:53.025653 bus /gobi_6: Setting Powered False 20:37:54.090590 run create_hlr_db(pid=11803): Terminated: ok {rc=0} 20:37:54.557714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11816): Launched 20:37:54.900479 run osmo-hlr_10.42.42.2(pid=11817): Launched 20:37:55.146584 run osmo-stp_10.42.42.5: Starting osmo-stp 20:37:55.819375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11819): Launched 20:37:56.161569 run osmo-stp_10.42.42.5(pid=11820): Launched 20:37:56.412410 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:37:57.065246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11822): Launched 20:37:57.203353 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:37:57.486296 run patchelf(pid=11823): Launched 20:37:57.682430 run osmo-stp_10.42.42.5(pid=11820): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11820)] 20:37:57.823496 run osmo-stp_10.42.42.5(pid=11820): stdout: | (launched: 2022-12-08_20:37:56.101950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:37:57.967085 run osmo-stp_10.42.42.5(pid=11820): stderr: | [0;m[38;5;43m20221208203756394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203756395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203756395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203756395 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203756397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203756398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203756398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:37:58.110172 run osmo-stp_10.42.42.5(pid=11820): stdout: | (launched: 2022-12-08_20:37:56.101950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:37:58.246727 run osmo-stp_10.42.42.5(pid=11820): stderr: | [0;m[38;5;43m20221208203756394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203756395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203756395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203756395 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203756397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203756398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203756398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:37:58.411819 run patchelf(pid=11823): Terminating (SIGINT) 20:37:58.599005 run patchelf(pid=11823): Terminated: ok {rc=0} 20:37:58.733516 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11820): Process ended prematurely: osmo-stp_10.42.42.5(pid=11820) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11820)] [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 20:37:58.744875 tst cs_paging_gprs_active.py:38: Test FAILED (9.4 sec) 20:37:58.775289 run osmo-hlr_10.42.42.2(pid=11817): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11817)] 20:37:58.827347 run osmo-hlr_10.42.42.2(pid=11817): stdout: | (launched: 2022-12-08_20:37:54.840115) 20:37:58.882344 run osmo-hlr_10.42.42.2(pid=11817): stderr: | [0;m[1;31m20221208203755150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203755150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203755150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203755150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203755150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203755150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203755163 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203755179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203755180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203755180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:37:58.937306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11799): Terminating (SIGTERM) 20:37:58.992304 run iperf3-srv_10.42.42.10(pid=11800): Terminating (SIGTERM) 20:37:59.035780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11801): Terminating (SIGTERM) 20:37:59.079205 run iperf3-srv_10.42.42.10(pid=11802): Terminating (SIGTERM) 20:37:59.122484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11816): Terminating (SIGTERM) 20:37:59.166311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11819): Terminating (SIGTERM) 20:37:59.211589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11822): Terminating (SIGTERM) 20:37:59.257094 --- ParallelTerminationStrategy: PID 11799 died... 20:37:59.276799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11799): Terminated: ok {rc=0} 20:37:59.325514 --- ParallelTerminationStrategy: PID 11800 died... 20:37:59.345389 run iperf3-srv_10.42.42.10(pid=11800): Terminated {rc=256} 20:37:59.393241 --- ParallelTerminationStrategy: PID 11801 died... 20:37:59.413237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11801): Terminated: ok {rc=0} 20:37:59.470842 --- ParallelTerminationStrategy: PID 11802 died... 20:37:59.495442 run iperf3-srv_10.42.42.10(pid=11802): Terminated {rc=256} 20:37:59.543959 --- ParallelTerminationStrategy: PID 11816 died... 20:37:59.564028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11816): Terminated: ok {rc=0} 20:37:59.611758 --- ParallelTerminationStrategy: PID 11819 died... 20:37:59.631700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11819): Terminated: ok {rc=0} 20:37:59.690381 --- ParallelTerminationStrategy: PID 11822 died... 20:37:59.714936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11822): Terminated: ok {rc=0} 20:37:59.838384 bus /gobi_0: Setting Powered False 20:38:00.968297 bus /gobi_0: Setting Powered False 20:38:02.119493 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 20:38:03.300332 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:03.314363 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:38:03.392131 tst iperf3.py: using LAC 16659 20:38:03.524450 tst iperf3.py: using RAC 84 20:38:03.658076 tst iperf3.py: using CellId 16659 20:38:03.793020 tst iperf3.py: using BVCI 16660 20:38:03.917859 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:03.930325 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:03.942993 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:03.955628 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:03.967948 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:03.980416 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:03.992907 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:04.005916 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:04.018613 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:38:04.144414 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:38:04.372703 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:38:04.713695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12084): Launched 20:38:05.019423 run iperf3-srv_10.42.42.10(pid=12085): Launched 20:38:05.159976 tst iperf3.py:8: start network... 20:38:05.387633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:38:05.913638 run create_hlr_db(pid=12086): Launched 20:38:06.083019 bus /gobi_6: Setting Powered False 20:38:07.149588 run create_hlr_db(pid=12086): Terminated: ok {rc=0} 20:38:07.620094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12088): Launched 20:38:07.970790 run osmo-hlr_10.42.42.2(pid=12089): Launched 20:38:08.227735 run osmo-stp_10.42.42.5: Starting osmo-stp 20:38:08.909410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12091): Launched 20:38:09.257959 run osmo-stp_10.42.42.5(pid=12092): Launched 20:38:09.511306 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:38:10.177031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12094): Launched 20:38:10.318078 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:38:10.605618 run patchelf(pid=12095): Launched 20:38:10.811065 run osmo-stp_10.42.42.5(pid=12092): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12092)] 20:38:10.957391 run osmo-stp_10.42.42.5(pid=12092): stdout: | (launched: 2022-12-08_20:38:09.197941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:38:11.102737 run osmo-stp_10.42.42.5(pid=12092): stderr: | [0;m[38;5;43m20221208203809498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203809498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203809498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203809499 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203809499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203809499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203809499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:38:11.247910 run osmo-stp_10.42.42.5(pid=12092): stdout: | (launched: 2022-12-08_20:38:09.197941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:38:11.388459 run osmo-stp_10.42.42.5(pid=12092): stderr: | [0;m[38;5;43m20221208203809498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203809498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203809498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203809499 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203809499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203809499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203809499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:38:11.554293 run patchelf(pid=12095): Terminating (SIGINT) 20:38:11.747983 run patchelf(pid=12095): Terminated: ok {rc=0} 20:38:11.886253 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12092): Process ended prematurely: osmo-stp_10.42.42.5(pid=12092) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12092)] [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 20:38:11.898024 tst iperf3.py:8: Test FAILED (8.6 sec) 20:38:11.929165 run osmo-hlr_10.42.42.2(pid=12089): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12089)] 20:38:11.982423 run osmo-hlr_10.42.42.2(pid=12089): stdout: | (launched: 2022-12-08_20:38:07.910272) 20:38:12.037321 run osmo-hlr_10.42.42.2(pid=12089): stderr: | [0;m[1;31m20221208203808218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203808218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203808218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203808218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203808219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203808219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203808235 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203808251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203808251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203808252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:38:12.093476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12084): Terminating (SIGTERM) 20:38:12.137960 run iperf3-srv_10.42.42.10(pid=12085): Terminating (SIGTERM) 20:38:12.185567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12088): Terminating (SIGTERM) 20:38:12.230595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12091): Terminating (SIGTERM) 20:38:12.276921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12094): Terminating (SIGTERM) 20:38:12.324484 --- ParallelTerminationStrategy: PID 12084 died... 20:38:12.346303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12084): Terminated: ok {rc=0} 20:38:12.396133 --- ParallelTerminationStrategy: PID 12085 died... 20:38:12.417157 run iperf3-srv_10.42.42.10(pid=12085): Terminated {rc=256} 20:38:12.465641 --- ParallelTerminationStrategy: PID 12088 died... 20:38:12.487764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12088): Terminated: ok {rc=0} 20:38:12.536581 --- ParallelTerminationStrategy: PID 12091 died... 20:38:12.557915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12091): Terminated: ok {rc=0} 20:38:12.606612 --- ParallelTerminationStrategy: PID 12094 died... 20:38:12.628210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12094): Terminated: ok {rc=0} 20:38:12.724018 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 20:38:13.882502 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:13.896538 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:38:13.971835 tst iperf3m4.py: using LAC 16660 20:38:14.104093 tst iperf3m4.py: using RAC 85 20:38:14.235441 tst iperf3m4.py: using CellId 16660 20:38:14.367974 tst iperf3m4.py: using BVCI 16661 20:38:14.492767 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:14.505417 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:14.517852 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:14.530879 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:14.543537 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:14.556363 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:14.569180 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:14.582046 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:14.594979 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:38:14.715942 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:38:14.839401 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:38:14.957271 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:38:15.071849 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:38:15.280358 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:38:15.591834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12096): Launched 20:38:15.876427 run iperf3-srv_10.42.42.10(pid=12097): Launched 20:38:16.025423 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:38:16.243193 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:38:16.556511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12100): Launched 20:38:16.897820 run iperf3-srv_10.42.42.10(pid=12101): Launched 20:38:17.067280 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:38:17.284568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:38:17.604251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12102): Launched 20:38:17.869850 run iperf3-srv_10.42.42.10(pid=12103): Launched 20:38:17.994684 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:38:18.215168 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:38:18.544472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12104): Launched 20:38:18.831538 run iperf3-srv_10.42.42.10(pid=12105): Launched 20:38:18.956368 tst iperf3m4.py:8: start network... 20:38:19.177542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:38:19.685952 run create_hlr_db(pid=12106): Launched 20:38:19.819347 bus /gobi_6: Setting Powered False 20:38:20.884769 run create_hlr_db(pid=12106): Terminated: ok {rc=0} 20:38:21.321302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12108): Launched 20:38:21.626507 run osmo-hlr_10.42.42.2(pid=12109): Launched 20:38:21.746412 run osmo-stp_10.42.42.5: Starting osmo-stp 20:38:22.273395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12111): Launched 20:38:22.578467 run osmo-stp_10.42.42.5(pid=12112): Launched 20:38:22.697158 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:38:23.236048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12114): Launched 20:38:23.353583 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:38:23.612018 run patchelf(pid=12115): Launched 20:38:23.782338 run osmo-stp_10.42.42.5(pid=12112): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12112)] 20:38:23.911819 run osmo-stp_10.42.42.5(pid=12112): stdout: | (launched: 2022-12-08_20:38:22.522278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:38:24.042640 run osmo-stp_10.42.42.5(pid=12112): stderr: | [0;m[38;5;43m20221208203822696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203822696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203822696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203822696 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203822697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203822697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203822697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:38:24.173366 run osmo-stp_10.42.42.5(pid=12112): stdout: | (launched: 2022-12-08_20:38:22.522278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:38:24.298670 run osmo-stp_10.42.42.5(pid=12112): stderr: | [0;m[38;5;43m20221208203822696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203822696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203822696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203822696 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203822697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203822697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203822697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:38:24.446919 run patchelf(pid=12115): Terminating (SIGINT) 20:38:24.618934 run patchelf(pid=12115): Terminated: ok {rc=0} 20:38:24.742244 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12112): Process ended prematurely: osmo-stp_10.42.42.5(pid=12112) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12112)] [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 20:38:24.751811 tst iperf3m4.py:8: Test FAILED (10.9 sec) 20:38:24.779893 run osmo-hlr_10.42.42.2(pid=12109): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12109)] 20:38:24.828153 run osmo-hlr_10.42.42.2(pid=12109): stdout: | (launched: 2022-12-08_20:38:21.570472) 20:38:24.878016 run osmo-hlr_10.42.42.2(pid=12109): stderr: | [0;m[1;31m20221208203821746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203821746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203821746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203821746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203821746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203821746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203821759 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203821767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203821767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203821767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:38:24.928235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12096): Terminating (SIGTERM) 20:38:24.968463 run iperf3-srv_10.42.42.10(pid=12097): Terminating (SIGTERM) 20:38:25.008775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12100): Terminating (SIGTERM) 20:38:25.049081 run iperf3-srv_10.42.42.10(pid=12101): Terminating (SIGTERM) 20:38:25.089684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12102): Terminating (SIGTERM) 20:38:25.130091 run iperf3-srv_10.42.42.10(pid=12103): Terminating (SIGTERM) 20:38:25.170241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12104): Terminating (SIGTERM) 20:38:25.210422 run iperf3-srv_10.42.42.10(pid=12105): Terminating (SIGTERM) 20:38:25.250520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12108): Terminating (SIGTERM) 20:38:25.290842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12111): Terminating (SIGTERM) 20:38:25.331020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12114): Terminating (SIGTERM) 20:38:25.371543 --- ParallelTerminationStrategy: PID 12096 died... 20:38:25.390764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12096): Terminated: ok {rc=0} 20:38:25.435443 --- ParallelTerminationStrategy: PID 12097 died... 20:38:25.454180 run iperf3-srv_10.42.42.10(pid=12097): Terminated {rc=256} 20:38:25.498549 --- ParallelTerminationStrategy: PID 12100 died... 20:38:25.517238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12100): Terminated: ok {rc=0} 20:38:25.562315 --- ParallelTerminationStrategy: PID 12101 died... 20:38:25.580879 run iperf3-srv_10.42.42.10(pid=12101): Terminated {rc=256} 20:38:25.625205 --- ParallelTerminationStrategy: PID 12102 died... 20:38:25.643646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12102): Terminated: ok {rc=0} 20:38:25.687872 --- ParallelTerminationStrategy: PID 12103 died... 20:38:25.706410 run iperf3-srv_10.42.42.10(pid=12103): Terminated {rc=256} 20:38:25.750531 --- ParallelTerminationStrategy: PID 12104 died... 20:38:25.769228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12104): Terminated: ok {rc=0} 20:38:25.814024 --- ParallelTerminationStrategy: PID 12105 died... 20:38:25.832512 run iperf3-srv_10.42.42.10(pid=12105): Terminated {rc=256} 20:38:25.876641 --- ParallelTerminationStrategy: PID 12108 died... 20:38:25.895350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12108): Terminated: ok {rc=0} 20:38:25.940340 --- ParallelTerminationStrategy: PID 12111 died... 20:38:25.959028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12111): Terminated: ok {rc=0} 20:38:26.003310 --- ParallelTerminationStrategy: PID 12114 died... 20:38:26.022069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12114): Terminated: ok {rc=0} 20:38:26.106512 bus /gobi_4: Setting Powered False 20:38:27.203435 bus /gobi_4: Setting Powered False 20:38:28.320549 bus /gobi_1: Setting Powered False 20:38:29.421098 bus /gobi_1: Setting Powered False 20:38:30.537617 bus /gobi_0: Setting Powered False 20:38:31.640221 bus /gobi_0: Setting Powered False 20:38:32.762235 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 20:38:33.866623 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:33.878385 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:38:33.950996 tst ping.py: using LAC 16661 20:38:34.070369 tst ping.py: using RAC 86 20:38:34.188562 tst ping.py: using CellId 16661 20:38:34.307608 tst ping.py: using BVCI 16662 20:38:34.418418 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:34.429689 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:34.440750 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:34.452878 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:34.464578 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:34.476194 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:34.487936 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:34.499691 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:38:34.618024 tst ping.py:19: start network... 20:38:34.817583 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:38:35.279521 run create_hlr_db(pid=12116): Launched 20:38:35.392826 bus /gobi_6: Setting Powered False 20:38:36.453284 run create_hlr_db(pid=12116): Terminated: ok {rc=0} 20:38:36.870984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12118): Launched 20:38:37.177547 run osmo-hlr_10.42.42.2(pid=12119): Launched 20:38:37.303587 run osmo-stp_10.42.42.5: Starting osmo-stp 20:38:37.860314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12121): Launched 20:38:38.181483 run osmo-stp_10.42.42.5(pid=12122): Launched 20:38:38.303684 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:38:38.858580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12124): Launched 20:38:38.983207 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:38:39.255188 run patchelf(pid=12125): Launched 20:38:39.435217 run osmo-stp_10.42.42.5(pid=12122): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12122)] 20:38:39.571216 run osmo-stp_10.42.42.5(pid=12122): stdout: | (launched: 2022-12-08_20:38:38.123040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:38:39.708674 run osmo-stp_10.42.42.5(pid=12122): stderr: | [0;m[38;5;43m20221208203838315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203838315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203838315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203838316 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203838316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203838316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203838316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:38:39.846423 run osmo-stp_10.42.42.5(pid=12122): stdout: | (launched: 2022-12-08_20:38:38.123040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:38:39.978511 run osmo-stp_10.42.42.5(pid=12122): stderr: | [0;m[38;5;43m20221208203838315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203838315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203838315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203838316 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203838316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203838316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203838316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:38:40.134354 run patchelf(pid=12125): Terminating (SIGINT) 20:38:40.315474 run patchelf(pid=12125): Terminated: ok {rc=0} 20:38:40.445767 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12122): Process ended prematurely: osmo-stp_10.42.42.5(pid=12122) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12122)] [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 20:38:40.455381 tst ping.py:22: Test FAILED (6.6 sec) 20:38:40.483663 run osmo-hlr_10.42.42.2(pid=12119): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12119)] 20:38:40.533993 run osmo-hlr_10.42.42.2(pid=12119): stdout: | (launched: 2022-12-08_20:38:37.119020) 20:38:40.586072 run osmo-hlr_10.42.42.2(pid=12119): stderr: | [0;m[1;31m20221208203837315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203837315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203837315 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203837316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203837316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203837316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203837332 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203837341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203837342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203837342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:38:40.638447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12118): Terminating (SIGTERM) 20:38:40.682231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12121): Terminating (SIGTERM) 20:38:40.724611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12124): Terminating (SIGTERM) 20:38:40.767641 --- ParallelTerminationStrategy: PID 12118 died... 20:38:40.787950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12118): Terminated: ok {rc=0} 20:38:40.834683 --- ParallelTerminationStrategy: PID 12121 died... 20:38:40.854354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12121): Terminated: ok {rc=0} 20:38:40.901263 --- ParallelTerminationStrategy: PID 12124 died... 20:38:40.920917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12124): Terminated: ok {rc=0} 20:38:41.009664 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 20:38:42.098998 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:42.111785 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:38:42.186506 tst ping_idle_ping.py: using LAC 16662 20:38:42.313673 tst ping_idle_ping.py: using RAC 87 20:38:42.439058 tst ping_idle_ping.py: using CellId 16662 20:38:42.567165 tst ping_idle_ping.py: using BVCI 16663 20:38:42.685172 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:42.697259 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:42.708819 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:42.720388 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:42.732031 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:42.743641 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:42.755334 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:42.766899 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:38:42.887053 tst ping_idle_ping.py:24: start network... 20:38:43.104162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:38:43.612239 run create_hlr_db(pid=12126): Launched 20:38:43.743244 bus /gobi_6: Setting Powered False 20:38:44.807377 run create_hlr_db(pid=12126): Terminated: ok {rc=0} 20:38:45.237755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12128): Launched 20:38:45.539390 run osmo-hlr_10.42.42.2(pid=12129): Launched 20:38:45.654360 run osmo-stp_10.42.42.5: Starting osmo-stp 20:38:46.240596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12131): Launched 20:38:46.585715 run osmo-stp_10.42.42.5(pid=12132): Launched 20:38:46.761876 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:38:47.417825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12134): Launched 20:38:47.542833 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:38:47.814825 run patchelf(pid=12135): Launched 20:38:47.995703 run osmo-stp_10.42.42.5(pid=12132): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12132)] 20:38:48.132075 run osmo-stp_10.42.42.5(pid=12132): stdout: | (launched: 2022-12-08_20:38:46.524007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:38:48.270335 run osmo-stp_10.42.42.5(pid=12132): stderr: | [0;m[38;5;43m20221208203846900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203846900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203846900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203846901 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203846901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203846901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203846901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:38:48.408134 run osmo-stp_10.42.42.5(pid=12132): stdout: | (launched: 2022-12-08_20:38:46.524007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:38:48.539877 run osmo-stp_10.42.42.5(pid=12132): stderr: | [0;m[38;5;43m20221208203846900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203846900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203846900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203846901 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203846901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203846901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203846901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:38:48.696021 run patchelf(pid=12135): Terminating (SIGINT) 20:38:48.876420 run patchelf(pid=12135): Terminated: ok {rc=0} 20:38:49.006857 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12132): Process ended prematurely: osmo-stp_10.42.42.5(pid=12132) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12132)] [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 20:38:49.016503 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 20:38:49.044553 run osmo-hlr_10.42.42.2(pid=12129): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12129)] 20:38:49.094911 run osmo-hlr_10.42.42.2(pid=12129): stdout: | (launched: 2022-12-08_20:38:45.484445) 20:38:49.146781 run osmo-hlr_10.42.42.2(pid=12129): stderr: | [0;m[1;31m20221208203845659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203845659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203845659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203845659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203845659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203845659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203845671 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203845680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203845680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203845680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:38:49.199197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12128): Terminating (SIGTERM) 20:38:49.241175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12131): Terminating (SIGTERM) 20:38:49.283648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12134): Terminating (SIGTERM) 20:38:49.326084 --- ParallelTerminationStrategy: PID 12128 died... 20:38:49.346158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12128): Terminated: ok {rc=0} 20:38:49.392793 --- ParallelTerminationStrategy: PID 12131 died... 20:38:49.412557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12131): Terminated: ok {rc=0} 20:38:49.458708 --- ParallelTerminationStrategy: PID 12134 died... 20:38:49.478360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12134): Terminated: ok {rc=0} 20:38:49.566462 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:38:50.876590 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:38:50.883267 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:38:50.918186 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 20:38:50.958964 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 20:38:51.048017 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:38:51.082622 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 20:38:51.122067 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 20:38:51.722165 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 20:38:51.774456 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:38:51.786034 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:38:51.858783 tst cs_paging_gprs_active.py: using LAC 16663 20:38:51.989141 tst cs_paging_gprs_active.py: using RAC 88 20:38:52.117004 tst cs_paging_gprs_active.py: using CellId 16663 20:38:52.245133 tst cs_paging_gprs_active.py: using BVCI 16664 20:38:52.363876 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:38:52.375444 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:38:52.386930 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:38:52.398310 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:38:52.409669 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:38:52.420999 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:38:52.432509 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:38:52.443841 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:38:52.455318 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:38:52.572574 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:38:52.696107 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:38:52.918042 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:38:53.246949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12141): Launched 20:38:53.532763 run iperf3-srv_10.42.42.10(pid=12142): Launched 20:38:53.655659 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:38:53.876358 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:38:54.205712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12143): Launched 20:38:54.491174 run iperf3-srv_10.42.42.10(pid=12144): Launched 20:38:54.614105 tst cs_paging_gprs_active.py:38: start network... 20:38:54.834752 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:38:55.342447 run create_hlr_db(pid=12145): Launched 20:38:55.475234 bus /gobi_6: Setting Powered False 20:38:56.539631 run create_hlr_db(pid=12145): Terminated: ok {rc=0} 20:38:56.995730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12147): Launched 20:38:57.323124 run osmo-hlr_10.42.42.2(pid=12148): Launched 20:38:57.448621 run osmo-stp_10.42.42.5: Starting osmo-stp 20:38:58.011916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12150): Launched 20:38:58.338674 run osmo-stp_10.42.42.5(pid=12151): Launched 20:38:58.464128 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:38:59.028927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12153): Launched 20:38:59.154591 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:38:59.430956 run patchelf(pid=12154): Launched 20:38:59.614090 run osmo-stp_10.42.42.5(pid=12151): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12151)] 20:38:59.752619 run osmo-stp_10.42.42.5(pid=12151): stdout: | (launched: 2022-12-08_20:38:58.279174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:38:59.892919 run osmo-stp_10.42.42.5(pid=12151): stderr: | [0;m[38;5;43m20221208203858471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203858471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203858471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203858471 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203858474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203858474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203858474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:00.033113 run osmo-stp_10.42.42.5(pid=12151): stdout: | (launched: 2022-12-08_20:38:58.279174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:00.167335 run osmo-stp_10.42.42.5(pid=12151): stderr: | [0;m[38;5;43m20221208203858471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203858471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203858471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203858471 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203858474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203858474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203858474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:00.326498 run patchelf(pid=12154): Terminating (SIGINT) 20:39:00.509422 run patchelf(pid=12154): Terminated: ok {rc=0} 20:39:00.641204 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12151): Process ended prematurely: osmo-stp_10.42.42.5(pid=12151) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12151)] [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 20:39:00.651507 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 20:39:00.679962 run osmo-hlr_10.42.42.2(pid=12148): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12148)] 20:39:00.730297 run osmo-hlr_10.42.42.2(pid=12148): stdout: | (launched: 2022-12-08_20:38:57.263213) 20:39:00.782203 run osmo-hlr_10.42.42.2(pid=12148): stderr: | [0;m[1;31m20221208203857461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203857461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203857461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203857461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203857461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203857461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203857474 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203857483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203857483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203857483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:39:00.834831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12141): Terminating (SIGTERM) 20:39:00.877263 run iperf3-srv_10.42.42.10(pid=12142): Terminating (SIGTERM) 20:39:00.920167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12143): Terminating (SIGTERM) 20:39:00.963221 run iperf3-srv_10.42.42.10(pid=12144): Terminating (SIGTERM) 20:39:01.007697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12147): Terminating (SIGTERM) 20:39:01.050978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12150): Terminating (SIGTERM) 20:39:01.093886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12153): Terminating (SIGTERM) 20:39:01.137204 --- ParallelTerminationStrategy: PID 12141 died... 20:39:01.157441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12141): Terminated: ok {rc=0} 20:39:01.204841 --- ParallelTerminationStrategy: PID 12142 died... 20:39:01.225300 run iperf3-srv_10.42.42.10(pid=12142): Terminated {rc=256} 20:39:01.272942 --- ParallelTerminationStrategy: PID 12143 died... 20:39:01.293708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12143): Terminated: ok {rc=0} 20:39:01.341423 --- ParallelTerminationStrategy: PID 12144 died... 20:39:01.361867 run iperf3-srv_10.42.42.10(pid=12144): Terminated {rc=256} 20:39:01.409444 --- ParallelTerminationStrategy: PID 12147 died... 20:39:01.429995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12147): Terminated: ok {rc=0} 20:39:01.477197 --- ParallelTerminationStrategy: PID 12150 died... 20:39:01.497491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12150): Terminated: ok {rc=0} 20:39:01.544621 --- ParallelTerminationStrategy: PID 12153 died... 20:39:01.565012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12153): Terminated: ok {rc=0} 20:39:01.659560 bus /gobi_0: Setting Powered False 20:39:02.770275 bus /gobi_0: Setting Powered False 20:39:03.882782 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 20:39:05.032902 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:05.045407 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:39:05.121856 tst iperf3.py: using LAC 16664 20:39:05.251347 tst iperf3.py: using RAC 89 20:39:05.381547 tst iperf3.py: using CellId 16664 20:39:05.503571 tst iperf3.py: using BVCI 16665 20:39:05.616589 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:05.627858 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:05.638924 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:05.650286 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:05.661616 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:05.673180 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:05.684469 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:05.695532 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:05.709761 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:39:05.826856 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:39:06.033499 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:39:06.340766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12155): Launched 20:39:06.608161 run iperf3-srv_10.42.42.10(pid=12156): Launched 20:39:06.723247 tst iperf3.py:8: start network... 20:39:06.927826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:39:07.401406 run create_hlr_db(pid=12157): Launched 20:39:07.520731 bus /gobi_6: Setting Powered False 20:39:08.581652 run create_hlr_db(pid=12157): Terminated: ok {rc=0} 20:39:09.029362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12159): Launched 20:39:09.356428 run osmo-hlr_10.42.42.2(pid=12160): Launched 20:39:09.481797 run osmo-stp_10.42.42.5: Starting osmo-stp 20:39:10.048193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12162): Launched 20:39:10.374875 run osmo-stp_10.42.42.5(pid=12163): Launched 20:39:10.498382 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:39:11.062993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12165): Launched 20:39:11.188470 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:39:11.466166 run patchelf(pid=12166): Launched 20:39:11.650705 run osmo-stp_10.42.42.5(pid=12163): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12163)] 20:39:11.789343 run osmo-stp_10.42.42.5(pid=12163): stdout: | (launched: 2022-12-08_20:39:10.314932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:11.930210 run osmo-stp_10.42.42.5(pid=12163): stderr: | [0;m[38;5;43m20221208203910508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203910508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203910509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203910509 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203910509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203910509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203910510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:12.070376 run osmo-stp_10.42.42.5(pid=12163): stdout: | (launched: 2022-12-08_20:39:10.314932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:12.205024 run osmo-stp_10.42.42.5(pid=12163): stderr: | [0;m[38;5;43m20221208203910508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203910508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203910509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203910509 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203910509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203910509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203910510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:12.364340 run patchelf(pid=12166): Terminating (SIGINT) 20:39:12.548537 run patchelf(pid=12166): Terminated: ok {rc=0} 20:39:12.680927 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12163): Process ended prematurely: osmo-stp_10.42.42.5(pid=12163) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12163)] [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 20:39:12.691423 tst iperf3.py:8: Test FAILED (7.7 sec) 20:39:12.720161 run osmo-hlr_10.42.42.2(pid=12160): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12160)] 20:39:12.770230 run osmo-hlr_10.42.42.2(pid=12160): stdout: | (launched: 2022-12-08_20:39:09.296401) 20:39:12.822059 run osmo-hlr_10.42.42.2(pid=12160): stderr: | [0;m[1;31m20221208203909496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203909496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203909496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203909496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203909496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203909497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203909509 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203909519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203909520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203909520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:39:12.874357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12155): Terminating (SIGTERM) 20:39:12.916549 run iperf3-srv_10.42.42.10(pid=12156): Terminating (SIGTERM) 20:39:12.958336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12159): Terminating (SIGTERM) 20:39:13.000176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12162): Terminating (SIGTERM) 20:39:13.042110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12165): Terminating (SIGTERM) 20:39:13.084169 --- ParallelTerminationStrategy: PID 12155 died... 20:39:13.104304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12155): Terminated: ok {rc=0} 20:39:13.150657 --- ParallelTerminationStrategy: PID 12156 died... 20:39:13.170214 run iperf3-srv_10.42.42.10(pid=12156): Terminated {rc=256} 20:39:13.216336 --- ParallelTerminationStrategy: PID 12159 died... 20:39:13.236064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12159): Terminated: ok {rc=0} 20:39:13.282614 --- ParallelTerminationStrategy: PID 12162 died... 20:39:13.302334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12162): Terminated: ok {rc=0} 20:39:13.348280 --- ParallelTerminationStrategy: PID 12165 died... 20:39:13.367999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12165): Terminated: ok {rc=0} 20:39:13.455155 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 20:39:14.606624 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:14.618949 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:39:14.696669 tst iperf3m4.py: using LAC 16665 20:39:14.824264 tst iperf3m4.py: using RAC 90 20:39:14.950655 tst iperf3m4.py: using CellId 16665 20:39:15.077582 tst iperf3m4.py: using BVCI 16666 20:39:15.196302 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:15.207992 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:15.219522 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:15.231021 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:15.242446 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:15.253842 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:15.265319 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:15.276552 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:15.288078 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:39:15.409698 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:39:15.532702 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:39:15.652437 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:39:15.769638 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:39:16.016900 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:39:16.332005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12167): Launched 20:39:16.621974 run iperf3-srv_10.42.42.10(pid=12168): Launched 20:39:16.753391 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:39:16.962871 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:39:17.275333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12169): Launched 20:39:17.547807 run iperf3-srv_10.42.42.10(pid=12170): Launched 20:39:17.662782 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:39:17.866625 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:39:18.173477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12171): Launched 20:39:18.439917 run iperf3-srv_10.42.42.10(pid=12172): Launched 20:39:18.554252 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:39:18.757427 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:39:19.063247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12173): Launched 20:39:19.329141 run iperf3-srv_10.42.42.10(pid=12174): Launched 20:39:19.443922 tst iperf3m4.py:8: start network... 20:39:19.647584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:39:20.119561 run create_hlr_db(pid=12175): Launched 20:39:20.237576 bus /gobi_6: Setting Powered False 20:39:21.298580 run create_hlr_db(pid=12175): Terminated: ok {rc=0} 20:39:21.724336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12177): Launched 20:39:22.030014 run osmo-hlr_10.42.42.2(pid=12178): Launched 20:39:22.146586 run osmo-stp_10.42.42.5: Starting osmo-stp 20:39:22.670601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12180): Launched 20:39:22.974918 run osmo-stp_10.42.42.5(pid=12181): Launched 20:39:23.091032 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:39:23.615996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12183): Launched 20:39:23.732666 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:39:23.990452 run patchelf(pid=12184): Launched 20:39:24.160615 run osmo-stp_10.42.42.5(pid=12181): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12181)] 20:39:24.290099 run osmo-stp_10.42.42.5(pid=12181): stdout: | (launched: 2022-12-08_20:39:22.918779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:24.420590 run osmo-stp_10.42.42.5(pid=12181): stderr: | [0;m[38;5;43m20221208203923090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203923090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203923091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203923091 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203923092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203923092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203923092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:24.551356 run osmo-stp_10.42.42.5(pid=12181): stdout: | (launched: 2022-12-08_20:39:22.918779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:24.676601 run osmo-stp_10.42.42.5(pid=12181): stderr: | [0;m[38;5;43m20221208203923090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203923090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203923091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203923091 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203923092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203923092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203923092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:24.824834 run patchelf(pid=12184): Terminating (SIGINT) 20:39:24.996363 run patchelf(pid=12184): Terminated: ok {rc=0} 20:39:25.119605 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12181): Process ended prematurely: osmo-stp_10.42.42.5(pid=12181) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12181)] [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 20:39:25.129317 tst iperf3m4.py:8: Test FAILED (10.6 sec) 20:39:25.157090 run osmo-hlr_10.42.42.2(pid=12178): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12178)] 20:39:25.205306 run osmo-hlr_10.42.42.2(pid=12178): stdout: | (launched: 2022-12-08_20:39:21.974096) 20:39:25.254937 run osmo-hlr_10.42.42.2(pid=12178): stderr: | [0;m[1;31m20221208203922154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203922154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203922154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203922154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203922154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203922154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203922176 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203922184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203922184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203922184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:39:25.305316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12167): Terminating (SIGTERM) 20:39:25.345426 run iperf3-srv_10.42.42.10(pid=12168): Terminating (SIGTERM) 20:39:25.385554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12169): Terminating (SIGTERM) 20:39:25.425683 run iperf3-srv_10.42.42.10(pid=12170): Terminating (SIGTERM) 20:39:25.465669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12171): Terminating (SIGTERM) 20:39:25.505773 run iperf3-srv_10.42.42.10(pid=12172): Terminating (SIGTERM) 20:39:25.545914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12173): Terminating (SIGTERM) 20:39:25.586165 run iperf3-srv_10.42.42.10(pid=12174): Terminating (SIGTERM) 20:39:25.626025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12177): Terminating (SIGTERM) 20:39:25.666014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12180): Terminating (SIGTERM) 20:39:25.706134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12183): Terminating (SIGTERM) 20:39:25.746428 --- ParallelTerminationStrategy: PID 12167 died... 20:39:25.765582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12167): Terminated: ok {rc=0} 20:39:25.810842 --- ParallelTerminationStrategy: PID 12168 died... 20:39:25.829480 run iperf3-srv_10.42.42.10(pid=12168): Terminated {rc=256} 20:39:25.873498 --- ParallelTerminationStrategy: PID 12169 died... 20:39:25.892142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12169): Terminated: ok {rc=0} 20:39:25.936769 --- ParallelTerminationStrategy: PID 12170 died... 20:39:25.955498 run iperf3-srv_10.42.42.10(pid=12170): Terminated {rc=256} 20:39:25.999869 --- ParallelTerminationStrategy: PID 12171 died... 20:39:26.018648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12171): Terminated: ok {rc=0} 20:39:26.063587 --- ParallelTerminationStrategy: PID 12172 died... 20:39:26.082265 run iperf3-srv_10.42.42.10(pid=12172): Terminated {rc=256} 20:39:26.126892 --- ParallelTerminationStrategy: PID 12173 died... 20:39:26.145674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12173): Terminated: ok {rc=0} 20:39:26.190700 --- ParallelTerminationStrategy: PID 12174 died... 20:39:26.209263 run iperf3-srv_10.42.42.10(pid=12174): Terminated {rc=256} 20:39:26.253765 --- ParallelTerminationStrategy: PID 12177 died... 20:39:26.272605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12177): Terminated: ok {rc=0} 20:39:26.317314 --- ParallelTerminationStrategy: PID 12180 died... 20:39:26.336063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12180): Terminated: ok {rc=0} 20:39:26.380681 --- ParallelTerminationStrategy: PID 12183 died... 20:39:26.399699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12183): Terminated: ok {rc=0} 20:39:26.487540 bus /gobi_4: Setting Powered False 20:39:27.589194 bus /gobi_4: Setting Powered False 20:39:28.704015 bus /gobi_1: Setting Powered False 20:39:29.803346 bus /gobi_1: Setting Powered False 20:39:30.930813 bus /gobi_0: Setting Powered False 20:39:32.034982 bus /gobi_0: Setting Powered False 20:39:33.151453 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 20:39:34.253724 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:34.265620 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:39:34.337886 tst ping.py: using LAC 16666 20:39:34.457932 tst ping.py: using RAC 91 20:39:34.574425 tst ping.py: using CellId 16666 20:39:34.689739 tst ping.py: using BVCI 16667 20:39:34.799569 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:34.810889 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:34.822139 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:34.833643 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:34.844877 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:34.856326 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:34.867669 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:34.878843 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:39:34.994378 tst ping.py:19: start network... 20:39:35.194958 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:39:35.658694 run create_hlr_db(pid=12186): Launched 20:39:35.772625 bus /gobi_6: Setting Powered False 20:39:36.833291 run create_hlr_db(pid=12186): Terminated: ok {rc=0} 20:39:37.274853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12188): Launched 20:39:37.597933 run osmo-hlr_10.42.42.2(pid=12189): Launched 20:39:37.723912 run osmo-stp_10.42.42.5: Starting osmo-stp 20:39:38.285251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12191): Launched 20:39:38.606195 run osmo-stp_10.42.42.5(pid=12192): Launched 20:39:38.728271 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:39:39.283009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12194): Launched 20:39:39.406199 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:39:39.677335 run patchelf(pid=12195): Launched 20:39:39.856158 run osmo-stp_10.42.42.5(pid=12192): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12192)] 20:39:39.993382 run osmo-stp_10.42.42.5(pid=12192): stdout: | (launched: 2022-12-08_20:39:38.547292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:40.131350 run osmo-stp_10.42.42.5(pid=12192): stderr: | [0;m[38;5;43m20221208203938742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203938742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203938742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203938743 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203938743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203938743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203938743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:40.269458 run osmo-stp_10.42.42.5(pid=12192): stdout: | (launched: 2022-12-08_20:39:38.547292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:40.401379 run osmo-stp_10.42.42.5(pid=12192): stderr: | [0;m[38;5;43m20221208203938742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203938742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203938742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203938743 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203938743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203938743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203938743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:40.557498 run patchelf(pid=12195): Terminating (SIGINT) 20:39:40.737748 run patchelf(pid=12195): Terminated: ok {rc=0} 20:39:40.867096 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12192): Process ended prematurely: osmo-stp_10.42.42.5(pid=12192) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12192)] [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 20:39:40.876598 tst ping.py:22: Test FAILED (6.6 sec) 20:39:40.904695 run osmo-hlr_10.42.42.2(pid=12189): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12189)] 20:39:40.954967 run osmo-hlr_10.42.42.2(pid=12189): stdout: | (launched: 2022-12-08_20:39:37.539445) 20:39:41.006987 run osmo-hlr_10.42.42.2(pid=12189): stderr: | [0;m[1;31m20221208203937739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203937739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203937739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203937739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203937739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203937739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203937751 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203937760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203937760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203937760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:39:41.059265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12188): Terminating (SIGTERM) 20:39:41.101194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12191): Terminating (SIGTERM) 20:39:41.143265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12194): Terminating (SIGTERM) 20:39:41.185589 --- ParallelTerminationStrategy: PID 12188 died... 20:39:41.205737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12188): Terminated: ok {rc=0} 20:39:41.252044 --- ParallelTerminationStrategy: PID 12191 died... 20:39:41.271640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12191): Terminated: ok {rc=0} 20:39:41.317828 --- ParallelTerminationStrategy: PID 12194 died... 20:39:41.337491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12194): Terminated: ok {rc=0} 20:39:41.425277 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 20:39:42.513661 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:42.525573 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:39:42.599338 tst ping_idle_ping.py: using LAC 16667 20:39:42.723397 tst ping_idle_ping.py: using RAC 92 20:39:42.840672 tst ping_idle_ping.py: using CellId 16667 20:39:42.957488 tst ping_idle_ping.py: using BVCI 16668 20:39:43.068844 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:43.080189 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:43.091403 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:43.102858 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:43.114391 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:43.125794 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:43.137285 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:43.148523 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:39:43.270270 tst ping_idle_ping.py:24: start network... 20:39:43.489398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:39:43.992311 run create_hlr_db(pid=12196): Launched 20:39:44.123751 bus /gobi_6: Setting Powered False 20:39:45.187431 run create_hlr_db(pid=12196): Terminated: ok {rc=0} 20:39:45.618729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12198): Launched 20:39:45.945828 run osmo-hlr_10.42.42.2(pid=12199): Launched 20:39:46.165293 run osmo-stp_10.42.42.5: Starting osmo-stp 20:39:46.789735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12201): Launched 20:39:47.133767 run osmo-stp_10.42.42.5(pid=12202): Launched 20:39:47.343328 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:39:47.904131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12204): Launched 20:39:48.028057 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:39:48.300433 run patchelf(pid=12205): Launched 20:39:48.480102 run osmo-stp_10.42.42.5(pid=12202): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12202)] 20:39:48.617540 run osmo-stp_10.42.42.5(pid=12202): stdout: | (launched: 2022-12-08_20:39:47.068000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:48.756126 run osmo-stp_10.42.42.5(pid=12202): stderr: | [0;m[38;5;43m20221208203947354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203947354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203947354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203947354 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203947355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203947355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203947355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:48.894716 run osmo-stp_10.42.42.5(pid=12202): stdout: | (launched: 2022-12-08_20:39:47.068000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:49.027597 run osmo-stp_10.42.42.5(pid=12202): stderr: | [0;m[38;5;43m20221208203947354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203947354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203947354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203947354 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203947355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203947355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203947355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:49.184584 run patchelf(pid=12205): Terminating (SIGINT) 20:39:49.366830 run patchelf(pid=12205): Terminated: ok {rc=0} 20:39:49.497762 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12202): Process ended prematurely: osmo-stp_10.42.42.5(pid=12202) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12202)] [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 20:39:49.507358 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 20:39:49.535603 run osmo-hlr_10.42.42.2(pid=12199): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12199)] 20:39:49.585959 run osmo-hlr_10.42.42.2(pid=12199): stdout: | (launched: 2022-12-08_20:39:45.870985) 20:39:49.638358 run osmo-hlr_10.42.42.2(pid=12199): stderr: | [0;m[1;31m20221208203946124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203946124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203946125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203946125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203946125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203946125 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203946159 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203946176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203946176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203946176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:39:49.690883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12198): Terminating (SIGTERM) 20:39:49.732913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12201): Terminating (SIGTERM) 20:39:49.775348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12204): Terminating (SIGTERM) 20:39:49.817869 --- ParallelTerminationStrategy: PID 12198 died... 20:39:49.838002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12198): Terminated: ok {rc=0} 20:39:49.884408 --- ParallelTerminationStrategy: PID 12201 died... 20:39:49.904096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12201): Terminated: ok {rc=0} 20:39:49.950573 --- ParallelTerminationStrategy: PID 12204 died... 20:39:49.970344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12204): Terminated: ok {rc=0} 20:39:50.058795 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:39:51.367886 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:39:51.374660 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:39:51.409736 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 20:39:51.444485 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:39:51.497254 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:39:51.531058 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 20:39:51.565641 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:39:52.125348 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2349 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 20:39:52.130606 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:39:52.142292 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:39:52.214282 tst switch_tch_pdch.py: using LAC 16668 20:39:52.343256 tst switch_tch_pdch.py: using RAC 93 20:39:52.473131 tst switch_tch_pdch.py: using CellId 16668 20:39:52.601331 tst switch_tch_pdch.py: using BVCI 16669 20:39:52.719426 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:39:52.731285 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:39:52.743106 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:39:52.755131 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:39:52.766806 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:39:52.778635 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:39:52.790671 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:39:52.802406 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:39:52.922971 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:39:53.042690 tst switch_tch_pdch.py:51: start network... 20:39:53.259534 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:39:53.756503 run create_hlr_db(pid=12209): Launched 20:39:53.887035 bus /gobi_6: Setting Powered False 20:39:54.952195 run create_hlr_db(pid=12209): Terminated: ok {rc=0} 20:39:55.381575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12211): Launched 20:39:55.681531 run osmo-hlr_10.42.42.2(pid=12212): Launched 20:39:55.796871 run osmo-stp_10.42.42.5: Starting osmo-stp 20:39:56.329065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12214): Launched 20:39:56.627573 run osmo-stp_10.42.42.5(pid=12215): Launched 20:39:56.741226 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:39:57.255971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12217): Launched 20:39:57.371165 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:39:57.638466 run patchelf(pid=12218): Launched 20:39:57.818443 run osmo-stp_10.42.42.5(pid=12215): ERR: Terminated: ERROR {rc=1} [trial-2349↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12215)] 20:39:57.955884 run osmo-stp_10.42.42.5(pid=12215): stdout: | (launched: 2022-12-08_20:39:56.573079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:58.095057 run osmo-stp_10.42.42.5(pid=12215): stderr: | [0;m[38;5;43m20221208203956746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203956746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203956747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203956747 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203956748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203956748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203956748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:58.233451 run osmo-stp_10.42.42.5(pid=12215): stdout: | (launched: 2022-12-08_20:39:56.573079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:58.365269 run osmo-stp_10.42.42.5(pid=12215): stderr: | [0;m[38;5;43m20221208203956746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208203956746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208203956747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208203956747 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208203956748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208203956748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208203956748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:58.521505 run patchelf(pid=12218): Terminating (SIGINT) 20:39:58.702021 run patchelf(pid=12218): Terminated: ok {rc=0} 20:39:58.831693 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12215): Process ended prematurely: osmo-stp_10.42.42.5(pid=12215) [trial-2349↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12215)] [trial-2349↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 20:39:58.841244 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 20:39:58.869242 run osmo-hlr_10.42.42.2(pid=12212): ERR: Terminated: ERROR {rc=237} [trial-2349↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12212)] 20:39:58.919743 run osmo-hlr_10.42.42.2(pid=12212): stdout: | (launched: 2022-12-08_20:39:55.626780) 20:39:58.971721 run osmo-hlr_10.42.42.2(pid=12212): stderr: | [0;m[1;31m20221208203955807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208203955807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208203955807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208203955807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208203955807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208203955807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208203955821 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208203955830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208203955831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208203955831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:39:59.024295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12211): Terminating (SIGTERM) 20:39:59.066411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12214): Terminating (SIGTERM) 20:39:59.108624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12217): Terminating (SIGTERM) 20:39:59.151525 --- ParallelTerminationStrategy: PID 12211 died... 20:39:59.171662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12211): Terminated: ok {rc=0} 20:39:59.218061 --- ParallelTerminationStrategy: PID 12214 died... 20:39:59.237767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12214): Terminated: ok {rc=0} 20:39:59.284235 --- ParallelTerminationStrategy: PID 12217 died... 20:39:59.303872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12217): Terminated: ok {rc=0} 20:39:59.391507 bus /gobi_0: Setting Powered False 20:40:00.486866 bus /gobi_0: Setting Powered False 20:40:01.602521 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 20:40:02.864204 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:40:02.870701 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 20:40:02.905542 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 20:40:02.941820 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 20:40:02.995142 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 20:40:03.029943 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 20:40:03.065378 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 20:40:03.625596 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2349 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 20:40:03.630971 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:40:03.642731 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 20:40:03.714659 tst switch_tch_pdch.py: using LAC 16669 20:40:03.840564 tst switch_tch_pdch.py: using RAC 94 20:40:03.965594 tst switch_tch_pdch.py: using CellId 16669 20:40:04.091761 tst switch_tch_pdch.py: using BVCI 16670 20:40:04.208196 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:40:04.219794 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:40:04.231215 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:40:04.242776 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:40:04.254130 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:40:04.265546 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:40:04.277050 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:40:04.288457 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:40:04.410667 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:40:04.531620 tst switch_tch_pdch.py:51: start network... 20:40:04.749009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:40:05.219034 run create_hlr_db(pid=12225): Launched 20:40:05.349805 bus /gobi_6: Setting Powered False 20:40:06.414207 run create_hlr_db(pid=12225): Terminated: ok {rc=0} 20:40:06.820340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12227): Launched 20:40:07.121865 run osmo-hlr_10.42.42.2(pid=12228): Launched 20:40:07.236110 run osmo-stp_10.42.42.5: Starting osmo-stp 20:40:07.741915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12230): Launched 20:40:08.040693 run osmo-stp_10.42.42.5(pid=12231): Launched 20:40:08.153747 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:40:08.644395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12233): Launched 20:40:08.759673 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:40:09.012053 run patchelf(pid=12234): Launched 20:40:09.178914 run osmo-stp_10.42.42.5(pid=12231): ERR: Terminated: ERROR {rc=1} [trial-2349↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12231)] 20:40:09.306238 run osmo-stp_10.42.42.5(pid=12231): stdout: | (launched: 2022-12-08_20:40:07.985897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:09.435008 run osmo-stp_10.42.42.5(pid=12231): stderr: | [0;m[38;5;43m20221208204008157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204008157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204008158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204008158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204008158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204008159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204008159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:09.563876 run osmo-stp_10.42.42.5(pid=12231): stdout: | (launched: 2022-12-08_20:40:07.985897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:09.686580 run osmo-stp_10.42.42.5(pid=12231): stderr: | [0;m[38;5;43m20221208204008157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204008157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204008158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204008158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204008158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204008159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204008159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:09.831916 run patchelf(pid=12234): Terminating (SIGINT) 20:40:10.000132 run patchelf(pid=12234): Terminated: ok {rc=0} 20:40:10.121628 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12231): Process ended prematurely: osmo-stp_10.42.42.5(pid=12231) [trial-2349↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12231)] [trial-2349↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 20:40:10.130502 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 20:40:10.157687 run osmo-hlr_10.42.42.2(pid=12228): ERR: Terminated: ERROR {rc=237} [trial-2349↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12228)] 20:40:10.205763 run osmo-hlr_10.42.42.2(pid=12228): stdout: | (launched: 2022-12-08_20:40:07.066892) 20:40:10.255577 run osmo-hlr_10.42.42.2(pid=12228): stderr: | [0;m[1;31m20221208204007240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204007240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204007240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204007240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204007240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204007240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204007252 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204007260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204007260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204007261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:40:10.305816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12227): Terminating (SIGTERM) 20:40:10.346074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12230): Terminating (SIGTERM) 20:40:10.386375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12233): Terminating (SIGTERM) 20:40:10.426863 --- ParallelTerminationStrategy: PID 12227 died... 20:40:10.445950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12227): Terminated: ok {rc=0} 20:40:10.490457 --- ParallelTerminationStrategy: PID 12230 died... 20:40:10.509108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12230): Terminated: ok {rc=0} 20:40:10.553487 --- ParallelTerminationStrategy: PID 12233 died... 20:40:10.572067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12233): Terminated: ok {rc=0} 20:40:10.655533 bus /gobi_0: Setting Powered False 20:40:11.751585 bus /gobi_0: Setting Powered False 20:40:12.863710 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 nitb_sms:trx-umtrx --------------------------------------------------------------------- 20:40:14.123860 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:40:14.128191 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 20:40:14.161978 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 20:40:14.169395 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 20:40:14.222893 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 20:40:14.256506 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 20:40:14.263693 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 20:40:14.803094 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 20:40:14.808516 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 20:40:14.819941 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 20:40:14.871947 tst mo_mt_sms.py: using LAC 16670 20:40:14.998137 tst mo_mt_sms.py: using RAC 95 20:40:15.115955 tst mo_mt_sms.py: using CellId 16670 20:40:15.231842 tst mo_mt_sms.py: using BVCI 16671 20:40:15.339558 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 20:40:15.459821 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 20:40:15.573698 tst mo_mt_sms.py:9: start nitb and bts... 20:40:15.775833 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:40:16.448140 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12238): Launched 20:40:16.785142 run osmo-nitb_10.42.42.2(pid=12239): Launched 20:40:16.986740 run osmo-nitb_10.42.42.2(pid=12239): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12239)] 20:40:17.135672 run osmo-nitb_10.42.42.2(pid=12239): stdout: | (launched: 2022-12-08_20:40:16.725679) 20:40:17.282749 run osmo-nitb_10.42.42.2(pid=12239): stderr: | (launched: 2022-12-08_20:40:16.775481) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:40:17.430248 run osmo-nitb_10.42.42.2(pid=12239): stdout: | (launched: 2022-12-08_20:40:16.725679) 20:40:17.571050 run osmo-nitb_10.42.42.2(pid=12239): stderr: | (launched: 2022-12-08_20:40:16.775481) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8fda692268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12239): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12239) [trial-2349↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12239)] 20:40:17.928129 tst osmo-nitb_10.42.42.2(pid=12239): stdout: | (launched: 2022-12-08_20:40:16.725679) 20:40:18.058672 tst osmo-nitb_10.42.42.2(pid=12239): stderr: | (launched: 2022-12-08_20:40:16.775481) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:40:18.212715 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=12239): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12239) [trial-2349↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12239)] [trial-2349↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 20:40:18.221871 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 20:40:18.228920 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12238): Terminating (SIGTERM) 20:40:18.441418 --- ParallelTerminationStrategy: PID 12238 died... 20:40:18.462880 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12238): Terminated: ok {rc=0} 20:40:18.552513 bus /sierra_3: Setting Powered False 20:40:19.653578 bus /sierra_3: Setting Powered False 20:40:20.768162 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 sms:trx-umtrx --------------------------------------------------------------------- 20:40:21.968186 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:40:21.972591 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 20:40:22.006419 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:40:22.034362 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 20:40:22.087822 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 20:40:22.120359 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:40:22.146794 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 20:40:22.695775 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 20:40:22.701348 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:22.712360 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 20:40:22.760662 tst mo_mt_sms.py: using LAC 16671 20:40:22.888011 tst mo_mt_sms.py: using RAC 96 20:40:23.014818 tst mo_mt_sms.py: using CellId 16671 20:40:23.142690 tst mo_mt_sms.py: using BVCI 16672 20:40:23.259025 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:23.270129 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:23.281081 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:23.292045 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:23.303052 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:23.314136 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 20:40:23.431650 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 20:40:23.551369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:40:24.051081 run create_hlr_db(pid=12244): Launched 20:40:24.181471 bus /sierra_2: Setting Powered False 20:40:25.245901 run create_hlr_db(pid=12244): Terminated: ok {rc=0} 20:40:25.677717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12246): Launched 20:40:25.976549 run osmo-hlr_10.42.42.2(pid=12247): Launched 20:40:26.090858 run osmo-stp_10.42.42.5: Starting osmo-stp 20:40:26.621546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12249): Launched 20:40:26.923496 run osmo-stp_10.42.42.5(pid=12250): Launched 20:40:27.038551 run osmo-msc_10.42.42.6: Starting osmo-msc 20:40:27.580355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12252): Launched 20:40:27.881958 run osmo-msc_10.42.42.6(pid=12253): Launched 20:40:28.049394 run osmo-stp_10.42.42.5(pid=12250): ERR: Terminated: ERROR {rc=1} [trial-2349↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12250)] 20:40:28.176392 run osmo-stp_10.42.42.5(pid=12250): stdout: | (launched: 2022-12-08_20:40:26.867924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:28.305614 run osmo-stp_10.42.42.5(pid=12250): stderr: | [0;m[38;5;43m20221208204027037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204027037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204027037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204027037 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204027040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204027040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204027040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:28.430614 run osmo-stp_10.42.42.5(pid=12250): stdout: | (launched: 2022-12-08_20:40:26.867924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:28.549858 run osmo-stp_10.42.42.5(pid=12250): stderr: | [0;m[38;5;43m20221208204027037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204027037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204027037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204027037 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204027040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204027040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204027040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:28.692100 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=12250): Process ended prematurely: osmo-stp_10.42.42.5(pid=12250) [trial-2349↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12250)] [trial-2349↪sms:trx-umtrx↪mo_mt_sms.py:16] 20:40:28.700649 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 20:40:28.727130 run osmo-hlr_10.42.42.2(pid=12247): ERR: Terminated: ERROR {rc=237} [trial-2349↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12247)] 20:40:28.776002 run osmo-hlr_10.42.42.2(pid=12247): stdout: | (launched: 2022-12-08_20:40:25.921891) 20:40:28.826340 run osmo-hlr_10.42.42.2(pid=12247): stderr: | [0;m[1;31m20221208204026096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204026096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204026097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204026097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204026097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204026097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204026110 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204026119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204026119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204026119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:40:28.895812 run osmo-msc_10.42.42.6(pid=12253): ERR: Terminated: ERROR {rc=2} [trial-2349↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12253)] 20:40:28.944328 run osmo-msc_10.42.42.6(pid=12253): stdout: | (launched: 2022-12-08_20:40:27.826855) 20:40:28.994374 run osmo-msc_10.42.42.6(pid=12253): stderr: | [0;m[38;5;43m20221208204028099 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204028099 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f98c3ef4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204028099 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204028099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204028100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204028100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204028102 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204028102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204028102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204028102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:40:29.044872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12246): Terminating (SIGTERM) 20:40:29.085181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12249): Terminating (SIGTERM) 20:40:29.125636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12252): Terminating (SIGTERM) 20:40:29.166242 --- ParallelTerminationStrategy: PID 12246 died... 20:40:29.185433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12246): Terminated: ok {rc=0} 20:40:29.230451 --- ParallelTerminationStrategy: PID 12249 died... 20:40:29.249318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12249): Terminated: ok {rc=0} 20:40:29.293837 --- ParallelTerminationStrategy: PID 12252 died... 20:40:29.312654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12252): Terminated: ok {rc=0} 20:40:29.399517 bus /sierra_3: Setting Powered False 20:40:30.499576 bus /sierra_3: Setting Powered False 20:40:31.616474 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 20:40:32.850213 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:40:32.854785 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 20:40:32.888819 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 20:40:32.895583 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 20:40:32.930723 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 20:40:32.963392 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 20:40:32.970113 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 20:40:33.490499 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2349 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 20:40:33.495644 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 20:40:33.506706 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 20:40:33.554305 tst assert_extension.py: using LAC 16672 20:40:33.674129 tst assert_extension.py: using RAC 97 20:40:33.802015 tst assert_extension.py: using CellId 16672 20:40:33.928192 tst assert_extension.py: using BVCI 16673 20:40:34.045090 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 20:40:34.164210 tst assert_extension.py:10: start nitb and bts... 20:40:34.381770 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:40:35.038630 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12258): Launched 20:40:35.361475 run osmo-nitb_10.42.42.2(pid=12259): Launched 20:40:35.540696 run osmo-nitb_10.42.42.2(pid=12259): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12259)] 20:40:35.685423 run osmo-nitb_10.42.42.2(pid=12259): stdout: | (launched: 2022-12-08_20:40:35.303136) 20:40:35.832009 run osmo-nitb_10.42.42.2(pid=12259): stderr: | (launched: 2022-12-08_20:40:35.350953) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:40:35.978746 run osmo-nitb_10.42.42.2(pid=12259): stdout: | (launched: 2022-12-08_20:40:35.303136) 20:40:36.119272 run osmo-nitb_10.42.42.2(pid=12259): stderr: | (launched: 2022-12-08_20:40:35.350953) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8fda692268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12259): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12259) [trial-2349↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12259)] 20:40:36.483444 tst osmo-nitb_10.42.42.2(pid=12259): stdout: | (launched: 2022-12-08_20:40:35.303136) 20:40:36.613373 tst osmo-nitb_10.42.42.2(pid=12259): stderr: | (launched: 2022-12-08_20:40:35.350953) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:40:36.766468 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=12259): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12259) [trial-2349↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12259)] [trial-2349↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 20:40:36.775619 tst assert_extension.py:12: Test FAILED (3.3 sec) 20:40:36.782729 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12258): Terminating (SIGTERM) 20:40:36.993822 --- ParallelTerminationStrategy: PID 12258 died... 20:40:37.015943 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12258): Terminated: ok {rc=0} 20:40:37.105116 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 ussd:trx-umtrx --------------------------------------------------------------------- 20:40:38.278208 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:40:38.282201 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 20:40:38.315678 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:40:38.342346 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 20:40:38.379858 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 20:40:38.413861 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:40:38.441621 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 20:40:38.964811 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2349 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 20:40:38.970512 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:38.981537 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 20:40:39.029296 tst assert_extension.py: using LAC 16673 20:40:39.145827 tst assert_extension.py: using RAC 98 20:40:39.262447 tst assert_extension.py: using CellId 16673 20:40:39.380707 tst assert_extension.py: using BVCI 16674 20:40:39.488256 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:39.499358 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:39.509901 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:39.520576 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:39.531374 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:39.542057 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 20:40:39.660807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:40:40.158163 run create_hlr_db(pid=12263): Launched 20:40:40.290663 bus /sierra_2: Setting Powered False 20:40:41.354673 run create_hlr_db(pid=12263): Terminated: ok {rc=0} 20:40:41.803759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12265): Launched 20:40:42.143701 run osmo-hlr_10.42.42.2(pid=12266): Launched 20:40:42.260123 run osmo-stp_10.42.42.5: Starting osmo-stp 20:40:42.794239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12268): Launched 20:40:43.093190 run osmo-stp_10.42.42.5(pid=12269): Launched 20:40:43.206718 run osmo-msc_10.42.42.6: Starting osmo-msc 20:40:43.745035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12271): Launched 20:40:44.042776 run osmo-msc_10.42.42.6(pid=12272): Launched 20:40:44.209810 run osmo-stp_10.42.42.5(pid=12269): ERR: Terminated: ERROR {rc=1} [trial-2349↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12269)] 20:40:44.336495 run osmo-stp_10.42.42.5(pid=12269): stdout: | (launched: 2022-12-08_20:40:43.038470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:44.463836 run osmo-stp_10.42.42.5(pid=12269): stderr: | [0;m[38;5;43m20221208204043207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204043207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204043207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204043208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204043208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204043208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204043208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:44.588491 run osmo-stp_10.42.42.5(pid=12269): stdout: | (launched: 2022-12-08_20:40:43.038470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:44.706735 run osmo-stp_10.42.42.5(pid=12269): stderr: | [0;m[38;5;43m20221208204043207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204043207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204043207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204043208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204043208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204043208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204043208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:44.848457 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=12269): Process ended prematurely: osmo-stp_10.42.42.5(pid=12269) [trial-2349↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12269)] [trial-2349↪ussd:trx-umtrx↪assert_extension.py:17] 20:40:44.856802 tst assert_extension.py:17: Test FAILED (5.9 sec) 20:40:44.883353 run osmo-hlr_10.42.42.2(pid=12266): ERR: Terminated: ERROR {rc=237} [trial-2349↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12266)] 20:40:44.931788 run osmo-hlr_10.42.42.2(pid=12266): stdout: | (launched: 2022-12-08_20:40:42.085364) 20:40:44.981869 run osmo-hlr_10.42.42.2(pid=12266): stderr: | [0;m[1;31m20221208204042266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204042266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204042266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204042266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204042266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204042266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204042278 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204042286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204042286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204042286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:40:45.051668 run osmo-msc_10.42.42.6(pid=12272): ERR: Terminated: ERROR {rc=2} [trial-2349↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12272)] 20:40:45.100000 run osmo-msc_10.42.42.6(pid=12272): stdout: | (launched: 2022-12-08_20:40:43.988083) 20:40:45.149992 run osmo-msc_10.42.42.6(pid=12272): stderr: | [0;m[38;5;43m20221208204044261 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204044262 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa7a5013c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204044262 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204044262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204044262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204044262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204044264 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204044264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204044264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204044264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:40:45.200389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12265): Terminating (SIGTERM) 20:40:45.240438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12268): Terminating (SIGTERM) 20:40:45.280765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12271): Terminating (SIGTERM) 20:40:45.321395 --- ParallelTerminationStrategy: PID 12265 died... 20:40:45.340534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12265): Terminated: ok {rc=0} 20:40:45.385227 --- ParallelTerminationStrategy: PID 12268 died... 20:40:45.403800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12268): Terminated: ok {rc=0} 20:40:45.448147 --- ParallelTerminationStrategy: PID 12271 died... 20:40:45.466836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12271): Terminated: ok {rc=0} 20:40:45.551283 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 20:40:46.769916 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:40:46.778042 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 20:40:46.814988 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 20:40:46.843455 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 20:40:46.900924 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 20:40:46.952171 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 20:40:46.981230 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 20:40:47.511721 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 20:40:47.564813 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:40:47.576651 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:40:47.646403 tst mo_mt_call.py: using LAC 16674 20:40:47.772660 tst mo_mt_call.py: using RAC 99 20:40:47.899848 tst mo_mt_call.py: using CellId 16674 20:40:48.026607 tst mo_mt_call.py: using BVCI 16675 20:40:48.146940 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:40:48.158597 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:40:48.170113 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:40:48.181521 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:40:48.193052 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:40:48.204636 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:40:48.326802 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:40:48.446495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:40:48.922501 run create_hlr_db(pid=12277): Launched 20:40:49.040028 bus /sierra_2: Setting Powered False 20:40:50.101151 run create_hlr_db(pid=12277): Terminated: ok {rc=0} 20:40:50.547975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12279): Launched 20:40:50.873905 run osmo-hlr_10.42.42.2(pid=12280): Launched 20:40:50.999826 run osmo-stp_10.42.42.5: Starting osmo-stp 20:40:51.561443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12282): Launched 20:40:51.889036 run osmo-stp_10.42.42.5(pid=12283): Launched 20:40:52.014913 run osmo-msc_10.42.42.6: Starting osmo-msc 20:40:52.606343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12285): Launched 20:40:52.934297 run osmo-msc_10.42.42.6(pid=12286): Launched 20:40:53.116000 run osmo-stp_10.42.42.5(pid=12283): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12283)] 20:40:53.253480 run osmo-stp_10.42.42.5(pid=12283): stdout: | (launched: 2022-12-08_20:40:51.829507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:53.391681 run osmo-stp_10.42.42.5(pid=12283): stderr: | [0;m[38;5;43m20221208204052023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204052023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204052023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204052024 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204052024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204052024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204052024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:53.529173 run osmo-stp_10.42.42.5(pid=12283): stdout: | (launched: 2022-12-08_20:40:51.829507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:53.659009 run osmo-stp_10.42.42.5(pid=12283): stderr: | [0;m[38;5;43m20221208204052023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204052023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204052023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204052024 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204052024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204052024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204052024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:53.815149 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12283): Process ended prematurely: osmo-stp_10.42.42.5(pid=12283) [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12283)] [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 20:40:53.824745 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:40:53.852416 run osmo-hlr_10.42.42.2(pid=12280): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12280)] 20:40:53.902817 run osmo-hlr_10.42.42.2(pid=12280): stdout: | (launched: 2022-12-08_20:40:50.814800) 20:40:53.955752 run osmo-hlr_10.42.42.2(pid=12280): stderr: | [0;m[1;31m20221208204051013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204051013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204051013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204051014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204051014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204051014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204051028 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204051037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204051037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204051037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:40:54.028336 run osmo-msc_10.42.42.6(pid=12286): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12286)] 20:40:54.078676 run osmo-msc_10.42.42.6(pid=12286): stdout: | (launched: 2022-12-08_20:40:52.874783) 20:40:54.130393 run osmo-msc_10.42.42.6(pid=12286): stderr: | [0;m[38;5;43m20221208204053199 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204053199 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7ac7ac1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204053199 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204053199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204053199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204053199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204053201 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204053201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204053202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204053202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:40:54.182753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12279): Terminating (SIGTERM) 20:40:54.224664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12282): Terminating (SIGTERM) 20:40:54.266926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12285): Terminating (SIGTERM) 20:40:54.309302 --- ParallelTerminationStrategy: PID 12279 died... 20:40:54.329289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12279): Terminated: ok {rc=0} 20:40:54.375682 --- ParallelTerminationStrategy: PID 12282 died... 20:40:54.395301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12282): Terminated: ok {rc=0} 20:40:54.441707 --- ParallelTerminationStrategy: PID 12285 died... 20:40:54.461358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12285): Terminated: ok {rc=0} 20:40:54.549539 bus /sierra_3: Setting Powered False 20:40:55.649657 bus /sierra_3: Setting Powered False 20:40:56.767835 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 20:40:57.913942 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:40:57.925737 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:40:57.998819 tst mo_mt_call_osmux.py: using LAC 16675 20:40:58.127411 tst mo_mt_call_osmux.py: using RAC 100 20:40:58.258809 tst mo_mt_call_osmux.py: using CellId 16675 20:40:58.386740 tst mo_mt_call_osmux.py: using BVCI 16676 20:40:58.499915 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:40:58.511070 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:40:58.522230 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:40:58.533552 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:40:58.544796 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:40:58.556101 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:40:58.678645 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:40:58.800050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:40:59.306549 run create_hlr_db(pid=12288): Launched 20:40:59.441830 bus /sierra_2: Setting Powered False 20:41:00.506272 run create_hlr_db(pid=12288): Terminated: ok {rc=0} 20:41:00.990569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12290): Launched 20:41:01.345213 run osmo-hlr_10.42.42.2(pid=12291): Launched 20:41:01.573304 run osmo-stp_10.42.42.5: Starting osmo-stp 20:41:02.288331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12293): Launched 20:41:02.626807 run osmo-stp_10.42.42.5(pid=12294): Launched 20:41:02.753520 run osmo-msc_10.42.42.6: Starting osmo-msc 20:41:03.344825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12296): Launched 20:41:03.671592 run osmo-msc_10.42.42.6(pid=12297): Launched 20:41:03.853555 run osmo-stp_10.42.42.5(pid=12294): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12294)] 20:41:03.991344 run osmo-stp_10.42.42.5(pid=12294): stdout: | (launched: 2022-12-08_20:41:02.567398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:04.130393 run osmo-stp_10.42.42.5(pid=12294): stderr: | [0;m[38;5;43m20221208204102759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204102759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204102760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204102760 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204102762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204102763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204102763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:04.267746 run osmo-stp_10.42.42.5(pid=12294): stdout: | (launched: 2022-12-08_20:41:02.567398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:04.398390 run osmo-stp_10.42.42.5(pid=12294): stderr: | [0;m[38;5;43m20221208204102759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204102759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204102760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204102760 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204102762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204102763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204102763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:04.553741 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12294): Process ended prematurely: osmo-stp_10.42.42.5(pid=12294) [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12294)] [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 20:41:04.563275 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 20:41:04.591133 run osmo-hlr_10.42.42.2(pid=12291): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12291)] 20:41:04.641729 run osmo-hlr_10.42.42.2(pid=12291): stdout: | (launched: 2022-12-08_20:41:01.283907) 20:41:04.693815 run osmo-hlr_10.42.42.2(pid=12291): stderr: | [0;m[1;31m20221208204101610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204101610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204101610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204101610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204101610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204101611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204101632 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204101644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204101649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204101649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:41:04.766392 run osmo-msc_10.42.42.6(pid=12297): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12297)] 20:41:04.816848 run osmo-msc_10.42.42.6(pid=12297): stdout: | (launched: 2022-12-08_20:41:03.611583) 20:41:04.868683 run osmo-msc_10.42.42.6(pid=12297): stderr: | [0;m[38;5;43m20221208204103937 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204103937 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff4e87c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204103938 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204103938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204103938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204103938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204103940 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204103940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204103940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204103940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:41:04.920892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12290): Terminating (SIGTERM) 20:41:04.963010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12293): Terminating (SIGTERM) 20:41:05.004881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12296): Terminating (SIGTERM) 20:41:05.047071 --- ParallelTerminationStrategy: PID 12290 died... 20:41:05.067236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12290): Terminated: ok {rc=0} 20:41:05.113827 --- ParallelTerminationStrategy: PID 12293 died... 20:41:05.133561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12293): Terminated: ok {rc=0} 20:41:05.179728 --- ParallelTerminationStrategy: PID 12296 died... 20:41:05.199396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12296): Terminated: ok {rc=0} 20:41:05.287481 bus /sierra_3: Setting Powered False 20:41:06.388889 bus /sierra_3: Setting Powered False 20:41:07.505638 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 20:41:08.755114 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:41:08.761685 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 20:41:08.794840 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 20:41:08.821693 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 20:41:08.875167 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 20:41:08.909142 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 20:41:08.935813 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 20:41:09.484088 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 20:41:09.533586 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:09.545168 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:41:09.616681 tst mo_mt_call.py: using LAC 16676 20:41:09.735608 tst mo_mt_call.py: using RAC 101 20:41:09.854289 tst mo_mt_call.py: using CellId 16676 20:41:09.973872 tst mo_mt_call.py: using BVCI 16677 20:41:10.084910 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:10.096323 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:10.107336 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:10.118840 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:10.130221 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:10.141623 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:41:10.257796 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:41:10.374388 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:41:10.885159 run create_hlr_db(pid=12302): Launched 20:41:11.020662 bus /sierra_2: Setting Powered False 20:41:12.085792 run create_hlr_db(pid=12302): Terminated: ok {rc=0} 20:41:12.541769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12304): Launched 20:41:12.869636 run osmo-hlr_10.42.42.2(pid=12305): Launched 20:41:12.994445 run osmo-stp_10.42.42.5: Starting osmo-stp 20:41:13.561404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12307): Launched 20:41:13.888938 run osmo-stp_10.42.42.5(pid=12308): Launched 20:41:14.015373 run osmo-msc_10.42.42.6: Starting osmo-msc 20:41:14.607803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12310): Launched 20:41:14.935263 run osmo-msc_10.42.42.6(pid=12311): Launched 20:41:15.119221 run osmo-stp_10.42.42.5(pid=12308): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12308)] 20:41:15.257646 run osmo-stp_10.42.42.5(pid=12308): stdout: | (launched: 2022-12-08_20:41:13.829234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:15.396594 run osmo-stp_10.42.42.5(pid=12308): stderr: | [0;m[38;5;43m20221208204114021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204114021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204114021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204114022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204114022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204114022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204114022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:15.533813 run osmo-stp_10.42.42.5(pid=12308): stdout: | (launched: 2022-12-08_20:41:13.829234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:15.663739 run osmo-stp_10.42.42.5(pid=12308): stderr: | [0;m[38;5;43m20221208204114021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204114021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204114021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204114022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204114022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204114022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204114022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:15.819088 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12308): Process ended prematurely: osmo-stp_10.42.42.5(pid=12308) [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12308)] [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 20:41:15.828515 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:41:15.857694 run osmo-hlr_10.42.42.2(pid=12305): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12305)] 20:41:15.922094 run osmo-hlr_10.42.42.2(pid=12305): stdout: | (launched: 2022-12-08_20:41:12.810299) 20:41:15.975643 run osmo-hlr_10.42.42.2(pid=12305): stderr: | [0;m[1;31m20221208204113007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204113008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204113008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204113008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204113008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204113008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204113020 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204113028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204113029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204113029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:41:16.050104 run osmo-msc_10.42.42.6(pid=12311): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12311)] 20:41:16.101777 run osmo-msc_10.42.42.6(pid=12311): stdout: | (launched: 2022-12-08_20:41:14.875614) 20:41:16.155866 run osmo-msc_10.42.42.6(pid=12311): stderr: | [0;m[38;5;43m20221208204115197 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204115197 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb764db4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204115197 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204115197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204115197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204115197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204115199 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204115199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204115200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204115200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:41:16.210049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12304): Terminating (SIGTERM) 20:41:16.253980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12307): Terminating (SIGTERM) 20:41:16.299398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12310): Terminating (SIGTERM) 20:41:16.346348 --- ParallelTerminationStrategy: PID 12304 died... 20:41:16.366757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12304): Terminated: ok {rc=0} 20:41:16.417093 --- ParallelTerminationStrategy: PID 12307 died... 20:41:16.437536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12307): Terminated: ok {rc=0} 20:41:16.486835 --- ParallelTerminationStrategy: PID 12310 died... 20:41:16.507997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12310): Terminated: ok {rc=0} 20:41:16.597667 bus /sierra_3: Setting Powered False 20:41:17.698299 bus /sierra_3: Setting Powered False 20:41:18.815988 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 20:41:19.963201 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:19.975047 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:41:20.044488 tst mo_mt_call_osmux.py: using LAC 16677 20:41:20.165367 tst mo_mt_call_osmux.py: using RAC 102 20:41:20.294921 tst mo_mt_call_osmux.py: using CellId 16677 20:41:20.425321 tst mo_mt_call_osmux.py: using BVCI 16678 20:41:20.545556 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:20.557345 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:20.568859 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:20.580787 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:20.592403 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:20.604085 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:41:20.724441 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:41:20.848198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:41:21.322536 run create_hlr_db(pid=12313): Launched 20:41:21.441965 bus /sierra_2: Setting Powered False 20:41:22.503029 run create_hlr_db(pid=12313): Terminated: ok {rc=0} 20:41:22.928640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12315): Launched 20:41:23.234687 run osmo-hlr_10.42.42.2(pid=12316): Launched 20:41:23.351253 run osmo-stp_10.42.42.5: Starting osmo-stp 20:41:23.875406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12318): Launched 20:41:24.180636 run osmo-stp_10.42.42.5(pid=12319): Launched 20:41:24.297652 run osmo-msc_10.42.42.6: Starting osmo-msc 20:41:24.851006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12321): Launched 20:41:25.155718 run osmo-msc_10.42.42.6(pid=12322): Launched 20:41:25.325997 run osmo-stp_10.42.42.5(pid=12319): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12319)] 20:41:25.455538 run osmo-stp_10.42.42.5(pid=12319): stdout: | (launched: 2022-12-08_20:41:24.124882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:25.585731 run osmo-stp_10.42.42.5(pid=12319): stderr: | [0;m[38;5;43m20221208204124296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204124296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204124296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204124297 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204124297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204124297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204124297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:25.713338 run osmo-stp_10.42.42.5(pid=12319): stdout: | (launched: 2022-12-08_20:41:24.124882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:25.834434 run osmo-stp_10.42.42.5(pid=12319): stderr: | [0;m[38;5;43m20221208204124296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204124296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204124296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204124297 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204124297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204124297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204124297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:25.979442 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12319): Process ended prematurely: osmo-stp_10.42.42.5(pid=12319) [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12319)] [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 20:41:25.988336 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 20:41:26.015013 run osmo-hlr_10.42.42.2(pid=12316): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12316)] 20:41:26.063420 run osmo-hlr_10.42.42.2(pid=12316): stdout: | (launched: 2022-12-08_20:41:23.178773) 20:41:26.113286 run osmo-hlr_10.42.42.2(pid=12316): stderr: | [0;m[1;31m20221208204123358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204123358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204123358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204123358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204123358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204123358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204123374 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204123383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204123384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204123384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:41:26.182909 run osmo-msc_10.42.42.6(pid=12322): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12322)] 20:41:26.231000 run osmo-msc_10.42.42.6(pid=12322): stdout: | (launched: 2022-12-08_20:41:25.099836) 20:41:26.280580 run osmo-msc_10.42.42.6(pid=12322): stderr: | [0;m[38;5;43m20221208204125371 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204125372 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb54b164c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204125372 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204125372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204125372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204125372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204125374 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204125374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204125374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204125375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:41:26.330826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12315): Terminating (SIGTERM) 20:41:26.371056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12318): Terminating (SIGTERM) 20:41:26.411394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12321): Terminating (SIGTERM) 20:41:26.451719 --- ParallelTerminationStrategy: PID 12315 died... 20:41:26.470943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12315): Terminated: ok {rc=0} 20:41:26.515859 --- ParallelTerminationStrategy: PID 12318 died... 20:41:26.534553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12318): Terminated: ok {rc=0} 20:41:26.579531 --- ParallelTerminationStrategy: PID 12321 died... 20:41:26.598120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12321): Terminated: ok {rc=0} 20:41:26.684458 bus /sierra_3: Setting Powered False 20:41:27.783973 bus /sierra_3: Setting Powered False 20:41:28.900718 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 20:41:30.154543 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:41:30.161496 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 20:41:30.194828 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 20:41:30.222484 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 20:41:30.275123 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 20:41:30.308688 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 20:41:30.336265 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 20:41:30.894782 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 20:41:30.954132 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:30.966204 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:41:31.038285 tst mo_mt_call.py: using LAC 16678 20:41:31.175623 tst mo_mt_call.py: using RAC 103 20:41:31.338332 tst mo_mt_call.py: using CellId 16678 20:41:31.465152 tst mo_mt_call.py: using BVCI 16679 20:41:31.586449 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:31.598201 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:31.609723 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:31.621824 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:31.634056 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:31.646305 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:41:31.767428 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:41:31.899268 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:41:32.403593 run create_hlr_db(pid=12328): Launched 20:41:32.522260 bus /sierra_2: Setting Powered False 20:41:33.582641 run create_hlr_db(pid=12328): Terminated: ok {rc=0} 20:41:34.008533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12330): Launched 20:41:34.314506 run osmo-hlr_10.42.42.2(pid=12331): Launched 20:41:34.431023 run osmo-stp_10.42.42.5: Starting osmo-stp 20:41:34.974085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12333): Launched 20:41:35.280016 run osmo-stp_10.42.42.5(pid=12334): Launched 20:41:35.396546 run osmo-msc_10.42.42.6: Starting osmo-msc 20:41:35.949217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12336): Launched 20:41:36.256260 run osmo-msc_10.42.42.6(pid=12337): Launched 20:41:36.427967 run osmo-stp_10.42.42.5(pid=12334): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12334)] 20:41:36.558778 run osmo-stp_10.42.42.5(pid=12334): stdout: | (launched: 2022-12-08_20:41:35.223924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:36.689154 run osmo-stp_10.42.42.5(pid=12334): stderr: | [0;m[38;5;43m20221208204135397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204135397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204135398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204135398 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204135398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204135399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204135399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:36.817418 run osmo-stp_10.42.42.5(pid=12334): stdout: | (launched: 2022-12-08_20:41:35.223924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:36.939011 run osmo-stp_10.42.42.5(pid=12334): stderr: | [0;m[38;5;43m20221208204135397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204135397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204135398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204135398 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204135398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204135399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204135399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:37.084636 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12334): Process ended prematurely: osmo-stp_10.42.42.5(pid=12334) [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12334)] [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 20:41:37.093737 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:41:37.120939 run osmo-hlr_10.42.42.2(pid=12331): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12331)] 20:41:37.169293 run osmo-hlr_10.42.42.2(pid=12331): stdout: | (launched: 2022-12-08_20:41:34.258431) 20:41:37.219720 run osmo-hlr_10.42.42.2(pid=12331): stderr: | [0;m[1;31m20221208204134435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204134435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204134435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204134435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204134435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204134436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204134451 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204134460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204134460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204134460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:41:37.289465 run osmo-msc_10.42.42.6(pid=12337): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12337)] 20:41:37.337597 run osmo-msc_10.42.42.6(pid=12337): stdout: | (launched: 2022-12-08_20:41:36.199533) 20:41:37.387446 run osmo-msc_10.42.42.6(pid=12337): stderr: | [0;m[38;5;43m20221208204136472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204136472 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa4226f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204136472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204136472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204136473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204136473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204136475 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204136475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204136475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204136475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:41:37.437578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12330): Terminating (SIGTERM) 20:41:37.477715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12333): Terminating (SIGTERM) 20:41:37.517845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12336): Terminating (SIGTERM) 20:41:37.558345 --- ParallelTerminationStrategy: PID 12330 died... 20:41:37.577522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12330): Terminated: ok {rc=0} 20:41:37.622043 --- ParallelTerminationStrategy: PID 12333 died... 20:41:37.640515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12333): Terminated: ok {rc=0} 20:41:37.685104 --- ParallelTerminationStrategy: PID 12336 died... 20:41:37.703830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12336): Terminated: ok {rc=0} 20:41:37.788536 bus /sierra_3: Setting Powered False 20:41:38.887154 bus /sierra_3: Setting Powered False 20:41:40.003953 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 20:41:41.153200 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:41.165519 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:41:41.237528 tst mo_mt_call_osmux.py: using LAC 16679 20:41:41.366291 tst mo_mt_call_osmux.py: using RAC 104 20:41:41.496029 tst mo_mt_call_osmux.py: using CellId 16679 20:41:41.624791 tst mo_mt_call_osmux.py: using BVCI 16680 20:41:41.743734 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:41.755438 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:41.766965 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:41.778619 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:41.790218 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:41.801780 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:41:41.922884 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:41:42.042212 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:41:42.516113 run create_hlr_db(pid=12339): Launched 20:41:42.634324 bus /sierra_2: Setting Powered False 20:41:43.695336 run create_hlr_db(pid=12339): Terminated: ok {rc=0} 20:41:44.120640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12341): Launched 20:41:44.426790 run osmo-hlr_10.42.42.2(pid=12342): Launched 20:41:44.543781 run osmo-stp_10.42.42.5: Starting osmo-stp 20:41:45.087831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12344): Launched 20:41:45.392811 run osmo-stp_10.42.42.5(pid=12345): Launched 20:41:45.509168 run osmo-msc_10.42.42.6: Starting osmo-msc 20:41:46.089760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12347): Launched 20:41:46.436245 run osmo-msc_10.42.42.6(pid=12348): Launched 20:41:46.659040 run osmo-stp_10.42.42.5(pid=12345): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12345)] 20:41:46.873919 run osmo-stp_10.42.42.5(pid=12345): stdout: | (launched: 2022-12-08_20:41:45.336894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:47.145673 run osmo-stp_10.42.42.5(pid=12345): stderr: | [0;m[38;5;43m20221208204145506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204145506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204145506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204145507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204145507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204145507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204145507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:47.440927 run osmo-stp_10.42.42.5(pid=12345): stdout: | (launched: 2022-12-08_20:41:45.336894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:47.571403 run osmo-stp_10.42.42.5(pid=12345): stderr: | [0;m[38;5;43m20221208204145506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204145506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204145506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204145507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204145507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204145507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204145507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:47.727667 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12345): Process ended prematurely: osmo-stp_10.42.42.5(pid=12345) [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12345)] [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 20:41:47.737448 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 20:41:47.765353 run osmo-hlr_10.42.42.2(pid=12342): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12342)] 20:41:47.815589 run osmo-hlr_10.42.42.2(pid=12342): stdout: | (launched: 2022-12-08_20:41:44.370804) 20:41:47.867679 run osmo-hlr_10.42.42.2(pid=12342): stderr: | [0;m[1;31m20221208204144548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204144548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204144548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204144548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204144548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204144548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204144561 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204144571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204144571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204144572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:41:47.940371 run osmo-msc_10.42.42.6(pid=12348): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12348)] 20:41:47.991156 run osmo-msc_10.42.42.6(pid=12348): stdout: | (launched: 2022-12-08_20:41:46.375449) 20:41:48.043200 run osmo-msc_10.42.42.6(pid=12348): stderr: | [0;m[38;5;43m20221208204147112 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204147112 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd602a91c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204147112 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204147112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204147114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204147114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204147118 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204147119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204147119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204147119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:41:48.095548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12341): Terminating (SIGTERM) 20:41:48.137763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12344): Terminating (SIGTERM) 20:41:48.179839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12347): Terminating (SIGTERM) 20:41:48.222328 --- ParallelTerminationStrategy: PID 12341 died... 20:41:48.242243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12341): Terminated: ok {rc=0} 20:41:48.288837 --- ParallelTerminationStrategy: PID 12344 died... 20:41:48.308504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12344): Terminated: ok {rc=0} 20:41:48.354885 --- ParallelTerminationStrategy: PID 12347 died... 20:41:48.374651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12347): Terminated: ok {rc=0} 20:41:48.462241 bus /sierra_3: Setting Powered False 20:41:49.560828 bus /sierra_3: Setting Powered False 20:41:50.676428 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 20:41:51.929848 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:41:51.936821 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 20:41:51.969905 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 20:41:51.996551 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 20:41:52.049048 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 20:41:52.083217 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 20:41:52.109687 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 20:41:52.659041 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 20:41:52.708634 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:41:52.720146 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:41:52.792143 tst mo_mt_call.py: using LAC 16680 20:41:52.910296 tst mo_mt_call.py: using RAC 105 20:41:53.043738 tst mo_mt_call.py: using CellId 16680 20:41:53.172684 tst mo_mt_call.py: using BVCI 16681 20:41:53.293516 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:41:53.305175 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:41:53.316584 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:41:53.328077 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:41:53.339614 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:41:53.351110 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:41:53.469355 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:41:53.593667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:41:54.103066 run create_hlr_db(pid=12353): Launched 20:41:54.237461 bus /sierra_2: Setting Powered False 20:41:55.302614 run create_hlr_db(pid=12353): Terminated: ok {rc=0} 20:41:55.739332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12355): Launched 20:41:56.045078 run osmo-hlr_10.42.42.2(pid=12356): Launched 20:41:56.160750 run osmo-stp_10.42.42.5: Starting osmo-stp 20:41:56.698930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12358): Launched 20:41:57.005068 run osmo-stp_10.42.42.5(pid=12359): Launched 20:41:57.121333 run osmo-msc_10.42.42.6: Starting osmo-msc 20:41:57.672814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12361): Launched 20:41:57.979050 run osmo-msc_10.42.42.6(pid=12362): Launched 20:41:58.149885 run osmo-stp_10.42.42.5(pid=12359): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12359)] 20:41:58.279336 run osmo-stp_10.42.42.5(pid=12359): stdout: | (launched: 2022-12-08_20:41:56.949102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:58.409308 run osmo-stp_10.42.42.5(pid=12359): stderr: | [0;m[38;5;43m20221208204157122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204157123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204157123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204157123 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204157124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204157124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204157124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:58.537207 run osmo-stp_10.42.42.5(pid=12359): stdout: | (launched: 2022-12-08_20:41:56.949102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:58.658387 run osmo-stp_10.42.42.5(pid=12359): stderr: | [0;m[38;5;43m20221208204157122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204157123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204157123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204157123 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204157124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204157124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204157124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:58.804158 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12359): Process ended prematurely: osmo-stp_10.42.42.5(pid=12359) [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12359)] [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 20:41:58.813156 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 20:41:58.839961 run osmo-hlr_10.42.42.2(pid=12356): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12356)] 20:41:58.888098 run osmo-hlr_10.42.42.2(pid=12356): stdout: | (launched: 2022-12-08_20:41:55.989201) 20:41:58.938074 run osmo-hlr_10.42.42.2(pid=12356): stderr: | [0;m[1;31m20221208204156166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204156166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204156166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204156166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204156166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204156166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204156176 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204156185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204156186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204156186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:41:59.007657 run osmo-msc_10.42.42.6(pid=12362): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12362)] 20:41:59.056105 run osmo-msc_10.42.42.6(pid=12362): stdout: | (launched: 2022-12-08_20:41:57.922512) 20:41:59.106113 run osmo-msc_10.42.42.6(pid=12362): stderr: | [0;m[38;5;43m20221208204158195 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204158195 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f05f4e2cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204158195 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204158195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204158196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204158196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204158198 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204158198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204158198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204158198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:41:59.156602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12355): Terminating (SIGTERM) 20:41:59.196275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12358): Terminating (SIGTERM) 20:41:59.236494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12361): Terminating (SIGTERM) 20:41:59.276616 --- ParallelTerminationStrategy: PID 12355 died... 20:41:59.295756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12355): Terminated: ok {rc=0} 20:41:59.340305 --- ParallelTerminationStrategy: PID 12358 died... 20:41:59.359272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12358): Terminated: ok {rc=0} 20:41:59.403485 --- ParallelTerminationStrategy: PID 12361 died... 20:41:59.422081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12361): Terminated: ok {rc=0} 20:41:59.507508 bus /sierra_3: Setting Powered False 20:42:00.607649 bus /sierra_3: Setting Powered False 20:42:01.743704 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 20:42:02.899602 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:42:02.911406 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:42:02.982659 tst mo_mt_call_osmux.py: using LAC 16681 20:42:03.114228 tst mo_mt_call_osmux.py: using RAC 106 20:42:03.236678 tst mo_mt_call_osmux.py: using CellId 16681 20:42:03.358535 tst mo_mt_call_osmux.py: using BVCI 16682 20:42:03.471318 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:42:03.482531 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:42:03.493549 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:42:03.505168 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:42:03.516833 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:42:03.528457 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:42:03.646301 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:42:03.767932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:42:04.276239 run create_hlr_db(pid=12365): Launched 20:42:04.410269 bus /sierra_2: Setting Powered False 20:42:05.474533 run create_hlr_db(pid=12365): Terminated: ok {rc=0} 20:42:05.930829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12367): Launched 20:42:06.260420 run osmo-hlr_10.42.42.2(pid=12368): Launched 20:42:06.385108 run osmo-stp_10.42.42.5: Starting osmo-stp 20:42:06.951027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12370): Launched 20:42:07.280280 run osmo-stp_10.42.42.5(pid=12371): Launched 20:42:07.404481 run osmo-msc_10.42.42.6: Starting osmo-msc 20:42:07.997948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12373): Launched 20:42:08.325420 run osmo-msc_10.42.42.6(pid=12374): Launched 20:42:08.508411 run osmo-stp_10.42.42.5(pid=12371): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12371)] 20:42:08.646666 run osmo-stp_10.42.42.5(pid=12371): stdout: | (launched: 2022-12-08_20:42:07.220594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:08.786139 run osmo-stp_10.42.42.5(pid=12371): stderr: | [0;m[38;5;43m20221208204207416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204207416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204207417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204207417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204207418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204207418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204207418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:08.924710 run osmo-stp_10.42.42.5(pid=12371): stdout: | (launched: 2022-12-08_20:42:07.220594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:09.055216 run osmo-stp_10.42.42.5(pid=12371): stderr: | [0;m[38;5;43m20221208204207416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204207416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204207417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204207417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204207418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204207418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204207418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:09.210955 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12371): Process ended prematurely: osmo-stp_10.42.42.5(pid=12371) [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12371)] [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 20:42:09.220579 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 20:42:09.248454 run osmo-hlr_10.42.42.2(pid=12368): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12368)] 20:42:09.298861 run osmo-hlr_10.42.42.2(pid=12368): stdout: | (launched: 2022-12-08_20:42:06.200612) 20:42:09.351173 run osmo-hlr_10.42.42.2(pid=12368): stderr: | [0;m[1;31m20221208204206401 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204206401 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204206401 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204206401 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204206402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204206402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204206414 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204206422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204206422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204206422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:42:09.423892 run osmo-msc_10.42.42.6(pid=12374): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12374)] 20:42:09.474220 run osmo-msc_10.42.42.6(pid=12374): stdout: | (launched: 2022-12-08_20:42:08.265624) 20:42:09.526239 run osmo-msc_10.42.42.6(pid=12374): stderr: | [0;m[38;5;43m20221208204208589 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204208589 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff1b672fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204208589 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204208589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204208589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204208590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204208591 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204208592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204208592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204208592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:42:09.578620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12367): Terminating (SIGTERM) 20:42:09.620495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12370): Terminating (SIGTERM) 20:42:09.662457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12373): Terminating (SIGTERM) 20:42:09.704475 --- ParallelTerminationStrategy: PID 12367 died... 20:42:09.724258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12367): Terminated: ok {rc=0} 20:42:09.770882 --- ParallelTerminationStrategy: PID 12370 died... 20:42:09.790629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12370): Terminated: ok {rc=0} 20:42:09.836767 --- ParallelTerminationStrategy: PID 12373 died... 20:42:09.856439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12373): Terminated: ok {rc=0} 20:42:09.945201 bus /sierra_3: Setting Powered False 20:42:11.043736 bus /sierra_3: Setting Powered False 20:42:12.159275 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 20:42:13.413697 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:42:13.420629 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 20:42:13.454728 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 20:42:13.482460 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 20:42:13.537277 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 20:42:13.571577 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 20:42:13.598175 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 20:42:14.146759 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 20:42:14.196563 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:14.207860 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:42:14.276473 tst mo_mt_call.py: using LAC 16682 20:42:14.396162 tst mo_mt_call.py: using RAC 107 20:42:14.515517 tst mo_mt_call.py: using CellId 16682 20:42:14.637027 tst mo_mt_call.py: using BVCI 16683 20:42:14.747933 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:14.759243 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:14.770396 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:14.781629 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:14.793190 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:14.804404 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:42:14.923564 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:42:15.040458 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:42:15.512813 run create_hlr_db(pid=12379): Launched 20:42:15.630406 bus /sierra_2: Setting Powered False 20:42:16.708286 run create_hlr_db(pid=12379): Terminated: ok {rc=0} 20:42:17.180150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12381): Launched 20:42:17.508872 run osmo-hlr_10.42.42.2(pid=12382): Launched 20:42:17.635597 run osmo-stp_10.42.42.5: Starting osmo-stp 20:42:18.203401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12384): Launched 20:42:18.530836 run osmo-stp_10.42.42.5(pid=12385): Launched 20:42:18.655590 run osmo-msc_10.42.42.6: Starting osmo-msc 20:42:19.246399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12387): Launched 20:42:19.574603 run osmo-msc_10.42.42.6(pid=12388): Launched 20:42:19.756930 run osmo-stp_10.42.42.5(pid=12385): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12385)] 20:42:19.895244 run osmo-stp_10.42.42.5(pid=12385): stdout: | (launched: 2022-12-08_20:42:18.471678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:20.034951 run osmo-stp_10.42.42.5(pid=12385): stderr: | [0;m[38;5;43m20221208204218663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204218664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204218664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204218664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204218667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204218667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204218667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:20.173124 run osmo-stp_10.42.42.5(pid=12385): stdout: | (launched: 2022-12-08_20:42:18.471678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:20.303200 run osmo-stp_10.42.42.5(pid=12385): stderr: | [0;m[38;5;43m20221208204218663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204218664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204218664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204218664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204218667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204218667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204218667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:20.459051 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12385): Process ended prematurely: osmo-stp_10.42.42.5(pid=12385) [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12385)] [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 20:42:20.468530 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:42:20.496537 run osmo-hlr_10.42.42.2(pid=12382): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12382)] 20:42:20.547203 run osmo-hlr_10.42.42.2(pid=12382): stdout: | (launched: 2022-12-08_20:42:17.449409) 20:42:20.599698 run osmo-hlr_10.42.42.2(pid=12382): stderr: | [0;m[1;31m20221208204217647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204217647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204217647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204217647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204217647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204217647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204217662 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204217672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204217673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204217673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:42:20.672694 run osmo-msc_10.42.42.6(pid=12388): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12388)] 20:42:20.723420 run osmo-msc_10.42.42.6(pid=12388): stdout: | (launched: 2022-12-08_20:42:19.515168) 20:42:20.775443 run osmo-msc_10.42.42.6(pid=12388): stderr: | [0;m[38;5;43m20221208204219838 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204219838 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5dbde2dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204219838 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204219838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204219839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204219839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204219840 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204219841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204219841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204219841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:42:20.827589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12381): Terminating (SIGTERM) 20:42:20.870366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12384): Terminating (SIGTERM) 20:42:20.912218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12387): Terminating (SIGTERM) 20:42:20.954813 --- ParallelTerminationStrategy: PID 12381 died... 20:42:20.975190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12381): Terminated: ok {rc=0} 20:42:21.022395 --- ParallelTerminationStrategy: PID 12384 died... 20:42:21.042541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12384): Terminated: ok {rc=0} 20:42:21.089291 --- ParallelTerminationStrategy: PID 12387 died... 20:42:21.109199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12387): Terminated: ok {rc=0} 20:42:21.197590 bus /sierra_3: Setting Powered False 20:42:22.299480 bus /sierra_3: Setting Powered False 20:42:23.416712 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 20:42:24.563155 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:24.574997 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:42:24.645377 tst mo_mt_call_osmux.py: using LAC 16683 20:42:24.766618 tst mo_mt_call_osmux.py: using RAC 108 20:42:24.890997 tst mo_mt_call_osmux.py: using CellId 16683 20:42:25.010119 tst mo_mt_call_osmux.py: using BVCI 16684 20:42:25.122978 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:25.134198 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:25.145204 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:25.156321 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:25.167701 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:25.179009 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:42:25.295490 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:42:25.412889 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:42:25.887176 run create_hlr_db(pid=12390): Launched 20:42:26.019128 bus /sierra_2: Setting Powered False 20:42:27.084105 run create_hlr_db(pid=12390): Terminated: ok {rc=0} 20:42:27.539030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12392): Launched 20:42:27.868768 run osmo-hlr_10.42.42.2(pid=12393): Launched 20:42:27.995027 run osmo-stp_10.42.42.5: Starting osmo-stp 20:42:28.559738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12395): Launched 20:42:28.886547 run osmo-stp_10.42.42.5(pid=12396): Launched 20:42:29.013488 run osmo-msc_10.42.42.6: Starting osmo-msc 20:42:29.606482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12398): Launched 20:42:29.935910 run osmo-msc_10.42.42.6(pid=12399): Launched 20:42:30.119121 run osmo-stp_10.42.42.5(pid=12396): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12396)] 20:42:30.257822 run osmo-stp_10.42.42.5(pid=12396): stdout: | (launched: 2022-12-08_20:42:28.826993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:30.397419 run osmo-stp_10.42.42.5(pid=12396): stderr: | [0;m[38;5;43m20221208204229021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204229022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204229022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204229022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204229023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204229023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204229023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:30.535480 run osmo-stp_10.42.42.5(pid=12396): stdout: | (launched: 2022-12-08_20:42:28.826993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:30.665863 run osmo-stp_10.42.42.5(pid=12396): stderr: | [0;m[38;5;43m20221208204229021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204229022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204229022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204229022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204229023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204229023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204229023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:30.821822 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12396): Process ended prematurely: osmo-stp_10.42.42.5(pid=12396) [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12396)] [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 20:42:30.831532 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:42:30.860833 run osmo-hlr_10.42.42.2(pid=12393): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12393)] 20:42:30.914646 run osmo-hlr_10.42.42.2(pid=12393): stdout: | (launched: 2022-12-08_20:42:27.809052) 20:42:30.980159 run osmo-hlr_10.42.42.2(pid=12393): stderr: | [0;m[1;31m20221208204228009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204228009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204228009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204228010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204228010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204228010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204228022 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204228030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204228030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204228030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:42:31.055361 run osmo-msc_10.42.42.6(pid=12399): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12399)] 20:42:31.110824 run osmo-msc_10.42.42.6(pid=12399): stdout: | (launched: 2022-12-08_20:42:29.876022) 20:42:31.164319 run osmo-msc_10.42.42.6(pid=12399): stderr: | [0;m[38;5;43m20221208204230198 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204230198 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbea8515c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204230198 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204230198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204230198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204230198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204230200 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204230200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204230201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204230201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:42:31.217672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12392): Terminating (SIGTERM) 20:42:31.261171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12395): Terminating (SIGTERM) 20:42:31.306537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12398): Terminating (SIGTERM) 20:42:31.352920 --- ParallelTerminationStrategy: PID 12392 died... 20:42:31.373424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12392): Terminated: ok {rc=0} 20:42:31.423540 --- ParallelTerminationStrategy: PID 12395 died... 20:42:31.443708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12395): Terminated: ok {rc=0} 20:42:31.491951 --- ParallelTerminationStrategy: PID 12398 died... 20:42:31.513076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12398): Terminated: ok {rc=0} 20:42:31.604179 bus /sierra_3: Setting Powered False 20:42:32.705686 bus /sierra_3: Setting Powered False 20:42:33.823471 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:42:35.084617 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:42:35.091866 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:42:35.126303 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 20:42:35.153680 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:42:35.206418 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:42:35.239617 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 20:42:35.267013 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:42:35.825356 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 20:42:35.877591 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:35.889246 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:42:35.960895 tst mo_mt_call.py: using LAC 16684 20:42:36.091870 tst mo_mt_call.py: using RAC 109 20:42:36.223225 tst mo_mt_call.py: using CellId 16684 20:42:36.353507 tst mo_mt_call.py: using BVCI 16685 20:42:36.466889 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:36.478440 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:36.489478 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:36.500913 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:36.512502 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:36.524330 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:42:36.640403 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:42:36.757127 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:42:37.232567 run create_hlr_db(pid=12407): Launched 20:42:37.348681 bus /sierra_2: Setting Powered False 20:42:38.409719 run create_hlr_db(pid=12407): Terminated: ok {rc=0} 20:42:38.835291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12409): Launched 20:42:39.140601 run osmo-hlr_10.42.42.2(pid=12410): Launched 20:42:39.256791 run osmo-stp_10.42.42.5: Starting osmo-stp 20:42:39.797299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12412): Launched 20:42:40.102692 run osmo-stp_10.42.42.5(pid=12413): Launched 20:42:40.219294 run osmo-msc_10.42.42.6: Starting osmo-msc 20:42:40.785882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12415): Launched 20:42:41.117061 run osmo-msc_10.42.42.6(pid=12416): Launched 20:42:41.300807 run osmo-stp_10.42.42.5(pid=12413): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12413)] 20:42:41.439618 run osmo-stp_10.42.42.5(pid=12413): stdout: | (launched: 2022-12-08_20:42:40.046803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:41.579936 run osmo-stp_10.42.42.5(pid=12413): stderr: | [0;m[38;5;43m20221208204240216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204240216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204240217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204240217 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204240219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204240219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204240220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:41.717707 run osmo-stp_10.42.42.5(pid=12413): stdout: | (launched: 2022-12-08_20:42:40.046803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:41.848172 run osmo-stp_10.42.42.5(pid=12413): stderr: | [0;m[38;5;43m20221208204240216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204240216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204240217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204240217 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204240219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204240219 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204240220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:42.004538 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12413): Process ended prematurely: osmo-stp_10.42.42.5(pid=12413) [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12413)] [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 20:42:42.014569 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:42:42.042645 run osmo-hlr_10.42.42.2(pid=12410): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12410)] 20:42:42.093357 run osmo-hlr_10.42.42.2(pid=12410): stdout: | (launched: 2022-12-08_20:42:39.084487) 20:42:42.145495 run osmo-hlr_10.42.42.2(pid=12410): stderr: | [0;m[1;31m20221208204239263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204239263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204239263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204239263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204239263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204239263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204239275 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204239283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204239283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204239283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:42:42.218397 run osmo-msc_10.42.42.6(pid=12416): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12416)] 20:42:42.269055 run osmo-msc_10.42.42.6(pid=12416): stdout: | (launched: 2022-12-08_20:42:41.056257) 20:42:42.321218 run osmo-msc_10.42.42.6(pid=12416): stderr: | [0;m[38;5;43m20221208204241379 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204241379 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdd89f3dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204241380 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204241380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204241380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204241380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204241382 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204241382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204241382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204241382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:42:42.373695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12409): Terminating (SIGTERM) 20:42:42.415816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12412): Terminating (SIGTERM) 20:42:42.458039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12415): Terminating (SIGTERM) 20:42:42.500479 --- ParallelTerminationStrategy: PID 12409 died... 20:42:42.521077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12409): Terminated: ok {rc=0} 20:42:42.567820 --- ParallelTerminationStrategy: PID 12412 died... 20:42:42.587704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12412): Terminated: ok {rc=0} 20:42:42.634296 --- ParallelTerminationStrategy: PID 12415 died... 20:42:42.654004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12415): Terminated: ok {rc=0} 20:42:42.742814 bus /sierra_3: Setting Powered False 20:42:43.843734 bus /sierra_3: Setting Powered False 20:42:44.962682 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 20:42:46.135975 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:46.149014 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:42:46.220373 tst mo_mt_call_osmux.py: using LAC 16685 20:42:46.392906 tst mo_mt_call_osmux.py: using RAC 110 20:42:46.524318 tst mo_mt_call_osmux.py: using CellId 16685 20:42:46.660177 tst mo_mt_call_osmux.py: using BVCI 16686 20:42:46.781811 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:46.794086 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:46.806283 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:46.818662 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:46.830910 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:46.843118 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:42:46.966234 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:42:47.115333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:42:47.630078 run create_hlr_db(pid=12418): Launched 20:42:47.764727 bus /sierra_2: Setting Powered False 20:42:48.829535 run create_hlr_db(pid=12418): Terminated: ok {rc=0} 20:42:49.266352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12420): Launched 20:42:49.571972 run osmo-hlr_10.42.42.2(pid=12421): Launched 20:42:49.688684 run osmo-stp_10.42.42.5: Starting osmo-stp 20:42:50.230178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12423): Launched 20:42:50.535696 run osmo-stp_10.42.42.5(pid=12424): Launched 20:42:50.651479 run osmo-msc_10.42.42.6: Starting osmo-msc 20:42:51.203950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12426): Launched 20:42:51.509677 run osmo-msc_10.42.42.6(pid=12427): Launched 20:42:51.683420 run osmo-stp_10.42.42.5(pid=12424): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12424)] 20:42:51.813605 run osmo-stp_10.42.42.5(pid=12424): stdout: | (launched: 2022-12-08_20:42:50.479788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:51.968749 run osmo-stp_10.42.42.5(pid=12424): stderr: | [0;m[38;5;43m20221208204250653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204250653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204250654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204250654 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204250655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204250655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204250655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:52.097395 run osmo-stp_10.42.42.5(pid=12424): stdout: | (launched: 2022-12-08_20:42:50.479788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:52.219336 run osmo-stp_10.42.42.5(pid=12424): stderr: | [0;m[38;5;43m20221208204250653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204250653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204250654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204250654 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204250655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204250655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204250655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:52.365448 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12424): Process ended prematurely: osmo-stp_10.42.42.5(pid=12424) [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12424)] [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 20:42:52.374523 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:42:52.401660 run osmo-hlr_10.42.42.2(pid=12421): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12421)] 20:42:52.451367 run osmo-hlr_10.42.42.2(pid=12421): stdout: | (launched: 2022-12-08_20:42:49.515948) 20:42:52.501749 run osmo-hlr_10.42.42.2(pid=12421): stderr: | [0;m[1;31m20221208204249694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204249694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204249694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204249694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204249694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204249694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204249706 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204249716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204249716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204249716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:42:52.571991 run osmo-msc_10.42.42.6(pid=12427): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12427)] 20:42:52.620595 run osmo-msc_10.42.42.6(pid=12427): stdout: | (launched: 2022-12-08_20:42:51.453459) 20:42:52.671029 run osmo-msc_10.42.42.6(pid=12427): stderr: | [0;m[38;5;43m20221208204251727 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204251727 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcdd2d99c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204251727 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204251727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204251728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204251728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204251730 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204251730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204251730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204251730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:42:52.721705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12420): Terminating (SIGTERM) 20:42:52.762654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12423): Terminating (SIGTERM) 20:42:52.803418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12426): Terminating (SIGTERM) 20:42:52.844422 --- ParallelTerminationStrategy: PID 12420 died... 20:42:52.863456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12420): Terminated: ok {rc=0} 20:42:52.909496 --- ParallelTerminationStrategy: PID 12423 died... 20:42:52.928106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12423): Terminated: ok {rc=0} 20:42:52.973699 --- ParallelTerminationStrategy: PID 12426 died... 20:42:52.992386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12426): Terminated: ok {rc=0} 20:42:53.079153 bus /sierra_3: Setting Powered False 20:42:54.178898 bus /sierra_3: Setting Powered False 20:42:55.294384 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:42:56.544864 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:42:56.550713 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:42:56.584083 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 20:42:56.610619 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 20:42:56.663133 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:42:56.696098 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 20:42:56.722733 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 20:42:57.271847 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 20:42:57.321187 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:42:57.332048 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:42:57.401302 tst mo_mt_call.py: using LAC 16686 20:42:57.523298 tst mo_mt_call.py: using RAC 111 20:42:57.645085 tst mo_mt_call.py: using CellId 16686 20:42:57.775633 tst mo_mt_call.py: using BVCI 16687 20:42:57.897359 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:42:57.908900 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:42:57.920445 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:42:57.932547 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:42:57.944504 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:42:57.956350 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:42:58.075492 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:42:58.196845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:42:58.671004 run create_hlr_db(pid=12432): Launched 20:42:58.787772 bus /sierra_2: Setting Powered False 20:42:59.849098 run create_hlr_db(pid=12432): Terminated: ok {rc=0} 20:43:00.275518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12434): Launched 20:43:00.581271 run osmo-hlr_10.42.42.2(pid=12435): Launched 20:43:00.697736 run osmo-stp_10.42.42.5: Starting osmo-stp 20:43:01.251711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12437): Launched 20:43:01.602053 run osmo-stp_10.42.42.5(pid=12438): Launched 20:43:01.886106 run osmo-msc_10.42.42.6: Starting osmo-msc 20:43:02.711946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12440): Launched 20:43:03.041270 run osmo-msc_10.42.42.6(pid=12441): Launched 20:43:03.223485 run osmo-stp_10.42.42.5(pid=12438): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12438)] 20:43:03.362495 run osmo-stp_10.42.42.5(pid=12438): stdout: | (launched: 2022-12-08_20:43:01.539509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:03.500814 run osmo-stp_10.42.42.5(pid=12438): stderr: | [0;m[38;5;43m20221208204301880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204301881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204301882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204301882 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204301883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204301883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204301883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:03.638425 run osmo-stp_10.42.42.5(pid=12438): stdout: | (launched: 2022-12-08_20:43:01.539509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:03.768865 run osmo-stp_10.42.42.5(pid=12438): stderr: | [0;m[38;5;43m20221208204301880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204301881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204301882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204301882 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204301883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204301883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204301883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:03.924851 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12438): Process ended prematurely: osmo-stp_10.42.42.5(pid=12438) [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12438)] [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 20:43:03.934589 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 20:43:03.962545 run osmo-hlr_10.42.42.2(pid=12435): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12435)] 20:43:04.013710 run osmo-hlr_10.42.42.2(pid=12435): stdout: | (launched: 2022-12-08_20:43:00.525139) 20:43:04.066646 run osmo-hlr_10.42.42.2(pid=12435): stderr: | [0;m[1;31m20221208204300702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204300702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204300702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204300702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204300702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204300702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204300716 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204300726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204300726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204300726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:43:04.139753 run osmo-msc_10.42.42.6(pid=12441): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12441)] 20:43:04.190728 run osmo-msc_10.42.42.6(pid=12441): stdout: | (launched: 2022-12-08_20:43:02.980833) 20:43:04.243459 run osmo-msc_10.42.42.6(pid=12441): stderr: | [0;m[38;5;43m20221208204303305 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204303305 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4b0448dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204303305 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204303306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204303306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204303306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204303307 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204303308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204303308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204303308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:43:04.296913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12434): Terminating (SIGTERM) 20:43:04.339245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12437): Terminating (SIGTERM) 20:43:04.381507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12440): Terminating (SIGTERM) 20:43:04.423864 --- ParallelTerminationStrategy: PID 12434 died... 20:43:04.444150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12434): Terminated: ok {rc=0} 20:43:04.491001 --- ParallelTerminationStrategy: PID 12437 died... 20:43:04.510682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12437): Terminated: ok {rc=0} 20:43:04.557770 --- ParallelTerminationStrategy: PID 12440 died... 20:43:04.578106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12440): Terminated: ok {rc=0} 20:43:04.667239 bus /sierra_3: Setting Powered False 20:43:05.766159 bus /sierra_3: Setting Powered False 20:43:06.882905 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 20:43:08.033432 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:43:08.045088 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:43:08.116429 tst mo_mt_call_osmux.py: using LAC 16687 20:43:08.246046 tst mo_mt_call_osmux.py: using RAC 112 20:43:08.375838 tst mo_mt_call_osmux.py: using CellId 16687 20:43:08.506544 tst mo_mt_call_osmux.py: using BVCI 16688 20:43:08.627538 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:43:08.639323 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:43:08.650799 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:43:08.662184 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:43:08.673560 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:43:08.684857 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:43:08.808217 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:43:08.930839 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:43:09.442313 run create_hlr_db(pid=12443): Launched 20:43:09.576784 bus /sierra_2: Setting Powered False 20:43:10.642054 run create_hlr_db(pid=12443): Terminated: ok {rc=0} 20:43:11.079432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12445): Launched 20:43:11.386994 run osmo-hlr_10.42.42.2(pid=12446): Launched 20:43:11.504207 run osmo-stp_10.42.42.5: Starting osmo-stp 20:43:12.034894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12448): Launched 20:43:12.342957 run osmo-stp_10.42.42.5(pid=12449): Launched 20:43:12.459539 run osmo-msc_10.42.42.6: Starting osmo-msc 20:43:13.019892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12451): Launched 20:43:13.327288 run osmo-msc_10.42.42.6(pid=12452): Launched 20:43:13.499193 run osmo-stp_10.42.42.5(pid=12449): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12449)] 20:43:13.629735 run osmo-stp_10.42.42.5(pid=12449): stdout: | (launched: 2022-12-08_20:43:12.286759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:13.759931 run osmo-stp_10.42.42.5(pid=12449): stderr: | [0;m[38;5;43m20221208204312458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204312458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204312458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204312459 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204312461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204312461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204312461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:13.888500 run osmo-stp_10.42.42.5(pid=12449): stdout: | (launched: 2022-12-08_20:43:12.286759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:14.010195 run osmo-stp_10.42.42.5(pid=12449): stderr: | [0;m[38;5;43m20221208204312458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204312458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204312458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204312459 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204312461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204312461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204312461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:14.156207 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12449): Process ended prematurely: osmo-stp_10.42.42.5(pid=12449) [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12449)] [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 20:43:14.165180 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 20:43:14.192225 run osmo-hlr_10.42.42.2(pid=12446): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12446)] 20:43:14.241174 run osmo-hlr_10.42.42.2(pid=12446): stdout: | (launched: 2022-12-08_20:43:11.330357) 20:43:14.291414 run osmo-hlr_10.42.42.2(pid=12446): stderr: | [0;m[1;31m20221208204311506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204311506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204311506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204311506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204311506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204311506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204311519 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204311529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204311529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204311530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:43:14.361709 run osmo-msc_10.42.42.6(pid=12452): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12452)] 20:43:14.410351 run osmo-msc_10.42.42.6(pid=12452): stdout: | (launched: 2022-12-08_20:43:13.270533) 20:43:14.460477 run osmo-msc_10.42.42.6(pid=12452): stderr: | [0;m[38;5;43m20221208204313546 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204313546 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f71896a0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204313546 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204313546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204313546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204313546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204313548 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204313549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204313549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204313549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:43:14.510850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12445): Terminating (SIGTERM) 20:43:14.551252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12448): Terminating (SIGTERM) 20:43:14.591536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12451): Terminating (SIGTERM) 20:43:14.632122 --- ParallelTerminationStrategy: PID 12445 died... 20:43:14.651466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12445): Terminated: ok {rc=0} 20:43:14.696433 --- ParallelTerminationStrategy: PID 12448 died... 20:43:14.715408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12448): Terminated: ok {rc=0} 20:43:14.760821 --- ParallelTerminationStrategy: PID 12451 died... 20:43:14.780204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12451): Terminated: ok {rc=0} 20:43:14.865079 bus /sierra_3: Setting Powered False 20:43:15.977201 bus /sierra_3: Setting Powered False 20:43:17.105736 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 20:43:18.368223 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:43:18.374991 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 20:43:18.408348 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 20:43:18.435910 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 20:43:18.487486 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 20:43:18.520884 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 20:43:18.548423 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 20:43:19.104647 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 20:43:19.157060 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:19.168909 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:43:19.220768 tst mo_mt_call.py: using LAC 16688 20:43:19.347971 tst mo_mt_call.py: using RAC 113 20:43:19.478188 tst mo_mt_call.py: using CellId 16688 20:43:19.609573 tst mo_mt_call.py: using BVCI 16689 20:43:19.731745 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:19.743605 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:19.755184 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:19.766794 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:19.778581 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:19.790287 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:43:19.907644 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:43:20.038886 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:43:20.542292 run create_hlr_db(pid=12457): Launched 20:43:20.674009 bus /sierra_2: Setting Powered False 20:43:21.733817 run create_hlr_db(pid=12457): Terminated: ok {rc=0} 20:43:22.185041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12459): Launched 20:43:22.509987 run osmo-hlr_10.42.42.2(pid=12460): Launched 20:43:22.633336 run osmo-stp_10.42.42.5: Starting osmo-stp 20:43:23.191579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12462): Launched 20:43:23.517640 run osmo-stp_10.42.42.5(pid=12463): Launched 20:43:23.642445 run osmo-msc_10.42.42.6: Starting osmo-msc 20:43:24.228775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12465): Launched 20:43:24.552739 run osmo-msc_10.42.42.6(pid=12466): Launched 20:43:24.733517 run osmo-stp_10.42.42.5(pid=12463): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12463)] 20:43:24.870486 run osmo-stp_10.42.42.5(pid=12463): stdout: | (launched: 2022-12-08_20:43:23.457608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:25.008172 run osmo-stp_10.42.42.5(pid=12463): stderr: | [0;m[38;5;43m20221208204323649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204323649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204323649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204323649 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204323650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204323650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204323650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:25.145681 run osmo-stp_10.42.42.5(pid=12463): stdout: | (launched: 2022-12-08_20:43:23.457608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:25.274985 run osmo-stp_10.42.42.5(pid=12463): stderr: | [0;m[38;5;43m20221208204323649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204323649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204323649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204323649 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204323650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204323650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204323650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:25.429691 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12463): Process ended prematurely: osmo-stp_10.42.42.5(pid=12463) [trial-2349↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12463)] [trial-2349↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 20:43:25.439360 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:43:25.467548 run osmo-hlr_10.42.42.2(pid=12460): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12460)] 20:43:25.517889 run osmo-hlr_10.42.42.2(pid=12460): stdout: | (launched: 2022-12-08_20:43:22.451151) 20:43:25.569910 run osmo-hlr_10.42.42.2(pid=12460): stderr: | [0;m[1;31m20221208204322649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204322649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204322649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204322650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204322650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204322650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204322663 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204322673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204322673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204322673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:43:25.642378 run osmo-msc_10.42.42.6(pid=12466): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12466)] 20:43:25.692093 run osmo-msc_10.42.42.6(pid=12466): stdout: | (launched: 2022-12-08_20:43:24.493593) 20:43:25.743557 run osmo-msc_10.42.42.6(pid=12466): stderr: | [0;m[38;5;43m20221208204324816 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204324816 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6d36329c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204324816 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204324816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204324816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204324817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204324818 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204324819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204324819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204324819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:43:25.795132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12459): Terminating (SIGTERM) 20:43:25.836776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12462): Terminating (SIGTERM) 20:43:25.878320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12465): Terminating (SIGTERM) 20:43:25.920172 --- ParallelTerminationStrategy: PID 12459 died... 20:43:25.940150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12459): Terminated: ok {rc=0} 20:43:25.986867 --- ParallelTerminationStrategy: PID 12462 died... 20:43:26.006595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12462): Terminated: ok {rc=0} 20:43:26.053244 --- ParallelTerminationStrategy: PID 12465 died... 20:43:26.073302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12465): Terminated: ok {rc=0} 20:43:26.160637 bus /sierra_3: Setting Powered False 20:43:27.259773 bus /sierra_3: Setting Powered False 20:43:28.378248 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 20:43:29.523494 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:29.535310 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:43:29.588096 tst mo_mt_call_osmux.py: using LAC 16689 20:43:29.711853 tst mo_mt_call_osmux.py: using RAC 114 20:43:29.829224 tst mo_mt_call_osmux.py: using CellId 16689 20:43:29.949102 tst mo_mt_call_osmux.py: using BVCI 16690 20:43:30.058675 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:30.069970 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:30.081152 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:30.092904 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:30.104880 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:30.116823 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:43:30.234275 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:43:30.351084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:43:30.817478 run create_hlr_db(pid=12468): Launched 20:43:30.944454 bus /sierra_2: Setting Powered False 20:43:32.009241 run create_hlr_db(pid=12468): Terminated: ok {rc=0} 20:43:32.466550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12470): Launched 20:43:32.791401 run osmo-hlr_10.42.42.2(pid=12471): Launched 20:43:32.915337 run osmo-stp_10.42.42.5: Starting osmo-stp 20:43:33.473248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12473): Launched 20:43:33.797500 run osmo-stp_10.42.42.5(pid=12474): Launched 20:43:33.920732 run osmo-msc_10.42.42.6: Starting osmo-msc 20:43:34.506737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12476): Launched 20:43:34.831565 run osmo-msc_10.42.42.6(pid=12477): Launched 20:43:35.012232 run osmo-stp_10.42.42.5(pid=12474): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12474)] 20:43:35.150110 run osmo-stp_10.42.42.5(pid=12474): stdout: | (launched: 2022-12-08_20:43:33.738644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:35.287634 run osmo-stp_10.42.42.5(pid=12474): stderr: | [0;m[38;5;43m20221208204333932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204333932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204333932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204333933 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204333933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204333933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204333933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:35.424548 run osmo-stp_10.42.42.5(pid=12474): stdout: | (launched: 2022-12-08_20:43:33.738644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:35.554334 run osmo-stp_10.42.42.5(pid=12474): stderr: | [0;m[38;5;43m20221208204333932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204333932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204333932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204333933 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204333933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204333933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204333933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:35.709505 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12474): Process ended prematurely: osmo-stp_10.42.42.5(pid=12474) [trial-2349↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12474)] [trial-2349↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 20:43:35.719028 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 20:43:35.747583 run osmo-hlr_10.42.42.2(pid=12471): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12471)] 20:43:35.797347 run osmo-hlr_10.42.42.2(pid=12471): stdout: | (launched: 2022-12-08_20:43:32.732403) 20:43:35.848670 run osmo-hlr_10.42.42.2(pid=12471): stderr: | [0;m[1;31m20221208204332932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204332933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204332933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204332933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204332933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204332933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204332945 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204332953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204332953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204332954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:43:35.920051 run osmo-msc_10.42.42.6(pid=12477): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12477)] 20:43:35.969399 run osmo-msc_10.42.42.6(pid=12477): stdout: | (launched: 2022-12-08_20:43:34.772247) 20:43:36.020343 run osmo-msc_10.42.42.6(pid=12477): stderr: | [0;m[38;5;43m20221208204335095 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204335095 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4116d61c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204335095 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204335095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204335095 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204335096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204335097 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204335098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204335098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204335098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:43:36.072102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12470): Terminating (SIGTERM) 20:43:36.113528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12473): Terminating (SIGTERM) 20:43:36.154859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12476): Terminating (SIGTERM) 20:43:36.196406 --- ParallelTerminationStrategy: PID 12470 died... 20:43:36.216434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12470): Terminated: ok {rc=0} 20:43:36.262536 --- ParallelTerminationStrategy: PID 12473 died... 20:43:36.281897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12473): Terminated: ok {rc=0} 20:43:36.328113 --- ParallelTerminationStrategy: PID 12476 died... 20:43:36.347838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12476): Terminated: ok {rc=0} 20:43:36.436500 bus /sierra_3: Setting Powered False 20:43:37.535128 bus /sierra_3: Setting Powered False 20:43:38.653269 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 emergency:trx-umtrx --------------------------------------------------------------------- 20:43:39.902392 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:43:39.906857 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 20:43:39.940933 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:43:39.967778 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 20:43:40.052450 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 20:43:40.085045 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:43:40.111817 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 20:43:40.693830 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2349 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 20:43:40.698859 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:43:40.709597 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 20:43:40.762497 tst emergency_mo_mt_call.py: using LAC 16690 20:43:40.877131 tst emergency_mo_mt_call.py: using RAC 115 20:43:40.990133 tst emergency_mo_mt_call.py: using CellId 16690 20:43:41.102698 tst emergency_mo_mt_call.py: using BVCI 16691 20:43:41.207955 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:43:41.218745 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:43:41.229497 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:43:41.240186 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:43:41.251021 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:43:41.261642 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 20:43:41.379133 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 20:43:41.496864 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:43:41.948658 run create_hlr_db(pid=12482): Launched 20:43:42.059168 bus /sierra_2: Setting Powered False 20:43:43.118162 run create_hlr_db(pid=12482): Terminated: ok {rc=0} 20:43:43.547879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12484): Launched 20:43:43.862277 run osmo-hlr_10.42.42.2(pid=12485): Launched 20:43:43.982091 run osmo-stp_10.42.42.5: Starting osmo-stp 20:43:44.527340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12487): Launched 20:43:44.840155 run osmo-stp_10.42.42.5(pid=12488): Launched 20:43:44.969440 tst emergency_mo_mt_call.py: using MSISDN 6845 20:43:45.131115 run osmo-msc_10.42.42.6: Starting osmo-msc 20:43:45.694135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12490): Launched 20:43:46.035222 run osmo-msc_10.42.42.6(pid=12491): Launched 20:43:46.438898 run osmo-stp_10.42.42.5(pid=12488): ERR: Terminated: ERROR {rc=1} [trial-2349↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12488)] 20:43:46.811192 run osmo-stp_10.42.42.5(pid=12488): stdout: | (launched: 2022-12-08_20:43:44.783510) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:46.970313 run osmo-stp_10.42.42.5(pid=12488): stderr: | [0;m[38;5;43m20221208204344974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204344974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204344975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204344975 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204344975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204344976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204344976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:47.097755 run osmo-stp_10.42.42.5(pid=12488): stdout: | (launched: 2022-12-08_20:43:44.783510) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:47.219150 run osmo-stp_10.42.42.5(pid=12488): stderr: | [0;m[38;5;43m20221208204344974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204344974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204344975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204344975 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204344975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204344976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204344976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:47.375784 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=12488): Process ended prematurely: osmo-stp_10.42.42.5(pid=12488) [trial-2349↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12488)] [trial-2349↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 20:43:47.385488 tst emergency_mo_mt_call.py:19: Test FAILED (6.7 sec) 20:43:47.413145 run osmo-hlr_10.42.42.2(pid=12485): ERR: Terminated: ERROR {rc=237} [trial-2349↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12485)] 20:43:47.463960 run osmo-hlr_10.42.42.2(pid=12485): stdout: | (launched: 2022-12-08_20:43:43.805638) 20:43:47.515733 run osmo-hlr_10.42.42.2(pid=12485): stderr: | [0;m[1;31m20221208204343998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204343998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204343998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204343998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204343998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204343999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204344011 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204344019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204344020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204344020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:43:47.587648 run osmo-msc_10.42.42.6(pid=12491): ERR: Terminated: ERROR {rc=2} [trial-2349↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12491)] 20:43:47.637813 run osmo-msc_10.42.42.6(pid=12491): stdout: | (launched: 2022-12-08_20:43:45.974469) 20:43:47.689503 run osmo-msc_10.42.42.6(pid=12491): stderr: | [0;m[38;5;43m20221208204346490 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204346490 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f842bc12c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204346490 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204346490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204346490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204346491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204346492 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204346493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204346493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204346493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:43:47.741225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12484): Terminating (SIGTERM) 20:43:47.782815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12487): Terminating (SIGTERM) 20:43:47.824530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12490): Terminating (SIGTERM) 20:43:47.866734 --- ParallelTerminationStrategy: PID 12484 died... 20:43:47.887027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12484): Terminated: ok {rc=0} 20:43:47.933184 --- ParallelTerminationStrategy: PID 12487 died... 20:43:47.952713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12487): Terminated: ok {rc=0} 20:43:47.998646 --- ParallelTerminationStrategy: PID 12490 died... 20:43:48.018220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12490): Terminated: ok {rc=0} 20:43:48.104774 bus /sierra_3: Setting Powered False 20:43:49.201758 bus /sierra_3: Setting Powered False 20:43:50.316702 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 20:43:51.403964 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:43:51.415383 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 20:43:51.465272 tst emergency_preemptive_call.py: using LAC 16691 20:43:51.581414 tst emergency_preemptive_call.py: using RAC 116 20:43:51.695885 tst emergency_preemptive_call.py: using CellId 16691 20:43:51.809520 tst emergency_preemptive_call.py: using BVCI 16692 20:43:51.924055 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:43:51.935328 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:43:51.946521 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:43:51.957737 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:43:51.968927 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:43:51.980121 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 20:43:52.099509 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 20:43:52.215600 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 20:43:52.331695 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 20:43:52.444836 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:43:52.933594 run create_hlr_db(pid=12493): Launched 20:43:53.061667 bus /sierra_2: Setting Powered False 20:43:54.125141 run create_hlr_db(pid=12493): Terminated: ok {rc=0} 20:43:54.564225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12495): Launched 20:43:54.877217 run osmo-hlr_10.42.42.2(pid=12496): Launched 20:43:54.996532 run osmo-stp_10.42.42.5: Starting osmo-stp 20:43:55.537450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12498): Launched 20:43:55.852464 run osmo-stp_10.42.42.5(pid=12499): Launched 20:43:55.982099 tst emergency_preemptive_call.py: using MSISDN 6846 20:43:56.143983 run osmo-msc_10.42.42.6: Starting osmo-msc 20:43:56.706405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12501): Launched 20:43:57.019402 run osmo-msc_10.42.42.6(pid=12502): Launched 20:43:57.193957 run osmo-stp_10.42.42.5(pid=12499): ERR: Terminated: ERROR {rc=1} [trial-2349↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12499)] 20:43:57.326227 run osmo-stp_10.42.42.5(pid=12499): stdout: | (launched: 2022-12-08_20:43:55.795264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:57.459376 run osmo-stp_10.42.42.5(pid=12499): stderr: | [0;m[38;5;43m20221208204355987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204355987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204355987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204355988 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204355988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204355988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204355988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:57.591664 run osmo-stp_10.42.42.5(pid=12499): stdout: | (launched: 2022-12-08_20:43:55.795264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:57.716654 run osmo-stp_10.42.42.5(pid=12499): stderr: | [0;m[38;5;43m20221208204355987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204355987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204355987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204355988 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204355988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204355988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204355988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:57.866332 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=12499): Process ended prematurely: osmo-stp_10.42.42.5(pid=12499) [trial-2349↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12499)] [trial-2349↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 20:43:57.875273 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 20:43:57.902494 run osmo-hlr_10.42.42.2(pid=12496): ERR: Terminated: ERROR {rc=237} [trial-2349↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12496)] 20:43:57.952079 run osmo-hlr_10.42.42.2(pid=12496): stdout: | (launched: 2022-12-08_20:43:54.820320) 20:43:58.003328 run osmo-hlr_10.42.42.2(pid=12496): stderr: | [0;m[1;31m20221208204355015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204355015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204355015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204355015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204355015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204355015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204355027 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204355035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204355036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204355036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:43:58.074799 run osmo-msc_10.42.42.6(pid=12502): ERR: Terminated: ERROR {rc=2} [trial-2349↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12502)] 20:43:58.124308 run osmo-msc_10.42.42.6(pid=12502): stdout: | (launched: 2022-12-08_20:43:56.962526) 20:43:58.175049 run osmo-msc_10.42.42.6(pid=12502): stderr: | [0;m[38;5;43m20221208204357281 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204357281 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f88ba5aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204357281 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204357281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204357281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204357282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204357283 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204357284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204357284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204357284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:43:58.226296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12495): Terminating (SIGTERM) 20:43:58.267438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12498): Terminating (SIGTERM) 20:43:58.308580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12501): Terminating (SIGTERM) 20:43:58.350564 --- ParallelTerminationStrategy: PID 12495 died... 20:43:58.370341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12495): Terminated: ok {rc=0} 20:43:58.416593 --- ParallelTerminationStrategy: PID 12498 died... 20:43:58.436139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12498): Terminated: ok {rc=0} 20:43:58.481770 --- ParallelTerminationStrategy: PID 12501 died... 20:43:58.501264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12501): Terminated: ok {rc=0} 20:43:58.587979 bus /sierra_9: Setting Powered False 20:43:59.684385 bus /sierra_9: Setting Powered False 20:44:00.799664 bus /sierra_8: Setting Powered False 20:44:01.904141 bus /sierra_8: Setting Powered False 20:44:03.025164 bus /sierra_3: Setting Powered False 20:44:04.123135 bus /sierra_3: Setting Powered False 20:44:05.238238 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-umtrx --------------------------------------------------------------------- 20:44:06.517408 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:44:06.522090 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 20:44:06.555148 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 20:44:06.594323 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 20:44:06.682311 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 20:44:06.715275 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 20:44:06.755232 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 20:44:07.346281 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 20:44:07.397857 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:07.409151 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 20:44:07.461475 tst cs_paging_gprs_active.py: using LAC 16692 20:44:07.587401 tst cs_paging_gprs_active.py: using RAC 117 20:44:07.705362 tst cs_paging_gprs_active.py: using CellId 16692 20:44:07.822842 tst cs_paging_gprs_active.py: using BVCI 16693 20:44:07.931513 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:07.942280 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:07.952719 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:07.963674 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:07.974552 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:07.985299 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:07.996054 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:08.006688 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:08.017458 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:08.136350 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:08.252109 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:44:08.454000 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:44:08.754355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12508): Launched 20:44:09.013896 run iperf3-srv_10.42.42.10(pid=12509): Launched 20:44:09.126055 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:44:09.325818 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:44:09.625604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12510): Launched 20:44:09.886459 run iperf3-srv_10.42.42.10(pid=12511): Launched 20:44:09.998818 tst cs_paging_gprs_active.py:38: start network... 20:44:10.198482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:44:10.660301 run create_hlr_db(pid=12512): Launched 20:44:10.774327 bus /sierra_2: Setting Powered False 20:44:11.834493 run create_hlr_db(pid=12512): Terminated: ok {rc=0} 20:44:12.273930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12514): Launched 20:44:12.595989 run osmo-hlr_10.42.42.2(pid=12515): Launched 20:44:12.718897 run osmo-stp_10.42.42.5: Starting osmo-stp 20:44:13.271036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12517): Launched 20:44:13.592439 run osmo-stp_10.42.42.5(pid=12518): Launched 20:44:13.714791 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:44:14.268053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12520): Launched 20:44:14.390502 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:44:14.659189 run patchelf(pid=12521): Launched 20:44:14.836790 run osmo-stp_10.42.42.5(pid=12518): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12518)] 20:44:14.972076 run osmo-stp_10.42.42.5(pid=12518): stdout: | (launched: 2022-12-08_20:44:13.534278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:15.110234 run osmo-stp_10.42.42.5(pid=12518): stderr: | [0;m[38;5;43m20221208204413725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204413725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204413725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204413726 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204413726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204413727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204413727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:15.247212 run osmo-stp_10.42.42.5(pid=12518): stdout: | (launched: 2022-12-08_20:44:13.534278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:15.379081 run osmo-stp_10.42.42.5(pid=12518): stderr: | [0;m[38;5;43m20221208204413725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204413725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204413725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204413726 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204413726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204413727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204413727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:15.534536 run patchelf(pid=12521): Terminating (SIGINT) 20:44:15.714532 run patchelf(pid=12521): Terminated: ok {rc=0} 20:44:15.849499 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12518): Process ended prematurely: osmo-stp_10.42.42.5(pid=12518) [trial-2349↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12518)] [trial-2349↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 20:44:15.860266 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 20:44:15.894236 run osmo-hlr_10.42.42.2(pid=12515): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12515)] 20:44:15.958821 run osmo-hlr_10.42.42.2(pid=12515): stdout: | (launched: 2022-12-08_20:44:12.537699) 20:44:16.011505 run osmo-hlr_10.42.42.2(pid=12515): stderr: | [0;m[1;31m20221208204412734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204412735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204412735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204412735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204412735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204412735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204412747 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204412755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204412756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204412756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:44:16.066885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12508): Terminating (SIGTERM) 20:44:16.109356 run iperf3-srv_10.42.42.10(pid=12509): Terminating (SIGTERM) 20:44:16.154326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12510): Terminating (SIGTERM) 20:44:16.197713 run iperf3-srv_10.42.42.10(pid=12511): Terminating (SIGTERM) 20:44:16.242542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12514): Terminating (SIGTERM) 20:44:16.285511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12517): Terminating (SIGTERM) 20:44:16.330377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12520): Terminating (SIGTERM) 20:44:16.375187 --- ParallelTerminationStrategy: PID 12508 died... 20:44:16.394986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12508): Terminated: ok {rc=0} 20:44:16.444241 --- ParallelTerminationStrategy: PID 12509 died... 20:44:16.463780 run iperf3-srv_10.42.42.10(pid=12509): Terminated {rc=256} 20:44:16.510770 --- ParallelTerminationStrategy: PID 12510 died... 20:44:16.531297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12510): Terminated: ok {rc=0} 20:44:16.578955 --- ParallelTerminationStrategy: PID 12511 died... 20:44:16.598511 run iperf3-srv_10.42.42.10(pid=12511): Terminated {rc=256} 20:44:16.645068 --- ParallelTerminationStrategy: PID 12514 died... 20:44:16.664926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12514): Terminated: ok {rc=0} 20:44:16.712376 --- ParallelTerminationStrategy: PID 12517 died... 20:44:16.733998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12517): Terminated: ok {rc=0} 20:44:16.781606 --- ParallelTerminationStrategy: PID 12520 died... 20:44:16.800911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12520): Terminated: ok {rc=0} 20:44:16.888048 bus /gobi_0: Setting Powered False 20:44:17.988403 bus /gobi_0: Setting Powered False 20:44:19.103096 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-umtrx iperf3.py ---------------------------------------------- 20:44:20.247311 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:20.258593 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 20:44:20.309922 tst iperf3.py: using LAC 16693 20:44:20.436578 tst iperf3.py: using RAC 118 20:44:20.561888 tst iperf3.py: using CellId 16693 20:44:20.687357 tst iperf3.py: using BVCI 16694 20:44:20.805606 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:20.816744 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:20.827765 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:20.838554 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:20.849236 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:20.859913 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:20.870812 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:20.881723 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:20.892563 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:21.012822 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:44:21.230697 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:44:21.551909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12522): Launched 20:44:21.830364 run iperf3-srv_10.42.42.10(pid=12523): Launched 20:44:21.950961 tst iperf3.py:8: start network... 20:44:22.167571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:44:22.663713 run create_hlr_db(pid=12524): Launched 20:44:22.794516 bus /gobi_6: Setting Powered False 20:44:23.858822 run create_hlr_db(pid=12524): Terminated: ok {rc=0} 20:44:24.306052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12526): Launched 20:44:24.626557 run osmo-hlr_10.42.42.2(pid=12527): Launched 20:44:24.748175 run osmo-stp_10.42.42.5: Starting osmo-stp 20:44:25.298380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12529): Launched 20:44:25.617109 run osmo-stp_10.42.42.5(pid=12530): Launched 20:44:25.739023 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:44:26.291394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12532): Launched 20:44:26.414393 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:44:26.684544 run patchelf(pid=12533): Launched 20:44:26.863158 run osmo-stp_10.42.42.5(pid=12530): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12530)] 20:44:26.999577 run osmo-stp_10.42.42.5(pid=12530): stdout: | (launched: 2022-12-08_20:44:25.559202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:27.138141 run osmo-stp_10.42.42.5(pid=12530): stderr: | [0;m[38;5;43m20221208204425750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204425750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204425750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204425750 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204425751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204425751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204425751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:27.275825 run osmo-stp_10.42.42.5(pid=12530): stdout: | (launched: 2022-12-08_20:44:25.559202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:27.408058 run osmo-stp_10.42.42.5(pid=12530): stderr: | [0;m[38;5;43m20221208204425750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204425750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204425750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204425750 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204425751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204425751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204425751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:27.564450 run patchelf(pid=12533): Terminating (SIGINT) 20:44:27.745247 run patchelf(pid=12533): Terminated: ok {rc=0} 20:44:27.875157 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12530): Process ended prematurely: osmo-stp_10.42.42.5(pid=12530) [trial-2349↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12530)] [trial-2349↪gprs:trx-umtrx↪iperf3.py:8] 20:44:27.885294 tst iperf3.py:8: Test FAILED (7.7 sec) 20:44:27.913886 run osmo-hlr_10.42.42.2(pid=12527): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12527)] 20:44:27.964295 run osmo-hlr_10.42.42.2(pid=12527): stdout: | (launched: 2022-12-08_20:44:24.568413) 20:44:28.016222 run osmo-hlr_10.42.42.2(pid=12527): stderr: | [0;m[1;31m20221208204424764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204424764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204424764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204424764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204424764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204424765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204424775 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204424783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204424783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204424783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:44:28.068696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12522): Terminating (SIGTERM) 20:44:28.110788 run iperf3-srv_10.42.42.10(pid=12523): Terminating (SIGTERM) 20:44:28.152695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12526): Terminating (SIGTERM) 20:44:28.194707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12529): Terminating (SIGTERM) 20:44:28.236422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12532): Terminating (SIGTERM) 20:44:28.278664 --- ParallelTerminationStrategy: PID 12522 died... 20:44:28.298727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12522): Terminated: ok {rc=0} 20:44:28.345172 --- ParallelTerminationStrategy: PID 12523 died... 20:44:28.364571 run iperf3-srv_10.42.42.10(pid=12523): Terminated {rc=256} 20:44:28.410548 --- ParallelTerminationStrategy: PID 12526 died... 20:44:28.430027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12526): Terminated: ok {rc=0} 20:44:28.475948 --- ParallelTerminationStrategy: PID 12529 died... 20:44:28.495554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12529): Terminated: ok {rc=0} 20:44:28.541539 --- ParallelTerminationStrategy: PID 12532 died... 20:44:28.560909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12532): Terminated: ok {rc=0} 20:44:28.647263 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 20:44:29.790934 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:29.802113 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 20:44:29.849327 tst iperf3m4.py: using LAC 16694 20:44:29.965484 tst iperf3m4.py: using RAC 119 20:44:30.093226 tst iperf3m4.py: using CellId 16694 20:44:30.220864 tst iperf3m4.py: using BVCI 16695 20:44:30.337687 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:30.348897 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:30.360245 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:30.371446 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:30.382606 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:30.393705 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:30.404804 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:30.415848 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:30.426994 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:30.543170 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:30.669213 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:30.788472 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:30.932907 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:44:31.166886 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:44:31.499717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12535): Launched 20:44:31.801685 run iperf3-srv_10.42.42.10(pid=12536): Launched 20:44:31.930944 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:44:32.152638 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:44:32.475216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12537): Launched 20:44:32.753668 run iperf3-srv_10.42.42.10(pid=12538): Launched 20:44:32.873978 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:44:33.090436 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:44:33.411852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12539): Launched 20:44:33.689636 run iperf3-srv_10.42.42.10(pid=12540): Launched 20:44:33.809637 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:44:34.025692 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:44:34.347413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12541): Launched 20:44:34.625728 run iperf3-srv_10.42.42.10(pid=12542): Launched 20:44:34.745569 tst iperf3m4.py:8: start network... 20:44:34.960707 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:44:35.456488 run create_hlr_db(pid=12543): Launched 20:44:35.586597 bus /gobi_6: Setting Powered False 20:44:36.649861 run create_hlr_db(pid=12543): Terminated: ok {rc=0} 20:44:37.074804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12545): Launched 20:44:37.371862 run osmo-hlr_10.42.42.2(pid=12546): Launched 20:44:37.486720 run osmo-stp_10.42.42.5: Starting osmo-stp 20:44:38.014277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12548): Launched 20:44:38.313118 run osmo-stp_10.42.42.5(pid=12549): Launched 20:44:38.426222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:44:38.940101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12551): Launched 20:44:39.054767 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:44:39.307025 run patchelf(pid=12552): Launched 20:44:39.473338 run osmo-stp_10.42.42.5(pid=12549): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12549)] 20:44:39.600228 run osmo-stp_10.42.42.5(pid=12549): stdout: | (launched: 2022-12-08_20:44:38.258669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:39.728195 run osmo-stp_10.42.42.5(pid=12549): stderr: | [0;m[38;5;43m20221208204438426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204438426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204438426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204438427 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204438427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204438427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204438427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:39.856239 run osmo-stp_10.42.42.5(pid=12549): stdout: | (launched: 2022-12-08_20:44:38.258669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:39.979060 run osmo-stp_10.42.42.5(pid=12549): stderr: | [0;m[38;5;43m20221208204438426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204438426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204438426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204438427 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204438427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204438427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204438427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:40.125463 run patchelf(pid=12552): Terminating (SIGINT) 20:44:40.293963 run patchelf(pid=12552): Terminated: ok {rc=0} 20:44:40.414726 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12549): Process ended prematurely: osmo-stp_10.42.42.5(pid=12549) [trial-2349↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12549)] [trial-2349↪gprs:trx-umtrx↪iperf3m4.py:8] 20:44:40.423947 tst iperf3m4.py:8: Test FAILED (10.7 sec) 20:44:40.451130 run osmo-hlr_10.42.42.2(pid=12546): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12546)] 20:44:40.498914 run osmo-hlr_10.42.42.2(pid=12546): stdout: | (launched: 2022-12-08_20:44:37.317598) 20:44:40.547825 run osmo-hlr_10.42.42.2(pid=12546): stderr: | [0;m[1;31m20221208204437491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204437491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204437491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204437491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204437491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204437491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204437503 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204437512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204437513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204437513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:44:40.597222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12535): Terminating (SIGTERM) 20:44:40.636847 run iperf3-srv_10.42.42.10(pid=12536): Terminating (SIGTERM) 20:44:40.676390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12537): Terminating (SIGTERM) 20:44:40.716012 run iperf3-srv_10.42.42.10(pid=12538): Terminating (SIGTERM) 20:44:40.755518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12539): Terminating (SIGTERM) 20:44:40.795156 run iperf3-srv_10.42.42.10(pid=12540): Terminating (SIGTERM) 20:44:40.834682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12541): Terminating (SIGTERM) 20:44:40.874307 run iperf3-srv_10.42.42.10(pid=12542): Terminating (SIGTERM) 20:44:40.913765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12545): Terminating (SIGTERM) 20:44:40.953412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12548): Terminating (SIGTERM) 20:44:40.992878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12551): Terminating (SIGTERM) 20:44:41.032699 --- ParallelTerminationStrategy: PID 12535 died... 20:44:41.051756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12535): Terminated: ok {rc=0} 20:44:41.095661 --- ParallelTerminationStrategy: PID 12536 died... 20:44:41.114256 run iperf3-srv_10.42.42.10(pid=12536): Terminated {rc=256} 20:44:41.158041 --- ParallelTerminationStrategy: PID 12537 died... 20:44:41.176404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12537): Terminated: ok {rc=0} 20:44:41.220838 --- ParallelTerminationStrategy: PID 12538 died... 20:44:41.239722 run iperf3-srv_10.42.42.10(pid=12538): Terminated {rc=256} 20:44:41.283585 --- ParallelTerminationStrategy: PID 12539 died... 20:44:41.301927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12539): Terminated: ok {rc=0} 20:44:41.346015 --- ParallelTerminationStrategy: PID 12540 died... 20:44:41.364586 run iperf3-srv_10.42.42.10(pid=12540): Terminated {rc=256} 20:44:41.408683 --- ParallelTerminationStrategy: PID 12541 died... 20:44:41.427399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12541): Terminated: ok {rc=0} 20:44:41.471293 --- ParallelTerminationStrategy: PID 12542 died... 20:44:41.489782 run iperf3-srv_10.42.42.10(pid=12542): Terminated {rc=256} 20:44:41.533672 --- ParallelTerminationStrategy: PID 12545 died... 20:44:41.552292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12545): Terminated: ok {rc=0} 20:44:41.596167 --- ParallelTerminationStrategy: PID 12548 died... 20:44:41.614738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12548): Terminated: ok {rc=0} 20:44:41.658741 --- ParallelTerminationStrategy: PID 12551 died... 20:44:41.677354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12551): Terminated: ok {rc=0} 20:44:41.763400 bus /gobi_4: Setting Powered False 20:44:42.862245 bus /gobi_4: Setting Powered False 20:44:43.974888 bus /gobi_1: Setting Powered False 20:44:45.072499 bus /gobi_1: Setting Powered False 20:44:46.197120 bus /gobi_0: Setting Powered False 20:44:47.308306 bus /gobi_0: Setting Powered False 20:44:48.425539 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-umtrx ping.py ---------------------------------------------- 20:44:49.526985 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:49.538074 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 20:44:49.585882 tst ping.py: using LAC 16695 20:44:49.705351 tst ping.py: using RAC 120 20:44:49.819307 tst ping.py: using CellId 16695 20:44:49.932151 tst ping.py: using BVCI 16696 20:44:50.037637 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:50.048143 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:50.058561 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:50.069255 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:50.079814 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:50.090422 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:50.101300 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:50.111882 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:50.225508 tst ping.py:19: start network... 20:44:50.421792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:44:50.873636 run create_hlr_db(pid=12553): Launched 20:44:50.984936 bus /gobi_6: Setting Powered False 20:44:52.044126 run create_hlr_db(pid=12553): Terminated: ok {rc=0} 20:44:52.475686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12555): Launched 20:44:52.790503 run osmo-hlr_10.42.42.2(pid=12556): Launched 20:44:52.909679 run osmo-stp_10.42.42.5: Starting osmo-stp 20:44:53.458911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12558): Launched 20:44:53.772523 run osmo-stp_10.42.42.5(pid=12559): Launched 20:44:53.892231 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:44:54.436262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12561): Launched 20:44:54.560725 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:44:54.826815 run patchelf(pid=12562): Launched 20:44:55.003010 run osmo-stp_10.42.42.5(pid=12559): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12559)] 20:44:55.137972 run osmo-stp_10.42.42.5(pid=12559): stdout: | (launched: 2022-12-08_20:44:53.715434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:55.273842 run osmo-stp_10.42.42.5(pid=12559): stderr: | [0;m[38;5;43m20221208204453903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204453903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204453903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204453904 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204453904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204453904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204453904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:55.410121 run osmo-stp_10.42.42.5(pid=12559): stdout: | (launched: 2022-12-08_20:44:53.715434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:55.540217 run osmo-stp_10.42.42.5(pid=12559): stderr: | [0;m[38;5;43m20221208204453903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204453903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204453903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204453904 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204453904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204453904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204453904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:55.694318 run patchelf(pid=12562): Terminating (SIGINT) 20:44:55.872007 run patchelf(pid=12562): Terminated: ok {rc=0} 20:44:55.999802 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12559): Process ended prematurely: osmo-stp_10.42.42.5(pid=12559) [trial-2349↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12559)] [trial-2349↪gprs:trx-umtrx↪ping.py:22] 20:44:56.009111 tst ping.py:22: Test FAILED (6.5 sec) 20:44:56.037207 run osmo-hlr_10.42.42.2(pid=12556): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12556)] 20:44:56.087069 run osmo-hlr_10.42.42.2(pid=12556): stdout: | (launched: 2022-12-08_20:44:52.733647) 20:44:56.138482 run osmo-hlr_10.42.42.2(pid=12556): stderr: | [0;m[1;31m20221208204452927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204452927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204452927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204452927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204452927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204452927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204452939 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204452948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204452948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204452948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:44:56.190617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12555): Terminating (SIGTERM) 20:44:56.232515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12558): Terminating (SIGTERM) 20:44:56.274458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12561): Terminating (SIGTERM) 20:44:56.316572 --- ParallelTerminationStrategy: PID 12555 died... 20:44:56.336673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12555): Terminated: ok {rc=0} 20:44:56.383101 --- ParallelTerminationStrategy: PID 12558 died... 20:44:56.402805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12558): Terminated: ok {rc=0} 20:44:56.449195 --- ParallelTerminationStrategy: PID 12561 died... 20:44:56.468793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12561): Terminated: ok {rc=0} 20:44:56.556774 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 20:44:57.642504 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:57.654331 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 20:44:57.705117 tst ping_idle_ping.py: using LAC 16696 20:44:57.830714 tst ping_idle_ping.py: using RAC 121 20:44:57.955779 tst ping_idle_ping.py: using CellId 16696 20:44:58.079970 tst ping_idle_ping.py: using BVCI 16697 20:44:58.196751 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:58.208202 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:58.219183 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:58.230290 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:58.241328 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:58.252219 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:58.263289 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:58.274396 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:58.390219 tst ping_idle_ping.py:24: start network... 20:44:58.586305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:44:59.041038 run create_hlr_db(pid=12563): Launched 20:44:59.153943 bus /gobi_6: Setting Powered False 20:45:00.213308 run create_hlr_db(pid=12563): Terminated: ok {rc=0} 20:45:00.625364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12565): Launched 20:45:00.938721 run osmo-hlr_10.42.42.2(pid=12566): Launched 20:45:01.161823 run osmo-stp_10.42.42.5: Starting osmo-stp 20:45:01.829721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12571): Launched 20:45:02.267254 run osmo-stp_10.42.42.5(pid=12572): Launched 20:45:02.532186 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:45:03.090138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12574): Launched 20:45:03.211025 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:45:03.478105 run patchelf(pid=12575): Launched 20:45:03.653978 run osmo-stp_10.42.42.5(pid=12572): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12572)] 20:45:03.787864 run osmo-stp_10.42.42.5(pid=12572): stdout: | (launched: 2022-12-08_20:45:02.191678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:03.923071 run osmo-stp_10.42.42.5(pid=12572): stderr: | [0;m[38;5;43m20221208204502462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204502462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204502462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204502463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204502463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204502463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204502463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:04.058725 run osmo-stp_10.42.42.5(pid=12572): stdout: | (launched: 2022-12-08_20:45:02.191678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:04.188831 run osmo-stp_10.42.42.5(pid=12572): stderr: | [0;m[38;5;43m20221208204502462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204502462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204502462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204502463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204502463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204502463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204502463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:04.342958 run patchelf(pid=12575): Terminating (SIGINT) 20:45:04.520275 run patchelf(pid=12575): Terminated: ok {rc=0} 20:45:04.647840 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12572): Process ended prematurely: osmo-stp_10.42.42.5(pid=12572) [trial-2349↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12572)] [trial-2349↪gprs:trx-umtrx↪ping_idle_ping.py:27] 20:45:04.657255 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 20:45:04.685334 run osmo-hlr_10.42.42.2(pid=12566): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12566)] 20:45:04.734910 run osmo-hlr_10.42.42.2(pid=12566): stdout: | (launched: 2022-12-08_20:45:00.877110) 20:45:04.786659 run osmo-hlr_10.42.42.2(pid=12566): stderr: | [0;m[1;31m20221208204501085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204501085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204501085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204501085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204501085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204501085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204501103 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204501119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204501119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204501119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:45:04.838592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12565): Terminating (SIGTERM) 20:45:04.879889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12571): Terminating (SIGTERM) 20:45:04.921550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12574): Terminating (SIGTERM) 20:45:04.963162 --- ParallelTerminationStrategy: PID 12565 died... 20:45:04.983108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12565): Terminated: ok {rc=0} 20:45:05.029532 --- ParallelTerminationStrategy: PID 12571 died... 20:45:05.048879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12571): Terminated: ok {rc=0} 20:45:05.095339 --- ParallelTerminationStrategy: PID 12574 died... 20:45:05.115001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12574): Terminated: ok {rc=0} 20:45:05.202131 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 20:45:06.500675 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:45:06.506231 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 20:45:06.539615 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 20:45:06.578967 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 20:45:06.668791 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 20:45:06.703033 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 20:45:06.742560 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 20:45:07.337884 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 20:45:07.390259 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:07.401321 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:45:07.450585 tst cs_paging_gprs_active.py: using LAC 16697 20:45:07.567407 tst cs_paging_gprs_active.py: using RAC 122 20:45:07.687091 tst cs_paging_gprs_active.py: using CellId 16697 20:45:07.805263 tst cs_paging_gprs_active.py: using BVCI 16698 20:45:07.914985 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:07.926061 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:07.936644 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:07.948218 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:07.959652 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:07.970880 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:07.982322 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:07.993661 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:08.005393 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:45:08.127991 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:45:08.244185 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:45:08.447455 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:45:08.749296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12579): Launched 20:45:09.011800 run iperf3-srv_10.42.42.10(pid=12580): Launched 20:45:09.125719 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:45:09.327294 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:45:09.629545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12581): Launched 20:45:09.891888 run iperf3-srv_10.42.42.10(pid=12582): Launched 20:45:10.004937 tst cs_paging_gprs_active.py:38: start network... 20:45:10.205876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:45:10.670717 run create_hlr_db(pid=12583): Launched 20:45:10.784909 bus /gobi_6: Setting Powered False 20:45:11.845327 run create_hlr_db(pid=12583): Terminated: ok {rc=0} 20:45:12.285663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12585): Launched 20:45:12.608142 run osmo-hlr_10.42.42.2(pid=12586): Launched 20:45:12.730738 run osmo-stp_10.42.42.5: Starting osmo-stp 20:45:13.282705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12588): Launched 20:45:13.604210 run osmo-stp_10.42.42.5(pid=12589): Launched 20:45:13.726491 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:45:14.280018 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12591): Launched 20:45:14.403597 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:45:14.674173 run patchelf(pid=12592): Launched 20:45:14.852209 run osmo-stp_10.42.42.5(pid=12589): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12589)] 20:45:14.988281 run osmo-stp_10.42.42.5(pid=12589): stdout: | (launched: 2022-12-08_20:45:13.545760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:15.126289 run osmo-stp_10.42.42.5(pid=12589): stderr: | [0;m[38;5;43m20221208204513737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204513737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204513738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204513738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204513738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204513738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204513739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:15.263671 run osmo-stp_10.42.42.5(pid=12589): stdout: | (launched: 2022-12-08_20:45:13.545760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:15.395891 run osmo-stp_10.42.42.5(pid=12589): stderr: | [0;m[38;5;43m20221208204513737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204513737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204513738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204513738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204513738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204513738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204513739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:15.552145 run patchelf(pid=12592): Terminating (SIGINT) 20:45:15.732471 run patchelf(pid=12592): Terminated: ok {rc=0} 20:45:15.868077 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12589): Process ended prematurely: osmo-stp_10.42.42.5(pid=12589) [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12589)] [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 20:45:15.879019 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 20:45:15.912172 run osmo-hlr_10.42.42.2(pid=12586): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12586)] 20:45:15.963691 run osmo-hlr_10.42.42.2(pid=12586): stdout: | (launched: 2022-12-08_20:45:12.549733) 20:45:16.015587 run osmo-hlr_10.42.42.2(pid=12586): stderr: | [0;m[1;31m20221208204512748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204512748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204512748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204512748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204512748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204512748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204512760 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204512768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204512768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204512768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:45:16.068231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12579): Terminating (SIGTERM) 20:45:16.111431 run iperf3-srv_10.42.42.10(pid=12580): Terminating (SIGTERM) 20:45:16.156563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12581): Terminating (SIGTERM) 20:45:16.199452 run iperf3-srv_10.42.42.10(pid=12582): Terminating (SIGTERM) 20:45:16.244755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12585): Terminating (SIGTERM) 20:45:16.287870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12588): Terminating (SIGTERM) 20:45:16.331752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12591): Terminating (SIGTERM) 20:45:16.374745 --- ParallelTerminationStrategy: PID 12579 died... 20:45:16.395030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12579): Terminated: ok {rc=0} 20:45:16.441942 --- ParallelTerminationStrategy: PID 12580 died... 20:45:16.461716 run iperf3-srv_10.42.42.10(pid=12580): Terminated {rc=256} 20:45:16.508555 --- ParallelTerminationStrategy: PID 12581 died... 20:45:16.528673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12581): Terminated: ok {rc=0} 20:45:16.574900 --- ParallelTerminationStrategy: PID 12582 died... 20:45:16.594737 run iperf3-srv_10.42.42.10(pid=12582): Terminated {rc=256} 20:45:16.641647 --- ParallelTerminationStrategy: PID 12585 died... 20:45:16.662197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12585): Terminated: ok {rc=0} 20:45:16.709393 --- ParallelTerminationStrategy: PID 12588 died... 20:45:16.729511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12588): Terminated: ok {rc=0} 20:45:16.778011 --- ParallelTerminationStrategy: PID 12591 died... 20:45:16.798314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12591): Terminated: ok {rc=0} 20:45:16.886653 bus /gobi_0: Setting Powered False 20:45:17.986394 bus /gobi_0: Setting Powered False 20:45:19.100244 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 20:45:20.247600 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:20.259397 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:45:20.311968 tst iperf3.py: using LAC 16698 20:45:20.430038 tst iperf3.py: using RAC 123 20:45:20.546578 tst iperf3.py: using CellId 16698 20:45:20.663859 tst iperf3.py: using BVCI 16699 20:45:20.773345 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:20.784250 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:20.795127 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:20.806093 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:20.816938 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:20.827768 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:20.838818 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:20.849649 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:20.860667 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:45:20.976027 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:45:21.177322 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:45:21.477429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12593): Launched 20:45:21.739744 run iperf3-srv_10.42.42.10(pid=12594): Launched 20:45:21.852316 tst iperf3.py:8: start network... 20:45:22.053310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:45:22.516259 run create_hlr_db(pid=12595): Launched 20:45:22.629803 bus /gobi_6: Setting Powered False 20:45:23.688823 run create_hlr_db(pid=12595): Terminated: ok {rc=0} 20:45:24.127968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12597): Launched 20:45:24.449360 run osmo-hlr_10.42.42.2(pid=12598): Launched 20:45:24.572169 run osmo-stp_10.42.42.5: Starting osmo-stp 20:45:25.133880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12600): Launched 20:45:25.454877 run osmo-stp_10.42.42.5(pid=12601): Launched 20:45:25.577116 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:45:26.128784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12603): Launched 20:45:26.251314 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:45:26.524020 run patchelf(pid=12604): Launched 20:45:26.702868 run osmo-stp_10.42.42.5(pid=12601): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12601)] 20:45:26.838141 run osmo-stp_10.42.42.5(pid=12601): stdout: | (launched: 2022-12-08_20:45:25.396845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:26.974908 run osmo-stp_10.42.42.5(pid=12601): stderr: | [0;m[38;5;43m20221208204525586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204525586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204525586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204525587 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204525587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204525587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204525587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:27.111979 run osmo-stp_10.42.42.5(pid=12601): stdout: | (launched: 2022-12-08_20:45:25.396845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:27.243247 run osmo-stp_10.42.42.5(pid=12601): stderr: | [0;m[38;5;43m20221208204525586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204525586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204525586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204525587 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204525587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204525587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204525587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:27.398640 run patchelf(pid=12604): Terminating (SIGINT) 20:45:27.578829 run patchelf(pid=12604): Terminated: ok {rc=0} 20:45:27.708119 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12601): Process ended prematurely: osmo-stp_10.42.42.5(pid=12601) [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12601)] [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 20:45:27.718031 tst iperf3.py:8: Test FAILED (7.5 sec) 20:45:27.746047 run osmo-hlr_10.42.42.2(pid=12598): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12598)] 20:45:27.795547 run osmo-hlr_10.42.42.2(pid=12598): stdout: | (launched: 2022-12-08_20:45:24.390637) 20:45:27.846626 run osmo-hlr_10.42.42.2(pid=12598): stderr: | [0;m[1;31m20221208204524586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204524586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204524586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204524586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204524586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204524586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204524599 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204524609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204524609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204524609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:45:27.898337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12593): Terminating (SIGTERM) 20:45:27.939531 run iperf3-srv_10.42.42.10(pid=12594): Terminating (SIGTERM) 20:45:27.980733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12597): Terminating (SIGTERM) 20:45:28.022074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12600): Terminating (SIGTERM) 20:45:28.063230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12603): Terminating (SIGTERM) 20:45:28.105150 --- ParallelTerminationStrategy: PID 12593 died... 20:45:28.125033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12593): Terminated: ok {rc=0} 20:45:28.170647 --- ParallelTerminationStrategy: PID 12594 died... 20:45:28.189993 run iperf3-srv_10.42.42.10(pid=12594): Terminated {rc=256} 20:45:28.235411 --- ParallelTerminationStrategy: PID 12597 died... 20:45:28.254731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12597): Terminated: ok {rc=0} 20:45:28.300506 --- ParallelTerminationStrategy: PID 12600 died... 20:45:28.319923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12600): Terminated: ok {rc=0} 20:45:28.365548 --- ParallelTerminationStrategy: PID 12603 died... 20:45:28.384795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12603): Terminated: ok {rc=0} 20:45:28.472125 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 20:45:29.620713 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:29.632870 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:45:29.683646 tst iperf3m4.py: using LAC 16699 20:45:29.809792 tst iperf3m4.py: using RAC 124 20:45:29.942021 tst iperf3m4.py: using CellId 16699 20:45:30.067808 tst iperf3m4.py: using BVCI 16700 20:45:30.185398 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:30.196516 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:30.207587 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:30.218658 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:30.229704 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:30.240623 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:30.251837 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:30.262819 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:30.274107 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:45:30.396136 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:45:30.521131 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:45:30.636022 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:45:30.756066 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:45:30.998903 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:45:31.310505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12605): Launched 20:45:31.595996 run iperf3-srv_10.42.42.10(pid=12606): Launched 20:45:31.726465 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:45:31.932248 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:45:32.238673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12607): Launched 20:45:32.497869 run iperf3-srv_10.42.42.10(pid=12608): Launched 20:45:32.609291 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:45:32.808602 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:45:33.107337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12609): Launched 20:45:33.366558 run iperf3-srv_10.42.42.10(pid=12610): Launched 20:45:33.478327 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:45:33.676908 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:45:33.974954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12611): Launched 20:45:34.233814 run iperf3-srv_10.42.42.10(pid=12612): Launched 20:45:34.344913 tst iperf3m4.py:8: start network... 20:45:34.544675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:45:35.004726 run create_hlr_db(pid=12613): Launched 20:45:35.119823 bus /gobi_6: Setting Powered False 20:45:36.180375 run create_hlr_db(pid=12613): Terminated: ok {rc=0} 20:45:36.595862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12615): Launched 20:45:36.893214 run osmo-hlr_10.42.42.2(pid=12616): Launched 20:45:37.006267 run osmo-stp_10.42.42.5: Starting osmo-stp 20:45:37.517605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12618): Launched 20:45:37.839449 run osmo-stp_10.42.42.5(pid=12619): Launched 20:45:37.961457 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:45:38.514966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12621): Launched 20:45:38.638788 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:45:38.909904 run patchelf(pid=12622): Launched 20:45:39.089593 run osmo-stp_10.42.42.5(pid=12619): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12619)] 20:45:39.225926 run osmo-stp_10.42.42.5(pid=12619): stdout: | (launched: 2022-12-08_20:45:37.781424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:39.363336 run osmo-stp_10.42.42.5(pid=12619): stderr: | [0;m[38;5;43m20221208204537969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204537970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204537970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204537970 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204537971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204537971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204537971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:39.500870 run osmo-stp_10.42.42.5(pid=12619): stdout: | (launched: 2022-12-08_20:45:37.781424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:39.633053 run osmo-stp_10.42.42.5(pid=12619): stderr: | [0;m[38;5;43m20221208204537969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204537970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204537970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204537970 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204537971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204537971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204537971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:39.789412 run patchelf(pid=12622): Terminating (SIGINT) 20:45:39.971560 run patchelf(pid=12622): Terminated: ok {rc=0} 20:45:40.093466 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12619): Process ended prematurely: osmo-stp_10.42.42.5(pid=12619) [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12619)] [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 20:45:40.102957 tst iperf3m4.py:8: Test FAILED (10.5 sec) 20:45:40.131133 run osmo-hlr_10.42.42.2(pid=12616): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12616)] 20:45:40.179331 run osmo-hlr_10.42.42.2(pid=12616): stdout: | (launched: 2022-12-08_20:45:36.838621) 20:45:40.229194 run osmo-hlr_10.42.42.2(pid=12616): stderr: | [0;m[1;31m20221208204537013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204537013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204537013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204537013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204537013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204537013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204537056 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204537066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204537066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204537066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:45:40.279120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12605): Terminating (SIGTERM) 20:45:40.319009 run iperf3-srv_10.42.42.10(pid=12606): Terminating (SIGTERM) 20:45:40.358651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12607): Terminating (SIGTERM) 20:45:40.398654 run iperf3-srv_10.42.42.10(pid=12608): Terminating (SIGTERM) 20:45:40.438755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12609): Terminating (SIGTERM) 20:45:40.478982 run iperf3-srv_10.42.42.10(pid=12610): Terminating (SIGTERM) 20:45:40.519346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12611): Terminating (SIGTERM) 20:45:40.560259 run iperf3-srv_10.42.42.10(pid=12612): Terminating (SIGTERM) 20:45:40.600608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12615): Terminating (SIGTERM) 20:45:40.640889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12618): Terminating (SIGTERM) 20:45:40.681274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12621): Terminating (SIGTERM) 20:45:40.721955 --- ParallelTerminationStrategy: PID 12605 died... 20:45:40.741429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12605): Terminated: ok {rc=0} 20:45:40.786373 --- ParallelTerminationStrategy: PID 12606 died... 20:45:40.805011 run iperf3-srv_10.42.42.10(pid=12606): Terminated {rc=256} 20:45:40.849795 --- ParallelTerminationStrategy: PID 12607 died... 20:45:40.868561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12607): Terminated: ok {rc=0} 20:45:40.913366 --- ParallelTerminationStrategy: PID 12608 died... 20:45:40.931983 run iperf3-srv_10.42.42.10(pid=12608): Terminated {rc=256} 20:45:40.976334 --- ParallelTerminationStrategy: PID 12609 died... 20:45:40.995105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12609): Terminated: ok {rc=0} 20:45:41.039833 --- ParallelTerminationStrategy: PID 12610 died... 20:45:41.058707 run iperf3-srv_10.42.42.10(pid=12610): Terminated {rc=256} 20:45:41.103430 --- ParallelTerminationStrategy: PID 12611 died... 20:45:41.122290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12611): Terminated: ok {rc=0} 20:45:41.166889 --- ParallelTerminationStrategy: PID 12612 died... 20:45:41.185833 run iperf3-srv_10.42.42.10(pid=12612): Terminated {rc=256} 20:45:41.230392 --- ParallelTerminationStrategy: PID 12615 died... 20:45:41.249276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12615): Terminated: ok {rc=0} 20:45:41.293975 --- ParallelTerminationStrategy: PID 12618 died... 20:45:41.312644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12618): Terminated: ok {rc=0} 20:45:41.357502 --- ParallelTerminationStrategy: PID 12621 died... 20:45:41.376295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12621): Terminated: ok {rc=0} 20:45:41.462973 bus /gobi_4: Setting Powered False 20:45:42.562435 bus /gobi_4: Setting Powered False 20:45:43.678428 bus /gobi_1: Setting Powered False 20:45:44.777680 bus /gobi_1: Setting Powered False 20:45:45.897156 bus /gobi_0: Setting Powered False 20:45:47.024617 bus /gobi_0: Setting Powered False 20:45:48.149956 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 20:45:49.252122 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:49.264163 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:45:49.316321 tst ping.py: using LAC 16700 20:45:49.433090 tst ping.py: using RAC 125 20:45:49.548472 tst ping.py: using CellId 16700 20:45:49.674074 tst ping.py: using BVCI 16701 20:45:49.789623 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:49.800820 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:49.812150 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:49.823415 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:49.834599 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:49.846098 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:49.857335 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:49.868363 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:45:49.981966 tst ping.py:19: start network... 20:45:50.177676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:45:50.629910 run create_hlr_db(pid=12623): Launched 20:45:50.741591 bus /gobi_6: Setting Powered False 20:45:51.801173 run create_hlr_db(pid=12623): Terminated: ok {rc=0} 20:45:52.233982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12625): Launched 20:45:52.548264 run osmo-hlr_10.42.42.2(pid=12626): Launched 20:45:52.670275 run osmo-stp_10.42.42.5: Starting osmo-stp 20:45:53.195984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12628): Launched 20:45:53.486473 run osmo-stp_10.42.42.5(pid=12629): Launched 20:45:53.596160 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:45:54.097323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12631): Launched 20:45:54.209247 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:45:54.456540 run patchelf(pid=12632): Launched 20:45:54.619440 run osmo-stp_10.42.42.5(pid=12629): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12629)] 20:45:54.744065 run osmo-stp_10.42.42.5(pid=12629): stdout: | (launched: 2022-12-08_20:45:53.433409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:54.869695 run osmo-stp_10.42.42.5(pid=12629): stderr: | [0;m[38;5;43m20221208204553599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204553599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204553599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204553599 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204553600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204553600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204553600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:54.995463 run osmo-stp_10.42.42.5(pid=12629): stdout: | (launched: 2022-12-08_20:45:53.433409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:55.115533 run osmo-stp_10.42.42.5(pid=12629): stderr: | [0;m[38;5;43m20221208204553599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204553599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204553599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204553599 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204553600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204553600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204553600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:55.257404 run patchelf(pid=12632): Terminating (SIGINT) 20:45:55.421918 run patchelf(pid=12632): Terminated: ok {rc=0} 20:45:55.540739 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12629): Process ended prematurely: osmo-stp_10.42.42.5(pid=12629) [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12629)] [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 20:45:55.549543 tst ping.py:22: Test FAILED (6.3 sec) 20:45:55.576063 run osmo-hlr_10.42.42.2(pid=12626): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12626)] 20:45:55.623399 run osmo-hlr_10.42.42.2(pid=12626): stdout: | (launched: 2022-12-08_20:45:52.490957) 20:45:55.672282 run osmo-hlr_10.42.42.2(pid=12626): stderr: | [0;m[1;31m20221208204552687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204552687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204552687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204552687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204552687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204552687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204552700 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204552708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204552708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204552708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:45:55.721492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12625): Terminating (SIGTERM) 20:45:55.761183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12628): Terminating (SIGTERM) 20:45:55.800656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12631): Terminating (SIGTERM) 20:45:55.840662 --- ParallelTerminationStrategy: PID 12625 died... 20:45:55.859579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12625): Terminated: ok {rc=0} 20:45:55.903599 --- ParallelTerminationStrategy: PID 12628 died... 20:45:55.922199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12628): Terminated: ok {rc=0} 20:45:55.965880 --- ParallelTerminationStrategy: PID 12631 died... 20:45:55.984401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12631): Terminated: ok {rc=0} 20:45:56.067314 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 20:45:57.153607 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:57.165607 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:45:57.217968 tst ping_idle_ping.py: using LAC 16701 20:45:57.343097 tst ping_idle_ping.py: using RAC 126 20:45:57.468660 tst ping_idle_ping.py: using CellId 16701 20:45:57.594011 tst ping_idle_ping.py: using BVCI 16702 20:45:57.709621 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:57.720815 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:57.732027 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:57.743073 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:57.754089 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:57.765143 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:57.776336 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:57.787482 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:45:57.902626 tst ping_idle_ping.py:24: start network... 20:45:58.100561 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:45:58.558042 run create_hlr_db(pid=12633): Launched 20:45:58.671715 bus /gobi_6: Setting Powered False 20:45:59.731007 run create_hlr_db(pid=12633): Terminated: ok {rc=0} 20:46:00.142544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12635): Launched 20:46:00.436365 run osmo-hlr_10.42.42.2(pid=12636): Launched 20:46:00.548351 run osmo-stp_10.42.42.5: Starting osmo-stp 20:46:01.099553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12638): Launched 20:46:01.441726 run osmo-stp_10.42.42.5(pid=12639): Launched 20:46:01.855751 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:46:02.433950 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12641): Launched 20:46:02.555893 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:46:02.825237 run patchelf(pid=12642): Launched 20:46:03.002144 run osmo-stp_10.42.42.5(pid=12639): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12639)] 20:46:03.137600 run osmo-stp_10.42.42.5(pid=12639): stdout: | (launched: 2022-12-08_20:46:01.379528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:03.274426 run osmo-stp_10.42.42.5(pid=12639): stderr: | [0;m[38;5;43m20221208204601616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204601616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204601620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204601621 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204601621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204601621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204601621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:03.411075 run osmo-stp_10.42.42.5(pid=12639): stdout: | (launched: 2022-12-08_20:46:01.379528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:03.541199 run osmo-stp_10.42.42.5(pid=12639): stderr: | [0;m[38;5;43m20221208204601616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204601616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204601620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204601621 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204601621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204601621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204601621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:03.695207 run patchelf(pid=12642): Terminating (SIGINT) 20:46:03.874114 run patchelf(pid=12642): Terminated: ok {rc=0} 20:46:04.002602 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12639): Process ended prematurely: osmo-stp_10.42.42.5(pid=12639) [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12639)] [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 20:46:04.012034 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 20:46:04.039945 run osmo-hlr_10.42.42.2(pid=12636): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12636)] 20:46:04.089605 run osmo-hlr_10.42.42.2(pid=12636): stdout: | (launched: 2022-12-08_20:46:00.382636) 20:46:04.141516 run osmo-hlr_10.42.42.2(pid=12636): stderr: | [0;m[1;31m20221208204600554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204600554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204600554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204600554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204600554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204600554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204600603 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204600612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204600613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204600613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:46:04.193685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12635): Terminating (SIGTERM) 20:46:04.234842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12638): Terminating (SIGTERM) 20:46:04.276416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12641): Terminating (SIGTERM) 20:46:04.318766 --- ParallelTerminationStrategy: PID 12635 died... 20:46:04.338953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12635): Terminated: ok {rc=0} 20:46:04.385353 --- ParallelTerminationStrategy: PID 12638 died... 20:46:04.405032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12638): Terminated: ok {rc=0} 20:46:04.451084 --- ParallelTerminationStrategy: PID 12641 died... 20:46:04.470960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12641): Terminated: ok {rc=0} 20:46:04.558684 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 20:46:05.860608 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:46:05.867350 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 20:46:05.900941 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 20:46:05.940462 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 20:46:06.027659 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 20:46:06.061218 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 20:46:06.101085 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 20:46:06.698999 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 20:46:06.750551 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:06.761837 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:46:06.832504 tst cs_paging_gprs_active.py: using LAC 16702 20:46:06.958470 tst cs_paging_gprs_active.py: using RAC 127 20:46:07.083521 tst cs_paging_gprs_active.py: using CellId 16702 20:46:07.210392 tst cs_paging_gprs_active.py: using BVCI 16703 20:46:07.329457 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:07.340656 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:07.351836 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:07.363062 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:07.374146 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:07.385382 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:07.396529 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:07.407702 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:07.419004 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:46:07.540556 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:46:07.660863 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:46:07.879466 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:46:08.203817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12647): Launched 20:46:08.484247 run iperf3-srv_10.42.42.10(pid=12648): Launched 20:46:08.605457 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:46:08.823289 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:46:09.146892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12649): Launched 20:46:09.426635 run iperf3-srv_10.42.42.10(pid=12650): Launched 20:46:09.547580 tst cs_paging_gprs_active.py:38: start network... 20:46:09.764849 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:46:10.264435 run create_hlr_db(pid=12651): Launched 20:46:10.395856 bus /gobi_6: Setting Powered False 20:46:11.460333 run create_hlr_db(pid=12651): Terminated: ok {rc=0} 20:46:11.889697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12653): Launched 20:46:12.189911 run osmo-hlr_10.42.42.2(pid=12654): Launched 20:46:12.303747 run osmo-stp_10.42.42.5: Starting osmo-stp 20:46:12.820042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12656): Launched 20:46:13.121620 run osmo-stp_10.42.42.5(pid=12657): Launched 20:46:13.236555 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:46:13.754551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12659): Launched 20:46:13.869584 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:46:14.128517 run patchelf(pid=12660): Launched 20:46:14.295950 run osmo-stp_10.42.42.5(pid=12657): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12657)] 20:46:14.423400 run osmo-stp_10.42.42.5(pid=12657): stdout: | (launched: 2022-12-08_20:46:13.065628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:14.552430 run osmo-stp_10.42.42.5(pid=12657): stderr: | [0;m[38;5;43m20221208204613232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204613232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204613232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204613233 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204613233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204613233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204613233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:14.682042 run osmo-stp_10.42.42.5(pid=12657): stdout: | (launched: 2022-12-08_20:46:13.065628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:14.806097 run osmo-stp_10.42.42.5(pid=12657): stderr: | [0;m[38;5;43m20221208204613232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204613232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204613232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204613233 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204613233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204613233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204613233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:14.953059 run patchelf(pid=12660): Terminating (SIGINT) 20:46:15.122362 run patchelf(pid=12660): Terminated: ok {rc=0} 20:46:15.244532 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12657): Process ended prematurely: osmo-stp_10.42.42.5(pid=12657) [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12657)] [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 20:46:15.253968 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 20:46:15.281225 run osmo-hlr_10.42.42.2(pid=12654): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12654)] 20:46:15.329503 run osmo-hlr_10.42.42.2(pid=12654): stdout: | (launched: 2022-12-08_20:46:12.134738) 20:46:15.378785 run osmo-hlr_10.42.42.2(pid=12654): stderr: | [0;m[1;31m20221208204612308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204612308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204612308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204612308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204612308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204612308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204612326 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204612335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204612335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204612335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:46:15.428624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12647): Terminating (SIGTERM) 20:46:15.468394 run iperf3-srv_10.42.42.10(pid=12648): Terminating (SIGTERM) 20:46:15.508022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12649): Terminating (SIGTERM) 20:46:15.547380 run iperf3-srv_10.42.42.10(pid=12650): Terminating (SIGTERM) 20:46:15.587169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12653): Terminating (SIGTERM) 20:46:15.626820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12656): Terminating (SIGTERM) 20:46:15.666515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12659): Terminating (SIGTERM) 20:46:15.706636 --- ParallelTerminationStrategy: PID 12647 died... 20:46:15.725621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12647): Terminated: ok {rc=0} 20:46:15.769950 --- ParallelTerminationStrategy: PID 12648 died... 20:46:15.788320 run iperf3-srv_10.42.42.10(pid=12648): Terminated {rc=256} 20:46:15.841928 --- ParallelTerminationStrategy: PID 12649 died... 20:46:15.865573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12649): Terminated: ok {rc=0} 20:46:15.918493 --- ParallelTerminationStrategy: PID 12650 died... 20:46:15.948874 run iperf3-srv_10.42.42.10(pid=12650): Terminated {rc=256} 20:46:15.996718 --- ParallelTerminationStrategy: PID 12653 died... 20:46:16.016904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12653): Terminated: ok {rc=0} 20:46:16.066411 --- ParallelTerminationStrategy: PID 12656 died... 20:46:16.086889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12656): Terminated: ok {rc=0} 20:46:16.136499 --- ParallelTerminationStrategy: PID 12659 died... 20:46:16.157034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12659): Terminated: ok {rc=0} 20:46:16.247483 bus /gobi_0: Setting Powered False 20:46:17.345621 bus /gobi_0: Setting Powered False 20:46:18.460788 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 20:46:19.606348 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:19.617740 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:46:19.686381 tst iperf3.py: using LAC 16703 20:46:19.805074 tst iperf3.py: using RAC 128 20:46:19.926968 tst iperf3.py: using CellId 16703 20:46:20.044598 tst iperf3.py: using BVCI 16704 20:46:20.153311 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:20.164058 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:20.174676 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:20.185680 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:20.196452 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:20.207440 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:20.218636 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:20.229481 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:20.240369 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:46:20.360114 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:46:20.561444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:46:20.861189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12661): Launched 20:46:21.122443 run iperf3-srv_10.42.42.10(pid=12662): Launched 20:46:21.234344 tst iperf3.py:8: start network... 20:46:21.433821 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:46:21.894752 run create_hlr_db(pid=12663): Launched 20:46:22.008772 bus /gobi_6: Setting Powered False 20:46:23.069169 run create_hlr_db(pid=12663): Terminated: ok {rc=0} 20:46:23.484591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12665): Launched 20:46:23.782865 run osmo-hlr_10.42.42.2(pid=12666): Launched 20:46:23.896582 run osmo-stp_10.42.42.5: Starting osmo-stp 20:46:24.527630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12668): Launched 20:46:24.822893 run osmo-stp_10.42.42.5(pid=12669): Launched 20:46:24.935388 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:46:25.443799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12671): Launched 20:46:25.556371 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:46:25.805268 run patchelf(pid=12672): Launched 20:46:25.970486 run osmo-stp_10.42.42.5(pid=12669): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12669)] 20:46:26.096119 run osmo-stp_10.42.42.5(pid=12669): stdout: | (launched: 2022-12-08_20:46:24.768938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:26.222899 run osmo-stp_10.42.42.5(pid=12669): stderr: | [0;m[38;5;43m20221208204624936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204624936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204624937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204624937 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204624938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204624938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204624938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:26.349447 run osmo-stp_10.42.42.5(pid=12669): stdout: | (launched: 2022-12-08_20:46:24.768938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:26.470652 run osmo-stp_10.42.42.5(pid=12669): stderr: | [0;m[38;5;43m20221208204624936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204624936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204624937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204624937 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204624938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204624938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204624938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:26.614487 run patchelf(pid=12672): Terminating (SIGINT) 20:46:26.780805 run patchelf(pid=12672): Terminated: ok {rc=0} 20:46:26.900820 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12669): Process ended prematurely: osmo-stp_10.42.42.5(pid=12669) [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12669)] [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 20:46:26.910271 tst iperf3.py:8: Test FAILED (7.3 sec) 20:46:26.937418 run osmo-hlr_10.42.42.2(pid=12666): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12666)] 20:46:26.984732 run osmo-hlr_10.42.42.2(pid=12666): stdout: | (launched: 2022-12-08_20:46:23.728278) 20:46:27.033513 run osmo-hlr_10.42.42.2(pid=12666): stderr: | [0;m[1;31m20221208204623898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204623898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204623898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204623899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204623899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204623899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204623915 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204623926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204623926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204623926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:46:27.082661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12661): Terminating (SIGTERM) 20:46:27.121950 run iperf3-srv_10.42.42.10(pid=12662): Terminating (SIGTERM) 20:46:27.161268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12665): Terminating (SIGTERM) 20:46:27.200886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12668): Terminating (SIGTERM) 20:46:27.240362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12671): Terminating (SIGTERM) 20:46:27.280042 --- ParallelTerminationStrategy: PID 12661 died... 20:46:27.298823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12661): Terminated: ok {rc=0} 20:46:27.343056 --- ParallelTerminationStrategy: PID 12662 died... 20:46:27.361693 run iperf3-srv_10.42.42.10(pid=12662): Terminated {rc=256} 20:46:27.405505 --- ParallelTerminationStrategy: PID 12665 died... 20:46:27.424059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12665): Terminated: ok {rc=0} 20:46:27.467848 --- ParallelTerminationStrategy: PID 12668 died... 20:46:27.486355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12668): Terminated: ok {rc=0} 20:46:27.530700 --- ParallelTerminationStrategy: PID 12671 died... 20:46:27.549173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12671): Terminated: ok {rc=0} 20:46:27.634839 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 20:46:28.779243 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:28.790835 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:46:28.860502 tst iperf3m4.py: using LAC 16704 20:46:28.978222 tst iperf3m4.py: using RAC 129 20:46:29.097281 tst iperf3m4.py: using CellId 16704 20:46:29.222669 tst iperf3m4.py: using BVCI 16705 20:46:29.339599 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:29.351119 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:29.362367 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:29.373605 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:29.384742 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:29.395980 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:29.407145 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:29.418160 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:29.429345 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:46:29.543999 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:46:29.663594 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:46:29.779397 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:46:29.897683 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:46:30.111896 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:46:30.428862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12673): Launched 20:46:30.703390 run iperf3-srv_10.42.42.10(pid=12674): Launched 20:46:30.821811 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:46:31.036036 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:46:31.355020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12675): Launched 20:46:31.629709 run iperf3-srv_10.42.42.10(pid=12676): Launched 20:46:31.759480 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:46:31.962752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:46:32.266971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12677): Launched 20:46:32.524156 run iperf3-srv_10.42.42.10(pid=12678): Launched 20:46:32.634523 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:46:32.831129 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:46:33.126597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12679): Launched 20:46:33.382234 run iperf3-srv_10.42.42.10(pid=12680): Launched 20:46:33.492843 tst iperf3m4.py:8: start network... 20:46:33.689510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:46:34.146713 run create_hlr_db(pid=12681): Launched 20:46:34.260013 bus /gobi_6: Setting Powered False 20:46:35.318383 run create_hlr_db(pid=12681): Terminated: ok {rc=0} 20:46:35.729620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12683): Launched 20:46:36.024398 run osmo-hlr_10.42.42.2(pid=12684): Launched 20:46:36.137541 run osmo-stp_10.42.42.5: Starting osmo-stp 20:46:36.645659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12686): Launched 20:46:36.941102 run osmo-stp_10.42.42.5(pid=12687): Launched 20:46:37.053797 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:46:37.562804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12689): Launched 20:46:37.675753 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:46:37.925324 run patchelf(pid=12690): Launched 20:46:38.090376 run osmo-stp_10.42.42.5(pid=12687): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12687)] 20:46:38.215896 run osmo-stp_10.42.42.5(pid=12687): stdout: | (launched: 2022-12-08_20:46:36.887047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:38.342420 run osmo-stp_10.42.42.5(pid=12687): stderr: | [0;m[38;5;43m20221208204637055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204637055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204637056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204637056 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204637056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204637057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204637057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:38.468892 run osmo-stp_10.42.42.5(pid=12687): stdout: | (launched: 2022-12-08_20:46:36.887047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:38.590224 run osmo-stp_10.42.42.5(pid=12687): stderr: | [0;m[38;5;43m20221208204637055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204637055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204637056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204637056 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204637056 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204637057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204637057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:38.733746 run patchelf(pid=12690): Terminating (SIGINT) 20:46:38.900012 run patchelf(pid=12690): Terminated: ok {rc=0} 20:46:39.020263 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12687): Process ended prematurely: osmo-stp_10.42.42.5(pid=12687) [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12687)] [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 20:46:39.029930 tst iperf3m4.py:8: Test FAILED (10.3 sec) 20:46:39.057449 run osmo-hlr_10.42.42.2(pid=12684): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12684)] 20:46:39.105169 run osmo-hlr_10.42.42.2(pid=12684): stdout: | (launched: 2022-12-08_20:46:35.970669) 20:46:39.154771 run osmo-hlr_10.42.42.2(pid=12684): stderr: | [0;m[1;31m20221208204636145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204636145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204636145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204636145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204636145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204636145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204636157 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204636165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204636166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204636166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:46:39.204710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12673): Terminating (SIGTERM) 20:46:39.244303 run iperf3-srv_10.42.42.10(pid=12674): Terminating (SIGTERM) 20:46:39.284086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12675): Terminating (SIGTERM) 20:46:39.323738 run iperf3-srv_10.42.42.10(pid=12676): Terminating (SIGTERM) 20:46:39.364698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12677): Terminating (SIGTERM) 20:46:39.404809 run iperf3-srv_10.42.42.10(pid=12678): Terminating (SIGTERM) 20:46:39.444251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12679): Terminating (SIGTERM) 20:46:39.483841 run iperf3-srv_10.42.42.10(pid=12680): Terminating (SIGTERM) 20:46:39.523262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12683): Terminating (SIGTERM) 20:46:39.562808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12686): Terminating (SIGTERM) 20:46:39.602358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12689): Terminating (SIGTERM) 20:46:39.642019 --- ParallelTerminationStrategy: PID 12673 died... 20:46:39.660822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12673): Terminated: ok {rc=0} 20:46:39.704614 --- ParallelTerminationStrategy: PID 12674 died... 20:46:39.722845 run iperf3-srv_10.42.42.10(pid=12674): Terminated {rc=256} 20:46:39.766506 --- ParallelTerminationStrategy: PID 12675 died... 20:46:39.784810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12675): Terminated: ok {rc=0} 20:46:39.828413 --- ParallelTerminationStrategy: PID 12676 died... 20:46:39.846624 run iperf3-srv_10.42.42.10(pid=12676): Terminated {rc=256} 20:46:39.889997 --- ParallelTerminationStrategy: PID 12677 died... 20:46:39.908200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12677): Terminated: ok {rc=0} 20:46:39.951851 --- ParallelTerminationStrategy: PID 12678 died... 20:46:39.970071 run iperf3-srv_10.42.42.10(pid=12678): Terminated {rc=256} 20:46:40.014142 --- ParallelTerminationStrategy: PID 12679 died... 20:46:40.032554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12679): Terminated: ok {rc=0} 20:46:40.076129 --- ParallelTerminationStrategy: PID 12680 died... 20:46:40.094449 run iperf3-srv_10.42.42.10(pid=12680): Terminated {rc=256} 20:46:40.137996 --- ParallelTerminationStrategy: PID 12683 died... 20:46:40.156177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12683): Terminated: ok {rc=0} 20:46:40.199868 --- ParallelTerminationStrategy: PID 12686 died... 20:46:40.218137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12686): Terminated: ok {rc=0} 20:46:40.261991 --- ParallelTerminationStrategy: PID 12689 died... 20:46:40.280502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12689): Terminated: ok {rc=0} 20:46:40.365291 bus /gobi_4: Setting Powered False 20:46:41.463264 bus /gobi_4: Setting Powered False 20:46:42.575700 bus /gobi_1: Setting Powered False 20:46:43.669647 bus /gobi_1: Setting Powered False 20:46:44.783596 bus /gobi_0: Setting Powered False 20:46:45.893991 bus /gobi_0: Setting Powered False 20:46:47.018681 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 20:46:48.121348 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:48.132601 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:46:48.201945 tst ping.py: using LAC 16705 20:46:48.325422 tst ping.py: using RAC 130 20:46:48.440488 tst ping.py: using CellId 16705 20:46:48.563214 tst ping.py: using BVCI 16706 20:46:48.677062 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:48.688298 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:48.699571 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:48.710859 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:48.722060 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:48.733243 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:48.744402 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:48.755440 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:46:48.872824 tst ping.py:19: start network... 20:46:49.082375 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:46:49.566216 run create_hlr_db(pid=12691): Launched 20:46:49.683606 bus /gobi_6: Setting Powered False 20:46:50.745478 run create_hlr_db(pid=12691): Terminated: ok {rc=0} 20:46:51.182750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12693): Launched 20:46:51.494162 run osmo-hlr_10.42.42.2(pid=12694): Launched 20:46:51.612550 run osmo-stp_10.42.42.5: Starting osmo-stp 20:46:52.151506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12696): Launched 20:46:52.461712 run osmo-stp_10.42.42.5(pid=12697): Launched 20:46:52.579770 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:46:53.114982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12699): Launched 20:46:53.234716 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:46:53.497361 run patchelf(pid=12700): Launched 20:46:53.671126 run osmo-stp_10.42.42.5(pid=12697): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12697)] 20:46:53.803585 run osmo-stp_10.42.42.5(pid=12697): stdout: | (launched: 2022-12-08_20:46:52.405417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:53.937786 run osmo-stp_10.42.42.5(pid=12697): stderr: | [0;m[38;5;43m20221208204652592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204652592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204652593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204652593 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204652593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204652594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204652594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:54.072007 run osmo-stp_10.42.42.5(pid=12697): stdout: | (launched: 2022-12-08_20:46:52.405417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:54.200696 run osmo-stp_10.42.42.5(pid=12697): stderr: | [0;m[38;5;43m20221208204652592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204652592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204652593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204652593 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204652593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204652594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204652594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:54.352525 run patchelf(pid=12700): Terminating (SIGINT) 20:46:54.527654 run patchelf(pid=12700): Terminated: ok {rc=0} 20:46:54.653745 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12697): Process ended prematurely: osmo-stp_10.42.42.5(pid=12697) [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12697)] [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 20:46:54.663164 tst ping.py:22: Test FAILED (6.5 sec) 20:46:54.690900 run osmo-hlr_10.42.42.2(pid=12694): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12694)] 20:46:54.740529 run osmo-hlr_10.42.42.2(pid=12694): stdout: | (launched: 2022-12-08_20:46:51.437606) 20:46:54.791987 run osmo-hlr_10.42.42.2(pid=12694): stderr: | [0;m[1;31m20221208204651632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204651632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204651632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204651632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204651632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204651632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204651646 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204651654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204651654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204651654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:46:54.843930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12693): Terminating (SIGTERM) 20:46:54.885444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12696): Terminating (SIGTERM) 20:46:54.927008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12699): Terminating (SIGTERM) 20:46:54.968685 --- ParallelTerminationStrategy: PID 12693 died... 20:46:54.988296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12693): Terminated: ok {rc=0} 20:46:55.034330 --- ParallelTerminationStrategy: PID 12696 died... 20:46:55.053555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12696): Terminated: ok {rc=0} 20:46:55.099367 --- ParallelTerminationStrategy: PID 12699 died... 20:46:55.119132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12699): Terminated: ok {rc=0} 20:46:55.207452 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 20:46:56.292853 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:56.304872 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:46:56.378888 tst ping_idle_ping.py: using LAC 16706 20:46:56.502563 tst ping_idle_ping.py: using RAC 131 20:46:56.628064 tst ping_idle_ping.py: using CellId 16706 20:46:56.750172 tst ping_idle_ping.py: using BVCI 16707 20:46:56.864874 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:56.876242 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:56.887503 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:56.898740 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:56.910055 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:56.921295 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:56.932608 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:56.943815 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:46:57.059278 tst ping_idle_ping.py:24: start network... 20:46:57.256688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:46:57.709859 run create_hlr_db(pid=12701): Launched 20:46:57.821862 bus /gobi_6: Setting Powered False 20:46:58.880517 run create_hlr_db(pid=12701): Terminated: ok {rc=0} 20:46:59.310232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12703): Launched 20:46:59.621511 run osmo-hlr_10.42.42.2(pid=12704): Launched 20:46:59.740460 run osmo-stp_10.42.42.5: Starting osmo-stp 20:47:00.281631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12706): Launched 20:47:00.594128 run osmo-stp_10.42.42.5(pid=12707): Launched 20:47:00.712373 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:47:01.317649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12709): Launched 20:47:01.439731 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:47:01.701807 run patchelf(pid=12710): Launched 20:47:01.884283 run osmo-stp_10.42.42.5(pid=12707): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12707)] 20:47:02.015651 run osmo-stp_10.42.42.5(pid=12707): stdout: | (launched: 2022-12-08_20:47:00.537613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:02.148152 run osmo-stp_10.42.42.5(pid=12707): stderr: | [0;m[38;5;43m20221208204700725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204700725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204700725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204700726 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204700726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204700726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204700726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:02.290122 run osmo-stp_10.42.42.5(pid=12707): stdout: | (launched: 2022-12-08_20:47:00.537613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:02.414713 run osmo-stp_10.42.42.5(pid=12707): stderr: | [0;m[38;5;43m20221208204700725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204700725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204700725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204700726 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204700726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204700726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204700726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:02.558478 run patchelf(pid=12710): Terminating (SIGINT) 20:47:02.724591 run patchelf(pid=12710): Terminated: ok {rc=0} 20:47:02.844378 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12707): Process ended prematurely: osmo-stp_10.42.42.5(pid=12707) [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12707)] [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 20:47:02.853460 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 20:47:02.880219 run osmo-hlr_10.42.42.2(pid=12704): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12704)] 20:47:02.928220 run osmo-hlr_10.42.42.2(pid=12704): stdout: | (launched: 2022-12-08_20:46:59.565181) 20:47:02.978380 run osmo-hlr_10.42.42.2(pid=12704): stderr: | [0;m[1;31m20221208204659760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204659760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204659760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204659760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204659760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204659760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204659773 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204659781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204659781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204659781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:47:03.028530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12703): Terminating (SIGTERM) 20:47:03.068155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12706): Terminating (SIGTERM) 20:47:03.108119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12709): Terminating (SIGTERM) 20:47:03.148097 --- ParallelTerminationStrategy: PID 12703 died... 20:47:03.167155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12703): Terminated: ok {rc=0} 20:47:03.211723 --- ParallelTerminationStrategy: PID 12706 died... 20:47:03.230241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12706): Terminated: ok {rc=0} 20:47:03.274528 --- ParallelTerminationStrategy: PID 12709 died... 20:47:03.293044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12709): Terminated: ok {rc=0} 20:47:03.377482 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:47:04.680757 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:47:04.687612 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:47:04.721702 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 20:47:04.761277 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 20:47:04.850164 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:47:04.883680 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 20:47:04.923382 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 20:47:05.519082 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 20:47:05.570975 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:05.582448 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:47:05.653467 tst cs_paging_gprs_active.py: using LAC 16707 20:47:05.778961 tst cs_paging_gprs_active.py: using RAC 132 20:47:05.904075 tst cs_paging_gprs_active.py: using CellId 16707 20:47:06.028878 tst cs_paging_gprs_active.py: using BVCI 16708 20:47:06.145511 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:06.156771 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:06.167916 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:06.179405 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:06.190599 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:06.201953 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:06.213408 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:06.224748 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:06.236430 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:47:06.353564 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:47:06.475205 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:47:06.675496 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:47:06.975758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12714): Launched 20:47:07.237309 run iperf3-srv_10.42.42.10(pid=12715): Launched 20:47:07.349858 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:47:07.550194 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:47:07.850337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12716): Launched 20:47:08.110199 run iperf3-srv_10.42.42.10(pid=12717): Launched 20:47:08.222560 tst cs_paging_gprs_active.py:38: start network... 20:47:08.421779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:47:08.882658 run create_hlr_db(pid=12718): Launched 20:47:08.997408 bus /gobi_6: Setting Powered False 20:47:10.057112 run create_hlr_db(pid=12718): Terminated: ok {rc=0} 20:47:10.494009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12720): Launched 20:47:10.813842 run osmo-hlr_10.42.42.2(pid=12721): Launched 20:47:10.934905 run osmo-stp_10.42.42.5: Starting osmo-stp 20:47:11.483140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12723): Launched 20:47:11.801602 run osmo-stp_10.42.42.5(pid=12724): Launched 20:47:11.923484 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:47:12.473670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12726): Launched 20:47:12.595444 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:47:12.867064 run patchelf(pid=12727): Launched 20:47:13.043792 run osmo-stp_10.42.42.5(pid=12724): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12724)] 20:47:13.179100 run osmo-stp_10.42.42.5(pid=12724): stdout: | (launched: 2022-12-08_20:47:11.743396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:13.315726 run osmo-stp_10.42.42.5(pid=12724): stderr: | [0;m[38;5;43m20221208204711936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204711936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204711936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204711936 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204711937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204711937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204711937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:13.452425 run osmo-stp_10.42.42.5(pid=12724): stdout: | (launched: 2022-12-08_20:47:11.743396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:13.582974 run osmo-stp_10.42.42.5(pid=12724): stderr: | [0;m[38;5;43m20221208204711936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204711936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204711936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204711936 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204711937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204711937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204711937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:13.737569 run patchelf(pid=12727): Terminating (SIGINT) 20:47:13.915991 run patchelf(pid=12727): Terminated: ok {rc=0} 20:47:14.044812 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12724): Process ended prematurely: osmo-stp_10.42.42.5(pid=12724) [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12724)] [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 20:47:14.054897 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 20:47:14.082906 run osmo-hlr_10.42.42.2(pid=12721): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12721)] 20:47:14.132899 run osmo-hlr_10.42.42.2(pid=12721): stdout: | (launched: 2022-12-08_20:47:10.755763) 20:47:14.184057 run osmo-hlr_10.42.42.2(pid=12721): stderr: | [0;m[1;31m20221208204710953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204710953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204710953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204710953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204710953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204710953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204710965 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204710974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204710974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204710974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:47:14.235838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12714): Terminating (SIGTERM) 20:47:14.277353 run iperf3-srv_10.42.42.10(pid=12715): Terminating (SIGTERM) 20:47:14.318839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12716): Terminating (SIGTERM) 20:47:14.360419 run iperf3-srv_10.42.42.10(pid=12717): Terminating (SIGTERM) 20:47:14.401882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12720): Terminating (SIGTERM) 20:47:14.443591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12723): Terminating (SIGTERM) 20:47:14.485066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12726): Terminating (SIGTERM) 20:47:14.526937 --- ParallelTerminationStrategy: PID 12714 died... 20:47:14.546833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12714): Terminated: ok {rc=0} 20:47:14.592688 --- ParallelTerminationStrategy: PID 12715 died... 20:47:14.612144 run iperf3-srv_10.42.42.10(pid=12715): Terminated {rc=256} 20:47:14.658526 --- ParallelTerminationStrategy: PID 12716 died... 20:47:14.678038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12716): Terminated: ok {rc=0} 20:47:14.724066 --- ParallelTerminationStrategy: PID 12717 died... 20:47:14.743557 run iperf3-srv_10.42.42.10(pid=12717): Terminated {rc=256} 20:47:14.789244 --- ParallelTerminationStrategy: PID 12720 died... 20:47:14.808599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12720): Terminated: ok {rc=0} 20:47:14.854457 --- ParallelTerminationStrategy: PID 12723 died... 20:47:14.874118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12723): Terminated: ok {rc=0} 20:47:14.919961 --- ParallelTerminationStrategy: PID 12726 died... 20:47:14.939499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12726): Terminated: ok {rc=0} 20:47:15.026870 bus /gobi_0: Setting Powered False 20:47:16.131449 bus /gobi_0: Setting Powered False 20:47:17.258510 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 20:47:18.403282 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:18.414885 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:47:18.484844 tst iperf3.py: using LAC 16708 20:47:18.606839 tst iperf3.py: using RAC 133 20:47:18.724562 tst iperf3.py: using CellId 16708 20:47:18.840463 tst iperf3.py: using BVCI 16709 20:47:18.949255 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:18.960199 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:18.970823 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:18.981857 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:18.992611 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:19.003481 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:19.014432 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:19.025267 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:19.036223 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:47:19.150410 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:47:19.350121 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:47:19.647911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12729): Launched 20:47:19.906926 run iperf3-srv_10.42.42.10(pid=12730): Launched 20:47:20.018100 tst iperf3.py:8: start network... 20:47:20.217017 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:47:20.674689 run create_hlr_db(pid=12731): Launched 20:47:20.787050 bus /gobi_6: Setting Powered False 20:47:21.846006 run create_hlr_db(pid=12731): Terminated: ok {rc=0} 20:47:22.281949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12733): Launched 20:47:22.598865 run osmo-hlr_10.42.42.2(pid=12734): Launched 20:47:22.719706 run osmo-stp_10.42.42.5: Starting osmo-stp 20:47:23.270323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12736): Launched 20:47:23.588014 run osmo-stp_10.42.42.5(pid=12737): Launched 20:47:23.708315 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:47:24.254730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12739): Launched 20:47:24.375947 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:47:24.643740 run patchelf(pid=12740): Launched 20:47:24.820568 run osmo-stp_10.42.42.5(pid=12737): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12737)] 20:47:24.955252 run osmo-stp_10.42.42.5(pid=12737): stdout: | (launched: 2022-12-08_20:47:23.530116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:25.091390 run osmo-stp_10.42.42.5(pid=12737): stderr: | [0;m[38;5;43m20221208204723721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204723722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204723723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204723723 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204723723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204723724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204723724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:25.228139 run osmo-stp_10.42.42.5(pid=12737): stdout: | (launched: 2022-12-08_20:47:23.530116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:25.359239 run osmo-stp_10.42.42.5(pid=12737): stderr: | [0;m[38;5;43m20221208204723721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204723722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204723723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204723723 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204723723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204723724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204723724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:25.514589 run patchelf(pid=12740): Terminating (SIGINT) 20:47:25.693970 run patchelf(pid=12740): Terminated: ok {rc=0} 20:47:25.822880 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12737): Process ended prematurely: osmo-stp_10.42.42.5(pid=12737) [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12737)] [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 20:47:25.832941 tst iperf3.py:8: Test FAILED (7.5 sec) 20:47:25.861263 run osmo-hlr_10.42.42.2(pid=12734): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12734)] 20:47:25.911055 run osmo-hlr_10.42.42.2(pid=12734): stdout: | (launched: 2022-12-08_20:47:22.540876) 20:47:25.962599 run osmo-hlr_10.42.42.2(pid=12734): stderr: | [0;m[1;31m20221208204722738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204722738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204722738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204722738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204722738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204722738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204722752 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204722760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204722761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204722761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:47:26.014929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12729): Terminating (SIGTERM) 20:47:26.056831 run iperf3-srv_10.42.42.10(pid=12730): Terminating (SIGTERM) 20:47:26.098584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12733): Terminating (SIGTERM) 20:47:26.140436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12736): Terminating (SIGTERM) 20:47:26.182017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12739): Terminating (SIGTERM) 20:47:26.223853 --- ParallelTerminationStrategy: PID 12729 died... 20:47:26.243621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12729): Terminated: ok {rc=0} 20:47:26.289783 --- ParallelTerminationStrategy: PID 12730 died... 20:47:26.309292 run iperf3-srv_10.42.42.10(pid=12730): Terminated {rc=256} 20:47:26.355270 --- ParallelTerminationStrategy: PID 12733 died... 20:47:26.374845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12733): Terminated: ok {rc=0} 20:47:26.420934 --- ParallelTerminationStrategy: PID 12736 died... 20:47:26.440524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12736): Terminated: ok {rc=0} 20:47:26.486580 --- ParallelTerminationStrategy: PID 12739 died... 20:47:26.506248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12739): Terminated: ok {rc=0} 20:47:26.594164 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 20:47:27.741764 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:27.757251 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:47:27.828931 tst iperf3m4.py: using LAC 16709 20:47:27.954220 tst iperf3m4.py: using RAC 134 20:47:28.078187 tst iperf3m4.py: using CellId 16709 20:47:28.203577 tst iperf3m4.py: using BVCI 16710 20:47:28.320924 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:28.332514 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:28.343670 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:28.355066 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:28.366204 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:28.377395 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:28.388616 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:28.399694 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:28.411058 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:47:28.528854 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:47:28.648280 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:47:28.766809 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:47:28.888478 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:47:29.102597 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:47:29.422465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12741): Launched 20:47:29.699180 run iperf3-srv_10.42.42.10(pid=12742): Launched 20:47:29.818069 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:47:30.030921 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:47:30.350078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12743): Launched 20:47:30.625810 run iperf3-srv_10.42.42.10(pid=12744): Launched 20:47:30.744240 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:47:30.974815 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:47:31.298592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12745): Launched 20:47:31.574211 run iperf3-srv_10.42.42.10(pid=12746): Launched 20:47:31.694139 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:47:31.899619 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:47:32.207661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12747): Launched 20:47:32.466383 run iperf3-srv_10.42.42.10(pid=12748): Launched 20:47:32.577795 tst iperf3m4.py:8: start network... 20:47:32.775664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:47:33.234456 run create_hlr_db(pid=12749): Launched 20:47:33.347843 bus /gobi_6: Setting Powered False 20:47:34.407239 run create_hlr_db(pid=12749): Terminated: ok {rc=0} 20:47:34.842131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12751): Launched 20:47:35.159894 run osmo-hlr_10.42.42.2(pid=12752): Launched 20:47:35.280677 run osmo-stp_10.42.42.5: Starting osmo-stp 20:47:35.830694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12756): Launched 20:47:36.127691 run osmo-stp_10.42.42.5(pid=12757): Launched 20:47:36.241122 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:47:36.752588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12759): Launched 20:47:36.866681 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:47:37.118037 run patchelf(pid=12760): Launched 20:47:37.283804 run osmo-stp_10.42.42.5(pid=12757): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12757)] 20:47:37.409826 run osmo-stp_10.42.42.5(pid=12757): stdout: | (launched: 2022-12-08_20:47:36.072249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:37.537810 run osmo-stp_10.42.42.5(pid=12757): stderr: | [0;m[38;5;43m20221208204736239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204736239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204736239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204736240 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204736240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204736240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204736240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:37.665476 run osmo-stp_10.42.42.5(pid=12757): stdout: | (launched: 2022-12-08_20:47:36.072249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:37.787585 run osmo-stp_10.42.42.5(pid=12757): stderr: | [0;m[38;5;43m20221208204736239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204736239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204736239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204736240 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204736240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204736240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204736240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:37.931888 run patchelf(pid=12760): Terminating (SIGINT) 20:47:38.099195 run patchelf(pid=12760): Terminated: ok {rc=0} 20:47:38.219678 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12757): Process ended prematurely: osmo-stp_10.42.42.5(pid=12757) [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12757)] [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 20:47:38.229144 tst iperf3m4.py:8: Test FAILED (10.5 sec) 20:47:38.256694 run osmo-hlr_10.42.42.2(pid=12752): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12752)] 20:47:38.304229 run osmo-hlr_10.42.42.2(pid=12752): stdout: | (launched: 2022-12-08_20:47:35.101355) 20:47:38.353248 run osmo-hlr_10.42.42.2(pid=12752): stderr: | [0;m[1;31m20221208204735298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204735298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204735298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204735298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204735298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204735298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204735311 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204735319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204735319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204735319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:47:38.402835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12741): Terminating (SIGTERM) 20:47:38.442607 run iperf3-srv_10.42.42.10(pid=12742): Terminating (SIGTERM) 20:47:38.482431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12743): Terminating (SIGTERM) 20:47:38.522628 run iperf3-srv_10.42.42.10(pid=12744): Terminating (SIGTERM) 20:47:38.562636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12745): Terminating (SIGTERM) 20:47:38.602331 run iperf3-srv_10.42.42.10(pid=12746): Terminating (SIGTERM) 20:47:38.641833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12747): Terminating (SIGTERM) 20:47:38.681564 run iperf3-srv_10.42.42.10(pid=12748): Terminating (SIGTERM) 20:47:38.721318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12751): Terminating (SIGTERM) 20:47:38.761643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12756): Terminating (SIGTERM) 20:47:38.801359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12759): Terminating (SIGTERM) 20:47:38.841540 --- ParallelTerminationStrategy: PID 12741 died... 20:47:38.860520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12741): Terminated: ok {rc=0} 20:47:38.904569 --- ParallelTerminationStrategy: PID 12742 died... 20:47:38.923007 run iperf3-srv_10.42.42.10(pid=12742): Terminated {rc=256} 20:47:38.967471 --- ParallelTerminationStrategy: PID 12743 died... 20:47:38.985893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12743): Terminated: ok {rc=0} 20:47:39.029620 --- ParallelTerminationStrategy: PID 12744 died... 20:47:39.048031 run iperf3-srv_10.42.42.10(pid=12744): Terminated {rc=256} 20:47:39.091831 --- ParallelTerminationStrategy: PID 12745 died... 20:47:39.110443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12745): Terminated: ok {rc=0} 20:47:39.154303 --- ParallelTerminationStrategy: PID 12746 died... 20:47:39.172694 run iperf3-srv_10.42.42.10(pid=12746): Terminated {rc=256} 20:47:39.216479 --- ParallelTerminationStrategy: PID 12747 died... 20:47:39.235022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12747): Terminated: ok {rc=0} 20:47:39.279519 --- ParallelTerminationStrategy: PID 12748 died... 20:47:39.298023 run iperf3-srv_10.42.42.10(pid=12748): Terminated {rc=256} 20:47:39.342169 --- ParallelTerminationStrategy: PID 12751 died... 20:47:39.360769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12751): Terminated: ok {rc=0} 20:47:39.404744 --- ParallelTerminationStrategy: PID 12756 died... 20:47:39.423257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12756): Terminated: ok {rc=0} 20:47:39.467887 --- ParallelTerminationStrategy: PID 12759 died... 20:47:39.486568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12759): Terminated: ok {rc=0} 20:47:39.572068 bus /gobi_4: Setting Powered False 20:47:40.671501 bus /gobi_4: Setting Powered False 20:47:41.787151 bus /gobi_1: Setting Powered False 20:47:42.885566 bus /gobi_1: Setting Powered False 20:47:43.999998 bus /gobi_0: Setting Powered False 20:47:45.098863 bus /gobi_0: Setting Powered False 20:47:46.222083 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 20:47:47.334499 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:47.346464 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:47:47.417626 tst ping.py: using LAC 16710 20:47:47.540494 tst ping.py: using RAC 135 20:47:47.666215 tst ping.py: using CellId 16710 20:47:47.789157 tst ping.py: using BVCI 16711 20:47:47.902068 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:47.913425 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:47.924495 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:47.935693 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:47.946933 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:47.958080 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:47.969359 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:47.980421 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:47:48.094283 tst ping.py:19: start network... 20:47:48.288512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:47:48.737843 run create_hlr_db(pid=12761): Launched 20:47:48.849245 bus /gobi_6: Setting Powered False 20:47:49.907794 run create_hlr_db(pid=12761): Terminated: ok {rc=0} 20:47:50.337041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12763): Launched 20:47:50.648581 run osmo-hlr_10.42.42.2(pid=12764): Launched 20:47:50.767500 run osmo-stp_10.42.42.5: Starting osmo-stp 20:47:51.304036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12766): Launched 20:47:51.616604 run osmo-stp_10.42.42.5(pid=12767): Launched 20:47:51.734637 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:47:52.272107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12769): Launched 20:47:52.391209 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:47:52.654030 run patchelf(pid=12770): Launched 20:47:52.827020 run osmo-stp_10.42.42.5(pid=12767): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12767)] 20:47:52.959187 run osmo-stp_10.42.42.5(pid=12767): stdout: | (launched: 2022-12-08_20:47:51.559058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:53.092651 run osmo-stp_10.42.42.5(pid=12767): stderr: | [0;m[38;5;43m20221208204751751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204751751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204751751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204751752 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204751752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204751752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204751752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:53.227146 run osmo-stp_10.42.42.5(pid=12767): stdout: | (launched: 2022-12-08_20:47:51.559058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:53.354765 run osmo-stp_10.42.42.5(pid=12767): stderr: | [0;m[38;5;43m20221208204751751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204751751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204751751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204751752 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204751752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204751752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204751752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:53.505987 run patchelf(pid=12770): Terminating (SIGINT) 20:47:53.683518 run patchelf(pid=12770): Terminated: ok {rc=0} 20:47:53.809649 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12767): Process ended prematurely: osmo-stp_10.42.42.5(pid=12767) [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12767)] [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 20:47:53.818934 tst ping.py:22: Test FAILED (6.5 sec) 20:47:53.846511 run osmo-hlr_10.42.42.2(pid=12764): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12764)] 20:47:53.896182 run osmo-hlr_10.42.42.2(pid=12764): stdout: | (launched: 2022-12-08_20:47:50.591795) 20:47:53.947397 run osmo-hlr_10.42.42.2(pid=12764): stderr: | [0;m[1;31m20221208204750790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204750790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204750790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204750790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204750790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204750790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204750806 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204750816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204750816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204750816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:47:53.998934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12763): Terminating (SIGTERM) 20:47:54.040457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12766): Terminating (SIGTERM) 20:47:54.082165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12769): Terminating (SIGTERM) 20:47:54.124222 --- ParallelTerminationStrategy: PID 12763 died... 20:47:54.143694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12763): Terminated: ok {rc=0} 20:47:54.190428 --- ParallelTerminationStrategy: PID 12766 died... 20:47:54.210140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12766): Terminated: ok {rc=0} 20:47:54.255938 --- ParallelTerminationStrategy: PID 12769 died... 20:47:54.275450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12769): Terminated: ok {rc=0} 20:47:54.362067 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 20:47:55.449494 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:55.461679 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:47:55.537158 tst ping_idle_ping.py: using LAC 16711 20:47:55.654076 tst ping_idle_ping.py: using RAC 136 20:47:55.782822 tst ping_idle_ping.py: using CellId 16711 20:47:55.905954 tst ping_idle_ping.py: using BVCI 16712 20:47:56.019678 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:56.031151 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:56.042536 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:56.054238 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:56.065698 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:56.077217 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:56.088604 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:56.099950 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:47:56.215686 tst ping_idle_ping.py:24: start network... 20:47:56.411746 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:47:56.862162 run create_hlr_db(pid=12771): Launched 20:47:56.973316 bus /gobi_6: Setting Powered False 20:47:58.031902 run create_hlr_db(pid=12771): Terminated: ok {rc=0} 20:47:58.438729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12773): Launched 20:47:58.729716 run osmo-hlr_10.42.42.2(pid=12774): Launched 20:47:58.841024 run osmo-stp_10.42.42.5: Starting osmo-stp 20:47:59.339286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12776): Launched 20:47:59.632428 run osmo-stp_10.42.42.5(pid=12777): Launched 20:47:59.743673 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:48:00.247774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12779): Launched 20:48:00.359762 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:48:00.606910 run patchelf(pid=12780): Launched 20:48:00.769981 run osmo-stp_10.42.42.5(pid=12777): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12777)] 20:48:00.902181 run osmo-stp_10.42.42.5(pid=12777): stdout: | (launched: 2022-12-08_20:47:59.578495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:01.032373 run osmo-stp_10.42.42.5(pid=12777): stderr: | [0;m[38;5;43m20221208204759746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204759746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204759747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204759747 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204759747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204759748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204759748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:01.163707 run osmo-stp_10.42.42.5(pid=12777): stdout: | (launched: 2022-12-08_20:47:59.578495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:01.288478 run osmo-stp_10.42.42.5(pid=12777): stderr: | [0;m[38;5;43m20221208204759746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204759746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204759747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204759747 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204759747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204759748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204759748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:01.436372 run patchelf(pid=12780): Terminating (SIGINT) 20:48:01.607625 run patchelf(pid=12780): Terminated: ok {rc=0} 20:48:01.730894 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12777): Process ended prematurely: osmo-stp_10.42.42.5(pid=12777) [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12777)] [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 20:48:01.741028 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 20:48:01.771157 run osmo-hlr_10.42.42.2(pid=12774): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12774)] 20:48:01.821711 run osmo-hlr_10.42.42.2(pid=12774): stdout: | (launched: 2022-12-08_20:47:58.676429) 20:48:01.873683 run osmo-hlr_10.42.42.2(pid=12774): stderr: | [0;m[1;31m20221208204758850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204758850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204758850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204758850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204758850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204758850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204758863 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204758871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204758872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204758872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:48:01.926458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12773): Terminating (SIGTERM) 20:48:01.968631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12776): Terminating (SIGTERM) 20:48:02.010695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12779): Terminating (SIGTERM) 20:48:02.052889 --- ParallelTerminationStrategy: PID 12773 died... 20:48:02.072646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12773): Terminated: ok {rc=0} 20:48:02.119770 --- ParallelTerminationStrategy: PID 12776 died... 20:48:02.139448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12776): Terminated: ok {rc=0} 20:48:02.186535 --- ParallelTerminationStrategy: PID 12779 died... 20:48:02.205042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12779): Terminated: ok {rc=0} 20:48:02.291767 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 20:48:03.593756 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:48:03.600364 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 20:48:03.633567 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 20:48:03.672040 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 20:48:03.763840 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 20:48:03.797858 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 20:48:03.837499 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 20:48:04.445644 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 20:48:04.497054 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:04.508846 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:48:04.565781 tst cs_paging_gprs_active.py: using LAC 16712 20:48:04.686870 tst cs_paging_gprs_active.py: using RAC 137 20:48:04.803775 tst cs_paging_gprs_active.py: using CellId 16712 20:48:04.923445 tst cs_paging_gprs_active.py: using BVCI 16713 20:48:05.032843 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:05.044168 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:05.055161 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:05.066449 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:05.077885 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:05.088924 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:05.100396 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:05.111576 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:05.123068 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:48:05.241079 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:48:05.361449 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:48:05.576015 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:48:05.895940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12784): Launched 20:48:06.173514 run iperf3-srv_10.42.42.10(pid=12785): Launched 20:48:06.293128 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:48:06.506949 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:48:06.826548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12786): Launched 20:48:07.102545 run iperf3-srv_10.42.42.10(pid=12787): Launched 20:48:07.222578 tst cs_paging_gprs_active.py:38: start network... 20:48:07.436805 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:48:07.930652 run create_hlr_db(pid=12788): Launched 20:48:08.061179 bus /gobi_6: Setting Powered False 20:48:09.123919 run create_hlr_db(pid=12788): Terminated: ok {rc=0} 20:48:09.568293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12790): Launched 20:48:09.887576 run osmo-hlr_10.42.42.2(pid=12791): Launched 20:48:10.008506 run osmo-stp_10.42.42.5: Starting osmo-stp 20:48:10.561042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12793): Launched 20:48:10.877718 run osmo-stp_10.42.42.5(pid=12794): Launched 20:48:10.998284 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:48:11.545620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12796): Launched 20:48:11.667242 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:48:11.937190 run patchelf(pid=12797): Launched 20:48:12.114089 run osmo-stp_10.42.42.5(pid=12794): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12794)] 20:48:12.249246 run osmo-stp_10.42.42.5(pid=12794): stdout: | (launched: 2022-12-08_20:48:10.819856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:12.385463 run osmo-stp_10.42.42.5(pid=12794): stderr: | [0;m[38;5;43m20221208204811011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204811011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204811011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204811011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204811012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204811012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204811012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:12.521664 run osmo-stp_10.42.42.5(pid=12794): stdout: | (launched: 2022-12-08_20:48:10.819856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:12.652471 run osmo-stp_10.42.42.5(pid=12794): stderr: | [0;m[38;5;43m20221208204811011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204811011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204811011 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204811011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204811012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204811012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204811012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:12.807144 run patchelf(pid=12797): Terminating (SIGINT) 20:48:12.985704 run patchelf(pid=12797): Terminated: ok {rc=0} 20:48:13.114751 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12794): Process ended prematurely: osmo-stp_10.42.42.5(pid=12794) [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12794)] [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 20:48:13.124789 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 20:48:13.153165 run osmo-hlr_10.42.42.2(pid=12791): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12791)] 20:48:13.203319 run osmo-hlr_10.42.42.2(pid=12791): stdout: | (launched: 2022-12-08_20:48:09.829666) 20:48:13.255170 run osmo-hlr_10.42.42.2(pid=12791): stderr: | [0;m[1;31m20221208204810025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204810025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204810025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204810025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204810025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204810025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204810037 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204810045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204810045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204810045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:48:13.307585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12784): Terminating (SIGTERM) 20:48:13.349613 run iperf3-srv_10.42.42.10(pid=12785): Terminating (SIGTERM) 20:48:13.391567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12786): Terminating (SIGTERM) 20:48:13.433580 run iperf3-srv_10.42.42.10(pid=12787): Terminating (SIGTERM) 20:48:13.475344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12790): Terminating (SIGTERM) 20:48:13.517240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12793): Terminating (SIGTERM) 20:48:13.559078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12796): Terminating (SIGTERM) 20:48:13.601264 --- ParallelTerminationStrategy: PID 12784 died... 20:48:13.621203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12784): Terminated: ok {rc=0} 20:48:13.667724 --- ParallelTerminationStrategy: PID 12785 died... 20:48:13.687246 run iperf3-srv_10.42.42.10(pid=12785): Terminated {rc=256} 20:48:13.733300 --- ParallelTerminationStrategy: PID 12786 died... 20:48:13.753135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12786): Terminated: ok {rc=0} 20:48:13.799297 --- ParallelTerminationStrategy: PID 12787 died... 20:48:13.818780 run iperf3-srv_10.42.42.10(pid=12787): Terminated {rc=256} 20:48:13.864795 --- ParallelTerminationStrategy: PID 12790 died... 20:48:13.884663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12790): Terminated: ok {rc=0} 20:48:13.930557 --- ParallelTerminationStrategy: PID 12793 died... 20:48:13.950153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12793): Terminated: ok {rc=0} 20:48:13.996212 --- ParallelTerminationStrategy: PID 12796 died... 20:48:14.015865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12796): Terminated: ok {rc=0} 20:48:14.103386 bus /gobi_0: Setting Powered False 20:48:15.202828 bus /gobi_0: Setting Powered False 20:48:16.328003 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 20:48:17.481256 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:17.493527 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:48:17.551174 tst iperf3.py: using LAC 16713 20:48:17.667192 tst iperf3.py: using RAC 138 20:48:17.791733 tst iperf3.py: using CellId 16713 20:48:17.915328 tst iperf3.py: using BVCI 16714 20:48:18.031199 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:18.043130 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:18.054857 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:18.066778 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:18.078675 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:18.090390 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:18.102203 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:18.113780 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:18.125687 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:48:18.246386 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:48:18.458728 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:48:18.778050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12798): Launched 20:48:19.053826 run iperf3-srv_10.42.42.10(pid=12799): Launched 20:48:19.173183 tst iperf3.py:8: start network... 20:48:19.388318 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:48:19.880503 run create_hlr_db(pid=12800): Launched 20:48:20.008843 bus /gobi_6: Setting Powered False 20:48:21.072091 run create_hlr_db(pid=12800): Terminated: ok {rc=0} 20:48:21.494892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12802): Launched 20:48:21.791253 run osmo-hlr_10.42.42.2(pid=12803): Launched 20:48:21.904252 run osmo-stp_10.42.42.5: Starting osmo-stp 20:48:22.427404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12805): Launched 20:48:22.722991 run osmo-stp_10.42.42.5(pid=12806): Launched 20:48:22.835940 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:48:23.346102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12808): Launched 20:48:23.459855 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:48:23.710629 run patchelf(pid=12809): Launched 20:48:23.877209 run osmo-stp_10.42.42.5(pid=12806): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12806)] 20:48:24.003269 run osmo-stp_10.42.42.5(pid=12806): stdout: | (launched: 2022-12-08_20:48:22.668630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:24.130822 run osmo-stp_10.42.42.5(pid=12806): stderr: | [0;m[38;5;43m20221208204822838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204822838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204822838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204822838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204822839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204822839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204822839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:24.258400 run osmo-stp_10.42.42.5(pid=12806): stdout: | (launched: 2022-12-08_20:48:22.668630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:24.380665 run osmo-stp_10.42.42.5(pid=12806): stderr: | [0;m[38;5;43m20221208204822838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204822838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204822838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204822838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204822839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204822839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204822839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:24.525234 run patchelf(pid=12809): Terminating (SIGINT) 20:48:24.693233 run patchelf(pid=12809): Terminated: ok {rc=0} 20:48:24.813986 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12806): Process ended prematurely: osmo-stp_10.42.42.5(pid=12806) [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12806)] [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 20:48:24.823383 tst iperf3.py:8: Test FAILED (7.4 sec) 20:48:24.850874 run osmo-hlr_10.42.42.2(pid=12803): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12803)] 20:48:24.898740 run osmo-hlr_10.42.42.2(pid=12803): stdout: | (launched: 2022-12-08_20:48:21.737065) 20:48:24.948307 run osmo-hlr_10.42.42.2(pid=12803): stderr: | [0;m[1;31m20221208204821911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204821911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204821911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204821911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204821911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204821911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204821924 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204821935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204821935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204821935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:48:24.998776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12798): Terminating (SIGTERM) 20:48:25.039070 run iperf3-srv_10.42.42.10(pid=12799): Terminating (SIGTERM) 20:48:25.079235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12802): Terminating (SIGTERM) 20:48:25.119541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12805): Terminating (SIGTERM) 20:48:25.159974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12808): Terminating (SIGTERM) 20:48:25.200504 --- ParallelTerminationStrategy: PID 12798 died... 20:48:25.219689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12798): Terminated: ok {rc=0} 20:48:25.264147 --- ParallelTerminationStrategy: PID 12799 died... 20:48:25.282699 run iperf3-srv_10.42.42.10(pid=12799): Terminated {rc=256} 20:48:25.327139 --- ParallelTerminationStrategy: PID 12802 died... 20:48:25.345692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12802): Terminated: ok {rc=0} 20:48:25.389981 --- ParallelTerminationStrategy: PID 12805 died... 20:48:25.408545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12805): Terminated: ok {rc=0} 20:48:25.453024 --- ParallelTerminationStrategy: PID 12808 died... 20:48:25.471635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12808): Terminated: ok {rc=0} 20:48:25.555897 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 20:48:26.703712 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:26.716056 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:48:26.771149 tst iperf3m4.py: using LAC 16714 20:48:26.896790 tst iperf3m4.py: using RAC 139 20:48:27.021220 tst iperf3m4.py: using CellId 16714 20:48:27.145613 tst iperf3m4.py: using BVCI 16715 20:48:27.261536 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:27.273438 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:27.284870 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:27.296560 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:27.308122 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:27.319583 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:27.331177 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:27.342709 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:27.354720 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:48:27.471561 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:48:27.593094 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:48:27.711537 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:48:27.826791 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:48:28.025288 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:48:28.322181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12810): Launched 20:48:28.580433 run iperf3-srv_10.42.42.10(pid=12811): Launched 20:48:28.691479 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:48:28.889596 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:48:29.185827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12812): Launched 20:48:29.442484 run iperf3-srv_10.42.42.10(pid=12813): Launched 20:48:29.553449 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:48:29.750928 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:48:30.048163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12814): Launched 20:48:30.306673 run iperf3-srv_10.42.42.10(pid=12815): Launched 20:48:30.418052 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:48:30.615345 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:48:30.931172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12816): Launched 20:48:31.206646 run iperf3-srv_10.42.42.10(pid=12817): Launched 20:48:31.335043 tst iperf3m4.py:8: start network... 20:48:31.537328 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:48:32.008256 run create_hlr_db(pid=12818): Launched 20:48:32.161506 bus /gobi_6: Setting Powered False 20:48:33.220834 run create_hlr_db(pid=12818): Terminated: ok {rc=0} 20:48:33.634831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12820): Launched 20:48:33.931946 run osmo-hlr_10.42.42.2(pid=12821): Launched 20:48:34.045713 run osmo-stp_10.42.42.5: Starting osmo-stp 20:48:34.563518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12823): Launched 20:48:34.859983 run osmo-stp_10.42.42.5(pid=12824): Launched 20:48:34.972324 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:48:35.482385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12826): Launched 20:48:35.595745 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:48:35.846190 run patchelf(pid=12827): Launched 20:48:36.012274 run osmo-stp_10.42.42.5(pid=12824): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12824)] 20:48:36.138501 run osmo-stp_10.42.42.5(pid=12824): stdout: | (launched: 2022-12-08_20:48:34.805675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:36.265834 run osmo-stp_10.42.42.5(pid=12824): stderr: | [0;m[38;5;43m20221208204834974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204834974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204834974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204834975 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204834975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204834975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204834975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:36.393184 run osmo-stp_10.42.42.5(pid=12824): stdout: | (launched: 2022-12-08_20:48:34.805675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:36.515055 run osmo-stp_10.42.42.5(pid=12824): stderr: | [0;m[38;5;43m20221208204834974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204834974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204834974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204834975 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204834975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204834975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204834975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:36.659284 run patchelf(pid=12827): Terminating (SIGINT) 20:48:36.826776 run patchelf(pid=12827): Terminated: ok {rc=0} 20:48:36.947094 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12824): Process ended prematurely: osmo-stp_10.42.42.5(pid=12824) [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12824)] [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 20:48:36.956757 tst iperf3m4.py:8: Test FAILED (10.3 sec) 20:48:36.984366 run osmo-hlr_10.42.42.2(pid=12821): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12821)] 20:48:37.032239 run osmo-hlr_10.42.42.2(pid=12821): stdout: | (launched: 2022-12-08_20:48:33.877066) 20:48:37.081632 run osmo-hlr_10.42.42.2(pid=12821): stderr: | [0;m[1;31m20221208204834050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204834050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204834050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204834050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204834050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204834050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204834062 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204834071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204834071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204834071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:48:37.131465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12810): Terminating (SIGTERM) 20:48:37.171568 run iperf3-srv_10.42.42.10(pid=12811): Terminating (SIGTERM) 20:48:37.211352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12812): Terminating (SIGTERM) 20:48:37.251032 run iperf3-srv_10.42.42.10(pid=12813): Terminating (SIGTERM) 20:48:37.290496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12814): Terminating (SIGTERM) 20:48:37.330225 run iperf3-srv_10.42.42.10(pid=12815): Terminating (SIGTERM) 20:48:37.369676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12816): Terminating (SIGTERM) 20:48:37.409235 run iperf3-srv_10.42.42.10(pid=12817): Terminating (SIGTERM) 20:48:37.449206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12820): Terminating (SIGTERM) 20:48:37.488679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12823): Terminating (SIGTERM) 20:48:37.528800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12826): Terminating (SIGTERM) 20:48:37.568900 --- ParallelTerminationStrategy: PID 12810 died... 20:48:37.587887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12810): Terminated: ok {rc=0} 20:48:37.631858 --- ParallelTerminationStrategy: PID 12811 died... 20:48:37.650894 run iperf3-srv_10.42.42.10(pid=12811): Terminated {rc=256} 20:48:37.695409 --- ParallelTerminationStrategy: PID 12812 died... 20:48:37.714049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12812): Terminated: ok {rc=0} 20:48:37.758568 --- ParallelTerminationStrategy: PID 12813 died... 20:48:37.776891 run iperf3-srv_10.42.42.10(pid=12813): Terminated {rc=256} 20:48:37.820782 --- ParallelTerminationStrategy: PID 12814 died... 20:48:37.839509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12814): Terminated: ok {rc=0} 20:48:37.883539 --- ParallelTerminationStrategy: PID 12815 died... 20:48:37.902024 run iperf3-srv_10.42.42.10(pid=12815): Terminated {rc=256} 20:48:37.946330 --- ParallelTerminationStrategy: PID 12816 died... 20:48:37.964822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12816): Terminated: ok {rc=0} 20:48:38.009138 --- ParallelTerminationStrategy: PID 12817 died... 20:48:38.027627 run iperf3-srv_10.42.42.10(pid=12817): Terminated {rc=256} 20:48:38.071824 --- ParallelTerminationStrategy: PID 12820 died... 20:48:38.090459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12820): Terminated: ok {rc=0} 20:48:38.134809 --- ParallelTerminationStrategy: PID 12823 died... 20:48:38.153391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12823): Terminated: ok {rc=0} 20:48:38.197739 --- ParallelTerminationStrategy: PID 12826 died... 20:48:38.216375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12826): Terminated: ok {rc=0} 20:48:38.302435 bus /gobi_4: Setting Powered False 20:48:39.401501 bus /gobi_4: Setting Powered False 20:48:40.516412 bus /gobi_1: Setting Powered False 20:48:41.616641 bus /gobi_1: Setting Powered False 20:48:42.732190 bus /gobi_0: Setting Powered False 20:48:43.829224 bus /gobi_0: Setting Powered False 20:48:44.946848 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 20:48:46.050963 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:46.064191 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:48:46.117736 tst ping.py: using LAC 16715 20:48:46.234070 tst ping.py: using RAC 140 20:48:46.351679 tst ping.py: using CellId 16715 20:48:46.477308 tst ping.py: using BVCI 16716 20:48:46.617653 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:46.631269 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:46.648717 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:46.665499 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:46.681930 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:46.697893 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:46.712609 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:46.724770 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:48:46.850964 tst ping.py:19: start network... 20:48:47.050409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:48:47.505578 run create_hlr_db(pid=12828): Launched 20:48:47.619714 bus /gobi_6: Setting Powered False 20:48:48.678724 run create_hlr_db(pid=12828): Terminated: ok {rc=0} 20:48:49.106438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12830): Launched 20:48:49.419873 run osmo-hlr_10.42.42.2(pid=12831): Launched 20:48:49.539237 run osmo-stp_10.42.42.5: Starting osmo-stp 20:48:50.081349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12833): Launched 20:48:50.395588 run osmo-stp_10.42.42.5(pid=12834): Launched 20:48:50.514737 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:48:51.053453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12836): Launched 20:48:51.173215 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:48:51.437651 run patchelf(pid=12837): Launched 20:48:51.611610 run osmo-stp_10.42.42.5(pid=12834): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12834)] 20:48:51.745018 run osmo-stp_10.42.42.5(pid=12834): stdout: | (launched: 2022-12-08_20:48:50.338257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:51.879754 run osmo-stp_10.42.42.5(pid=12834): stderr: | [0;m[38;5;43m20221208204850530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204850530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204850530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204850531 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204850531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204850531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204850531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:52.014642 run osmo-stp_10.42.42.5(pid=12834): stdout: | (launched: 2022-12-08_20:48:50.338257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:52.144299 run osmo-stp_10.42.42.5(pid=12834): stderr: | [0;m[38;5;43m20221208204850530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204850530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204850530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204850531 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204850531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204850531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204850531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:52.297708 run patchelf(pid=12837): Terminating (SIGINT) 20:48:52.474005 run patchelf(pid=12837): Terminated: ok {rc=0} 20:48:52.600669 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12834): Process ended prematurely: osmo-stp_10.42.42.5(pid=12834) [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12834)] [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 20:48:52.610405 tst ping.py:22: Test FAILED (6.6 sec) 20:48:52.638312 run osmo-hlr_10.42.42.2(pid=12831): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12831)] 20:48:52.688228 run osmo-hlr_10.42.42.2(pid=12831): stdout: | (launched: 2022-12-08_20:48:49.362903) 20:48:52.739653 run osmo-hlr_10.42.42.2(pid=12831): stderr: | [0;m[1;31m20221208204849560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204849561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204849561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204849561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204849561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204849561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204849573 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204849582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204849582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204849582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:48:52.791629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12830): Terminating (SIGTERM) 20:48:52.833167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12833): Terminating (SIGTERM) 20:48:52.874884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12836): Terminating (SIGTERM) 20:48:52.916853 --- ParallelTerminationStrategy: PID 12830 died... 20:48:52.936512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12830): Terminated: ok {rc=0} 20:48:52.982561 --- ParallelTerminationStrategy: PID 12833 died... 20:48:53.002159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12833): Terminated: ok {rc=0} 20:48:53.047843 --- ParallelTerminationStrategy: PID 12836 died... 20:48:53.067293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12836): Terminated: ok {rc=0} 20:48:53.154289 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 20:48:54.241315 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:54.253812 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:48:54.308025 tst ping_idle_ping.py: using LAC 16716 20:48:54.431947 tst ping_idle_ping.py: using RAC 141 20:48:54.554317 tst ping_idle_ping.py: using CellId 16716 20:48:54.677875 tst ping_idle_ping.py: using BVCI 16717 20:48:54.785749 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:54.797334 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:54.808563 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:54.820755 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:54.833061 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:54.845639 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:54.856916 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:54.868917 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:48:54.990436 tst ping_idle_ping.py:24: start network... 20:48:55.202868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:48:55.689993 run create_hlr_db(pid=12838): Launched 20:48:55.817965 bus /gobi_6: Setting Powered False 20:48:56.880725 run create_hlr_db(pid=12838): Terminated: ok {rc=0} 20:48:57.320047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12840): Launched 20:48:57.633757 run osmo-hlr_10.42.42.2(pid=12841): Launched 20:48:57.752153 run osmo-stp_10.42.42.5: Starting osmo-stp 20:48:58.294202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12843): Launched 20:48:58.606432 run osmo-stp_10.42.42.5(pid=12844): Launched 20:48:58.724504 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:48:59.263901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12846): Launched 20:48:59.384120 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:48:59.648172 run patchelf(pid=12847): Launched 20:48:59.822549 run osmo-stp_10.42.42.5(pid=12844): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12844)] 20:48:59.955591 run osmo-stp_10.42.42.5(pid=12844): stdout: | (launched: 2022-12-08_20:48:58.549408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:00.090566 run osmo-stp_10.42.42.5(pid=12844): stderr: | [0;m[38;5;43m20221208204858740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204858740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204858740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204858741 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204858741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204858741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204858741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:00.226841 run osmo-stp_10.42.42.5(pid=12844): stdout: | (launched: 2022-12-08_20:48:58.549408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:00.355679 run osmo-stp_10.42.42.5(pid=12844): stderr: | [0;m[38;5;43m20221208204858740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204858740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204858740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204858741 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204858741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204858741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204858741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:00.507748 run patchelf(pid=12847): Terminating (SIGINT) 20:49:00.684178 run patchelf(pid=12847): Terminated: ok {rc=0} 20:49:00.811566 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12844): Process ended prematurely: osmo-stp_10.42.42.5(pid=12844) [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12844)] [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 20:49:00.821051 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 20:49:00.856142 run osmo-hlr_10.42.42.2(pid=12841): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12841)] 20:49:00.917972 run osmo-hlr_10.42.42.2(pid=12841): stdout: | (launched: 2022-12-08_20:48:57.576578) 20:49:00.971235 run osmo-hlr_10.42.42.2(pid=12841): stderr: | [0;m[1;31m20221208204857775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204857775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204857775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204857775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204857775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204857775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204857788 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204857796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204857796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204857796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:49:01.027909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12840): Terminating (SIGTERM) 20:49:01.083213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12843): Terminating (SIGTERM) 20:49:01.128069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12846): Terminating (SIGTERM) 20:49:01.173437 --- ParallelTerminationStrategy: PID 12840 died... 20:49:01.193308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12840): Terminated: ok {rc=0} 20:49:01.242489 --- ParallelTerminationStrategy: PID 12843 died... 20:49:01.262208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12843): Terminated: ok {rc=0} 20:49:01.310018 --- ParallelTerminationStrategy: PID 12846 died... 20:49:01.330658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12846): Terminated: ok {rc=0} 20:49:01.418402 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:49:02.735513 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:49:02.742828 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:49:02.776518 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 20:49:02.812083 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:49:02.865265 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:49:02.898792 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 20:49:02.934277 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:49:03.500509 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2349 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 20:49:03.506083 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:49:03.517787 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:49:03.587178 tst switch_tch_pdch.py: using LAC 16717 20:49:03.709403 tst switch_tch_pdch.py: using RAC 142 20:49:03.829964 tst switch_tch_pdch.py: using CellId 16717 20:49:03.950190 tst switch_tch_pdch.py: using BVCI 16718 20:49:04.063171 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:49:04.074840 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:49:04.086303 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:49:04.098062 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:49:04.109693 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:49:04.121221 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:49:04.132875 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:49:04.144577 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:49:04.260684 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:49:04.380691 tst switch_tch_pdch.py:51: start network... 20:49:04.592338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:49:05.075219 run create_hlr_db(pid=12851): Launched 20:49:05.202252 bus /gobi_6: Setting Powered False 20:49:06.264058 run create_hlr_db(pid=12851): Terminated: ok {rc=0} 20:49:06.681995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12853): Launched 20:49:06.973711 run osmo-hlr_10.42.42.2(pid=12854): Launched 20:49:07.084321 run osmo-stp_10.42.42.5: Starting osmo-stp 20:49:07.597414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12856): Launched 20:49:07.888575 run osmo-stp_10.42.42.5(pid=12857): Launched 20:49:07.999260 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:49:08.500278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12859): Launched 20:49:08.611670 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:49:08.857422 run patchelf(pid=12860): Launched 20:49:09.019627 run osmo-stp_10.42.42.5(pid=12857): ERR: Terminated: ERROR {rc=1} [trial-2349↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12857)] 20:49:09.144178 run osmo-stp_10.42.42.5(pid=12857): stdout: | (launched: 2022-12-08_20:49:07.835453) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:09.269800 run osmo-stp_10.42.42.5(pid=12857): stderr: | [0;m[38;5;43m20221208204908002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204908003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204908003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204908003 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204908004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204908004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204908004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:09.395521 run osmo-stp_10.42.42.5(pid=12857): stdout: | (launched: 2022-12-08_20:49:07.835453) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:09.515035 run osmo-stp_10.42.42.5(pid=12857): stderr: | [0;m[38;5;43m20221208204908002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204908003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204908003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204908003 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204908004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204908004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204908004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:09.656897 run patchelf(pid=12860): Terminating (SIGINT) 20:49:09.821198 run patchelf(pid=12860): Terminated: ok {rc=0} 20:49:09.939505 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12857): Process ended prematurely: osmo-stp_10.42.42.5(pid=12857) [trial-2349↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12857)] [trial-2349↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 20:49:09.948429 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 20:49:09.974698 run osmo-hlr_10.42.42.2(pid=12854): ERR: Terminated: ERROR {rc=237} [trial-2349↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12854)] 20:49:10.022326 run osmo-hlr_10.42.42.2(pid=12854): stdout: | (launched: 2022-12-08_20:49:06.920542) 20:49:10.071749 run osmo-hlr_10.42.42.2(pid=12854): stderr: | [0;m[1;31m20221208204907093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204907093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204907093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204907093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204907093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204907093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204907109 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204907117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204907117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204907117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:49:10.121473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12853): Terminating (SIGTERM) 20:49:10.161439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12856): Terminating (SIGTERM) 20:49:10.201621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12859): Terminating (SIGTERM) 20:49:10.242006 --- ParallelTerminationStrategy: PID 12853 died... 20:49:10.261005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12853): Terminated: ok {rc=0} 20:49:10.305223 --- ParallelTerminationStrategy: PID 12856 died... 20:49:10.324039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12856): Terminated: ok {rc=0} 20:49:10.368189 --- ParallelTerminationStrategy: PID 12859 died... 20:49:10.386975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12859): Terminated: ok {rc=0} 20:49:10.471678 bus /gobi_0: Setting Powered False 20:49:11.569308 bus /gobi_0: Setting Powered False 20:49:12.683289 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 20:49:13.935638 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:49:13.942073 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 20:49:13.975740 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 20:49:14.011428 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 20:49:14.066673 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 20:49:14.100285 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 20:49:14.135927 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 20:49:14.690999 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2349 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 20:49:14.696438 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:49:14.707957 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 20:49:14.778954 tst switch_tch_pdch.py: using LAC 16718 20:49:14.907355 tst switch_tch_pdch.py: using RAC 143 20:49:15.030424 tst switch_tch_pdch.py: using CellId 16718 20:49:15.151307 tst switch_tch_pdch.py: using BVCI 16719 20:49:15.265486 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:49:15.276743 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:49:15.287962 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:49:15.299273 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:49:15.310594 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:49:15.322064 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:49:15.333654 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:49:15.345059 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:49:15.461628 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:49:15.575886 tst switch_tch_pdch.py:51: start network... 20:49:15.770061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:49:16.213060 run create_hlr_db(pid=12864): Launched 20:49:16.343854 bus /gobi_6: Setting Powered False 20:49:17.405506 run create_hlr_db(pid=12864): Terminated: ok {rc=0} 20:49:17.798642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12866): Launched 20:49:18.089866 run osmo-hlr_10.42.42.2(pid=12867): Launched 20:49:18.200880 run osmo-stp_10.42.42.5: Starting osmo-stp 20:49:18.688237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12869): Launched 20:49:18.979073 run osmo-stp_10.42.42.5(pid=12870): Launched 20:49:19.089076 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:49:19.564847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12872): Launched 20:49:19.676793 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:49:19.922347 run patchelf(pid=12873): Launched 20:49:20.084551 run osmo-stp_10.42.42.5(pid=12870): ERR: Terminated: ERROR {rc=1} [trial-2349↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12870)] 20:49:20.208825 run osmo-stp_10.42.42.5(pid=12870): stdout: | (launched: 2022-12-08_20:49:18.926032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:20.335131 run osmo-stp_10.42.42.5(pid=12870): stderr: | [0;m[38;5;43m20221208204919092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204919093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204919093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204919093 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204919094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204919094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204919094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:20.460752 run osmo-stp_10.42.42.5(pid=12870): stdout: | (launched: 2022-12-08_20:49:18.926032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:20.580045 run osmo-stp_10.42.42.5(pid=12870): stderr: | [0;m[38;5;43m20221208204919092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204919093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204919093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204919093 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204919094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204919094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204919094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:20.721398 run patchelf(pid=12873): Terminating (SIGINT) 20:49:20.885194 run patchelf(pid=12873): Terminated: ok {rc=0} 20:49:21.003003 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12870): Process ended prematurely: osmo-stp_10.42.42.5(pid=12870) [trial-2349↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12870)] [trial-2349↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 20:49:21.011796 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 20:49:21.038469 run osmo-hlr_10.42.42.2(pid=12867): ERR: Terminated: ERROR {rc=237} [trial-2349↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12867)] 20:49:21.086773 run osmo-hlr_10.42.42.2(pid=12867): stdout: | (launched: 2022-12-08_20:49:18.036746) 20:49:21.136186 run osmo-hlr_10.42.42.2(pid=12867): stderr: | [0;m[1;31m20221208204918212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204918212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204918212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204918212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204918212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204918212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204918224 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204918232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204918233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204918233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:49:21.186578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12866): Terminating (SIGTERM) 20:49:21.226679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12869): Terminating (SIGTERM) 20:49:21.266605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12872): Terminating (SIGTERM) 20:49:21.306693 --- ParallelTerminationStrategy: PID 12866 died... 20:49:21.325716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12866): Terminated: ok {rc=0} 20:49:21.369947 --- ParallelTerminationStrategy: PID 12869 died... 20:49:21.388411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12869): Terminated: ok {rc=0} 20:49:21.432566 --- ParallelTerminationStrategy: PID 12872 died... 20:49:21.451252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12872): Terminated: ok {rc=0} 20:49:21.535462 bus /gobi_0: Setting Powered False 20:49:22.634179 bus /gobi_0: Setting Powered False 20:49:23.751258 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 nitb_sms:trx-lms --------------------------------------------------------------------- 20:49:25.001888 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:49:25.006418 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 20:49:25.040607 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 20:49:25.047577 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 20:49:25.099784 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 20:49:25.133567 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 20:49:25.140424 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 20:49:25.679833 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 20:49:25.684862 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 20:49:25.696284 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 20:49:25.745451 tst mo_mt_sms.py: using LAC 16719 20:49:25.869115 tst mo_mt_sms.py: using RAC 144 20:49:25.990829 tst mo_mt_sms.py: using CellId 16719 20:49:26.113412 tst mo_mt_sms.py: using BVCI 16720 20:49:26.228023 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 20:49:26.344287 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 20:49:26.461136 tst mo_mt_sms.py:9: start nitb and bts... 20:49:26.672723 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:49:27.308889 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12878): Launched 20:49:27.621041 run osmo-nitb_10.42.42.2(pid=12879): Launched 20:49:27.793686 run osmo-nitb_10.42.42.2(pid=12879): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12879)] 20:49:27.934128 run osmo-nitb_10.42.42.2(pid=12879): stdout: | (launched: 2022-12-08_20:49:27.564241) 20:49:28.076645 run osmo-nitb_10.42.42.2(pid=12879): stderr: | (launched: 2022-12-08_20:49:27.610746) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:49:28.219366 run osmo-nitb_10.42.42.2(pid=12879): stdout: | (launched: 2022-12-08_20:49:27.564241) 20:49:28.356075 run osmo-nitb_10.42.42.2(pid=12879): stderr: | (launched: 2022-12-08_20:49:27.610746) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8fda692268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12879): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12879) [trial-2349↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12879)] 20:49:28.738353 tst osmo-nitb_10.42.42.2(pid=12879): stdout: | (launched: 2022-12-08_20:49:27.564241) 20:49:28.864759 tst osmo-nitb_10.42.42.2(pid=12879): stderr: | (launched: 2022-12-08_20:49:27.610746) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:49:29.013455 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=12879): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12879) [trial-2349↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12879)] [trial-2349↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 20:49:29.022511 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 20:49:29.029742 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12878): Terminating (SIGTERM) 20:49:29.240038 --- ParallelTerminationStrategy: PID 12878 died... 20:49:29.261582 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12878): Terminated: ok {rc=0} 20:49:29.348303 bus /sierra_3: Setting Powered False 20:49:30.446092 bus /sierra_3: Setting Powered False 20:49:31.560379 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 sms:trx-lms --------------------------------------------------------------------- 20:49:32.758338 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:49:32.762612 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 20:49:32.796401 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 20:49:32.823702 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 20:49:32.877686 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 20:49:32.912065 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 20:49:32.939190 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 20:49:33.485630 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 20:49:33.490686 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 20:49:33.501633 tst sms:trx-lms: Using 1 x bts (candidates: 1) 20:49:33.549463 tst mo_mt_sms.py: using LAC 16720 20:49:33.673083 tst mo_mt_sms.py: using RAC 145 20:49:33.794617 tst mo_mt_sms.py: using CellId 16720 20:49:33.917066 tst mo_mt_sms.py: using BVCI 16721 20:49:34.026113 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 20:49:34.036668 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 20:49:34.047648 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 20:49:34.058901 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 20:49:34.072816 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 20:49:34.084623 tst sms:trx-lms: Using 1 x modem (candidates: 2) 20:49:34.200672 tst sms:trx-lms: Using 1 x modem (candidates: 2) 20:49:34.321529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:49:34.805959 run create_hlr_db(pid=12884): Launched 20:49:34.932166 bus /sierra_2: Setting Powered False 20:49:35.994713 run create_hlr_db(pid=12884): Terminated: ok {rc=0} 20:49:36.413299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12886): Launched 20:49:36.705120 run osmo-hlr_10.42.42.2(pid=12887): Launched 20:49:36.816520 run osmo-stp_10.42.42.5: Starting osmo-stp 20:49:37.317536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12889): Launched 20:49:37.608663 run osmo-stp_10.42.42.5(pid=12890): Launched 20:49:37.719392 run osmo-msc_10.42.42.6: Starting osmo-msc 20:49:38.246202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12892): Launched 20:49:38.538355 run osmo-msc_10.42.42.6(pid=12893): Launched 20:49:38.703033 run osmo-stp_10.42.42.5(pid=12890): ERR: Terminated: ERROR {rc=1} [trial-2349↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12890)] 20:49:38.827632 run osmo-stp_10.42.42.5(pid=12890): stdout: | (launched: 2022-12-08_20:49:37.555513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:38.952152 run osmo-stp_10.42.42.5(pid=12890): stderr: | [0;m[38;5;43m20221208204937725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204937726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204937726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204937726 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204937727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204937727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204937727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:39.074217 run osmo-stp_10.42.42.5(pid=12890): stdout: | (launched: 2022-12-08_20:49:37.555513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:39.190891 run osmo-stp_10.42.42.5(pid=12890): stderr: | [0;m[38;5;43m20221208204937725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204937726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204937726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204937726 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204937727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204937727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204937727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:39.329957 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=12890): Process ended prematurely: osmo-stp_10.42.42.5(pid=12890) [trial-2349↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12890)] [trial-2349↪sms:trx-lms↪mo_mt_sms.py:16] 20:49:39.338322 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 20:49:39.364374 run osmo-hlr_10.42.42.2(pid=12887): ERR: Terminated: ERROR {rc=237} [trial-2349↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12887)] 20:49:39.412288 run osmo-hlr_10.42.42.2(pid=12887): stdout: | (launched: 2022-12-08_20:49:36.652086) 20:49:39.462092 run osmo-hlr_10.42.42.2(pid=12887): stderr: | [0;m[1;31m20221208204936827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204936827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204936827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204936827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204936827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204936827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204936839 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204936847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204936847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204936847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:49:39.530483 run osmo-msc_10.42.42.6(pid=12893): ERR: Terminated: ERROR {rc=2} [trial-2349↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12893)] 20:49:39.578129 run osmo-msc_10.42.42.6(pid=12893): stdout: | (launched: 2022-12-08_20:49:38.484810) 20:49:39.627265 run osmo-msc_10.42.42.6(pid=12893): stderr: | [0;m[38;5;43m20221208204938753 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204938753 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f14e15b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204938753 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204938754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204938755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204938755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204938756 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204938757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204938757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204938757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:49:39.677114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12886): Terminating (SIGTERM) 20:49:39.717318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12889): Terminating (SIGTERM) 20:49:39.757285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12892): Terminating (SIGTERM) 20:49:39.797769 --- ParallelTerminationStrategy: PID 12886 died... 20:49:39.816642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12886): Terminated: ok {rc=0} 20:49:39.861204 --- ParallelTerminationStrategy: PID 12889 died... 20:49:39.879854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12889): Terminated: ok {rc=0} 20:49:39.923912 --- ParallelTerminationStrategy: PID 12892 died... 20:49:39.943143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12892): Terminated: ok {rc=0} 20:49:40.027437 bus /sierra_3: Setting Powered False 20:49:41.126780 bus /sierra_3: Setting Powered False 20:49:42.241702 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 nitb_ussd:trx-lms --------------------------------------------------------------------- 20:49:43.467613 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:49:43.473147 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 20:49:43.508085 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 20:49:43.515028 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 20:49:43.552278 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 20:49:43.585305 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 20:49:43.591958 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 20:49:44.115001 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2349 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 20:49:44.121063 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 20:49:44.133818 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 20:49:44.182212 tst assert_extension.py: using LAC 16721 20:49:44.306979 tst assert_extension.py: using RAC 146 20:49:44.428556 tst assert_extension.py: using CellId 16721 20:49:44.550541 tst assert_extension.py: using BVCI 16722 20:49:44.664042 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 20:49:44.776503 tst assert_extension.py:10: start nitb and bts... 20:49:44.971984 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:49:45.567792 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12900): Launched 20:49:45.870759 run osmo-nitb_10.42.42.2(pid=12901): Launched 20:49:46.078930 run osmo-nitb_10.42.42.2(pid=12901): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12901)] 20:49:46.214448 run osmo-nitb_10.42.42.2(pid=12901): stdout: | (launched: 2022-12-08_20:49:45.805905) 20:49:46.351499 run osmo-nitb_10.42.42.2(pid=12901): stderr: | (launched: 2022-12-08_20:49:45.854200) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:49:46.488900 run osmo-nitb_10.42.42.2(pid=12901): stdout: | (launched: 2022-12-08_20:49:45.805905) 20:49:46.619397 run osmo-nitb_10.42.42.2(pid=12901): stderr: | (launched: 2022-12-08_20:49:45.854200) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8fda692268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12901): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12901) [trial-2349↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12901)] 20:49:47.025857 tst osmo-nitb_10.42.42.2(pid=12901): stdout: | (launched: 2022-12-08_20:49:45.805905) 20:49:47.182821 tst osmo-nitb_10.42.42.2(pid=12901): stderr: | (launched: 2022-12-08_20:49:45.854200) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:49:47.336590 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=12901): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12901) [trial-2349↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12901)] [trial-2349↪nitb_ussd:trx-lms↪assert_extension.py:12] 20:49:47.346199 tst assert_extension.py:12: Test FAILED (3.2 sec) 20:49:47.353667 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12900): Terminating (SIGTERM) 20:49:47.565021 --- ParallelTerminationStrategy: PID 12900 died... 20:49:47.587661 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12900): Terminated: ok {rc=0} 20:49:47.674965 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 ussd:trx-lms --------------------------------------------------------------------- 20:49:48.852021 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:49:48.855998 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 20:49:48.889419 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 20:49:48.916088 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 20:49:48.950798 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 20:49:48.983555 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 20:49:49.009851 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 20:49:49.537143 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2349 ussd:trx-lms assert_extension.py ---------------------------------------------- 20:49:49.542345 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 20:49:49.552852 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 20:49:49.601093 tst assert_extension.py: using LAC 16722 20:49:49.714816 tst assert_extension.py: using RAC 147 20:49:49.830145 tst assert_extension.py: using CellId 16722 20:49:49.944082 tst assert_extension.py: using BVCI 16723 20:49:50.048627 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 20:49:50.059252 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 20:49:50.069846 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 20:49:50.080618 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 20:49:50.091695 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 20:49:50.102613 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 20:49:50.214150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:49:50.664441 run create_hlr_db(pid=12905): Launched 20:49:50.776125 bus /sierra_2: Setting Powered False 20:49:51.834189 run create_hlr_db(pid=12905): Terminated: ok {rc=0} 20:49:52.264346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12907): Launched 20:49:52.577725 run osmo-hlr_10.42.42.2(pid=12908): Launched 20:49:52.697545 run osmo-stp_10.42.42.5: Starting osmo-stp 20:49:53.237805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12910): Launched 20:49:53.550039 run osmo-stp_10.42.42.5(pid=12911): Launched 20:49:53.669343 run osmo-msc_10.42.42.6: Starting osmo-msc 20:49:54.234188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12913): Launched 20:49:54.546462 run osmo-msc_10.42.42.6(pid=12914): Launched 20:49:54.720886 run osmo-stp_10.42.42.5(pid=12911): ERR: Terminated: ERROR {rc=1} [trial-2349↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12911)] 20:49:54.853126 run osmo-stp_10.42.42.5(pid=12911): stdout: | (launched: 2022-12-08_20:49:53.493099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:54.985898 run osmo-stp_10.42.42.5(pid=12911): stderr: | [0;m[38;5;43m20221208204953683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204953683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204953683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204953684 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204953684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204953684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204953684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:55.118341 run osmo-stp_10.42.42.5(pid=12911): stdout: | (launched: 2022-12-08_20:49:53.493099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:55.243445 run osmo-stp_10.42.42.5(pid=12911): stderr: | [0;m[38;5;43m20221208204953683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208204953683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208204953683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208204953684 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208204953684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208204953684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208204953684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:55.393088 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=12911): Process ended prematurely: osmo-stp_10.42.42.5(pid=12911) [trial-2349↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12911)] [trial-2349↪ussd:trx-lms↪assert_extension.py:17] 20:49:55.402095 tst assert_extension.py:17: Test FAILED (5.9 sec) 20:49:55.429271 run osmo-hlr_10.42.42.2(pid=12908): ERR: Terminated: ERROR {rc=237} [trial-2349↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12908)] 20:49:55.479503 run osmo-hlr_10.42.42.2(pid=12908): stdout: | (launched: 2022-12-08_20:49:52.520017) 20:49:55.531147 run osmo-hlr_10.42.42.2(pid=12908): stderr: | [0;m[1;31m20221208204952717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208204952717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208204952717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208204952717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208204952717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208204952717 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208204952730 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208204952738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208204952738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208204952738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:49:55.602914 run osmo-msc_10.42.42.6(pid=12914): ERR: Terminated: ERROR {rc=2} [trial-2349↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12914)] 20:49:55.652448 run osmo-msc_10.42.42.6(pid=12914): stdout: | (launched: 2022-12-08_20:49:54.489347) 20:49:55.703592 run osmo-msc_10.42.42.6(pid=12914): stderr: | [0;m[38;5;43m20221208204954810 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208204954810 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f06a6877c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208204954810 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208204954810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208204954810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208204954811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208204954812 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208204954813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208204954813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208204954813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:49:55.755286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12907): Terminating (SIGTERM) 20:49:55.796659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12910): Terminating (SIGTERM) 20:49:55.838051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12913): Terminating (SIGTERM) 20:49:55.879637 --- ParallelTerminationStrategy: PID 12907 died... 20:49:55.899663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12907): Terminated: ok {rc=0} 20:49:55.945939 --- ParallelTerminationStrategy: PID 12910 died... 20:49:55.965636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12910): Terminated: ok {rc=0} 20:49:56.011757 --- ParallelTerminationStrategy: PID 12913 died... 20:49:56.031383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12913): Terminated: ok {rc=0} 20:49:56.119184 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 20:49:57.334293 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:49:57.342028 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 20:49:57.377477 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 20:49:57.403652 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 20:49:57.456812 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 20:49:57.491363 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 20:49:57.518645 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 20:49:58.066054 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 20:49:58.119761 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:49:58.131411 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:49:58.205491 tst mo_mt_call.py: using LAC 16723 20:49:58.330755 tst mo_mt_call.py: using RAC 148 20:49:58.457531 tst mo_mt_call.py: using CellId 16723 20:49:58.583678 tst mo_mt_call.py: using BVCI 16724 20:49:58.692510 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:49:58.703492 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:49:58.714559 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:49:58.725613 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:49:58.736762 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:49:58.747990 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:49:58.864262 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:49:58.987426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:49:59.482532 run create_hlr_db(pid=12919): Launched 20:49:59.611850 bus /sierra_2: Setting Powered False 20:50:00.675631 run create_hlr_db(pid=12919): Terminated: ok {rc=0} 20:50:01.145419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12921): Launched 20:50:01.467613 run osmo-hlr_10.42.42.2(pid=12922): Launched 20:50:01.609803 run osmo-stp_10.42.42.5: Starting osmo-stp 20:50:02.320398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12927): Launched 20:50:02.630139 run osmo-stp_10.42.42.5(pid=12928): Launched 20:50:02.744757 run osmo-msc_10.42.42.6: Starting osmo-msc 20:50:03.280530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12930): Launched 20:50:03.576899 run osmo-msc_10.42.42.6(pid=12931): Launched 20:50:03.742953 run osmo-stp_10.42.42.5(pid=12928): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12928)] 20:50:03.869210 run osmo-stp_10.42.42.5(pid=12928): stdout: | (launched: 2022-12-08_20:50:02.574808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:03.995520 run osmo-stp_10.42.42.5(pid=12928): stderr: | [0;m[38;5;43m20221208205002741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205002741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205002742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205002742 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205002742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205002743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205002743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:04.119446 run osmo-stp_10.42.42.5(pid=12928): stdout: | (launched: 2022-12-08_20:50:02.574808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:04.237183 run osmo-stp_10.42.42.5(pid=12928): stderr: | [0;m[38;5;43m20221208205002741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205002741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205002742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205002742 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205002742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205002743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205002743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:04.378202 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12928): Process ended prematurely: osmo-stp_10.42.42.5(pid=12928) [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12928)] [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 20:50:04.387066 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:50:04.413504 run osmo-hlr_10.42.42.2(pid=12922): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12922)] 20:50:04.461383 run osmo-hlr_10.42.42.2(pid=12922): stdout: | (launched: 2022-12-08_20:50:01.408338) 20:50:04.510492 run osmo-hlr_10.42.42.2(pid=12922): stderr: | [0;m[1;31m20221208205001754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205001754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205001754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205001754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205001755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205001755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205001772 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205001786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205001786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205001786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:50:04.578949 run osmo-msc_10.42.42.6(pid=12931): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12931)] 20:50:04.626674 run osmo-msc_10.42.42.6(pid=12931): stdout: | (launched: 2022-12-08_20:50:03.522750) 20:50:04.675955 run osmo-msc_10.42.42.6(pid=12931): stderr: | [0;m[38;5;43m20221208205003793 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205003793 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f86212cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205003793 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205003793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205003794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205003794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205003795 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205003796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205003796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205003796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:50:04.725721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12921): Terminating (SIGTERM) 20:50:04.765275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12927): Terminating (SIGTERM) 20:50:04.804822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12930): Terminating (SIGTERM) 20:50:04.844269 --- ParallelTerminationStrategy: PID 12921 died... 20:50:04.863265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12921): Terminated: ok {rc=0} 20:50:04.907368 --- ParallelTerminationStrategy: PID 12927 died... 20:50:04.925771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12927): Terminated: ok {rc=0} 20:50:04.969147 --- ParallelTerminationStrategy: PID 12930 died... 20:50:04.987554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12930): Terminated: ok {rc=0} 20:50:05.072367 bus /sierra_3: Setting Powered False 20:50:06.171278 bus /sierra_3: Setting Powered False 20:50:07.285198 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 20:50:08.435855 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:50:08.448098 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:50:08.520123 tst mo_mt_call_osmux.py: using LAC 16724 20:50:08.647549 tst mo_mt_call_osmux.py: using RAC 149 20:50:08.773656 tst mo_mt_call_osmux.py: using CellId 16724 20:50:08.899452 tst mo_mt_call_osmux.py: using BVCI 16725 20:50:09.015382 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:50:09.027072 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:50:09.038375 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:50:09.049818 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:50:09.061503 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:50:09.072851 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:50:09.193065 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:50:09.315991 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:50:09.809509 run create_hlr_db(pid=12933): Launched 20:50:09.938621 bus /sierra_2: Setting Powered False 20:50:11.001232 run create_hlr_db(pid=12933): Terminated: ok {rc=0} 20:50:11.426019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12935): Launched 20:50:11.722830 run osmo-hlr_10.42.42.2(pid=12936): Launched 20:50:11.835204 run osmo-stp_10.42.42.5: Starting osmo-stp 20:50:12.350562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12938): Launched 20:50:12.648158 run osmo-stp_10.42.42.5(pid=12939): Launched 20:50:12.762167 run osmo-msc_10.42.42.6: Starting osmo-msc 20:50:13.299723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12941): Launched 20:50:13.597020 run osmo-msc_10.42.42.6(pid=12942): Launched 20:50:13.763575 run osmo-stp_10.42.42.5(pid=12939): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12939)] 20:50:13.890083 run osmo-stp_10.42.42.5(pid=12939): stdout: | (launched: 2022-12-08_20:50:12.594014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:14.017196 run osmo-stp_10.42.42.5(pid=12939): stderr: | [0;m[38;5;43m20221208205012762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205012762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205012762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205012763 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205012763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205012763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205012763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:14.141928 run osmo-stp_10.42.42.5(pid=12939): stdout: | (launched: 2022-12-08_20:50:12.594014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:14.260184 run osmo-stp_10.42.42.5(pid=12939): stderr: | [0;m[38;5;43m20221208205012762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205012762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205012762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205012763 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205012763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205012763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205012763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:14.401787 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12939): Process ended prematurely: osmo-stp_10.42.42.5(pid=12939) [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12939)] [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 20:50:14.410618 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 20:50:14.437520 run osmo-hlr_10.42.42.2(pid=12936): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12936)] 20:50:14.485339 run osmo-hlr_10.42.42.2(pid=12936): stdout: | (launched: 2022-12-08_20:50:11.668429) 20:50:14.534564 run osmo-hlr_10.42.42.2(pid=12936): stderr: | [0;m[1;31m20221208205011845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205011845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205011845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205011845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205011845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205011845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205011858 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205011866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205011866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205011866 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:50:14.603480 run osmo-msc_10.42.42.6(pid=12942): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12942)] 20:50:14.651701 run osmo-msc_10.42.42.6(pid=12942): stdout: | (launched: 2022-12-08_20:50:13.542212) 20:50:14.701205 run osmo-msc_10.42.42.6(pid=12942): stderr: | [0;m[38;5;43m20221208205013812 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205013812 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa9cedcdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205013812 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205013812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205013812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205013812 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205013814 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205013815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205013815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205013815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:50:14.751056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12935): Terminating (SIGTERM) 20:50:14.790785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12938): Terminating (SIGTERM) 20:50:14.830643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12941): Terminating (SIGTERM) 20:50:14.870702 --- ParallelTerminationStrategy: PID 12935 died... 20:50:14.889684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12935): Terminated: ok {rc=0} 20:50:14.933819 --- ParallelTerminationStrategy: PID 12938 died... 20:50:14.952204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12938): Terminated: ok {rc=0} 20:50:14.996750 --- ParallelTerminationStrategy: PID 12941 died... 20:50:15.015260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12941): Terminated: ok {rc=0} 20:50:15.098541 bus /sierra_3: Setting Powered False 20:50:16.206601 bus /sierra_3: Setting Powered False 20:50:17.331395 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 20:50:18.580596 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:50:18.587716 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 20:50:18.621634 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 20:50:18.648835 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 20:50:18.701095 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 20:50:18.734879 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 20:50:18.762180 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 20:50:19.315776 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 20:50:19.366837 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:19.378221 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:50:19.449288 tst mo_mt_call.py: using LAC 16725 20:50:19.573395 tst mo_mt_call.py: using RAC 150 20:50:19.697887 tst mo_mt_call.py: using CellId 16725 20:50:19.823467 tst mo_mt_call.py: using BVCI 16726 20:50:19.933498 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:19.944515 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:19.955395 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:19.966816 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:19.977983 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:19.989166 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:50:20.108271 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:50:20.227926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:50:20.721131 run create_hlr_db(pid=12947): Launched 20:50:20.842545 bus /sierra_2: Setting Powered False 20:50:21.905929 run create_hlr_db(pid=12947): Terminated: ok {rc=0} 20:50:22.350148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12949): Launched 20:50:22.668847 run osmo-hlr_10.42.42.2(pid=12950): Launched 20:50:22.790225 run osmo-stp_10.42.42.5: Starting osmo-stp 20:50:23.306098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12952): Launched 20:50:23.603284 run osmo-stp_10.42.42.5(pid=12953): Launched 20:50:23.716557 run osmo-msc_10.42.42.6: Starting osmo-msc 20:50:24.251005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12955): Launched 20:50:24.547124 run osmo-msc_10.42.42.6(pid=12956): Launched 20:50:24.713140 run osmo-stp_10.42.42.5(pid=12953): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12953)] 20:50:24.839471 run osmo-stp_10.42.42.5(pid=12953): stdout: | (launched: 2022-12-08_20:50:23.548639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:24.966205 run osmo-stp_10.42.42.5(pid=12953): stderr: | [0;m[38;5;43m20221208205023718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205023718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205023719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205023719 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205023720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205023720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205023720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:25.091133 run osmo-stp_10.42.42.5(pid=12953): stdout: | (launched: 2022-12-08_20:50:23.548639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:25.208906 run osmo-stp_10.42.42.5(pid=12953): stderr: | [0;m[38;5;43m20221208205023718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205023718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205023719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205023719 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205023720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205023720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205023720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:25.349724 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12953): Process ended prematurely: osmo-stp_10.42.42.5(pid=12953) [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12953)] [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 20:50:25.358451 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 20:50:25.384833 run osmo-hlr_10.42.42.2(pid=12950): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12950)] 20:50:25.432505 run osmo-hlr_10.42.42.2(pid=12950): stdout: | (launched: 2022-12-08_20:50:22.610720) 20:50:25.481732 run osmo-hlr_10.42.42.2(pid=12950): stderr: | [0;m[1;31m20221208205022807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205022807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205022807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205022807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205022807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205022807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205022823 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205022833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205022833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205022833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:50:25.550207 run osmo-msc_10.42.42.6(pid=12956): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12956)] 20:50:25.597619 run osmo-msc_10.42.42.6(pid=12956): stdout: | (launched: 2022-12-08_20:50:24.492760) 20:50:25.646677 run osmo-msc_10.42.42.6(pid=12956): stderr: | [0;m[38;5;43m20221208205024765 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205024765 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f838a563c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205024765 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205024765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205024766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205024766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205024768 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205024768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205024768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205024768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:50:25.696256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12949): Terminating (SIGTERM) 20:50:25.735840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12952): Terminating (SIGTERM) 20:50:25.775284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12955): Terminating (SIGTERM) 20:50:25.815173 --- ParallelTerminationStrategy: PID 12949 died... 20:50:25.834088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12949): Terminated: ok {rc=0} 20:50:25.878016 --- ParallelTerminationStrategy: PID 12952 died... 20:50:25.896221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12952): Terminated: ok {rc=0} 20:50:25.940040 --- ParallelTerminationStrategy: PID 12955 died... 20:50:25.958454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12955): Terminated: ok {rc=0} 20:50:26.040881 bus /sierra_3: Setting Powered False 20:50:27.137570 bus /sierra_3: Setting Powered False 20:50:28.252844 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 20:50:29.399688 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:29.411781 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:50:29.482595 tst mo_mt_call_osmux.py: using LAC 16726 20:50:29.608468 tst mo_mt_call_osmux.py: using RAC 151 20:50:29.734225 tst mo_mt_call_osmux.py: using CellId 16726 20:50:29.858667 tst mo_mt_call_osmux.py: using BVCI 16727 20:50:29.975327 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:29.986838 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:29.998172 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:30.009539 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:30.020830 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:30.032132 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:50:30.153338 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:50:30.272885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:50:30.764709 run create_hlr_db(pid=12958): Launched 20:50:30.921248 bus /sierra_2: Setting Powered False 20:50:31.979866 run create_hlr_db(pid=12958): Terminated: ok {rc=0} 20:50:32.427636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12960): Launched 20:50:32.724136 run osmo-hlr_10.42.42.2(pid=12961): Launched 20:50:32.837151 run osmo-stp_10.42.42.5: Starting osmo-stp 20:50:33.361343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12963): Launched 20:50:33.681055 run osmo-stp_10.42.42.5(pid=12964): Launched 20:50:33.801461 run osmo-msc_10.42.42.6: Starting osmo-msc 20:50:34.376330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12966): Launched 20:50:34.694824 run osmo-msc_10.42.42.6(pid=12967): Launched 20:50:34.871788 run osmo-stp_10.42.42.5(pid=12964): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12964)] 20:50:35.006321 run osmo-stp_10.42.42.5(pid=12964): stdout: | (launched: 2022-12-08_20:50:33.623218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:35.141392 run osmo-stp_10.42.42.5(pid=12964): stderr: | [0;m[38;5;43m20221208205033813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205033814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205033814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205033814 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205033815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205033815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205033815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:35.276336 run osmo-stp_10.42.42.5(pid=12964): stdout: | (launched: 2022-12-08_20:50:33.623218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:35.402864 run osmo-stp_10.42.42.5(pid=12964): stderr: | [0;m[38;5;43m20221208205033813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205033814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205033814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205033814 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205033815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205033815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205033815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:35.553738 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12964): Process ended prematurely: osmo-stp_10.42.42.5(pid=12964) [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12964)] [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 20:50:35.563345 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 20:50:35.591106 run osmo-hlr_10.42.42.2(pid=12961): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12961)] 20:50:35.641353 run osmo-hlr_10.42.42.2(pid=12961): stdout: | (launched: 2022-12-08_20:50:32.669810) 20:50:35.692825 run osmo-hlr_10.42.42.2(pid=12961): stderr: | [0;m[1;31m20221208205032847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205032847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205032847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205032847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205032847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205032847 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205032860 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205032870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205032870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205032870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:50:35.764788 run osmo-msc_10.42.42.6(pid=12967): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12967)] 20:50:35.814637 run osmo-msc_10.42.42.6(pid=12967): stdout: | (launched: 2022-12-08_20:50:34.636365) 20:50:35.865829 run osmo-msc_10.42.42.6(pid=12967): stderr: | [0;m[38;5;43m20221208205034957 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205034957 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe1e2593c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205034957 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205034957 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205034958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205034958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205034959 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205034960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205034960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205034960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:50:35.917524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12960): Terminating (SIGTERM) 20:50:35.958909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12963): Terminating (SIGTERM) 20:50:36.000518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12966): Terminating (SIGTERM) 20:50:36.042571 --- ParallelTerminationStrategy: PID 12960 died... 20:50:36.062339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12960): Terminated: ok {rc=0} 20:50:36.108429 --- ParallelTerminationStrategy: PID 12963 died... 20:50:36.128143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12963): Terminated: ok {rc=0} 20:50:36.174047 --- ParallelTerminationStrategy: PID 12966 died... 20:50:36.193512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12966): Terminated: ok {rc=0} 20:50:36.281192 bus /sierra_3: Setting Powered False 20:50:37.379406 bus /sierra_3: Setting Powered False 20:50:38.495660 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 20:50:39.742998 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:50:39.749429 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 20:50:39.782795 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 20:50:39.809367 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 20:50:39.864347 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 20:50:39.899061 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 20:50:39.925559 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 20:50:40.470973 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 20:50:40.518301 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:50:40.529311 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:50:40.596146 tst mo_mt_call.py: using LAC 16727 20:50:40.710791 tst mo_mt_call.py: using RAC 152 20:50:40.825657 tst mo_mt_call.py: using CellId 16727 20:50:40.942829 tst mo_mt_call.py: using BVCI 16728 20:50:41.058776 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:50:41.070358 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:50:41.081837 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:50:41.093501 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:50:41.105259 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:50:41.116859 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:50:41.234494 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:50:41.355990 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:50:41.854557 run create_hlr_db(pid=12972): Launched 20:50:41.984297 bus /sierra_2: Setting Powered False 20:50:43.047819 run create_hlr_db(pid=12972): Terminated: ok {rc=0} 20:50:43.494828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12974): Launched 20:50:43.814694 run osmo-hlr_10.42.42.2(pid=12975): Launched 20:50:43.936107 run osmo-stp_10.42.42.5: Starting osmo-stp 20:50:44.489850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12977): Launched 20:50:44.808219 run osmo-stp_10.42.42.5(pid=12978): Launched 20:50:44.930116 run osmo-msc_10.42.42.6: Starting osmo-msc 20:50:45.506677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12980): Launched 20:50:45.824815 run osmo-msc_10.42.42.6(pid=12981): Launched 20:50:46.268698 run osmo-stp_10.42.42.5(pid=12978): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12978)] 20:50:46.612721 run osmo-stp_10.42.42.5(pid=12978): stdout: | (launched: 2022-12-08_20:50:44.750061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:46.741861 run osmo-stp_10.42.42.5(pid=12978): stderr: | [0;m[38;5;43m20221208205044942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205044942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205044942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205044943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205044943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205044943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205044943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:46.872425 run osmo-stp_10.42.42.5(pid=12978): stdout: | (launched: 2022-12-08_20:50:44.750061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:46.993749 run osmo-stp_10.42.42.5(pid=12978): stderr: | [0;m[38;5;43m20221208205044942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205044942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205044942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205044943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205044943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205044943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205044943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:47.140720 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12978): Process ended prematurely: osmo-stp_10.42.42.5(pid=12978) [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12978)] [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 20:50:47.150678 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 20:50:47.178870 run osmo-hlr_10.42.42.2(pid=12975): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12975)] 20:50:47.228420 run osmo-hlr_10.42.42.2(pid=12975): stdout: | (launched: 2022-12-08_20:50:43.756653) 20:50:47.281725 run osmo-hlr_10.42.42.2(pid=12975): stderr: | [0;m[1;31m20221208205043952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205043953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205043953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205043953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205043953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205043953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205043965 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205043973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205043973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205043973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:50:47.353589 run osmo-msc_10.42.42.6(pid=12981): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12981)] 20:50:47.403213 run osmo-msc_10.42.42.6(pid=12981): stdout: | (launched: 2022-12-08_20:50:45.766933) 20:50:47.454078 run osmo-msc_10.42.42.6(pid=12981): stderr: | [0;m[38;5;43m20221208205046233 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205046233 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f87ade6dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205046233 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205046233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205046233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205046235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205046242 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205046243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205046243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205046244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:50:47.504140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12974): Terminating (SIGTERM) 20:50:47.544451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12977): Terminating (SIGTERM) 20:50:47.584578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12980): Terminating (SIGTERM) 20:50:47.624710 --- ParallelTerminationStrategy: PID 12974 died... 20:50:47.643955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12974): Terminated: ok {rc=0} 20:50:47.688576 --- ParallelTerminationStrategy: PID 12977 died... 20:50:47.707134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12977): Terminated: ok {rc=0} 20:50:47.751231 --- ParallelTerminationStrategy: PID 12980 died... 20:50:47.769757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12980): Terminated: ok {rc=0} 20:50:47.856523 bus /sierra_3: Setting Powered False 20:50:48.955764 bus /sierra_3: Setting Powered False 20:50:50.071451 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 20:50:51.218973 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:50:51.231141 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:50:51.302699 tst mo_mt_call_osmux.py: using LAC 16728 20:50:51.432348 tst mo_mt_call_osmux.py: using RAC 153 20:50:51.557986 tst mo_mt_call_osmux.py: using CellId 16728 20:50:51.674898 tst mo_mt_call_osmux.py: using BVCI 16729 20:50:51.783156 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:50:51.794485 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:50:51.805555 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:50:51.817566 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:50:51.829361 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:50:51.841052 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:50:51.962591 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:50:52.084013 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:50:52.545841 run create_hlr_db(pid=12983): Launched 20:50:52.659569 bus /sierra_2: Setting Powered False 20:50:53.718419 run create_hlr_db(pid=12983): Terminated: ok {rc=0} 20:50:54.133101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12985): Launched 20:50:54.430719 run osmo-hlr_10.42.42.2(pid=12986): Launched 20:50:54.544311 run osmo-stp_10.42.42.5: Starting osmo-stp 20:50:55.068018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12988): Launched 20:50:55.363500 run osmo-stp_10.42.42.5(pid=12989): Launched 20:50:55.476909 run osmo-msc_10.42.42.6: Starting osmo-msc 20:50:56.012313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12991): Launched 20:50:56.310148 run osmo-msc_10.42.42.6(pid=12992): Launched 20:50:56.475635 run osmo-stp_10.42.42.5(pid=12989): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12989)] 20:50:56.601786 run osmo-stp_10.42.42.5(pid=12989): stdout: | (launched: 2022-12-08_20:50:55.309324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:56.728335 run osmo-stp_10.42.42.5(pid=12989): stderr: | [0;m[38;5;43m20221208205055479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205055479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205055479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205055480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205055480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205055480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205055480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:56.852720 run osmo-stp_10.42.42.5(pid=12989): stdout: | (launched: 2022-12-08_20:50:55.309324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:56.970295 run osmo-stp_10.42.42.5(pid=12989): stderr: | [0;m[38;5;43m20221208205055479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205055479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205055479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205055480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205055480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205055480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205055480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:57.112104 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12989): Process ended prematurely: osmo-stp_10.42.42.5(pid=12989) [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12989)] [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 20:50:57.120942 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 20:50:57.147512 run osmo-hlr_10.42.42.2(pid=12986): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12986)] 20:50:57.195238 run osmo-hlr_10.42.42.2(pid=12986): stdout: | (launched: 2022-12-08_20:50:54.376243) 20:50:57.244603 run osmo-hlr_10.42.42.2(pid=12986): stderr: | [0;m[1;31m20221208205054549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205054549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205054549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205054549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205054549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205054549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205054562 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205054570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205054570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205054570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:50:57.313310 run osmo-msc_10.42.42.6(pid=12992): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12992)] 20:50:57.360732 run osmo-msc_10.42.42.6(pid=12992): stdout: | (launched: 2022-12-08_20:50:56.255378) 20:50:57.409784 run osmo-msc_10.42.42.6(pid=12992): stderr: | [0;m[38;5;43m20221208205056525 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205056526 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3130c6cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205056526 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205056526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205056526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205056527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205056528 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205056529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205056529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205056529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:50:57.459175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12985): Terminating (SIGTERM) 20:50:57.498663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12988): Terminating (SIGTERM) 20:50:57.538152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12991): Terminating (SIGTERM) 20:50:57.577771 --- ParallelTerminationStrategy: PID 12985 died... 20:50:57.596486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12985): Terminated: ok {rc=0} 20:50:57.640622 --- ParallelTerminationStrategy: PID 12988 died... 20:50:57.659116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12988): Terminated: ok {rc=0} 20:50:57.703119 --- ParallelTerminationStrategy: PID 12991 died... 20:50:57.721574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12991): Terminated: ok {rc=0} 20:50:57.806928 bus /sierra_3: Setting Powered False 20:50:58.904176 bus /sierra_3: Setting Powered False 20:51:00.015560 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 20:51:01.261530 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:51:01.270806 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 20:51:01.313699 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 20:51:01.348046 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 20:51:01.411909 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 20:51:01.455991 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 20:51:01.486208 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 20:51:02.025744 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 20:51:02.080865 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:02.093437 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:51:02.166177 tst mo_mt_call.py: using LAC 16729 20:51:02.297565 tst mo_mt_call.py: using RAC 154 20:51:02.422326 tst mo_mt_call.py: using CellId 16729 20:51:02.547398 tst mo_mt_call.py: using BVCI 16730 20:51:02.657486 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:02.668678 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:02.679661 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:02.690690 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:02.702067 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:02.713813 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:51:02.833679 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:51:02.953986 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:51:03.413629 run create_hlr_db(pid=12998): Launched 20:51:03.527757 bus /sierra_2: Setting Powered False 20:51:04.587587 run create_hlr_db(pid=12998): Terminated: ok {rc=0} 20:51:05.023267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13000): Launched 20:51:05.325441 run osmo-hlr_10.42.42.2(pid=13001): Launched 20:51:05.438698 run osmo-stp_10.42.42.5: Starting osmo-stp 20:51:05.948655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13003): Launched 20:51:06.247098 run osmo-stp_10.42.42.5(pid=13004): Launched 20:51:06.359950 run osmo-msc_10.42.42.6: Starting osmo-msc 20:51:06.896464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13006): Launched 20:51:07.194109 run osmo-msc_10.42.42.6(pid=13007): Launched 20:51:07.359864 run osmo-stp_10.42.42.5(pid=13004): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13004)] 20:51:07.485925 run osmo-stp_10.42.42.5(pid=13004): stdout: | (launched: 2022-12-08_20:51:06.191704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:07.612918 run osmo-stp_10.42.42.5(pid=13004): stderr: | [0;m[38;5;43m20221208205106361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205106361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205106361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205106362 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205106362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205106362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205106362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:07.737642 run osmo-stp_10.42.42.5(pid=13004): stdout: | (launched: 2022-12-08_20:51:06.191704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:07.856272 run osmo-stp_10.42.42.5(pid=13004): stderr: | [0;m[38;5;43m20221208205106361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205106361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205106361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205106362 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205106362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205106362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205106362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:07.997525 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13004): Process ended prematurely: osmo-stp_10.42.42.5(pid=13004) [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13004)] [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 20:51:08.006266 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 20:51:08.033155 run osmo-hlr_10.42.42.2(pid=13001): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13001)] 20:51:08.080902 run osmo-hlr_10.42.42.2(pid=13001): stdout: | (launched: 2022-12-08_20:51:05.271187) 20:51:08.130534 run osmo-hlr_10.42.42.2(pid=13001): stderr: | [0;m[1;31m20221208205105446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205105446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205105446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205105446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205105446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205105447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205105458 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205105467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205105467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205105467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:51:08.199440 run osmo-msc_10.42.42.6(pid=13007): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13007)] 20:51:08.247473 run osmo-msc_10.42.42.6(pid=13007): stdout: | (launched: 2022-12-08_20:51:07.139624) 20:51:08.297197 run osmo-msc_10.42.42.6(pid=13007): stderr: | [0;m[38;5;43m20221208205107411 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205107411 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9c1ea3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205107411 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205107411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205107411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205107411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205107413 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205107414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205107414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205107414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:51:08.347211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13000): Terminating (SIGTERM) 20:51:08.386718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13003): Terminating (SIGTERM) 20:51:08.426924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13006): Terminating (SIGTERM) 20:51:08.466826 --- ParallelTerminationStrategy: PID 13000 died... 20:51:08.485724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13000): Terminated: ok {rc=0} 20:51:08.530526 --- ParallelTerminationStrategy: PID 13003 died... 20:51:08.548994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13003): Terminated: ok {rc=0} 20:51:08.593042 --- ParallelTerminationStrategy: PID 13006 died... 20:51:08.611486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13006): Terminated: ok {rc=0} 20:51:08.695284 bus /sierra_3: Setting Powered False 20:51:09.793329 bus /sierra_3: Setting Powered False 20:51:10.911258 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 20:51:12.055245 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:12.066867 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:51:12.136578 tst mo_mt_call_osmux.py: using LAC 16730 20:51:12.254735 tst mo_mt_call_osmux.py: using RAC 155 20:51:12.371521 tst mo_mt_call_osmux.py: using CellId 16730 20:51:12.489870 tst mo_mt_call_osmux.py: using BVCI 16731 20:51:12.597006 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:12.608069 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:12.618996 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:12.630061 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:12.641261 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:12.652166 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:51:12.772277 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:51:12.890325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:51:13.351559 run create_hlr_db(pid=13009): Launched 20:51:13.465689 bus /sierra_2: Setting Powered False 20:51:14.525069 run create_hlr_db(pid=13009): Terminated: ok {rc=0} 20:51:14.940003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13011): Launched 20:51:15.239071 run osmo-hlr_10.42.42.2(pid=13012): Launched 20:51:15.352524 run osmo-stp_10.42.42.5: Starting osmo-stp 20:51:15.877443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13014): Launched 20:51:16.215698 run osmo-stp_10.42.42.5(pid=13015): Launched 20:51:16.451726 run osmo-msc_10.42.42.6: Starting osmo-msc 20:51:17.073414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13017): Launched 20:51:17.386584 run osmo-msc_10.42.42.6(pid=13018): Launched 20:51:17.553250 run osmo-stp_10.42.42.5(pid=13015): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13015)] 20:51:17.679493 run osmo-stp_10.42.42.5(pid=13015): stdout: | (launched: 2022-12-08_20:51:16.155736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:17.805842 run osmo-stp_10.42.42.5(pid=13015): stderr: | [0;m[38;5;43m20221208205116432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205116432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205116432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205116432 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205116434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205116434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205116434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:17.929825 run osmo-stp_10.42.42.5(pid=13015): stdout: | (launched: 2022-12-08_20:51:16.155736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:18.047214 run osmo-stp_10.42.42.5(pid=13015): stderr: | [0;m[38;5;43m20221208205116432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205116432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205116432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205116432 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205116434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205116434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205116434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:18.188247 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13015): Process ended prematurely: osmo-stp_10.42.42.5(pid=13015) [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13015)] [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 20:51:18.197329 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 20:51:18.223628 run osmo-hlr_10.42.42.2(pid=13012): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13012)] 20:51:18.271028 run osmo-hlr_10.42.42.2(pid=13012): stdout: | (launched: 2022-12-08_20:51:15.183950) 20:51:18.319929 run osmo-hlr_10.42.42.2(pid=13012): stderr: | [0;m[1;31m20221208205115361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205115361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205115361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205115361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205115361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205115361 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205115373 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205115382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205115382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205115382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:51:18.388054 run osmo-msc_10.42.42.6(pid=13018): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13018)] 20:51:18.435462 run osmo-msc_10.42.42.6(pid=13018): stdout: | (launched: 2022-12-08_20:51:17.332052) 20:51:18.484415 run osmo-msc_10.42.42.6(pid=13018): stderr: | [0;m[38;5;43m20221208205117602 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205117602 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffa2bb3cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205117602 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205117602 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205117602 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205117603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205117604 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205117605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205117605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205117605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:51:18.533979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13011): Terminating (SIGTERM) 20:51:18.573369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13014): Terminating (SIGTERM) 20:51:18.612586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13017): Terminating (SIGTERM) 20:51:18.652135 --- ParallelTerminationStrategy: PID 13011 died... 20:51:18.670896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13011): Terminated: ok {rc=0} 20:51:18.715538 --- ParallelTerminationStrategy: PID 13014 died... 20:51:18.733966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13014): Terminated: ok {rc=0} 20:51:18.777627 --- ParallelTerminationStrategy: PID 13017 died... 20:51:18.795956 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13017): Terminated: ok {rc=0} 20:51:18.882777 bus /sierra_3: Setting Powered False 20:51:19.982757 bus /sierra_3: Setting Powered False 20:51:21.096928 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 20:51:22.342215 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:51:22.348401 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 20:51:22.381504 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 20:51:22.407881 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 20:51:22.461492 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 20:51:22.496084 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 20:51:22.523290 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 20:51:23.070592 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 20:51:23.118536 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:23.129640 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:51:23.198154 tst mo_mt_call.py: using LAC 16731 20:51:23.315150 tst mo_mt_call.py: using RAC 156 20:51:23.432742 tst mo_mt_call.py: using CellId 16731 20:51:23.549379 tst mo_mt_call.py: using BVCI 16732 20:51:23.659145 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:23.670295 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:23.681042 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:23.692010 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:23.703105 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:23.714198 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:51:23.833550 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:51:23.952444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:51:24.449270 run create_hlr_db(pid=13024): Launched 20:51:24.580224 bus /sierra_2: Setting Powered False 20:51:25.644102 run create_hlr_db(pid=13024): Terminated: ok {rc=0} 20:51:26.088834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13026): Launched 20:51:26.407609 run osmo-hlr_10.42.42.2(pid=13027): Launched 20:51:26.528326 run osmo-stp_10.42.42.5: Starting osmo-stp 20:51:27.079186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13029): Launched 20:51:27.399138 run osmo-stp_10.42.42.5(pid=13030): Launched 20:51:27.521703 run osmo-msc_10.42.42.6: Starting osmo-msc 20:51:28.097695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13032): Launched 20:51:28.416758 run osmo-msc_10.42.42.6(pid=13033): Launched 20:51:28.593311 run osmo-stp_10.42.42.5(pid=13030): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13030)] 20:51:28.730104 run osmo-stp_10.42.42.5(pid=13030): stdout: | (launched: 2022-12-08_20:51:27.341068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:28.865179 run osmo-stp_10.42.42.5(pid=13030): stderr: | [0;m[38;5;43m20221208205127532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205127532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205127532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205127533 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205127533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205127533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205127533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:28.998908 run osmo-stp_10.42.42.5(pid=13030): stdout: | (launched: 2022-12-08_20:51:27.341068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:29.125250 run osmo-stp_10.42.42.5(pid=13030): stderr: | [0;m[38;5;43m20221208205127532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205127532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205127532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205127533 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205127533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205127533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205127533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:29.276773 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13030): Process ended prematurely: osmo-stp_10.42.42.5(pid=13030) [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13030)] [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 20:51:29.286332 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:51:29.314294 run osmo-hlr_10.42.42.2(pid=13027): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13027)] 20:51:29.363965 run osmo-hlr_10.42.42.2(pid=13027): stdout: | (launched: 2022-12-08_20:51:26.349768) 20:51:29.414983 run osmo-hlr_10.42.42.2(pid=13027): stderr: | [0;m[1;31m20221208205126546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205126546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205126546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205126546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205126547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205126547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205126559 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205126567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205126567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205126567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:51:29.486204 run osmo-msc_10.42.42.6(pid=13033): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13033)] 20:51:29.535837 run osmo-msc_10.42.42.6(pid=13033): stdout: | (launched: 2022-12-08_20:51:28.358785) 20:51:29.587110 run osmo-msc_10.42.42.6(pid=13033): stderr: | [0;m[38;5;43m20221208205128681 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205128682 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5ce8366c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205128682 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205128682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205128682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205128682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205128684 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205128684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205128684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205128684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:51:29.638559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13026): Terminating (SIGTERM) 20:51:29.679818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13029): Terminating (SIGTERM) 20:51:29.721082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13032): Terminating (SIGTERM) 20:51:29.762704 --- ParallelTerminationStrategy: PID 13026 died... 20:51:29.782421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13026): Terminated: ok {rc=0} 20:51:29.828190 --- ParallelTerminationStrategy: PID 13029 died... 20:51:29.847583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13029): Terminated: ok {rc=0} 20:51:29.893110 --- ParallelTerminationStrategy: PID 13032 died... 20:51:29.912341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13032): Terminated: ok {rc=0} 20:51:29.998011 bus /sierra_3: Setting Powered False 20:51:31.104121 bus /sierra_3: Setting Powered False 20:51:32.238573 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 20:51:33.383448 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:33.394988 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:51:33.463394 tst mo_mt_call_osmux.py: using LAC 16732 20:51:33.594845 tst mo_mt_call_osmux.py: using RAC 157 20:51:33.719344 tst mo_mt_call_osmux.py: using CellId 16732 20:51:33.847210 tst mo_mt_call_osmux.py: using BVCI 16733 20:51:33.962200 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:33.973878 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:33.985070 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:33.996277 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:34.007560 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:34.018814 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:51:34.135458 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:51:34.254462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:51:34.712884 run create_hlr_db(pid=13035): Launched 20:51:34.826509 bus /sierra_2: Setting Powered False 20:51:35.885308 run create_hlr_db(pid=13035): Terminated: ok {rc=0} 20:51:36.298471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13037): Launched 20:51:36.593791 run osmo-hlr_10.42.42.2(pid=13038): Launched 20:51:36.706903 run osmo-stp_10.42.42.5: Starting osmo-stp 20:51:37.231957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13040): Launched 20:51:37.529428 run osmo-stp_10.42.42.5(pid=13041): Launched 20:51:37.642978 run osmo-msc_10.42.42.6: Starting osmo-msc 20:51:38.180789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13043): Launched 20:51:38.477620 run osmo-msc_10.42.42.6(pid=13044): Launched 20:51:38.643325 run osmo-stp_10.42.42.5(pid=13041): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13041)] 20:51:38.770614 run osmo-stp_10.42.42.5(pid=13041): stdout: | (launched: 2022-12-08_20:51:37.475043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:38.896638 run osmo-stp_10.42.42.5(pid=13041): stderr: | [0;m[38;5;43m20221208205137644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205137644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205137644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205137644 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205137645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205137645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205137645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:39.021261 run osmo-stp_10.42.42.5(pid=13041): stdout: | (launched: 2022-12-08_20:51:37.475043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:39.138457 run osmo-stp_10.42.42.5(pid=13041): stderr: | [0;m[38;5;43m20221208205137644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205137644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205137644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205137644 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205137645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205137645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205137645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:39.279490 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13041): Process ended prematurely: osmo-stp_10.42.42.5(pid=13041) [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13041)] [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 20:51:39.288289 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 20:51:39.314491 run osmo-hlr_10.42.42.2(pid=13038): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13038)] 20:51:39.362200 run osmo-hlr_10.42.42.2(pid=13038): stdout: | (launched: 2022-12-08_20:51:36.539375) 20:51:39.411458 run osmo-hlr_10.42.42.2(pid=13038): stderr: | [0;m[1;31m20221208205136712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205136712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205136712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205136712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205136712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205136712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205136725 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205136733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205136734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205136734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:51:39.479996 run osmo-msc_10.42.42.6(pid=13044): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13044)] 20:51:39.527318 run osmo-msc_10.42.42.6(pid=13044): stdout: | (launched: 2022-12-08_20:51:38.423284) 20:51:39.576271 run osmo-msc_10.42.42.6(pid=13044): stderr: | [0;m[38;5;43m20221208205138692 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205138692 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f571359cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205138692 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205138692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205138693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205138693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205138695 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205138695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205138696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205138696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:51:39.625745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13037): Terminating (SIGTERM) 20:51:39.664869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13040): Terminating (SIGTERM) 20:51:39.703976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13043): Terminating (SIGTERM) 20:51:39.743917 --- ParallelTerminationStrategy: PID 13037 died... 20:51:39.763163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13037): Terminated: ok {rc=0} 20:51:39.807724 --- ParallelTerminationStrategy: PID 13040 died... 20:51:39.826135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13040): Terminated: ok {rc=0} 20:51:39.870014 --- ParallelTerminationStrategy: PID 13043 died... 20:51:39.888258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13043): Terminated: ok {rc=0} 20:51:39.970225 bus /sierra_3: Setting Powered False 20:51:41.066918 bus /sierra_3: Setting Powered False 20:51:42.181865 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:51:43.434783 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:51:43.441121 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:51:43.478854 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 20:51:43.507244 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:51:43.559212 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:51:43.592837 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 20:51:43.619214 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:51:44.170923 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 20:51:44.219626 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:51:44.230870 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:51:44.298623 tst mo_mt_call.py: using LAC 16733 20:51:44.415113 tst mo_mt_call.py: using RAC 158 20:51:44.529306 tst mo_mt_call.py: using CellId 16733 20:51:44.644267 tst mo_mt_call.py: using BVCI 16734 20:51:44.751608 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:51:44.762694 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:51:44.773549 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:51:44.784809 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:51:44.796246 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:51:44.807652 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:51:44.926249 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:51:45.041961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:51:45.500275 run create_hlr_db(pid=13049): Launched 20:51:45.614016 bus /sierra_2: Setting Powered False 20:51:46.690180 run create_hlr_db(pid=13049): Terminated: ok {rc=0} 20:51:47.207482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13051): Launched 20:51:47.536767 run osmo-hlr_10.42.42.2(pid=13052): Launched 20:51:47.657787 run osmo-stp_10.42.42.5: Starting osmo-stp 20:51:48.210008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13054): Launched 20:51:48.528695 run osmo-stp_10.42.42.5(pid=13055): Launched 20:51:48.649062 run osmo-msc_10.42.42.6: Starting osmo-msc 20:51:49.223691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13057): Launched 20:51:49.542446 run osmo-msc_10.42.42.6(pid=13058): Launched 20:51:49.722087 run osmo-stp_10.42.42.5(pid=13055): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13055)] 20:51:49.857103 run osmo-stp_10.42.42.5(pid=13055): stdout: | (launched: 2022-12-08_20:51:48.470591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:49.992610 run osmo-stp_10.42.42.5(pid=13055): stderr: | [0;m[38;5;43m20221208205148661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205148662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205148662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205148662 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205148663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205148663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205148663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:50.127205 run osmo-stp_10.42.42.5(pid=13055): stdout: | (launched: 2022-12-08_20:51:48.470591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:50.253568 run osmo-stp_10.42.42.5(pid=13055): stderr: | [0;m[38;5;43m20221208205148661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205148662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205148662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205148662 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205148663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205148663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205148663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:50.405221 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13055): Process ended prematurely: osmo-stp_10.42.42.5(pid=13055) [trial-2349↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13055)] [trial-2349↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 20:51:50.414684 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:51:50.442080 run osmo-hlr_10.42.42.2(pid=13052): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13052)] 20:51:50.491860 run osmo-hlr_10.42.42.2(pid=13052): stdout: | (launched: 2022-12-08_20:51:47.478431) 20:51:50.543262 run osmo-hlr_10.42.42.2(pid=13052): stderr: | [0;m[1;31m20221208205147676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205147676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205147676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205147676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205147676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205147676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205147689 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205147697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205147698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205147698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:51:50.615484 run osmo-msc_10.42.42.6(pid=13058): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13058)] 20:51:50.665501 run osmo-msc_10.42.42.6(pid=13058): stdout: | (launched: 2022-12-08_20:51:49.484631) 20:51:50.717086 run osmo-msc_10.42.42.6(pid=13058): stderr: | [0;m[38;5;43m20221208205149805 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205149806 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8a37737c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205149806 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205149806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205149806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205149806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205149808 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205149808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205149808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205149809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:51:50.768696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13051): Terminating (SIGTERM) 20:51:50.810028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13054): Terminating (SIGTERM) 20:51:50.851274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13057): Terminating (SIGTERM) 20:51:50.893160 --- ParallelTerminationStrategy: PID 13051 died... 20:51:50.913047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13051): Terminated: ok {rc=0} 20:51:50.959183 --- ParallelTerminationStrategy: PID 13054 died... 20:51:50.978587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13054): Terminated: ok {rc=0} 20:51:51.024427 --- ParallelTerminationStrategy: PID 13057 died... 20:51:51.043920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13057): Terminated: ok {rc=0} 20:51:51.131141 bus /sierra_3: Setting Powered False 20:51:52.229937 bus /sierra_3: Setting Powered False 20:51:53.346741 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 20:51:54.491099 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:51:54.503005 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:51:54.573633 tst mo_mt_call_osmux.py: using LAC 16734 20:51:54.693430 tst mo_mt_call_osmux.py: using RAC 159 20:51:54.819858 tst mo_mt_call_osmux.py: using CellId 16734 20:51:54.945484 tst mo_mt_call_osmux.py: using BVCI 16735 20:51:55.061170 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:51:55.072709 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:51:55.084218 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:51:55.095731 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:51:55.107446 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:51:55.118873 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:51:55.236347 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:51:55.351791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:51:55.814299 run create_hlr_db(pid=13060): Launched 20:51:55.929801 bus /sierra_2: Setting Powered False 20:51:56.989291 run create_hlr_db(pid=13060): Terminated: ok {rc=0} 20:51:57.427582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13062): Launched 20:51:57.748681 run osmo-hlr_10.42.42.2(pid=13063): Launched 20:51:57.870585 run osmo-stp_10.42.42.5: Starting osmo-stp 20:51:58.420021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13065): Launched 20:51:58.739546 run osmo-stp_10.42.42.5(pid=13066): Launched 20:51:58.860779 run osmo-msc_10.42.42.6: Starting osmo-msc 20:51:59.442542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13068): Launched 20:51:59.762462 run osmo-msc_10.42.42.6(pid=13069): Launched 20:51:59.939732 run osmo-stp_10.42.42.5(pid=13066): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13066)] 20:52:00.075345 run osmo-stp_10.42.42.5(pid=13066): stdout: | (launched: 2022-12-08_20:51:58.681495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:00.211586 run osmo-stp_10.42.42.5(pid=13066): stderr: | [0;m[38;5;43m20221208205158871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205158871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205158872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205158872 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205158873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205158873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205158873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:00.347544 run osmo-stp_10.42.42.5(pid=13066): stdout: | (launched: 2022-12-08_20:51:58.681495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:00.475000 run osmo-stp_10.42.42.5(pid=13066): stderr: | [0;m[38;5;43m20221208205158871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205158871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205158872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205158872 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205158873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205158873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205158873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:00.627669 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13066): Process ended prematurely: osmo-stp_10.42.42.5(pid=13066) [trial-2349↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13066)] [trial-2349↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 20:52:00.637434 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 20:52:00.665362 run osmo-hlr_10.42.42.2(pid=13063): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13063)] 20:52:00.715451 run osmo-hlr_10.42.42.2(pid=13063): stdout: | (launched: 2022-12-08_20:51:57.690388) 20:52:00.767443 run osmo-hlr_10.42.42.2(pid=13063): stderr: | [0;m[1;31m20221208205157887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205157887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205157887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205157887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205157887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205157887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205157900 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205157910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205157911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205157911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:52:00.839614 run osmo-msc_10.42.42.6(pid=13069): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13069)] 20:52:00.902466 run osmo-msc_10.42.42.6(pid=13069): stdout: | (launched: 2022-12-08_20:51:59.704381) 20:52:00.955180 run osmo-msc_10.42.42.6(pid=13069): stderr: | [0;m[38;5;43m20221208205200024 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205200024 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9a4bd49c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205200024 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205200024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205200024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205200024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205200026 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205200026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205200026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205200027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:52:01.008012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13062): Terminating (SIGTERM) 20:52:01.050483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13065): Terminating (SIGTERM) 20:52:01.093301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13068): Terminating (SIGTERM) 20:52:01.136763 --- ParallelTerminationStrategy: PID 13062 died... 20:52:01.157598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13062): Terminated: ok {rc=0} 20:52:01.206496 --- ParallelTerminationStrategy: PID 13065 died... 20:52:01.226688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13065): Terminated: ok {rc=0} 20:52:01.273921 --- ParallelTerminationStrategy: PID 13068 died... 20:52:01.293980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13068): Terminated: ok {rc=0} 20:52:01.382964 bus /sierra_3: Setting Powered False 20:52:02.483242 bus /sierra_3: Setting Powered False 20:52:03.598316 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:52:04.854491 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:52:04.860725 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:52:04.894734 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 20:52:04.921955 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 20:52:04.972375 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:52:05.006297 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 20:52:05.034042 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 20:52:05.586327 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 20:52:05.638103 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:05.649567 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:52:05.719332 tst mo_mt_call.py: using LAC 16735 20:52:05.842960 tst mo_mt_call.py: using RAC 160 20:52:05.966349 tst mo_mt_call.py: using CellId 16735 20:52:06.090468 tst mo_mt_call.py: using BVCI 16736 20:52:06.206378 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:06.217685 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:06.228765 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:06.239903 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:06.251026 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:06.262183 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:52:06.380808 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:52:06.499855 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:52:06.994936 run create_hlr_db(pid=13074): Launched 20:52:07.123815 bus /sierra_2: Setting Powered False 20:52:08.183671 run create_hlr_db(pid=13074): Terminated: ok {rc=0} 20:52:08.607161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13076): Launched 20:52:08.903274 run osmo-hlr_10.42.42.2(pid=13077): Launched 20:52:09.015606 run osmo-stp_10.42.42.5: Starting osmo-stp 20:52:09.537265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13079): Launched 20:52:09.835534 run osmo-stp_10.42.42.5(pid=13080): Launched 20:52:09.949257 run osmo-msc_10.42.42.6: Starting osmo-msc 20:52:10.486836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13082): Launched 20:52:10.784733 run osmo-msc_10.42.42.6(pid=13083): Launched 20:52:10.951517 run osmo-stp_10.42.42.5(pid=13080): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13080)] 20:52:11.078389 run osmo-stp_10.42.42.5(pid=13080): stdout: | (launched: 2022-12-08_20:52:09.780704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:11.205296 run osmo-stp_10.42.42.5(pid=13080): stderr: | [0;m[38;5;43m20221208205209951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205209951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205209951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205209952 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205209952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205209952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205209952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:11.329826 run osmo-stp_10.42.42.5(pid=13080): stdout: | (launched: 2022-12-08_20:52:09.780704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:11.447812 run osmo-stp_10.42.42.5(pid=13080): stderr: | [0;m[38;5;43m20221208205209951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205209951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205209951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205209952 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205209952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205209952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205209952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:11.589311 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13080): Process ended prematurely: osmo-stp_10.42.42.5(pid=13080) [trial-2349↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13080)] [trial-2349↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 20:52:11.598117 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 20:52:11.624257 run osmo-hlr_10.42.42.2(pid=13077): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13077)] 20:52:11.672168 run osmo-hlr_10.42.42.2(pid=13077): stdout: | (launched: 2022-12-08_20:52:08.849087) 20:52:11.721430 run osmo-hlr_10.42.42.2(pid=13077): stderr: | [0;m[1;31m20221208205209021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205209021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205209021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205209021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205209021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205209021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205209033 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205209042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205209042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205209042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:52:11.790056 run osmo-msc_10.42.42.6(pid=13083): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13083)] 20:52:11.837810 run osmo-msc_10.42.42.6(pid=13083): stdout: | (launched: 2022-12-08_20:52:10.729997) 20:52:11.887303 run osmo-msc_10.42.42.6(pid=13083): stderr: | [0;m[38;5;43m20221208205210997 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205210997 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f31d3807c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205210997 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205210997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205210997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205210997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205210999 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205210999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205211000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205211000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:52:11.937433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13076): Terminating (SIGTERM) 20:52:11.976775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13079): Terminating (SIGTERM) 20:52:12.016475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13082): Terminating (SIGTERM) 20:52:12.056092 --- ParallelTerminationStrategy: PID 13076 died... 20:52:12.075044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13076): Terminated: ok {rc=0} 20:52:12.119064 --- ParallelTerminationStrategy: PID 13079 died... 20:52:12.137476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13079): Terminated: ok {rc=0} 20:52:12.181226 --- ParallelTerminationStrategy: PID 13082 died... 20:52:12.199682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13082): Terminated: ok {rc=0} 20:52:12.285909 bus /sierra_3: Setting Powered False 20:52:13.387322 bus /sierra_3: Setting Powered False 20:52:14.501648 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 20:52:15.642905 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:15.654350 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:52:15.725066 tst mo_mt_call_osmux.py: using LAC 16736 20:52:15.854741 tst mo_mt_call_osmux.py: using RAC 161 20:52:15.995331 tst mo_mt_call_osmux.py: using CellId 16736 20:52:16.126882 tst mo_mt_call_osmux.py: using BVCI 16737 20:52:16.236285 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:16.247860 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:16.259178 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:16.270705 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:16.282300 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:16.293845 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:52:16.407754 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:52:16.525173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:52:17.003006 run create_hlr_db(pid=13085): Launched 20:52:17.158705 bus /sierra_2: Setting Powered False 20:52:18.217743 run create_hlr_db(pid=13085): Terminated: ok {rc=0} 20:52:18.630623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13087): Launched 20:52:18.926680 run osmo-hlr_10.42.42.2(pid=13088): Launched 20:52:19.038978 run osmo-stp_10.42.42.5: Starting osmo-stp 20:52:19.565655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13090): Launched 20:52:19.861379 run osmo-stp_10.42.42.5(pid=13091): Launched 20:52:19.974209 run osmo-msc_10.42.42.6: Starting osmo-msc 20:52:20.509305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13093): Launched 20:52:20.805164 run osmo-msc_10.42.42.6(pid=13094): Launched 20:52:20.972107 run osmo-stp_10.42.42.5(pid=13091): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13091)] 20:52:21.098224 run osmo-stp_10.42.42.5(pid=13091): stdout: | (launched: 2022-12-08_20:52:19.807026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:21.224871 run osmo-stp_10.42.42.5(pid=13091): stderr: | [0;m[38;5;43m20221208205219978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205219978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205219978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205219978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205219979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205219979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205219979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:21.349620 run osmo-stp_10.42.42.5(pid=13091): stdout: | (launched: 2022-12-08_20:52:19.807026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:21.467239 run osmo-stp_10.42.42.5(pid=13091): stderr: | [0;m[38;5;43m20221208205219978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205219978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205219978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205219978 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205219979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205219979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205219979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:21.608254 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13091): Process ended prematurely: osmo-stp_10.42.42.5(pid=13091) [trial-2349↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13091)] [trial-2349↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 20:52:21.617004 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 20:52:21.643370 run osmo-hlr_10.42.42.2(pid=13088): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13088)] 20:52:21.691328 run osmo-hlr_10.42.42.2(pid=13088): stdout: | (launched: 2022-12-08_20:52:18.871766) 20:52:21.740741 run osmo-hlr_10.42.42.2(pid=13088): stderr: | [0;m[1;31m20221208205219046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205219046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205219046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205219046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205219046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205219046 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205219059 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205219068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205219069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205219069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:52:21.809343 run osmo-msc_10.42.42.6(pid=13094): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13094)] 20:52:21.856635 run osmo-msc_10.42.42.6(pid=13094): stdout: | (launched: 2022-12-08_20:52:20.750606) 20:52:21.905381 run osmo-msc_10.42.42.6(pid=13094): stderr: | [0;m[38;5;43m20221208205221019 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205221019 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcf7596dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205221019 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205221019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205221019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205221020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205221021 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205221022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205221022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205221022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:52:21.954763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13087): Terminating (SIGTERM) 20:52:21.994129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13090): Terminating (SIGTERM) 20:52:22.033418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13093): Terminating (SIGTERM) 20:52:22.073637 --- ParallelTerminationStrategy: PID 13087 died... 20:52:22.092498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13087): Terminated: ok {rc=0} 20:52:22.136717 --- ParallelTerminationStrategy: PID 13090 died... 20:52:22.155194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13090): Terminated: ok {rc=0} 20:52:22.199043 --- ParallelTerminationStrategy: PID 13093 died... 20:52:22.217442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13093): Terminated: ok {rc=0} 20:52:22.303223 bus /sierra_3: Setting Powered False 20:52:23.402374 bus /sierra_3: Setting Powered False 20:52:24.515448 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 emergency:trx-lms --------------------------------------------------------------------- 20:52:25.767683 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:52:25.772417 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 20:52:25.806855 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 20:52:25.834608 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 20:52:25.922354 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 20:52:25.956595 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 20:52:25.983989 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 20:52:26.568303 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2349 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 20:52:26.573472 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:26.584430 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 20:52:26.639288 tst emergency_mo_mt_call.py: using LAC 16737 20:52:26.764297 tst emergency_mo_mt_call.py: using RAC 162 20:52:26.886488 tst emergency_mo_mt_call.py: using CellId 16737 20:52:27.008318 tst emergency_mo_mt_call.py: using BVCI 16738 20:52:27.122862 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:27.134020 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:27.144761 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:27.155645 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:27.166606 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:27.177506 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 20:52:27.290555 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 20:52:27.410058 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:52:27.894589 run create_hlr_db(pid=13099): Launched 20:52:28.021256 bus /sierra_2: Setting Powered False 20:52:29.083410 run create_hlr_db(pid=13099): Terminated: ok {rc=0} 20:52:29.500148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13101): Launched 20:52:29.792029 run osmo-hlr_10.42.42.2(pid=13102): Launched 20:52:29.901828 run osmo-stp_10.42.42.5: Starting osmo-stp 20:52:30.413202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13104): Launched 20:52:30.702976 run osmo-stp_10.42.42.5(pid=13105): Launched 20:52:30.822892 tst emergency_mo_mt_call.py: using MSISDN 6847 20:52:31.092281 run osmo-msc_10.42.42.6: Starting osmo-msc 20:52:31.629697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13107): Launched 20:52:31.954373 run osmo-msc_10.42.42.6(pid=13108): Launched 20:52:32.360883 run osmo-stp_10.42.42.5(pid=13105): ERR: Terminated: ERROR {rc=1} [trial-2349↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13105)] 20:52:32.506754 run osmo-stp_10.42.42.5(pid=13105): stdout: | (launched: 2022-12-08_20:52:30.649657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:32.637190 run osmo-stp_10.42.42.5(pid=13105): stderr: | [0;m[38;5;43m20221208205230819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205230819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205230819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205230819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205230821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205230821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205230821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:32.767036 run osmo-stp_10.42.42.5(pid=13105): stdout: | (launched: 2022-12-08_20:52:30.649657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:32.891020 run osmo-stp_10.42.42.5(pid=13105): stderr: | [0;m[38;5;43m20221208205230819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205230819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205230819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205230819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205230821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205230821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205230821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:33.039279 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=13105): Process ended prematurely: osmo-stp_10.42.42.5(pid=13105) [trial-2349↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13105)] [trial-2349↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 20:52:33.047992 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 20:52:33.074824 run osmo-hlr_10.42.42.2(pid=13102): ERR: Terminated: ERROR {rc=237} [trial-2349↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13102)] 20:52:33.124465 run osmo-hlr_10.42.42.2(pid=13102): stdout: | (launched: 2022-12-08_20:52:29.737452) 20:52:33.175984 run osmo-hlr_10.42.42.2(pid=13102): stderr: | [0;m[1;31m20221208205229910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205229910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205229910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205229910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205229911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205229911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205229922 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205229932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205229932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205229932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:52:33.247643 run osmo-msc_10.42.42.6(pid=13108): ERR: Terminated: ERROR {rc=2} [trial-2349↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13108)] 20:52:33.297615 run osmo-msc_10.42.42.6(pid=13108): stdout: | (launched: 2022-12-08_20:52:31.897965) 20:52:33.349214 run osmo-msc_10.42.42.6(pid=13108): stderr: | [0;m[38;5;43m20221208205232263 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205232264 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4796034c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205232264 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205232264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205232264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205232264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205232270 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205232271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205232271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205232271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:52:33.401187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13101): Terminating (SIGTERM) 20:52:33.442507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13104): Terminating (SIGTERM) 20:52:33.484016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13107): Terminating (SIGTERM) 20:52:33.525842 --- ParallelTerminationStrategy: PID 13101 died... 20:52:33.545678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13101): Terminated: ok {rc=0} 20:52:33.591556 --- ParallelTerminationStrategy: PID 13104 died... 20:52:33.610960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13104): Terminated: ok {rc=0} 20:52:33.656515 --- ParallelTerminationStrategy: PID 13107 died... 20:52:33.675931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13107): Terminated: ok {rc=0} 20:52:33.763112 bus /sierra_3: Setting Powered False 20:52:34.861946 bus /sierra_3: Setting Powered False 20:52:35.976587 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 20:52:37.063338 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:37.075411 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 20:52:37.127713 tst emergency_preemptive_call.py: using LAC 16738 20:52:37.249644 tst emergency_preemptive_call.py: using RAC 163 20:52:37.372609 tst emergency_preemptive_call.py: using CellId 16738 20:52:37.496250 tst emergency_preemptive_call.py: using BVCI 16739 20:52:37.608757 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:37.619872 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:37.630760 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:37.641779 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:37.652535 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:37.663416 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 20:52:37.780925 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 20:52:37.897617 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 20:52:38.012149 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 20:52:38.130257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:52:38.615578 run create_hlr_db(pid=13110): Launched 20:52:38.742896 bus /sierra_2: Setting Powered False 20:52:39.805190 run create_hlr_db(pid=13110): Terminated: ok {rc=0} 20:52:40.243733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13112): Launched 20:52:40.556610 run osmo-hlr_10.42.42.2(pid=13113): Launched 20:52:40.674615 run osmo-stp_10.42.42.5: Starting osmo-stp 20:52:41.210619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13115): Launched 20:52:41.522887 run osmo-stp_10.42.42.5(pid=13116): Launched 20:52:41.650972 tst emergency_preemptive_call.py: using MSISDN 6848 20:52:41.810298 run osmo-msc_10.42.42.6: Starting osmo-msc 20:52:42.372873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13118): Launched 20:52:42.685904 run osmo-msc_10.42.42.6(pid=13119): Launched 20:52:42.859664 run osmo-stp_10.42.42.5(pid=13116): ERR: Terminated: ERROR {rc=1} [trial-2349↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13116)] 20:52:42.991243 run osmo-stp_10.42.42.5(pid=13116): stdout: | (launched: 2022-12-08_20:52:41.466031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:43.123383 run osmo-stp_10.42.42.5(pid=13116): stderr: | [0;m[38;5;43m20221208205241656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205241656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205241656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205241657 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205241657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205241657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205241657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:43.254914 run osmo-stp_10.42.42.5(pid=13116): stdout: | (launched: 2022-12-08_20:52:41.466031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:43.379424 run osmo-stp_10.42.42.5(pid=13116): stderr: | [0;m[38;5;43m20221208205241656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205241656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205241656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205241657 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205241657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205241657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205241657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:43.527584 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=13116): Process ended prematurely: osmo-stp_10.42.42.5(pid=13116) [trial-2349↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13116)] [trial-2349↪emergency:trx-lms↪emergency_preemptive_call.py:32] 20:52:43.536460 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 20:52:43.563571 run osmo-hlr_10.42.42.2(pid=13113): ERR: Terminated: ERROR {rc=237} [trial-2349↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13113)] 20:52:43.613623 run osmo-hlr_10.42.42.2(pid=13113): stdout: | (launched: 2022-12-08_20:52:40.499627) 20:52:43.665332 run osmo-hlr_10.42.42.2(pid=13113): stderr: | [0;m[1;31m20221208205240696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205240696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205240696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205240697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205240697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205240697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205240709 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205240718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205240719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205240719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:52:43.737385 run osmo-msc_10.42.42.6(pid=13119): ERR: Terminated: ERROR {rc=2} [trial-2349↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13119)] 20:52:43.787314 run osmo-msc_10.42.42.6(pid=13119): stdout: | (launched: 2022-12-08_20:52:42.628571) 20:52:43.838860 run osmo-msc_10.42.42.6(pid=13119): stderr: | [0;m[38;5;43m20221208205242949 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205242949 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7e3ef8ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205242949 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205242949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205242949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205242950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205242952 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205242952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205242952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205242952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:52:43.891040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13112): Terminating (SIGTERM) 20:52:43.932816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13115): Terminating (SIGTERM) 20:52:43.974532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13118): Terminating (SIGTERM) 20:52:44.016419 --- ParallelTerminationStrategy: PID 13112 died... 20:52:44.036352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13112): Terminated: ok {rc=0} 20:52:44.082918 --- ParallelTerminationStrategy: PID 13115 died... 20:52:44.102429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13115): Terminated: ok {rc=0} 20:52:44.148479 --- ParallelTerminationStrategy: PID 13118 died... 20:52:44.168060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13118): Terminated: ok {rc=0} 20:52:44.255626 bus /sierra_9: Setting Powered False 20:52:45.353205 bus /sierra_9: Setting Powered False 20:52:46.472043 bus /sierra_8: Setting Powered False 20:52:47.568266 bus /sierra_8: Setting Powered False 20:52:48.683973 bus /sierra_3: Setting Powered False 20:52:49.782456 bus /sierra_3: Setting Powered False 20:52:50.898541 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-lms --------------------------------------------------------------------- 20:52:52.175247 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:52:52.179849 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 20:52:52.213879 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 20:52:52.253188 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 20:52:52.342312 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 20:52:52.376217 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 20:52:52.415796 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 20:52:53.006552 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 20:52:53.058141 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:52:53.068924 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 20:52:53.118879 tst cs_paging_gprs_active.py: using LAC 16739 20:52:53.244789 tst cs_paging_gprs_active.py: using RAC 164 20:52:53.369407 tst cs_paging_gprs_active.py: using CellId 16739 20:52:53.496463 tst cs_paging_gprs_active.py: using BVCI 16740 20:52:53.611833 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:52:53.622943 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:52:53.633718 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:52:53.644452 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:52:53.655235 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:52:53.665954 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:52:53.676752 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:52:53.687499 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:52:53.698391 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 20:52:53.813840 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 20:52:53.934092 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:52:54.150693 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:52:54.471814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13124): Launched 20:52:54.749101 run iperf3-srv_10.42.42.10(pid=13125): Launched 20:52:54.868454 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:52:55.083147 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:52:55.403605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13126): Launched 20:52:55.681285 run iperf3-srv_10.42.42.10(pid=13127): Launched 20:52:55.801135 tst cs_paging_gprs_active.py:38: start network... 20:52:56.016017 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:52:56.509824 run create_hlr_db(pid=13128): Launched 20:52:56.640169 bus /sierra_2: Setting Powered False 20:52:57.703829 run create_hlr_db(pid=13128): Terminated: ok {rc=0} 20:52:58.129779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13130): Launched 20:52:58.427423 run osmo-hlr_10.42.42.2(pid=13131): Launched 20:52:58.540753 run osmo-stp_10.42.42.5: Starting osmo-stp 20:52:59.065409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13133): Launched 20:52:59.364574 run osmo-stp_10.42.42.5(pid=13134): Launched 20:52:59.477673 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:52:59.989477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13136): Launched 20:53:00.104349 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:53:00.355623 run patchelf(pid=13137): Launched 20:53:00.521332 run osmo-stp_10.42.42.5(pid=13134): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13134)] 20:53:00.647076 run osmo-stp_10.42.42.5(pid=13134): stdout: | (launched: 2022-12-08_20:52:59.309294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:00.774220 run osmo-stp_10.42.42.5(pid=13134): stderr: | [0;m[38;5;43m20221208205259478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205259479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205259479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205259479 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205259480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205259480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205259480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:00.911591 run osmo-stp_10.42.42.5(pid=13134): stdout: | (launched: 2022-12-08_20:52:59.309294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:01.078484 run osmo-stp_10.42.42.5(pid=13134): stderr: | [0;m[38;5;43m20221208205259478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205259479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205259479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205259479 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205259480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205259480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205259480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:01.251019 run patchelf(pid=13137): Terminating (SIGINT) 20:53:01.443385 run patchelf(pid=13137): Terminated: ok {rc=0} 20:53:01.567269 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13134): Process ended prematurely: osmo-stp_10.42.42.5(pid=13134) [trial-2349↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13134)] [trial-2349↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 20:53:01.577961 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 20:53:01.608724 run osmo-hlr_10.42.42.2(pid=13131): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13131)] 20:53:01.658977 run osmo-hlr_10.42.42.2(pid=13131): stdout: | (launched: 2022-12-08_20:52:58.373124) 20:53:01.712851 run osmo-hlr_10.42.42.2(pid=13131): stderr: | [0;m[1;31m20221208205258547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205258547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205258547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205258548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205258548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205258548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205258569 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205258578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205258578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205258578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:53:01.778665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13124): Terminating (SIGTERM) 20:53:01.824252 run iperf3-srv_10.42.42.10(pid=13125): Terminating (SIGTERM) 20:53:01.869875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13126): Terminating (SIGTERM) 20:53:01.913455 run iperf3-srv_10.42.42.10(pid=13127): Terminating (SIGTERM) 20:53:01.958445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13130): Terminating (SIGTERM) 20:53:02.002514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13133): Terminating (SIGTERM) 20:53:02.053874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13136): Terminating (SIGTERM) 20:53:02.097316 --- ParallelTerminationStrategy: PID 13124 died... 20:53:02.116587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13124): Terminated: ok {rc=0} 20:53:02.164306 --- ParallelTerminationStrategy: PID 13125 died... 20:53:02.186674 run iperf3-srv_10.42.42.10(pid=13125): Terminated {rc=256} 20:53:02.239242 --- ParallelTerminationStrategy: PID 13126 died... 20:53:02.258945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13126): Terminated: ok {rc=0} 20:53:02.316395 --- ParallelTerminationStrategy: PID 13127 died... 20:53:02.336021 run iperf3-srv_10.42.42.10(pid=13127): Terminated {rc=256} 20:53:02.383586 --- ParallelTerminationStrategy: PID 13130 died... 20:53:02.404721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13130): Terminated: ok {rc=0} 20:53:02.458890 --- ParallelTerminationStrategy: PID 13133 died... 20:53:02.479119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13133): Terminated: ok {rc=0} 20:53:02.531018 --- ParallelTerminationStrategy: PID 13136 died... 20:53:02.556311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13136): Terminated: ok {rc=0} 20:53:02.656831 bus /gobi_0: Setting Powered False 20:53:03.778702 bus /gobi_0: Setting Powered False 20:53:04.916492 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms iperf3.py ---------------------------------------------- 20:53:06.063182 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:06.075509 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 20:53:06.129382 tst iperf3.py: using LAC 16740 20:53:06.249130 tst iperf3.py: using RAC 165 20:53:06.369418 tst iperf3.py: using CellId 16740 20:53:06.494441 tst iperf3.py: using BVCI 16741 20:53:06.607287 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:06.619021 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:06.630323 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:06.642485 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:06.655635 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:06.669250 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:06.680819 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:06.692813 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:06.705335 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 20:53:06.823563 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:53:07.041149 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:53:07.368941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13409): Launched 20:53:07.664330 run iperf3-srv_10.42.42.10(pid=13410): Launched 20:53:07.800278 tst iperf3.py:8: start network... 20:53:08.020630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:53:08.529793 run create_hlr_db(pid=13411): Launched 20:53:08.692096 bus /gobi_6: Setting Powered False 20:53:09.752629 run create_hlr_db(pid=13411): Terminated: ok {rc=0} 20:53:10.189281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13413): Launched 20:53:10.516032 run osmo-hlr_10.42.42.2(pid=13414): Launched 20:53:10.762005 run osmo-stp_10.42.42.5: Starting osmo-stp 20:53:11.474951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13416): Launched 20:53:11.801249 run osmo-stp_10.42.42.5(pid=13417): Launched 20:53:12.042936 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:53:12.737140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13419): Launched 20:53:12.869570 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:53:13.133067 run patchelf(pid=13420): Launched 20:53:13.322061 run osmo-stp_10.42.42.5(pid=13417): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13417)] 20:53:13.456347 run osmo-stp_10.42.42.5(pid=13417): stdout: | (launched: 2022-12-08_20:53:11.743184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:13.592275 run osmo-stp_10.42.42.5(pid=13417): stderr: | [0;m[38;5;43m20221208205312071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205312071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205312072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205312072 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205312072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205312077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205312077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:13.727752 run osmo-stp_10.42.42.5(pid=13417): stdout: | (launched: 2022-12-08_20:53:11.743184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:13.859100 run osmo-stp_10.42.42.5(pid=13417): stderr: | [0;m[38;5;43m20221208205312071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205312071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205312072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205312072 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205312072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205312077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205312077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:14.011300 run patchelf(pid=13420): Terminating (SIGINT) 20:53:14.188904 run patchelf(pid=13420): Terminated: ok {rc=0} 20:53:14.317436 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13417): Process ended prematurely: osmo-stp_10.42.42.5(pid=13417) [trial-2349↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13417)] [trial-2349↪gprs:trx-lms↪iperf3.py:8] 20:53:14.328002 tst iperf3.py:8: Test FAILED (8.3 sec) 20:53:14.358753 run osmo-hlr_10.42.42.2(pid=13414): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13414)] 20:53:14.410820 run osmo-hlr_10.42.42.2(pid=13414): stdout: | (launched: 2022-12-08_20:53:10.459717) 20:53:14.464662 run osmo-hlr_10.42.42.2(pid=13414): stderr: | [0;m[1;31m20221208205310801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205310801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205310801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205310801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205310801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205310802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205310822 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205310837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205310837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205310837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:53:14.518400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13409): Terminating (SIGTERM) 20:53:14.561305 run iperf3-srv_10.42.42.10(pid=13410): Terminating (SIGTERM) 20:53:14.604592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13413): Terminating (SIGTERM) 20:53:14.647749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13416): Terminating (SIGTERM) 20:53:14.693431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13419): Terminating (SIGTERM) 20:53:14.738698 --- ParallelTerminationStrategy: PID 13409 died... 20:53:14.759176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13409): Terminated: ok {rc=0} 20:53:14.808830 --- ParallelTerminationStrategy: PID 13410 died... 20:53:14.828537 run iperf3-srv_10.42.42.10(pid=13410): Terminated {rc=256} 20:53:14.877703 --- ParallelTerminationStrategy: PID 13413 died... 20:53:14.897825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13413): Terminated: ok {rc=0} 20:53:14.945632 --- ParallelTerminationStrategy: PID 13416 died... 20:53:14.965511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13416): Terminated: ok {rc=0} 20:53:15.013363 --- ParallelTerminationStrategy: PID 13419 died... 20:53:15.033096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13419): Terminated: ok {rc=0} 20:53:15.123170 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms iperf3m4.py ---------------------------------------------- 20:53:16.314385 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:16.329379 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 20:53:16.391200 tst iperf3m4.py: using LAC 16741 20:53:16.523871 tst iperf3m4.py: using RAC 166 20:53:16.671955 tst iperf3m4.py: using CellId 16741 20:53:16.831563 tst iperf3m4.py: using BVCI 16742 20:53:16.951350 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:16.963099 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:16.974513 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:16.986078 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:16.997592 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:17.008805 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:17.020468 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:17.032053 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:17.043755 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 20:53:17.173078 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 20:53:17.343623 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 20:53:17.492758 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 20:53:17.645873 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:53:17.907995 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:53:18.241858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13421): Launched 20:53:18.540317 run iperf3-srv_10.42.42.10(pid=13422): Launched 20:53:18.677080 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:53:18.900425 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:53:19.231381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13423): Launched 20:53:19.529741 run iperf3-srv_10.42.42.10(pid=13424): Launched 20:53:19.667086 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:53:19.890172 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:53:20.223625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13425): Launched 20:53:20.522255 run iperf3-srv_10.42.42.10(pid=13426): Launched 20:53:20.659994 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:53:20.882277 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:53:21.212500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13427): Launched 20:53:21.510792 run iperf3-srv_10.42.42.10(pid=13428): Launched 20:53:21.647307 tst iperf3m4.py:8: start network... 20:53:21.870741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:53:22.383649 run create_hlr_db(pid=13429): Launched 20:53:22.548659 bus /gobi_6: Setting Powered False 20:53:23.613257 run create_hlr_db(pid=13429): Terminated: ok {rc=0} 20:53:24.076161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13431): Launched 20:53:24.424047 run osmo-hlr_10.42.42.2(pid=13432): Launched 20:53:24.551980 run osmo-stp_10.42.42.5: Starting osmo-stp 20:53:25.110862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13435): Launched 20:53:25.435461 run osmo-stp_10.42.42.5(pid=13436): Launched 20:53:25.557920 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:53:26.114183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13438): Launched 20:53:26.239144 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:53:26.512686 run patchelf(pid=13439): Launched 20:53:26.692519 run osmo-stp_10.42.42.5(pid=13436): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13436)] 20:53:26.829426 run osmo-stp_10.42.42.5(pid=13436): stdout: | (launched: 2022-12-08_20:53:25.376589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:26.967459 run osmo-stp_10.42.42.5(pid=13436): stderr: | [0;m[38;5;43m20221208205325570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205325570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205325570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205325570 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205325571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205325571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205325571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:27.105809 run osmo-stp_10.42.42.5(pid=13436): stdout: | (launched: 2022-12-08_20:53:25.376589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:27.238357 run osmo-stp_10.42.42.5(pid=13436): stderr: | [0;m[38;5;43m20221208205325570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205325570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205325570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205325570 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205325571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205325571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205325571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:27.395606 run patchelf(pid=13439): Terminating (SIGINT) 20:53:27.577551 run patchelf(pid=13439): Terminated: ok {rc=0} 20:53:27.707632 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13436): Process ended prematurely: osmo-stp_10.42.42.5(pid=13436) [trial-2349↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13436)] [trial-2349↪gprs:trx-lms↪iperf3m4.py:8] 20:53:27.717886 tst iperf3m4.py:8: Test FAILED (11.5 sec) 20:53:27.746464 run osmo-hlr_10.42.42.2(pid=13432): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13432)] 20:53:27.796194 run osmo-hlr_10.42.42.2(pid=13432): stdout: | (launched: 2022-12-08_20:53:24.358256) 20:53:27.847317 run osmo-hlr_10.42.42.2(pid=13432): stderr: | [0;m[1;31m20221208205324564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205324564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205324564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205324564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205324564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205324564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205324577 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205324586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205324586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205324586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:53:27.898917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13421): Terminating (SIGTERM) 20:53:27.940170 run iperf3-srv_10.42.42.10(pid=13422): Terminating (SIGTERM) 20:53:27.981429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13423): Terminating (SIGTERM) 20:53:28.023036 run iperf3-srv_10.42.42.10(pid=13424): Terminating (SIGTERM) 20:53:28.064205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13425): Terminating (SIGTERM) 20:53:28.105881 run iperf3-srv_10.42.42.10(pid=13426): Terminating (SIGTERM) 20:53:28.147144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13427): Terminating (SIGTERM) 20:53:28.188320 run iperf3-srv_10.42.42.10(pid=13428): Terminating (SIGTERM) 20:53:28.229530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13431): Terminating (SIGTERM) 20:53:28.271607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13435): Terminating (SIGTERM) 20:53:28.312895 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13438): Terminating (SIGTERM) 20:53:28.354934 --- ParallelTerminationStrategy: PID 13421 died... 20:53:28.374923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13421): Terminated: ok {rc=0} 20:53:28.420639 --- ParallelTerminationStrategy: PID 13422 died... 20:53:28.439986 run iperf3-srv_10.42.42.10(pid=13422): Terminated {rc=256} 20:53:28.485349 --- ParallelTerminationStrategy: PID 13423 died... 20:53:28.504652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13423): Terminated: ok {rc=0} 20:53:28.550548 --- ParallelTerminationStrategy: PID 13424 died... 20:53:28.569824 run iperf3-srv_10.42.42.10(pid=13424): Terminated {rc=256} 20:53:28.615837 --- ParallelTerminationStrategy: PID 13425 died... 20:53:28.635238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13425): Terminated: ok {rc=0} 20:53:28.680759 --- ParallelTerminationStrategy: PID 13426 died... 20:53:28.700096 run iperf3-srv_10.42.42.10(pid=13426): Terminated {rc=256} 20:53:28.745536 --- ParallelTerminationStrategy: PID 13427 died... 20:53:28.764872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13427): Terminated: ok {rc=0} 20:53:28.810661 --- ParallelTerminationStrategy: PID 13428 died... 20:53:28.830100 run iperf3-srv_10.42.42.10(pid=13428): Terminated {rc=256} 20:53:28.875685 --- ParallelTerminationStrategy: PID 13431 died... 20:53:28.895106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13431): Terminated: ok {rc=0} 20:53:28.940443 --- ParallelTerminationStrategy: PID 13435 died... 20:53:28.959937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13435): Terminated: ok {rc=0} 20:53:29.005790 --- ParallelTerminationStrategy: PID 13438 died... 20:53:29.025489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13438): Terminated: ok {rc=0} 20:53:29.111801 bus /gobi_4: Setting Powered False 20:53:30.209234 bus /gobi_4: Setting Powered False 20:53:31.326949 bus /gobi_1: Setting Powered False 20:53:32.426541 bus /gobi_1: Setting Powered False 20:53:33.542260 bus /gobi_0: Setting Powered False 20:53:34.639992 bus /gobi_0: Setting Powered False 20:53:35.755937 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms ping.py ---------------------------------------------- 20:53:36.859162 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:36.870671 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 20:53:36.929235 tst ping.py: using LAC 16742 20:53:37.044664 tst ping.py: using RAC 167 20:53:37.158772 tst ping.py: using CellId 16742 20:53:37.272604 tst ping.py: using BVCI 16743 20:53:37.379362 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:37.389962 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:37.400263 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:37.410957 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:37.421589 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:37.432029 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:37.442748 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:37.453587 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 20:53:37.571790 tst ping.py:19: start network... 20:53:37.785233 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:53:38.274296 run create_hlr_db(pid=13440): Launched 20:53:38.405444 bus /gobi_6: Setting Powered False 20:53:39.468594 run create_hlr_db(pid=13440): Terminated: ok {rc=0} 20:53:39.892871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13442): Launched 20:53:40.189975 run osmo-hlr_10.42.42.2(pid=13443): Launched 20:53:40.303099 run osmo-stp_10.42.42.5: Starting osmo-stp 20:53:40.830518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13445): Launched 20:53:41.126035 run osmo-stp_10.42.42.5(pid=13446): Launched 20:53:41.237438 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:53:41.744565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13448): Launched 20:53:41.858470 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:53:42.108299 run patchelf(pid=13449): Launched 20:53:42.273889 run osmo-stp_10.42.42.5(pid=13446): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13446)] 20:53:42.400060 run osmo-stp_10.42.42.5(pid=13446): stdout: | (launched: 2022-12-08_20:53:41.071934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:42.527521 run osmo-stp_10.42.42.5(pid=13446): stderr: | [0;m[38;5;43m20221208205341241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205341242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205341242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205341242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205341243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205341243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205341243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:42.654735 run osmo-stp_10.42.42.5(pid=13446): stdout: | (launched: 2022-12-08_20:53:41.071934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:42.776290 run osmo-stp_10.42.42.5(pid=13446): stderr: | [0;m[38;5;43m20221208205341241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205341242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205341242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205341242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205341243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205341243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205341243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:42.919650 run patchelf(pid=13449): Terminating (SIGINT) 20:53:43.086311 run patchelf(pid=13449): Terminated: ok {rc=0} 20:53:43.206364 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13446): Process ended prematurely: osmo-stp_10.42.42.5(pid=13446) [trial-2349↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13446)] [trial-2349↪gprs:trx-lms↪ping.py:22] 20:53:43.215262 tst ping.py:22: Test FAILED (6.3 sec) 20:53:43.242185 run osmo-hlr_10.42.42.2(pid=13443): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13443)] 20:53:43.289956 run osmo-hlr_10.42.42.2(pid=13443): stdout: | (launched: 2022-12-08_20:53:40.135699) 20:53:43.339350 run osmo-hlr_10.42.42.2(pid=13443): stderr: | [0;m[1;31m20221208205340311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205340311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205340311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205340311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205340311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205340311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205340325 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205340335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205340335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205340335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:53:43.389144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13442): Terminating (SIGTERM) 20:53:43.428937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13445): Terminating (SIGTERM) 20:53:43.469101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13448): Terminating (SIGTERM) 20:53:43.509118 --- ParallelTerminationStrategy: PID 13442 died... 20:53:43.528132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13442): Terminated: ok {rc=0} 20:53:43.572464 --- ParallelTerminationStrategy: PID 13445 died... 20:53:43.591060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13445): Terminated: ok {rc=0} 20:53:43.635322 --- ParallelTerminationStrategy: PID 13448 died... 20:53:43.653936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13448): Terminated: ok {rc=0} 20:53:43.739731 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 20:53:44.825851 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:44.837183 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 20:53:44.887297 tst ping_idle_ping.py: using LAC 16743 20:53:45.002816 tst ping_idle_ping.py: using RAC 168 20:53:45.121392 tst ping_idle_ping.py: using CellId 16743 20:53:45.237423 tst ping_idle_ping.py: using BVCI 16744 20:53:45.345959 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:45.356506 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:45.367021 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:45.377786 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:45.388429 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:45.399121 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:45.409931 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:45.420629 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 20:53:45.535443 tst ping_idle_ping.py:24: start network... 20:53:45.751526 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:53:46.245163 run create_hlr_db(pid=13450): Launched 20:53:46.417343 bus /gobi_6: Setting Powered False 20:53:47.477711 run create_hlr_db(pid=13450): Terminated: ok {rc=0} 20:53:47.945212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13452): Launched 20:53:48.265415 run osmo-hlr_10.42.42.2(pid=13453): Launched 20:53:48.387114 run osmo-stp_10.42.42.5: Starting osmo-stp 20:53:48.934403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13455): Launched 20:53:49.253216 run osmo-stp_10.42.42.5(pid=13456): Launched 20:53:49.375756 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:53:49.923787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13458): Launched 20:53:50.046230 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:53:50.314821 run patchelf(pid=13459): Launched 20:53:50.494097 run osmo-stp_10.42.42.5(pid=13456): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13456)] 20:53:50.629174 run osmo-stp_10.42.42.5(pid=13456): stdout: | (launched: 2022-12-08_20:53:49.195299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:50.765850 run osmo-stp_10.42.42.5(pid=13456): stderr: | [0;m[38;5;43m20221208205349387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205349388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205349388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205349388 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205349389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205349389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205349389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:50.902372 run osmo-stp_10.42.42.5(pid=13456): stdout: | (launched: 2022-12-08_20:53:49.195299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:51.032728 run osmo-stp_10.42.42.5(pid=13456): stderr: | [0;m[38;5;43m20221208205349387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205349388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205349388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205349388 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205349389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205349389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205349389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:51.187316 run patchelf(pid=13459): Terminating (SIGINT) 20:53:51.366724 run patchelf(pid=13459): Terminated: ok {rc=0} 20:53:51.495448 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13456): Process ended prematurely: osmo-stp_10.42.42.5(pid=13456) [trial-2349↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13456)] [trial-2349↪gprs:trx-lms↪ping_idle_ping.py:27] 20:53:51.505308 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 20:53:51.534030 run osmo-hlr_10.42.42.2(pid=13453): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13453)] 20:53:51.584077 run osmo-hlr_10.42.42.2(pid=13453): stdout: | (launched: 2022-12-08_20:53:48.207500) 20:53:51.635977 run osmo-hlr_10.42.42.2(pid=13453): stderr: | [0;m[1;31m20221208205348404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205348404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205348404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205348404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205348404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205348404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205348416 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205348424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205348425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205348425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:53:51.688145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13452): Terminating (SIGTERM) 20:53:51.730305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13455): Terminating (SIGTERM) 20:53:51.772254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13458): Terminating (SIGTERM) 20:53:51.814686 --- ParallelTerminationStrategy: PID 13452 died... 20:53:51.834660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13452): Terminated: ok {rc=0} 20:53:51.880884 --- ParallelTerminationStrategy: PID 13455 died... 20:53:51.900705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13455): Terminated: ok {rc=0} 20:53:51.946692 --- ParallelTerminationStrategy: PID 13458 died... 20:53:51.966246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13458): Terminated: ok {rc=0} 20:53:52.054112 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 20:53:53.348649 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:53:53.353934 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 20:53:53.388854 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 20:53:53.427850 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 20:53:53.516705 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 20:53:53.551146 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 20:53:53.590653 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 20:53:54.179293 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 20:53:54.229208 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:53:54.239942 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:53:54.291026 tst cs_paging_gprs_active.py: using LAC 16744 20:53:54.414688 tst cs_paging_gprs_active.py: using RAC 169 20:53:54.534023 tst cs_paging_gprs_active.py: using CellId 16744 20:53:54.662872 tst cs_paging_gprs_active.py: using BVCI 16745 20:53:54.775673 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:53:54.786649 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:53:54.797356 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:53:54.808748 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:53:54.820068 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:53:54.831637 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:53:54.843317 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:53:54.854604 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:53:54.866220 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:53:54.988015 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:53:55.104376 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:53:55.308730 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:53:55.613679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13464): Launched 20:53:55.878962 run iperf3-srv_10.42.42.10(pid=13465): Launched 20:53:55.994966 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:53:56.197534 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:53:56.502337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13466): Launched 20:53:56.768517 run iperf3-srv_10.42.42.10(pid=13467): Launched 20:53:56.884499 tst cs_paging_gprs_active.py:38: start network... 20:53:57.087300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:53:57.554764 run create_hlr_db(pid=13468): Launched 20:53:57.670878 bus /gobi_6: Setting Powered False 20:53:58.731389 run create_hlr_db(pid=13468): Terminated: ok {rc=0} 20:53:59.151951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13470): Launched 20:53:59.454786 run osmo-hlr_10.42.42.2(pid=13471): Launched 20:53:59.570105 run osmo-stp_10.42.42.5: Starting osmo-stp 20:54:00.103327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13473): Launched 20:54:00.405572 run osmo-stp_10.42.42.5(pid=13474): Launched 20:54:00.521397 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:54:01.057176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13476): Launched 20:54:01.193067 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:54:01.477936 run patchelf(pid=13477): Launched 20:54:01.718527 run osmo-stp_10.42.42.5(pid=13474): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13474)] 20:54:01.879782 run osmo-stp_10.42.42.5(pid=13474): stdout: | (launched: 2022-12-08_20:54:00.350209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:02.022384 run osmo-stp_10.42.42.5(pid=13474): stderr: | [0;m[38;5;43m20221208205400524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205400524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205400524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205400524 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205400525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205400525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205400525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:02.165868 run osmo-stp_10.42.42.5(pid=13474): stdout: | (launched: 2022-12-08_20:54:00.350209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:02.301287 run osmo-stp_10.42.42.5(pid=13474): stderr: | [0;m[38;5;43m20221208205400524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205400524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205400524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205400524 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205400525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205400525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205400525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:02.460564 run patchelf(pid=13477): Terminating (SIGINT) 20:54:02.644448 run patchelf(pid=13477): Terminated: ok {rc=0} 20:54:02.776566 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13474): Process ended prematurely: osmo-stp_10.42.42.5(pid=13474) [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13474)] [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 20:54:02.787078 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 20:54:02.815897 run osmo-hlr_10.42.42.2(pid=13471): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13471)] 20:54:02.866680 run osmo-hlr_10.42.42.2(pid=13471): stdout: | (launched: 2022-12-08_20:53:59.399182) 20:54:02.918820 run osmo-hlr_10.42.42.2(pid=13471): stderr: | [0;m[1;31m20221208205359577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205359577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205359577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205359577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205359577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205359577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205359589 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205359597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205359598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205359598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:54:02.971441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13464): Terminating (SIGTERM) 20:54:03.013653 run iperf3-srv_10.42.42.10(pid=13465): Terminating (SIGTERM) 20:54:03.056815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13466): Terminating (SIGTERM) 20:54:03.098581 run iperf3-srv_10.42.42.10(pid=13467): Terminating (SIGTERM) 20:54:03.138373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13470): Terminating (SIGTERM) 20:54:03.177753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13473): Terminating (SIGTERM) 20:54:03.217660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13476): Terminating (SIGTERM) 20:54:03.257497 --- ParallelTerminationStrategy: PID 13464 died... 20:54:03.276182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13464): Terminated: ok {rc=0} 20:54:03.320270 --- ParallelTerminationStrategy: PID 13465 died... 20:54:03.338645 run iperf3-srv_10.42.42.10(pid=13465): Terminated {rc=256} 20:54:03.382605 --- ParallelTerminationStrategy: PID 13466 died... 20:54:03.401046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13466): Terminated: ok {rc=0} 20:54:03.444821 --- ParallelTerminationStrategy: PID 13467 died... 20:54:03.463280 run iperf3-srv_10.42.42.10(pid=13467): Terminated {rc=256} 20:54:03.507176 --- ParallelTerminationStrategy: PID 13470 died... 20:54:03.525650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13470): Terminated: ok {rc=0} 20:54:03.569650 --- ParallelTerminationStrategy: PID 13473 died... 20:54:03.588012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13473): Terminated: ok {rc=0} 20:54:03.632048 --- ParallelTerminationStrategy: PID 13476 died... 20:54:03.650487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13476): Terminated: ok {rc=0} 20:54:03.735677 bus /gobi_0: Setting Powered False 20:54:04.834187 bus /gobi_0: Setting Powered False 20:54:05.949186 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 20:54:07.095237 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:07.106704 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:54:07.157948 tst iperf3.py: using LAC 16745 20:54:07.287105 tst iperf3.py: using RAC 170 20:54:07.415381 tst iperf3.py: using CellId 16745 20:54:07.534912 tst iperf3.py: using BVCI 16746 20:54:07.646536 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:07.657546 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:07.668270 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:07.679280 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:07.690174 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:07.701122 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:07.712059 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:07.722880 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:07.733871 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:54:07.853155 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:54:08.071737 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:54:08.395793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13478): Launched 20:54:08.679110 run iperf3-srv_10.42.42.10(pid=13479): Launched 20:54:08.802289 tst iperf3.py:8: start network... 20:54:09.020685 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:54:09.521923 run create_hlr_db(pid=13480): Launched 20:54:09.655280 bus /gobi_6: Setting Powered False 20:54:10.719220 run create_hlr_db(pid=13480): Terminated: ok {rc=0} 20:54:11.151421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13482): Launched 20:54:11.453742 run osmo-hlr_10.42.42.2(pid=13483): Launched 20:54:11.570595 run osmo-stp_10.42.42.5: Starting osmo-stp 20:54:12.107459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13485): Launched 20:54:12.408375 run osmo-stp_10.42.42.5(pid=13486): Launched 20:54:12.524321 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:54:13.049175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13488): Launched 20:54:13.166252 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:54:13.419172 run patchelf(pid=13489): Launched 20:54:13.587240 run osmo-stp_10.42.42.5(pid=13486): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13486)] 20:54:13.714891 run osmo-stp_10.42.42.5(pid=13486): stdout: | (launched: 2022-12-08_20:54:12.352813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:13.843797 run osmo-stp_10.42.42.5(pid=13486): stderr: | [0;m[38;5;43m20221208205412528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205412528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205412528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205412529 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205412529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205412529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205412529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:13.972739 run osmo-stp_10.42.42.5(pid=13486): stdout: | (launched: 2022-12-08_20:54:12.352813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:14.096114 run osmo-stp_10.42.42.5(pid=13486): stderr: | [0;m[38;5;43m20221208205412528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205412528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205412528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205412529 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205412529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205412529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205412529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:14.242050 run patchelf(pid=13489): Terminating (SIGINT) 20:54:14.411336 run patchelf(pid=13489): Terminated: ok {rc=0} 20:54:14.532683 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13486): Process ended prematurely: osmo-stp_10.42.42.5(pid=13486) [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13486)] [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 20:54:14.542283 tst iperf3.py:8: Test FAILED (7.5 sec) 20:54:14.569668 run osmo-hlr_10.42.42.2(pid=13483): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13483)] 20:54:14.617430 run osmo-hlr_10.42.42.2(pid=13483): stdout: | (launched: 2022-12-08_20:54:11.398582) 20:54:14.666872 run osmo-hlr_10.42.42.2(pid=13483): stderr: | [0;m[1;31m20221208205411574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205411574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205411574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205411574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205411574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205411574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205411586 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205411595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205411595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205411595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:54:14.716522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13478): Terminating (SIGTERM) 20:54:14.755868 run iperf3-srv_10.42.42.10(pid=13479): Terminating (SIGTERM) 20:54:14.795253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13482): Terminating (SIGTERM) 20:54:14.834905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13485): Terminating (SIGTERM) 20:54:14.874294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13488): Terminating (SIGTERM) 20:54:14.914085 --- ParallelTerminationStrategy: PID 13478 died... 20:54:14.932667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13478): Terminated: ok {rc=0} 20:54:14.977660 --- ParallelTerminationStrategy: PID 13479 died... 20:54:14.995823 run iperf3-srv_10.42.42.10(pid=13479): Terminated {rc=256} 20:54:15.039416 --- ParallelTerminationStrategy: PID 13482 died... 20:54:15.057834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13482): Terminated: ok {rc=0} 20:54:15.101661 --- ParallelTerminationStrategy: PID 13485 died... 20:54:15.120041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13485): Terminated: ok {rc=0} 20:54:15.163600 --- ParallelTerminationStrategy: PID 13488 died... 20:54:15.182055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13488): Terminated: ok {rc=0} 20:54:15.265426 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 20:54:16.407741 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:16.420122 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:54:16.473336 tst iperf3m4.py: using LAC 16746 20:54:16.594102 tst iperf3m4.py: using RAC 171 20:54:16.723447 tst iperf3m4.py: using CellId 16746 20:54:16.875295 tst iperf3m4.py: using BVCI 16747 20:54:17.031052 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:17.046867 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:17.059010 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:17.073017 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:17.084785 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:17.096748 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:17.109019 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:17.121504 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:17.133398 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:54:17.266732 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:54:17.391752 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:54:17.512870 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:54:17.634275 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:54:17.853738 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:54:18.179056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13490): Launched 20:54:18.463545 run iperf3-srv_10.42.42.10(pid=13491): Launched 20:54:18.585487 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:54:18.804175 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:54:19.129480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13492): Launched 20:54:19.413571 run iperf3-srv_10.42.42.10(pid=13493): Launched 20:54:19.536822 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:54:19.754866 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:54:20.079766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13494): Launched 20:54:20.361816 run iperf3-srv_10.42.42.10(pid=13495): Launched 20:54:20.483243 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:54:20.702070 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:54:21.027352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13496): Launched 20:54:21.310285 run iperf3-srv_10.42.42.10(pid=13497): Launched 20:54:21.433754 tst iperf3m4.py:8: start network... 20:54:21.651665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:54:22.154464 run create_hlr_db(pid=13498): Launched 20:54:22.285859 bus /gobi_6: Setting Powered False 20:54:23.350784 run create_hlr_db(pid=13498): Terminated: ok {rc=0} 20:54:23.801865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13500): Launched 20:54:24.127725 run osmo-hlr_10.42.42.2(pid=13501): Launched 20:54:24.250775 run osmo-stp_10.42.42.5: Starting osmo-stp 20:54:24.809463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13503): Launched 20:54:25.133487 run osmo-stp_10.42.42.5(pid=13504): Launched 20:54:25.258511 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:54:25.817804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13506): Launched 20:54:25.943114 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:54:26.217362 run patchelf(pid=13507): Launched 20:54:26.399685 run osmo-stp_10.42.42.5(pid=13504): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13504)] 20:54:26.537601 run osmo-stp_10.42.42.5(pid=13504): stdout: | (launched: 2022-12-08_20:54:25.074406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:26.676027 run osmo-stp_10.42.42.5(pid=13504): stderr: | [0;m[38;5;43m20221208205425266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205425266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205425266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205425267 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205425267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205425267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205425267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:26.815204 run osmo-stp_10.42.42.5(pid=13504): stdout: | (launched: 2022-12-08_20:54:25.074406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:26.948039 run osmo-stp_10.42.42.5(pid=13504): stderr: | [0;m[38;5;43m20221208205425266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205425266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205425266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205425267 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205425267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205425267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205425267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:27.105897 run patchelf(pid=13507): Terminating (SIGINT) 20:54:27.288162 run patchelf(pid=13507): Terminated: ok {rc=0} 20:54:27.419604 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13504): Process ended prematurely: osmo-stp_10.42.42.5(pid=13504) [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13504)] [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 20:54:27.429799 tst iperf3m4.py:8: Test FAILED (11.1 sec) 20:54:27.458578 run osmo-hlr_10.42.42.2(pid=13501): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13501)] 20:54:27.508592 run osmo-hlr_10.42.42.2(pid=13501): stdout: | (launched: 2022-12-08_20:54:24.068778) 20:54:27.560217 run osmo-hlr_10.42.42.2(pid=13501): stderr: | [0;m[1;31m20221208205424268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205424268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205424268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205424268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205424268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205424268 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205424280 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205424289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205424289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205424289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:54:27.612219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13490): Terminating (SIGTERM) 20:54:27.654027 run iperf3-srv_10.42.42.10(pid=13491): Terminating (SIGTERM) 20:54:27.695998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13492): Terminating (SIGTERM) 20:54:27.738060 run iperf3-srv_10.42.42.10(pid=13493): Terminating (SIGTERM) 20:54:27.779798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13494): Terminating (SIGTERM) 20:54:27.821748 run iperf3-srv_10.42.42.10(pid=13495): Terminating (SIGTERM) 20:54:27.863538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13496): Terminating (SIGTERM) 20:54:27.906078 run iperf3-srv_10.42.42.10(pid=13497): Terminating (SIGTERM) 20:54:27.947918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13500): Terminating (SIGTERM) 20:54:27.989992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13503): Terminating (SIGTERM) 20:54:28.032784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13506): Terminating (SIGTERM) 20:54:28.075320 --- ParallelTerminationStrategy: PID 13490 died... 20:54:28.095371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13490): Terminated: ok {rc=0} 20:54:28.141994 --- ParallelTerminationStrategy: PID 13491 died... 20:54:28.161713 run iperf3-srv_10.42.42.10(pid=13491): Terminated {rc=256} 20:54:28.207777 --- ParallelTerminationStrategy: PID 13492 died... 20:54:28.227364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13492): Terminated: ok {rc=0} 20:54:28.273268 --- ParallelTerminationStrategy: PID 13493 died... 20:54:28.292778 run iperf3-srv_10.42.42.10(pid=13493): Terminated {rc=256} 20:54:28.338744 --- ParallelTerminationStrategy: PID 13494 died... 20:54:28.358659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13494): Terminated: ok {rc=0} 20:54:28.404779 --- ParallelTerminationStrategy: PID 13495 died... 20:54:28.424598 run iperf3-srv_10.42.42.10(pid=13495): Terminated {rc=256} 20:54:28.470661 --- ParallelTerminationStrategy: PID 13496 died... 20:54:28.490166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13496): Terminated: ok {rc=0} 20:54:28.536233 --- ParallelTerminationStrategy: PID 13497 died... 20:54:28.555898 run iperf3-srv_10.42.42.10(pid=13497): Terminated {rc=256} 20:54:28.602104 --- ParallelTerminationStrategy: PID 13500 died... 20:54:28.621668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13500): Terminated: ok {rc=0} 20:54:28.667659 --- ParallelTerminationStrategy: PID 13503 died... 20:54:28.687154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13503): Terminated: ok {rc=0} 20:54:28.733637 --- ParallelTerminationStrategy: PID 13506 died... 20:54:28.753434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13506): Terminated: ok {rc=0} 20:54:28.841104 bus /gobi_4: Setting Powered False 20:54:29.939654 bus /gobi_4: Setting Powered False 20:54:31.056666 bus /gobi_1: Setting Powered False 20:54:32.165357 bus /gobi_1: Setting Powered False 20:54:33.281215 bus /gobi_0: Setting Powered False 20:54:34.377100 bus /gobi_0: Setting Powered False 20:54:35.492429 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 20:54:36.595057 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:36.607150 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:54:36.659595 tst ping.py: using LAC 16747 20:54:36.777475 tst ping.py: using RAC 172 20:54:36.895597 tst ping.py: using CellId 16747 20:54:37.011495 tst ping.py: using BVCI 16748 20:54:37.128097 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:37.139734 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:37.151139 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:37.162667 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:37.174116 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:37.185661 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:37.197440 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:37.208825 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:54:37.325569 tst ping.py:19: start network... 20:54:37.522913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:54:37.978535 run create_hlr_db(pid=13508): Launched 20:54:38.091894 bus /gobi_6: Setting Powered False 20:54:39.150997 run create_hlr_db(pid=13508): Terminated: ok {rc=0} 20:54:39.562866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13510): Launched 20:54:39.858427 run osmo-hlr_10.42.42.2(pid=13511): Launched 20:54:39.974907 run osmo-stp_10.42.42.5: Starting osmo-stp 20:54:40.498177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13513): Launched 20:54:40.794149 run osmo-stp_10.42.42.5(pid=13514): Launched 20:54:40.907206 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:54:41.416756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13516): Launched 20:54:41.530647 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:54:41.781026 run patchelf(pid=13517): Launched 20:54:41.946708 run osmo-stp_10.42.42.5(pid=13514): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13514)] 20:54:42.072328 run osmo-stp_10.42.42.5(pid=13514): stdout: | (launched: 2022-12-08_20:54:40.740211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:42.199944 run osmo-stp_10.42.42.5(pid=13514): stderr: | [0;m[38;5;43m20221208205440907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205440908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205440908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205440908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205440909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205440909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205440909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:42.327191 run osmo-stp_10.42.42.5(pid=13514): stdout: | (launched: 2022-12-08_20:54:40.740211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:42.448867 run osmo-stp_10.42.42.5(pid=13514): stderr: | [0;m[38;5;43m20221208205440907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205440908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205440908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205440908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205440909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205440909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205440909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:42.592761 run patchelf(pid=13517): Terminating (SIGINT) 20:54:42.759301 run patchelf(pid=13517): Terminated: ok {rc=0} 20:54:42.880180 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13514): Process ended prematurely: osmo-stp_10.42.42.5(pid=13514) [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13514)] [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 20:54:42.889227 tst ping.py:22: Test FAILED (6.3 sec) 20:54:42.916241 run osmo-hlr_10.42.42.2(pid=13511): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13511)] 20:54:42.964759 run osmo-hlr_10.42.42.2(pid=13511): stdout: | (launched: 2022-12-08_20:54:39.804032) 20:54:43.014417 run osmo-hlr_10.42.42.2(pid=13511): stderr: | [0;m[1;31m20221208205439980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205439980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205439980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205439980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205439980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205439980 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205439992 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205440000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205440000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205440000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:54:43.064421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13510): Terminating (SIGTERM) 20:54:43.104150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13513): Terminating (SIGTERM) 20:54:43.143769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13516): Terminating (SIGTERM) 20:54:43.184197 --- ParallelTerminationStrategy: PID 13510 died... 20:54:43.203470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13510): Terminated: ok {rc=0} 20:54:43.247943 --- ParallelTerminationStrategy: PID 13513 died... 20:54:43.266676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13513): Terminated: ok {rc=0} 20:54:43.310870 --- ParallelTerminationStrategy: PID 13516 died... 20:54:43.329485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13516): Terminated: ok {rc=0} 20:54:43.416018 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 20:54:44.504266 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:44.516187 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:54:44.568052 tst ping_idle_ping.py: using LAC 16748 20:54:44.687097 tst ping_idle_ping.py: using RAC 173 20:54:44.803314 tst ping_idle_ping.py: using CellId 16748 20:54:44.919467 tst ping_idle_ping.py: using BVCI 16749 20:54:45.037372 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:45.049076 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:45.060488 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:45.072466 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:45.084422 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:45.096413 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:45.108663 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:45.120692 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:54:45.240872 tst ping_idle_ping.py:24: start network... 20:54:45.456404 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:54:45.987752 run create_hlr_db(pid=13518): Launched 20:54:46.156612 bus /gobi_6: Setting Powered False 20:54:47.234631 run create_hlr_db(pid=13518): Terminated: ok {rc=0} 20:54:47.664873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13520): Launched 20:54:47.962061 run osmo-hlr_10.42.42.2(pid=13521): Launched 20:54:48.074611 run osmo-stp_10.42.42.5: Starting osmo-stp 20:54:48.587698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13523): Launched 20:54:48.884810 run osmo-stp_10.42.42.5(pid=13524): Launched 20:54:48.998584 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:54:49.510208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13526): Launched 20:54:49.626270 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:54:49.877757 run patchelf(pid=13527): Launched 20:54:50.043447 run osmo-stp_10.42.42.5(pid=13524): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13524)] 20:54:50.169828 run osmo-stp_10.42.42.5(pid=13524): stdout: | (launched: 2022-12-08_20:54:48.830443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:50.297133 run osmo-stp_10.42.42.5(pid=13524): stderr: | [0;m[38;5;43m20221208205448999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205448999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205448999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205448999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205449000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205449000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205449000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:50.424820 run osmo-stp_10.42.42.5(pid=13524): stdout: | (launched: 2022-12-08_20:54:48.830443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:50.546381 run osmo-stp_10.42.42.5(pid=13524): stderr: | [0;m[38;5;43m20221208205448999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205448999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205448999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205448999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205449000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205449000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205449000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:50.690330 run patchelf(pid=13527): Terminating (SIGINT) 20:54:50.857819 run patchelf(pid=13527): Terminated: ok {rc=0} 20:54:50.978715 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13524): Process ended prematurely: osmo-stp_10.42.42.5(pid=13524) [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13524)] [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 20:54:50.987557 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 20:54:51.014710 run osmo-hlr_10.42.42.2(pid=13521): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13521)] 20:54:51.062367 run osmo-hlr_10.42.42.2(pid=13521): stdout: | (launched: 2022-12-08_20:54:47.907933) 20:54:51.111556 run osmo-hlr_10.42.42.2(pid=13521): stderr: | [0;m[1;31m20221208205448083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205448083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205448083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205448083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205448083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205448083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205448095 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205448103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205448104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205448104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:54:51.161534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13520): Terminating (SIGTERM) 20:54:51.201396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13523): Terminating (SIGTERM) 20:54:51.241196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13526): Terminating (SIGTERM) 20:54:51.281329 --- ParallelTerminationStrategy: PID 13520 died... 20:54:51.300410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13520): Terminated: ok {rc=0} 20:54:51.344556 --- ParallelTerminationStrategy: PID 13523 died... 20:54:51.363132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13523): Terminated: ok {rc=0} 20:54:51.406872 --- ParallelTerminationStrategy: PID 13526 died... 20:54:51.425803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13526): Terminated: ok {rc=0} 20:54:51.511697 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 20:54:52.815288 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:54:52.821580 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 20:54:52.855507 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 20:54:52.893954 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 20:54:52.981171 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 20:54:53.014370 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 20:54:53.052881 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 20:54:53.648122 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 20:54:53.697236 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:54:53.708102 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:54:53.775710 tst cs_paging_gprs_active.py: using LAC 16749 20:54:53.892043 tst cs_paging_gprs_active.py: using RAC 174 20:54:54.011755 tst cs_paging_gprs_active.py: using CellId 16749 20:54:54.129945 tst cs_paging_gprs_active.py: using BVCI 16750 20:54:54.241606 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:54:54.252345 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:54:54.263099 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:54:54.274141 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:54:54.284858 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:54:54.295792 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:54:54.306792 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:54:54.317781 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:54:54.328770 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:54:54.448516 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:54:54.566468 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:54:54.769475 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:54:55.073609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13532): Launched 20:54:55.337524 run iperf3-srv_10.42.42.10(pid=13533): Launched 20:54:55.451038 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:54:55.653477 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:54:55.957126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13534): Launched 20:54:56.219914 run iperf3-srv_10.42.42.10(pid=13535): Launched 20:54:56.333433 tst cs_paging_gprs_active.py:38: start network... 20:54:56.535246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:54:57.004014 run create_hlr_db(pid=13536): Launched 20:54:57.138347 bus /gobi_6: Setting Powered False 20:54:58.203332 run create_hlr_db(pid=13536): Terminated: ok {rc=0} 20:54:58.634819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13538): Launched 20:54:58.936904 run osmo-hlr_10.42.42.2(pid=13539): Launched 20:54:59.053157 run osmo-stp_10.42.42.5: Starting osmo-stp 20:54:59.585351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13541): Launched 20:54:59.909936 run osmo-stp_10.42.42.5(pid=13542): Launched 20:55:00.033856 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:55:00.592432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13544): Launched 20:55:00.717106 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:55:01.004445 run patchelf(pid=13545): Launched 20:55:01.204598 run osmo-stp_10.42.42.5(pid=13542): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13542)] 20:55:01.344572 run osmo-stp_10.42.42.5(pid=13542): stdout: | (launched: 2022-12-08_20:54:59.850806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:01.486377 run osmo-stp_10.42.42.5(pid=13542): stderr: | [0;m[38;5;43m20221208205500043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205500044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205500044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205500044 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205500045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205500045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205500045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:01.628217 run osmo-stp_10.42.42.5(pid=13542): stdout: | (launched: 2022-12-08_20:54:59.850806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:01.793084 run osmo-stp_10.42.42.5(pid=13542): stderr: | [0;m[38;5;43m20221208205500043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205500044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205500044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205500044 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205500045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205500045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205500045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:01.974513 run patchelf(pid=13545): Terminating (SIGINT) 20:55:02.159749 run patchelf(pid=13545): Terminated: ok {rc=0} 20:55:02.292272 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13542): Process ended prematurely: osmo-stp_10.42.42.5(pid=13542) [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13542)] [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 20:55:02.302620 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 20:55:02.331164 run osmo-hlr_10.42.42.2(pid=13539): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13539)] 20:55:02.381981 run osmo-hlr_10.42.42.2(pid=13539): stdout: | (launched: 2022-12-08_20:54:58.881522) 20:55:02.433966 run osmo-hlr_10.42.42.2(pid=13539): stderr: | [0;m[1;31m20221208205459059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205459059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205459059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205459059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205459060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205459060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205459072 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205459082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205459082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205459082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:55:02.485721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13532): Terminating (SIGTERM) 20:55:02.527487 run iperf3-srv_10.42.42.10(pid=13533): Terminating (SIGTERM) 20:55:02.569340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13534): Terminating (SIGTERM) 20:55:02.611146 run iperf3-srv_10.42.42.10(pid=13535): Terminating (SIGTERM) 20:55:02.652639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13538): Terminating (SIGTERM) 20:55:02.694505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13541): Terminating (SIGTERM) 20:55:02.736015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13544): Terminating (SIGTERM) 20:55:02.778088 --- ParallelTerminationStrategy: PID 13532 died... 20:55:02.798091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13532): Terminated: ok {rc=0} 20:55:02.844158 --- ParallelTerminationStrategy: PID 13533 died... 20:55:02.863672 run iperf3-srv_10.42.42.10(pid=13533): Terminated {rc=256} 20:55:02.909521 --- ParallelTerminationStrategy: PID 13534 died... 20:55:02.929157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13534): Terminated: ok {rc=0} 20:55:02.975143 --- ParallelTerminationStrategy: PID 13535 died... 20:55:02.994916 run iperf3-srv_10.42.42.10(pid=13535): Terminated {rc=256} 20:55:03.041600 --- ParallelTerminationStrategy: PID 13538 died... 20:55:03.061342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13538): Terminated: ok {rc=0} 20:55:03.107442 --- ParallelTerminationStrategy: PID 13541 died... 20:55:03.127207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13541): Terminated: ok {rc=0} 20:55:03.173302 --- ParallelTerminationStrategy: PID 13544 died... 20:55:03.193135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13544): Terminated: ok {rc=0} 20:55:03.280727 bus /gobi_0: Setting Powered False 20:55:04.378013 bus /gobi_0: Setting Powered False 20:55:05.493800 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 20:55:06.643974 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:06.656001 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:55:06.727838 tst iperf3.py: using LAC 16750 20:55:06.856162 tst iperf3.py: using RAC 175 20:55:06.982031 tst iperf3.py: using CellId 16750 20:55:07.109078 tst iperf3.py: using BVCI 16751 20:55:07.219510 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:07.230687 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:07.241463 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:07.252316 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:07.263296 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:07.274280 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:07.285218 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:07.295985 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:07.306923 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:55:07.426229 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:55:07.646182 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:55:07.970210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13550): Launched 20:55:08.253218 run iperf3-srv_10.42.42.10(pid=13551): Launched 20:55:08.376364 tst iperf3.py:8: start network... 20:55:08.594304 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:55:09.095669 run create_hlr_db(pid=13552): Launched 20:55:09.227543 bus /gobi_6: Setting Powered False 20:55:10.291717 run create_hlr_db(pid=13552): Terminated: ok {rc=0} 20:55:10.723564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13554): Launched 20:55:11.024118 run osmo-hlr_10.42.42.2(pid=13555): Launched 20:55:11.138479 run osmo-stp_10.42.42.5: Starting osmo-stp 20:55:11.659468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13557): Launched 20:55:11.960386 run osmo-stp_10.42.42.5(pid=13558): Launched 20:55:12.073956 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:55:12.590495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13560): Launched 20:55:12.705891 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:55:12.960199 run patchelf(pid=13561): Launched 20:55:13.128599 run osmo-stp_10.42.42.5(pid=13558): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13558)] 20:55:13.256398 run osmo-stp_10.42.42.5(pid=13558): stdout: | (launched: 2022-12-08_20:55:11.904780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:13.385704 run osmo-stp_10.42.42.5(pid=13558): stderr: | [0;m[38;5;43m20221208205512076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205512076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205512077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205512077 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205512078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205512078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205512078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:13.515371 run osmo-stp_10.42.42.5(pid=13558): stdout: | (launched: 2022-12-08_20:55:11.904780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:13.638868 run osmo-stp_10.42.42.5(pid=13558): stderr: | [0;m[38;5;43m20221208205512076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205512076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205512077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205512077 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205512078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205512078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205512078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:13.785320 run patchelf(pid=13561): Terminating (SIGINT) 20:55:13.954812 run patchelf(pid=13561): Terminated: ok {rc=0} 20:55:14.076838 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13558): Process ended prematurely: osmo-stp_10.42.42.5(pid=13558) [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13558)] [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 20:55:14.086265 tst iperf3.py:8: Test FAILED (7.5 sec) 20:55:14.113772 run osmo-hlr_10.42.42.2(pid=13555): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13555)] 20:55:14.161614 run osmo-hlr_10.42.42.2(pid=13555): stdout: | (launched: 2022-12-08_20:55:10.969148) 20:55:14.210527 run osmo-hlr_10.42.42.2(pid=13555): stderr: | [0;m[1;31m20221208205511146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205511146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205511146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205511146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205511146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205511146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205511159 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205511168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205511168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205511168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:55:14.260124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13550): Terminating (SIGTERM) 20:55:14.299504 run iperf3-srv_10.42.42.10(pid=13551): Terminating (SIGTERM) 20:55:14.338655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13554): Terminating (SIGTERM) 20:55:14.378012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13557): Terminating (SIGTERM) 20:55:14.417278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13560): Terminating (SIGTERM) 20:55:14.457293 --- ParallelTerminationStrategy: PID 13550 died... 20:55:14.476169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13550): Terminated: ok {rc=0} 20:55:14.520309 --- ParallelTerminationStrategy: PID 13551 died... 20:55:14.538857 run iperf3-srv_10.42.42.10(pid=13551): Terminated {rc=256} 20:55:14.583207 --- ParallelTerminationStrategy: PID 13554 died... 20:55:14.601727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13554): Terminated: ok {rc=0} 20:55:14.645876 --- ParallelTerminationStrategy: PID 13557 died... 20:55:14.664389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13557): Terminated: ok {rc=0} 20:55:14.708262 --- ParallelTerminationStrategy: PID 13560 died... 20:55:14.726877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13560): Terminated: ok {rc=0} 20:55:14.812691 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 20:55:15.976741 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:15.989280 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:55:16.063268 tst iperf3m4.py: using LAC 16751 20:55:16.192362 tst iperf3m4.py: using RAC 176 20:55:16.321744 tst iperf3m4.py: using CellId 16751 20:55:16.450462 tst iperf3m4.py: using BVCI 16752 20:55:16.598726 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:16.610678 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:16.622581 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:16.634767 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:16.647117 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:16.659220 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:16.671256 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:16.683578 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:16.695644 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:55:16.818849 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:55:16.959163 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:55:17.081733 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:55:17.229490 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:55:17.451925 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:55:17.777064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13562): Launched 20:55:18.059697 run iperf3-srv_10.42.42.10(pid=13563): Launched 20:55:18.182810 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:55:18.401358 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:55:18.725953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13564): Launched 20:55:19.010046 run iperf3-srv_10.42.42.10(pid=13565): Launched 20:55:19.133826 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:55:19.351997 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:55:19.677629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13566): Launched 20:55:19.961358 run iperf3-srv_10.42.42.10(pid=13567): Launched 20:55:20.084785 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:55:20.302971 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:55:20.628494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13568): Launched 20:55:20.910187 run iperf3-srv_10.42.42.10(pid=13569): Launched 20:55:21.032911 tst iperf3m4.py:8: start network... 20:55:21.251663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:55:21.754508 run create_hlr_db(pid=13570): Launched 20:55:21.887604 bus /gobi_6: Setting Powered False 20:55:22.951379 run create_hlr_db(pid=13570): Terminated: ok {rc=0} 20:55:23.383729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13572): Launched 20:55:23.686140 run osmo-hlr_10.42.42.2(pid=13573): Launched 20:55:23.800892 run osmo-stp_10.42.42.5: Starting osmo-stp 20:55:24.317693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13575): Launched 20:55:24.619226 run osmo-stp_10.42.42.5(pid=13576): Launched 20:55:24.733580 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:55:25.252813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13578): Launched 20:55:25.368390 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:55:25.623480 run patchelf(pid=13579): Launched 20:55:25.791634 run osmo-stp_10.42.42.5(pid=13576): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13576)] 20:55:25.919689 run osmo-stp_10.42.42.5(pid=13576): stdout: | (launched: 2022-12-08_20:55:24.563681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:26.048840 run osmo-stp_10.42.42.5(pid=13576): stderr: | [0;m[38;5;43m20221208205524733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205524733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205524734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205524734 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205524735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205524735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205524735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:26.178292 run osmo-stp_10.42.42.5(pid=13576): stdout: | (launched: 2022-12-08_20:55:24.563681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:26.302108 run osmo-stp_10.42.42.5(pid=13576): stderr: | [0;m[38;5;43m20221208205524733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205524733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205524734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205524734 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205524735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205524735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205524735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:26.449292 run patchelf(pid=13579): Terminating (SIGINT) 20:55:26.619132 run patchelf(pid=13579): Terminated: ok {rc=0} 20:55:26.741305 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13576): Process ended prematurely: osmo-stp_10.42.42.5(pid=13576) [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13576)] [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 20:55:26.750702 tst iperf3m4.py:8: Test FAILED (10.8 sec) 20:55:26.778198 run osmo-hlr_10.42.42.2(pid=13573): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13573)] 20:55:26.826176 run osmo-hlr_10.42.42.2(pid=13573): stdout: | (launched: 2022-12-08_20:55:23.630672) 20:55:26.875480 run osmo-hlr_10.42.42.2(pid=13573): stderr: | [0;m[1;31m20221208205523807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205523807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205523807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205523807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205523807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205523807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205523825 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205523834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205523834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205523834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:55:26.925231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13562): Terminating (SIGTERM) 20:55:26.965142 run iperf3-srv_10.42.42.10(pid=13563): Terminating (SIGTERM) 20:55:27.004763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13564): Terminating (SIGTERM) 20:55:27.044170 run iperf3-srv_10.42.42.10(pid=13565): Terminating (SIGTERM) 20:55:27.083761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13566): Terminating (SIGTERM) 20:55:27.123517 run iperf3-srv_10.42.42.10(pid=13567): Terminating (SIGTERM) 20:55:27.163140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13568): Terminating (SIGTERM) 20:55:27.203088 run iperf3-srv_10.42.42.10(pid=13569): Terminating (SIGTERM) 20:55:27.243900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13572): Terminating (SIGTERM) 20:55:27.288639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13575): Terminating (SIGTERM) 20:55:27.331106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13578): Terminating (SIGTERM) 20:55:27.373698 --- ParallelTerminationStrategy: PID 13562 died... 20:55:27.393884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13562): Terminated: ok {rc=0} 20:55:27.441610 --- ParallelTerminationStrategy: PID 13563 died... 20:55:27.461498 run iperf3-srv_10.42.42.10(pid=13563): Terminated {rc=256} 20:55:27.509227 --- ParallelTerminationStrategy: PID 13564 died... 20:55:27.528849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13564): Terminated: ok {rc=0} 20:55:27.576383 --- ParallelTerminationStrategy: PID 13565 died... 20:55:27.596107 run iperf3-srv_10.42.42.10(pid=13565): Terminated {rc=256} 20:55:27.643352 --- ParallelTerminationStrategy: PID 13566 died... 20:55:27.663184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13566): Terminated: ok {rc=0} 20:55:27.710355 --- ParallelTerminationStrategy: PID 13567 died... 20:55:27.730097 run iperf3-srv_10.42.42.10(pid=13567): Terminated {rc=256} 20:55:27.777617 --- ParallelTerminationStrategy: PID 13568 died... 20:55:27.797388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13568): Terminated: ok {rc=0} 20:55:27.844734 --- ParallelTerminationStrategy: PID 13569 died... 20:55:27.864421 run iperf3-srv_10.42.42.10(pid=13569): Terminated {rc=256} 20:55:27.911578 --- ParallelTerminationStrategy: PID 13572 died... 20:55:27.931212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13572): Terminated: ok {rc=0} 20:55:27.978248 --- ParallelTerminationStrategy: PID 13575 died... 20:55:27.998248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13575): Terminated: ok {rc=0} 20:55:28.045353 --- ParallelTerminationStrategy: PID 13578 died... 20:55:28.065144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13578): Terminated: ok {rc=0} 20:55:28.154320 bus /gobi_4: Setting Powered False 20:55:29.255260 bus /gobi_4: Setting Powered False 20:55:30.372566 bus /gobi_1: Setting Powered False 20:55:31.474533 bus /gobi_1: Setting Powered False 20:55:32.594066 bus /gobi_0: Setting Powered False 20:55:33.692824 bus /gobi_0: Setting Powered False 20:55:34.809885 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 20:55:35.915555 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:35.927607 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:55:36.000410 tst ping.py: using LAC 16752 20:55:36.126488 tst ping.py: using RAC 177 20:55:36.256411 tst ping.py: using CellId 16752 20:55:36.380513 tst ping.py: using BVCI 16753 20:55:36.497949 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:36.509459 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:36.520596 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:36.531808 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:36.542921 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:36.554066 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:36.565438 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:36.576567 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:55:36.695221 tst ping.py:19: start network... 20:55:36.909540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:55:37.402041 run create_hlr_db(pid=13580): Launched 20:55:37.531042 bus /gobi_6: Setting Powered False 20:55:38.594410 run create_hlr_db(pid=13580): Terminated: ok {rc=0} 20:55:39.019584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13582): Launched 20:55:39.316925 run osmo-hlr_10.42.42.2(pid=13583): Launched 20:55:39.430039 run osmo-stp_10.42.42.5: Starting osmo-stp 20:55:39.941593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13585): Launched 20:55:40.239428 run osmo-stp_10.42.42.5(pid=13586): Launched 20:55:40.352401 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:55:40.863946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13588): Launched 20:55:40.978176 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:55:41.230226 run patchelf(pid=13589): Launched 20:55:41.396591 run osmo-stp_10.42.42.5(pid=13586): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13586)] 20:55:41.522795 run osmo-stp_10.42.42.5(pid=13586): stdout: | (launched: 2022-12-08_20:55:40.184280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:41.649987 run osmo-stp_10.42.42.5(pid=13586): stderr: | [0;m[38;5;43m20221208205540353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205540353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205540353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205540353 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205540356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205540356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205540356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:41.777577 run osmo-stp_10.42.42.5(pid=13586): stdout: | (launched: 2022-12-08_20:55:40.184280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:41.902405 run osmo-stp_10.42.42.5(pid=13586): stderr: | [0;m[38;5;43m20221208205540353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205540353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205540353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205540353 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205540356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205540356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205540356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:42.047855 run patchelf(pid=13589): Terminating (SIGINT) 20:55:42.214370 run patchelf(pid=13589): Terminated: ok {rc=0} 20:55:42.334648 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13586): Process ended prematurely: osmo-stp_10.42.42.5(pid=13586) [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13586)] [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 20:55:42.343807 tst ping.py:22: Test FAILED (6.4 sec) 20:55:42.371583 run osmo-hlr_10.42.42.2(pid=13583): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13583)] 20:55:42.420114 run osmo-hlr_10.42.42.2(pid=13583): stdout: | (launched: 2022-12-08_20:55:39.261478) 20:55:42.469731 run osmo-hlr_10.42.42.2(pid=13583): stderr: | [0;m[1;31m20221208205539435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205539435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205539435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205539435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205539435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205539435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205539448 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205539457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205539457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205539457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:55:42.519915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13582): Terminating (SIGTERM) 20:55:42.560159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13585): Terminating (SIGTERM) 20:55:42.600421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13588): Terminating (SIGTERM) 20:55:42.640883 --- ParallelTerminationStrategy: PID 13582 died... 20:55:42.659881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13582): Terminated: ok {rc=0} 20:55:42.705108 --- ParallelTerminationStrategy: PID 13585 died... 20:55:42.723731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13585): Terminated: ok {rc=0} 20:55:42.767971 --- ParallelTerminationStrategy: PID 13588 died... 20:55:42.786549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13588): Terminated: ok {rc=0} 20:55:42.870421 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 20:55:43.957220 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:43.969959 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:55:44.044623 tst ping_idle_ping.py: using LAC 16753 20:55:44.171801 tst ping_idle_ping.py: using RAC 178 20:55:44.298500 tst ping_idle_ping.py: using CellId 16753 20:55:44.425966 tst ping_idle_ping.py: using BVCI 16754 20:55:44.542691 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:44.554544 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:44.566069 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:44.577890 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:44.589814 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:44.601490 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:44.613306 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:44.624775 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:55:44.745190 tst ping_idle_ping.py:24: start network... 20:55:44.960422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:55:45.458638 run create_hlr_db(pid=13590): Launched 20:55:45.587766 bus /gobi_6: Setting Powered False 20:55:46.649279 run create_hlr_db(pid=13590): Terminated: ok {rc=0} 20:55:47.110551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13592): Launched 20:55:47.440773 run osmo-hlr_10.42.42.2(pid=13593): Launched 20:55:47.563733 run osmo-stp_10.42.42.5: Starting osmo-stp 20:55:48.113665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13595): Launched 20:55:48.433357 run osmo-stp_10.42.42.5(pid=13596): Launched 20:55:48.554988 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:55:49.106273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13598): Launched 20:55:49.228707 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:55:49.500214 run patchelf(pid=13599): Launched 20:55:49.678782 run osmo-stp_10.42.42.5(pid=13596): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13596)] 20:55:49.815954 run osmo-stp_10.42.42.5(pid=13596): stdout: | (launched: 2022-12-08_20:55:48.374292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:49.953725 run osmo-stp_10.42.42.5(pid=13596): stderr: | [0;m[38;5;43m20221208205548567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205548567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205548567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205548568 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205548568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205548568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205548568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:50.091511 run osmo-stp_10.42.42.5(pid=13596): stdout: | (launched: 2022-12-08_20:55:48.374292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:50.222955 run osmo-stp_10.42.42.5(pid=13596): stderr: | [0;m[38;5;43m20221208205548567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205548567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205548567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205548568 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205548568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205548568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205548568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:50.378203 run patchelf(pid=13599): Terminating (SIGINT) 20:55:50.558380 run patchelf(pid=13599): Terminated: ok {rc=0} 20:55:50.687177 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13596): Process ended prematurely: osmo-stp_10.42.42.5(pid=13596) [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13596)] [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 20:55:50.696771 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 20:55:50.725056 run osmo-hlr_10.42.42.2(pid=13593): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13593)] 20:55:50.775342 run osmo-hlr_10.42.42.2(pid=13593): stdout: | (launched: 2022-12-08_20:55:47.381807) 20:55:50.827408 run osmo-hlr_10.42.42.2(pid=13593): stderr: | [0;m[1;31m20221208205547580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205547580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205547580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205547581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205547581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205547581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205547592 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205547600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205547601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205547601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:55:50.879784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13592): Terminating (SIGTERM) 20:55:50.922008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13595): Terminating (SIGTERM) 20:55:50.964460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13598): Terminating (SIGTERM) 20:55:51.007114 --- ParallelTerminationStrategy: PID 13592 died... 20:55:51.027212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13592): Terminated: ok {rc=0} 20:55:51.074413 --- ParallelTerminationStrategy: PID 13595 died... 20:55:51.094326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13595): Terminated: ok {rc=0} 20:55:51.141556 --- ParallelTerminationStrategy: PID 13598 died... 20:55:51.161485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13598): Terminated: ok {rc=0} 20:55:51.249255 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:55:52.548474 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:55:52.555612 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:55:52.590715 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 20:55:52.630785 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 20:55:52.720140 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:55:52.754610 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 20:55:52.794830 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 20:55:53.390525 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 20:55:53.443549 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:55:53.455179 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:55:53.527664 tst cs_paging_gprs_active.py: using LAC 16754 20:55:53.650809 tst cs_paging_gprs_active.py: using RAC 179 20:55:53.772484 tst cs_paging_gprs_active.py: using CellId 16754 20:55:53.893352 tst cs_paging_gprs_active.py: using BVCI 16755 20:55:54.013155 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:55:54.024807 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:55:54.036261 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:55:54.047879 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:55:54.059830 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:55:54.071471 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:55:54.083246 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:55:54.094832 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:55:54.106387 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:55:54.225618 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:55:54.350171 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:55:54.553935 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:55:54.858365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13603): Launched 20:55:55.122579 run iperf3-srv_10.42.42.10(pid=13604): Launched 20:55:55.236406 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:55:55.439881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:55:55.744332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13605): Launched 20:55:56.007827 run iperf3-srv_10.42.42.10(pid=13606): Launched 20:55:56.121923 tst cs_paging_gprs_active.py:38: start network... 20:55:56.323757 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:55:56.792206 run create_hlr_db(pid=13607): Launched 20:55:56.910016 bus /gobi_6: Setting Powered False 20:55:57.970226 run create_hlr_db(pid=13607): Terminated: ok {rc=0} 20:55:58.414221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13609): Launched 20:55:58.740072 run osmo-hlr_10.42.42.2(pid=13610): Launched 20:55:58.863503 run osmo-stp_10.42.42.5: Starting osmo-stp 20:55:59.424701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13612): Launched 20:55:59.750704 run osmo-stp_10.42.42.5(pid=13613): Launched 20:55:59.874220 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:56:00.434880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13615): Launched 20:56:00.560175 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:56:00.845690 run patchelf(pid=13616): Launched 20:56:01.067429 run osmo-stp_10.42.42.5(pid=13613): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13613)] 20:56:01.208606 run osmo-stp_10.42.42.5(pid=13613): stdout: | (launched: 2022-12-08_20:55:59.691230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:01.351413 run osmo-stp_10.42.42.5(pid=13613): stderr: | [0;m[38;5;43m20221208205559884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205559884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205559885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205559885 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205559886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205559886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205559886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:01.494924 run osmo-stp_10.42.42.5(pid=13613): stdout: | (launched: 2022-12-08_20:55:59.691230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:01.632609 run osmo-stp_10.42.42.5(pid=13613): stderr: | [0;m[38;5;43m20221208205559884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205559884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205559885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205559885 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205559886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205559886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205559886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:01.794868 run patchelf(pid=13616): Terminating (SIGINT) 20:56:01.982055 run patchelf(pid=13616): Terminated: ok {rc=0} 20:56:02.116336 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13613): Process ended prematurely: osmo-stp_10.42.42.5(pid=13613) [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13613)] [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 20:56:02.127288 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 20:56:02.157076 run osmo-hlr_10.42.42.2(pid=13610): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13610)] 20:56:02.207487 run osmo-hlr_10.42.42.2(pid=13610): stdout: | (launched: 2022-12-08_20:55:58.680227) 20:56:02.259593 run osmo-hlr_10.42.42.2(pid=13610): stderr: | [0;m[1;31m20221208205558880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205558880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205558880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205558880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205558880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205558880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205558892 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205558900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205558900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205558901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:56:02.311787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13603): Terminating (SIGTERM) 20:56:02.353806 run iperf3-srv_10.42.42.10(pid=13604): Terminating (SIGTERM) 20:56:02.395932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13605): Terminating (SIGTERM) 20:56:02.438000 run iperf3-srv_10.42.42.10(pid=13606): Terminating (SIGTERM) 20:56:02.479881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13609): Terminating (SIGTERM) 20:56:02.521816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13612): Terminating (SIGTERM) 20:56:02.563676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13615): Terminating (SIGTERM) 20:56:02.605864 --- ParallelTerminationStrategy: PID 13603 died... 20:56:02.626008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13603): Terminated: ok {rc=0} 20:56:02.672364 --- ParallelTerminationStrategy: PID 13604 died... 20:56:02.692116 run iperf3-srv_10.42.42.10(pid=13604): Terminated {rc=256} 20:56:02.737918 --- ParallelTerminationStrategy: PID 13605 died... 20:56:02.757574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13605): Terminated: ok {rc=0} 20:56:02.803791 --- ParallelTerminationStrategy: PID 13606 died... 20:56:02.823493 run iperf3-srv_10.42.42.10(pid=13606): Terminated {rc=256} 20:56:02.869630 --- ParallelTerminationStrategy: PID 13609 died... 20:56:02.889311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13609): Terminated: ok {rc=0} 20:56:02.935375 --- ParallelTerminationStrategy: PID 13612 died... 20:56:02.955015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13612): Terminated: ok {rc=0} 20:56:03.001294 --- ParallelTerminationStrategy: PID 13615 died... 20:56:03.020758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13615): Terminated: ok {rc=0} 20:56:03.108672 bus /gobi_0: Setting Powered False 20:56:04.206713 bus /gobi_0: Setting Powered False 20:56:05.323109 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 20:56:06.468483 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:06.480089 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:56:06.550602 tst iperf3.py: using LAC 16755 20:56:06.680877 tst iperf3.py: using RAC 180 20:56:06.810326 tst iperf3.py: using CellId 16755 20:56:06.937456 tst iperf3.py: using BVCI 16756 20:56:07.050605 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:07.061725 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:07.072518 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:07.083695 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:07.094902 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:07.106061 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:07.117186 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:07.127962 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:07.139100 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:56:07.255867 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:56:07.458898 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:56:07.762187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13617): Launched 20:56:08.026410 run iperf3-srv_10.42.42.10(pid=13618): Launched 20:56:08.140411 tst iperf3.py:8: start network... 20:56:08.342415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:56:08.810250 run create_hlr_db(pid=13619): Launched 20:56:08.925646 bus /gobi_6: Setting Powered False 20:56:09.985743 run create_hlr_db(pid=13619): Terminated: ok {rc=0} 20:56:10.431029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13621): Launched 20:56:10.756671 run osmo-hlr_10.42.42.2(pid=13622): Launched 20:56:10.879778 run osmo-stp_10.42.42.5: Starting osmo-stp 20:56:11.439626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13624): Launched 20:56:11.765615 run osmo-stp_10.42.42.5(pid=13625): Launched 20:56:11.889883 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:56:12.451542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13627): Launched 20:56:12.575778 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:56:12.850586 run patchelf(pid=13628): Launched 20:56:13.031469 run osmo-stp_10.42.42.5(pid=13625): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13625)] 20:56:13.169759 run osmo-stp_10.42.42.5(pid=13625): stdout: | (launched: 2022-12-08_20:56:11.706277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:13.308936 run osmo-stp_10.42.42.5(pid=13625): stderr: | [0;m[38;5;43m20221208205611899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205611899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205611899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205611899 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205611900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205611900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205611900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:13.448264 run osmo-stp_10.42.42.5(pid=13625): stdout: | (launched: 2022-12-08_20:56:11.706277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:13.582744 run osmo-stp_10.42.42.5(pid=13625): stderr: | [0;m[38;5;43m20221208205611899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205611899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205611899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205611899 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205611900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205611900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205611900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:13.740754 run patchelf(pid=13628): Terminating (SIGINT) 20:56:13.923401 run patchelf(pid=13628): Terminated: ok {rc=0} 20:56:14.054380 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13625): Process ended prematurely: osmo-stp_10.42.42.5(pid=13625) [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13625)] [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 20:56:14.064562 tst iperf3.py:8: Test FAILED (7.6 sec) 20:56:14.093617 run osmo-hlr_10.42.42.2(pid=13622): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13622)] 20:56:14.143860 run osmo-hlr_10.42.42.2(pid=13622): stdout: | (launched: 2022-12-08_20:56:10.697426) 20:56:14.195891 run osmo-hlr_10.42.42.2(pid=13622): stderr: | [0;m[1;31m20221208205610900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205610900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205610900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205610900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205610900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205610900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205610913 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205610921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205610921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205610921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:56:14.248150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13617): Terminating (SIGTERM) 20:56:14.290364 run iperf3-srv_10.42.42.10(pid=13618): Terminating (SIGTERM) 20:56:14.332257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13621): Terminating (SIGTERM) 20:56:14.374378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13624): Terminating (SIGTERM) 20:56:14.416726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13627): Terminating (SIGTERM) 20:56:14.459185 --- ParallelTerminationStrategy: PID 13617 died... 20:56:14.479213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13617): Terminated: ok {rc=0} 20:56:14.525625 --- ParallelTerminationStrategy: PID 13618 died... 20:56:14.545158 run iperf3-srv_10.42.42.10(pid=13618): Terminated {rc=256} 20:56:14.591154 --- ParallelTerminationStrategy: PID 13621 died... 20:56:14.610784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13621): Terminated: ok {rc=0} 20:56:14.657122 --- ParallelTerminationStrategy: PID 13624 died... 20:56:14.676730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13624): Terminated: ok {rc=0} 20:56:14.723446 --- ParallelTerminationStrategy: PID 13627 died... 20:56:14.743241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13627): Terminated: ok {rc=0} 20:56:14.831197 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 20:56:15.991251 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:16.005934 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:56:16.091081 tst iperf3m4.py: using LAC 16756 20:56:16.253952 tst iperf3m4.py: using RAC 181 20:56:16.411502 tst iperf3m4.py: using CellId 16756 20:56:16.541834 tst iperf3m4.py: using BVCI 16757 20:56:16.664800 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:16.677603 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:16.689836 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:16.703114 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:16.715931 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:16.728206 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:16.741807 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:16.754296 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:16.767357 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:56:16.893851 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:56:17.046777 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:56:17.163807 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:56:17.284048 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:56:17.491053 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:56:17.795940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13629): Launched 20:56:18.061119 run iperf3-srv_10.42.42.10(pid=13630): Launched 20:56:18.174891 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:56:18.377306 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:56:18.680579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13631): Launched 20:56:18.944824 run iperf3-srv_10.42.42.10(pid=13632): Launched 20:56:19.058925 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:56:19.261726 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:56:19.565549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13633): Launched 20:56:19.830990 run iperf3-srv_10.42.42.10(pid=13634): Launched 20:56:19.944424 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:56:20.146480 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:56:20.449579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13635): Launched 20:56:20.713443 run iperf3-srv_10.42.42.10(pid=13636): Launched 20:56:20.826901 tst iperf3m4.py:8: start network... 20:56:21.027903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:56:21.495205 run create_hlr_db(pid=13637): Launched 20:56:21.611726 bus /gobi_6: Setting Powered False 20:56:22.671791 run create_hlr_db(pid=13637): Terminated: ok {rc=0} 20:56:23.114924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13639): Launched 20:56:23.421629 run osmo-hlr_10.42.42.2(pid=13640): Launched 20:56:23.536711 run osmo-stp_10.42.42.5: Starting osmo-stp 20:56:24.075005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13642): Launched 20:56:24.376035 run osmo-stp_10.42.42.5(pid=13643): Launched 20:56:24.490007 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:56:25.006155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13645): Launched 20:56:25.121172 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:56:25.376074 run patchelf(pid=13646): Launched 20:56:25.544277 run osmo-stp_10.42.42.5(pid=13643): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13643)] 20:56:25.672480 run osmo-stp_10.42.42.5(pid=13643): stdout: | (launched: 2022-12-08_20:56:24.320347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:25.802026 run osmo-stp_10.42.42.5(pid=13643): stderr: | [0;m[38;5;43m20221208205624491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205624491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205624491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205624492 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205624492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205624492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205624493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:25.931369 run osmo-stp_10.42.42.5(pid=13643): stdout: | (launched: 2022-12-08_20:56:24.320347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:26.054929 run osmo-stp_10.42.42.5(pid=13643): stderr: | [0;m[38;5;43m20221208205624491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205624491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205624491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205624492 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205624492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205624492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205624493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:26.201658 run patchelf(pid=13646): Terminating (SIGINT) 20:56:26.371549 run patchelf(pid=13646): Terminated: ok {rc=0} 20:56:26.493262 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13643): Process ended prematurely: osmo-stp_10.42.42.5(pid=13643) [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13643)] [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 20:56:26.502637 tst iperf3m4.py:8: Test FAILED (10.6 sec) 20:56:26.532253 run osmo-hlr_10.42.42.2(pid=13640): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13640)] 20:56:26.582943 run osmo-hlr_10.42.42.2(pid=13640): stdout: | (launched: 2022-12-08_20:56:23.365625) 20:56:26.635862 run osmo-hlr_10.42.42.2(pid=13640): stderr: | [0;m[1;31m20221208205623542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205623542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205623543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205623543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205623543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205623543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205623559 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205623567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205623567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205623567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:56:26.688712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13629): Terminating (SIGTERM) 20:56:26.731534 run iperf3-srv_10.42.42.10(pid=13630): Terminating (SIGTERM) 20:56:26.773780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13631): Terminating (SIGTERM) 20:56:26.816198 run iperf3-srv_10.42.42.10(pid=13632): Terminating (SIGTERM) 20:56:26.858557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13633): Terminating (SIGTERM) 20:56:26.900925 run iperf3-srv_10.42.42.10(pid=13634): Terminating (SIGTERM) 20:56:26.943240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13635): Terminating (SIGTERM) 20:56:26.985831 run iperf3-srv_10.42.42.10(pid=13636): Terminating (SIGTERM) 20:56:27.028080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13639): Terminating (SIGTERM) 20:56:27.070595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13642): Terminating (SIGTERM) 20:56:27.112903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13645): Terminating (SIGTERM) 20:56:27.155550 --- ParallelTerminationStrategy: PID 13629 died... 20:56:27.175663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13629): Terminated: ok {rc=0} 20:56:27.223121 --- ParallelTerminationStrategy: PID 13630 died... 20:56:27.242749 run iperf3-srv_10.42.42.10(pid=13630): Terminated {rc=256} 20:56:27.289929 --- ParallelTerminationStrategy: PID 13631 died... 20:56:27.309588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13631): Terminated: ok {rc=0} 20:56:27.356556 --- ParallelTerminationStrategy: PID 13632 died... 20:56:27.376125 run iperf3-srv_10.42.42.10(pid=13632): Terminated {rc=256} 20:56:27.423561 --- ParallelTerminationStrategy: PID 13633 died... 20:56:27.443313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13633): Terminated: ok {rc=0} 20:56:27.490875 --- ParallelTerminationStrategy: PID 13634 died... 20:56:27.510458 run iperf3-srv_10.42.42.10(pid=13634): Terminated {rc=256} 20:56:27.557801 --- ParallelTerminationStrategy: PID 13635 died... 20:56:27.577790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13635): Terminated: ok {rc=0} 20:56:27.625310 --- ParallelTerminationStrategy: PID 13636 died... 20:56:27.644763 run iperf3-srv_10.42.42.10(pid=13636): Terminated {rc=256} 20:56:27.692003 --- ParallelTerminationStrategy: PID 13639 died... 20:56:27.712184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13639): Terminated: ok {rc=0} 20:56:27.759408 --- ParallelTerminationStrategy: PID 13642 died... 20:56:27.779123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13642): Terminated: ok {rc=0} 20:56:27.826502 --- ParallelTerminationStrategy: PID 13645 died... 20:56:27.846308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13645): Terminated: ok {rc=0} 20:56:27.935358 bus /gobi_4: Setting Powered False 20:56:29.034979 bus /gobi_4: Setting Powered False 20:56:30.152105 bus /gobi_1: Setting Powered False 20:56:31.262660 bus /gobi_1: Setting Powered False 20:56:32.396747 bus /gobi_0: Setting Powered False 20:56:33.496179 bus /gobi_0: Setting Powered False 20:56:34.613881 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 20:56:35.716556 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:35.728737 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:56:35.801532 tst ping.py: using LAC 16757 20:56:35.926793 tst ping.py: using RAC 182 20:56:36.051264 tst ping.py: using CellId 16757 20:56:36.177891 tst ping.py: using BVCI 16758 20:56:36.294678 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:36.306139 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:36.317346 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:36.328455 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:36.339719 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:36.350890 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:36.362185 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:36.373349 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:56:36.493169 tst ping.py:19: start network... 20:56:36.709091 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:56:37.202112 run create_hlr_db(pid=13647): Launched 20:56:37.331651 bus /gobi_6: Setting Powered False 20:56:38.395121 run create_hlr_db(pid=13647): Terminated: ok {rc=0} 20:56:38.842759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13649): Launched 20:56:39.163054 run osmo-hlr_10.42.42.2(pid=13650): Launched 20:56:39.284561 run osmo-stp_10.42.42.5: Starting osmo-stp 20:56:39.836710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13652): Launched 20:56:40.156826 run osmo-stp_10.42.42.5(pid=13653): Launched 20:56:40.278183 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:56:40.835310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13655): Launched 20:56:40.958591 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:56:41.229651 run patchelf(pid=13656): Launched 20:56:41.407705 run osmo-stp_10.42.42.5(pid=13653): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13653)] 20:56:41.543908 run osmo-stp_10.42.42.5(pid=13653): stdout: | (launched: 2022-12-08_20:56:40.097594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:41.681115 run osmo-stp_10.42.42.5(pid=13653): stderr: | [0;m[38;5;43m20221208205640290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205640291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205640291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205640291 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205640292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205640292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205640292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:41.818966 run osmo-stp_10.42.42.5(pid=13653): stdout: | (launched: 2022-12-08_20:56:40.097594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:41.950179 run osmo-stp_10.42.42.5(pid=13653): stderr: | [0;m[38;5;43m20221208205640290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205640291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205640291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205640291 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205640292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205640292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205640292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:42.105621 run patchelf(pid=13656): Terminating (SIGINT) 20:56:42.285449 run patchelf(pid=13656): Terminated: ok {rc=0} 20:56:42.414873 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13653): Process ended prematurely: osmo-stp_10.42.42.5(pid=13653) [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13653)] [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 20:56:42.424402 tst ping.py:22: Test FAILED (6.7 sec) 20:56:42.452697 run osmo-hlr_10.42.42.2(pid=13650): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13650)] 20:56:42.503423 run osmo-hlr_10.42.42.2(pid=13650): stdout: | (launched: 2022-12-08_20:56:39.104154) 20:56:42.555456 run osmo-hlr_10.42.42.2(pid=13650): stderr: | [0;m[1;31m20221208205639302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205639302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205639302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205639302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205639302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205639302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205639314 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205639323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205639323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205639323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:56:42.608202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13649): Terminating (SIGTERM) 20:56:42.650539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13652): Terminating (SIGTERM) 20:56:42.693166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13655): Terminating (SIGTERM) 20:56:42.735939 --- ParallelTerminationStrategy: PID 13649 died... 20:56:42.756378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13649): Terminated: ok {rc=0} 20:56:42.803521 --- ParallelTerminationStrategy: PID 13652 died... 20:56:42.823418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13652): Terminated: ok {rc=0} 20:56:42.870327 --- ParallelTerminationStrategy: PID 13655 died... 20:56:42.890364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13655): Terminated: ok {rc=0} 20:56:42.979045 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 20:56:44.068422 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:44.081284 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:56:44.154553 tst ping_idle_ping.py: using LAC 16758 20:56:44.281145 tst ping_idle_ping.py: using RAC 183 20:56:44.407598 tst ping_idle_ping.py: using CellId 16758 20:56:44.535078 tst ping_idle_ping.py: using BVCI 16759 20:56:44.651307 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:44.662767 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:44.674489 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:44.686276 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:44.697622 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:44.708738 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:44.720264 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:44.731743 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:56:44.851307 tst ping_idle_ping.py:24: start network... 20:56:45.067232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:56:45.565539 run create_hlr_db(pid=13657): Launched 20:56:45.695703 bus /gobi_6: Setting Powered False 20:56:46.759446 run create_hlr_db(pid=13657): Terminated: ok {rc=0} 20:56:47.276384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13659): Launched 20:56:47.575174 run osmo-hlr_10.42.42.2(pid=13660): Launched 20:56:47.689766 run osmo-stp_10.42.42.5: Starting osmo-stp 20:56:48.206952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13662): Launched 20:56:48.504609 run osmo-stp_10.42.42.5(pid=13663): Launched 20:56:48.617436 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:56:49.129872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13665): Launched 20:56:49.244647 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:56:49.497012 run patchelf(pid=13666): Launched 20:56:49.662993 run osmo-stp_10.42.42.5(pid=13663): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13663)] 20:56:49.789339 run osmo-stp_10.42.42.5(pid=13663): stdout: | (launched: 2022-12-08_20:56:48.449306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:49.917770 run osmo-stp_10.42.42.5(pid=13663): stderr: | [0;m[38;5;43m20221208205648619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205648619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205648619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205648620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205648620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205648620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205648620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:50.045745 run osmo-stp_10.42.42.5(pid=13663): stdout: | (launched: 2022-12-08_20:56:48.449306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:50.167584 run osmo-stp_10.42.42.5(pid=13663): stderr: | [0;m[38;5;43m20221208205648619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205648619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205648619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205648620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205648620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205648620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205648620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:50.311757 run patchelf(pid=13666): Terminating (SIGINT) 20:56:50.479411 run patchelf(pid=13666): Terminated: ok {rc=0} 20:56:50.600115 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13663): Process ended prematurely: osmo-stp_10.42.42.5(pid=13663) [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13663)] [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 20:56:50.609099 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 20:56:50.636561 run osmo-hlr_10.42.42.2(pid=13660): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13660)] 20:56:50.685087 run osmo-hlr_10.42.42.2(pid=13660): stdout: | (launched: 2022-12-08_20:56:47.520072) 20:56:50.734990 run osmo-hlr_10.42.42.2(pid=13660): stderr: | [0;m[1;31m20221208205647694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205647695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205647695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205647695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205647695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205647695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205647707 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205647715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205647715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205647715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:56:50.785427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13659): Terminating (SIGTERM) 20:56:50.825718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13662): Terminating (SIGTERM) 20:56:50.865796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13665): Terminating (SIGTERM) 20:56:50.906547 --- ParallelTerminationStrategy: PID 13659 died... 20:56:50.925926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13659): Terminated: ok {rc=0} 20:56:50.971094 --- ParallelTerminationStrategy: PID 13662 died... 20:56:50.989997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13662): Terminated: ok {rc=0} 20:56:51.034621 --- ParallelTerminationStrategy: PID 13665 died... 20:56:51.053491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13665): Terminated: ok {rc=0} 20:56:51.139340 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:56:52.448708 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:56:52.455943 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:56:52.490827 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 20:56:52.526621 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:56:52.584454 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:56:52.619711 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 20:56:52.655608 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:56:53.209970 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2349 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 20:56:53.216812 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:56:53.228684 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:56:53.298988 tst switch_tch_pdch.py: using LAC 16759 20:56:53.413586 tst switch_tch_pdch.py: using RAC 184 20:56:53.539654 tst switch_tch_pdch.py: using CellId 16759 20:56:53.664220 tst switch_tch_pdch.py: using BVCI 16760 20:56:53.781811 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:56:53.793668 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:56:53.805396 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:56:53.817391 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:56:53.829228 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:56:53.840795 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:56:53.852579 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:56:53.864299 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:56:53.981893 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:56:54.103864 tst switch_tch_pdch.py:51: start network... 20:56:54.302147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:56:54.760035 run create_hlr_db(pid=13670): Launched 20:56:54.873938 bus /gobi_6: Setting Powered False 20:56:55.933448 run create_hlr_db(pid=13670): Terminated: ok {rc=0} 20:56:56.370307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13672): Launched 20:56:56.689919 run osmo-hlr_10.42.42.2(pid=13673): Launched 20:56:56.810567 run osmo-stp_10.42.42.5: Starting osmo-stp 20:56:57.362975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13675): Launched 20:56:57.682450 run osmo-stp_10.42.42.5(pid=13676): Launched 20:56:57.803122 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:56:58.351778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13678): Launched 20:56:58.474355 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:56:58.742912 run patchelf(pid=13679): Launched 20:56:58.919490 run osmo-stp_10.42.42.5(pid=13676): ERR: Terminated: ERROR {rc=1} [trial-2349↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13676)] 20:56:59.054216 run osmo-stp_10.42.42.5(pid=13676): stdout: | (launched: 2022-12-08_20:56:57.624105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:59.190395 run osmo-stp_10.42.42.5(pid=13676): stderr: | [0;m[38;5;43m20221208205657817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205657817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205657817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205657818 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205657818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205657818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205657818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:59.326643 run osmo-stp_10.42.42.5(pid=13676): stdout: | (launched: 2022-12-08_20:56:57.624105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:59.457221 run osmo-stp_10.42.42.5(pid=13676): stderr: | [0;m[38;5;43m20221208205657817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205657817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205657817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205657818 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205657818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205657818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205657818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:59.611302 run patchelf(pid=13679): Terminating (SIGINT) 20:56:59.789670 run patchelf(pid=13679): Terminated: ok {rc=0} 20:56:59.918323 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13676): Process ended prematurely: osmo-stp_10.42.42.5(pid=13676) [trial-2349↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13676)] [trial-2349↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 20:56:59.927936 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 20:56:59.956101 run osmo-hlr_10.42.42.2(pid=13673): ERR: Terminated: ERROR {rc=237} [trial-2349↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13673)] 20:57:00.005787 run osmo-hlr_10.42.42.2(pid=13673): stdout: | (launched: 2022-12-08_20:56:56.631596) 20:57:00.057343 run osmo-hlr_10.42.42.2(pid=13673): stderr: | [0;m[1;31m20221208205656831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205656831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205656831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205656831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205656831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205656831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205656844 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205656852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205656852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205656852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:57:00.109168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13672): Terminating (SIGTERM) 20:57:00.150364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13675): Terminating (SIGTERM) 20:57:00.191742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13678): Terminating (SIGTERM) 20:57:00.233428 --- ParallelTerminationStrategy: PID 13672 died... 20:57:00.253316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13672): Terminated: ok {rc=0} 20:57:00.299516 --- ParallelTerminationStrategy: PID 13675 died... 20:57:00.319127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13675): Terminated: ok {rc=0} 20:57:00.365185 --- ParallelTerminationStrategy: PID 13678 died... 20:57:00.384739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13678): Terminated: ok {rc=0} 20:57:00.472390 bus /gobi_0: Setting Powered False 20:57:01.572094 bus /gobi_0: Setting Powered False 20:57:02.689673 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 20:57:03.951401 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:57:03.958271 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 20:57:03.992350 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 20:57:04.026821 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 20:57:04.079382 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 20:57:04.114204 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 20:57:04.149877 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 20:57:04.707067 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2349 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 20:57:04.712274 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:57:04.723642 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 20:57:04.794824 tst switch_tch_pdch.py: using LAC 16760 20:57:04.918220 tst switch_tch_pdch.py: using RAC 185 20:57:05.041165 tst switch_tch_pdch.py: using CellId 16760 20:57:05.162442 tst switch_tch_pdch.py: using BVCI 16761 20:57:05.271399 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:57:05.282651 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:57:05.293739 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:57:05.305153 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:57:05.316306 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:57:05.327554 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:57:05.338943 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:57:05.350271 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:57:05.464712 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:57:05.588095 tst switch_tch_pdch.py:51: start network... 20:57:05.802596 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:57:06.268546 run create_hlr_db(pid=13684): Launched 20:57:06.398239 bus /gobi_6: Setting Powered False 20:57:07.461516 run create_hlr_db(pid=13684): Terminated: ok {rc=0} 20:57:07.879055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13686): Launched 20:57:08.198433 run osmo-hlr_10.42.42.2(pid=13687): Launched 20:57:08.319550 run osmo-stp_10.42.42.5: Starting osmo-stp 20:57:08.839259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13689): Launched 20:57:09.158269 run osmo-stp_10.42.42.5(pid=13690): Launched 20:57:09.279247 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:57:09.802171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13692): Launched 20:57:09.923897 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:57:10.193542 run patchelf(pid=13693): Launched 20:57:10.371150 run osmo-stp_10.42.42.5(pid=13690): ERR: Terminated: ERROR {rc=1} [trial-2349↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13690)] 20:57:10.506870 run osmo-stp_10.42.42.5(pid=13690): stdout: | (launched: 2022-12-08_20:57:09.099623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:10.643345 run osmo-stp_10.42.42.5(pid=13690): stderr: | [0;m[38;5;43m20221208205709291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205709291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205709291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205709292 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205709292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205709292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205709293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:10.779594 run osmo-stp_10.42.42.5(pid=13690): stdout: | (launched: 2022-12-08_20:57:09.099623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:10.909764 run osmo-stp_10.42.42.5(pid=13690): stderr: | [0;m[38;5;43m20221208205709291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205709291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205709291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205709292 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205709292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205709292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205709293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:11.064552 run patchelf(pid=13693): Terminating (SIGINT) 20:57:11.244661 run patchelf(pid=13693): Terminated: ok {rc=0} 20:57:11.373948 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13690): Process ended prematurely: osmo-stp_10.42.42.5(pid=13690) [trial-2349↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13690)] [trial-2349↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 20:57:11.383457 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 20:57:11.411368 run osmo-hlr_10.42.42.2(pid=13687): ERR: Terminated: ERROR {rc=237} [trial-2349↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13687)] 20:57:11.461437 run osmo-hlr_10.42.42.2(pid=13687): stdout: | (launched: 2022-12-08_20:57:08.139819) 20:57:11.512930 run osmo-hlr_10.42.42.2(pid=13687): stderr: | [0;m[1;31m20221208205708337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205708337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205708337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205708337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205708338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205708338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205708353 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205708361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205708361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205708361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:57:11.565112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13686): Terminating (SIGTERM) 20:57:11.606769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13689): Terminating (SIGTERM) 20:57:11.648239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13692): Terminating (SIGTERM) 20:57:11.690123 --- ParallelTerminationStrategy: PID 13686 died... 20:57:11.709992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13686): Terminated: ok {rc=0} 20:57:11.756371 --- ParallelTerminationStrategy: PID 13689 died... 20:57:11.775862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13689): Terminated: ok {rc=0} 20:57:11.821815 --- ParallelTerminationStrategy: PID 13692 died... 20:57:11.841417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13692): Terminated: ok {rc=0} 20:57:11.929258 bus /gobi_0: Setting Powered False 20:57:13.027985 bus /gobi_0: Setting Powered False 20:57:14.144417 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 20:57:15.399519 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:57:15.403614 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 20:57:15.435164 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 20:57:15.442248 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 20:57:15.494886 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 20:57:15.525428 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 20:57:15.532348 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 20:57:16.093052 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 20:57:16.100725 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 20:57:16.117910 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 20:57:16.175140 tst mo_mt_sms.py: using LAC 16761 20:57:16.302531 tst mo_mt_sms.py: using RAC 186 20:57:16.433577 tst mo_mt_sms.py: using CellId 16761 20:57:16.574099 tst mo_mt_sms.py: using BVCI 16762 20:57:16.689598 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:57:16.831460 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:57:16.973959 tst mo_mt_sms.py:9: start nitb and bts... 20:57:17.206139 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:57:17.855133 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13699): Launched 20:57:18.174542 run osmo-nitb_10.42.42.2(pid=13700): Launched 20:57:18.350886 run osmo-nitb_10.42.42.2(pid=13700): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13700)] 20:57:18.494274 run osmo-nitb_10.42.42.2(pid=13700): stdout: | (launched: 2022-12-08_20:57:18.116167) 20:57:18.638711 run osmo-nitb_10.42.42.2(pid=13700): stderr: | (launched: 2022-12-08_20:57:18.163389) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:57:18.783004 run osmo-nitb_10.42.42.2(pid=13700): stdout: | (launched: 2022-12-08_20:57:18.116167) 20:57:18.921371 run osmo-nitb_10.42.42.2(pid=13700): stderr: | (launched: 2022-12-08_20:57:18.163389) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8fda692268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13700): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13700) [trial-2349↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13700)] 20:57:19.294422 tst osmo-nitb_10.42.42.2(pid=13700): stdout: | (launched: 2022-12-08_20:57:18.116167) 20:57:19.422894 tst osmo-nitb_10.42.42.2(pid=13700): stderr: | (launched: 2022-12-08_20:57:18.163389) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:57:19.574475 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=13700): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13700) [trial-2349↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13700)] [trial-2349↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 20:57:19.583456 tst mo_mt_sms.py:11: Test FAILED (3.5 sec) 20:57:19.590553 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13699): Terminating (SIGTERM) 20:57:19.801077 --- ParallelTerminationStrategy: PID 13699 died... 20:57:19.822170 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13699): Terminated: ok {rc=0} 20:57:19.908660 bus /sierra_3: Setting Powered False 20:57:21.008311 bus /sierra_3: Setting Powered False 20:57:22.127038 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 20:57:23.322846 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:57:23.327291 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 20:57:23.357355 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 20:57:23.384870 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 20:57:23.438971 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 20:57:23.469808 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 20:57:23.497405 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 20:57:24.044589 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 20:57:24.049703 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:24.060815 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 20:57:24.105054 tst mo_mt_sms.py: using LAC 16762 20:57:24.229137 tst mo_mt_sms.py: using RAC 187 20:57:24.367826 tst mo_mt_sms.py: using CellId 16762 20:57:24.501837 tst mo_mt_sms.py: using BVCI 16763 20:57:24.618111 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:24.629311 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:24.640373 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:24.651411 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:24.662686 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:24.674234 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:57:24.791822 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:57:24.912085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:57:25.405663 run create_hlr_db(pid=13704): Launched 20:57:25.535840 bus /sierra_2: Setting Powered False 20:57:26.598689 run create_hlr_db(pid=13704): Terminated: ok {rc=0} 20:57:27.023976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13706): Launched 20:57:27.320143 run osmo-hlr_10.42.42.2(pid=13707): Launched 20:57:27.432875 run osmo-stp_10.42.42.5: Starting osmo-stp 20:57:27.943644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13709): Launched 20:57:28.241166 run osmo-stp_10.42.42.5(pid=13710): Launched 20:57:28.353638 run osmo-msc_10.42.42.6: Starting osmo-msc 20:57:28.894525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13712): Launched 20:57:29.192785 run osmo-msc_10.42.42.6(pid=13713): Launched 20:57:29.360118 run osmo-stp_10.42.42.5(pid=13710): ERR: Terminated: ERROR {rc=1} [trial-2349↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13710)] 20:57:29.486652 run osmo-stp_10.42.42.5(pid=13710): stdout: | (launched: 2022-12-08_20:57:28.185979) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:29.613563 run osmo-stp_10.42.42.5(pid=13710): stderr: | [0;m[38;5;43m20221208205728354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205728354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205728354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205728355 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205728355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205728355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205728355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:29.737500 run osmo-stp_10.42.42.5(pid=13710): stdout: | (launched: 2022-12-08_20:57:28.185979) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:29.855211 run osmo-stp_10.42.42.5(pid=13710): stderr: | [0;m[38;5;43m20221208205728354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205728354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205728354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205728355 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205728355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205728355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205728355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:29.996625 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=13710): Process ended prematurely: osmo-stp_10.42.42.5(pid=13710) [trial-2349↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13710)] [trial-2349↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 20:57:30.004886 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 20:57:30.031391 run osmo-hlr_10.42.42.2(pid=13707): ERR: Terminated: ERROR {rc=237} [trial-2349↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13707)] 20:57:30.079950 run osmo-hlr_10.42.42.2(pid=13707): stdout: | (launched: 2022-12-08_20:57:27.265265) 20:57:30.129505 run osmo-hlr_10.42.42.2(pid=13707): stderr: | [0;m[1;31m20221208205727439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205727439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205727439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205727439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205727439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205727439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205727452 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205727463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205727463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205727463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:57:30.198950 run osmo-msc_10.42.42.6(pid=13713): ERR: Terminated: ERROR {rc=2} [trial-2349↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13713)] 20:57:30.246604 run osmo-msc_10.42.42.6(pid=13713): stdout: | (launched: 2022-12-08_20:57:29.137284) 20:57:30.296084 run osmo-msc_10.42.42.6(pid=13713): stderr: | [0;m[38;5;43m20221208205729407 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205729407 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4b88dffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205729408 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205729408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205729408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205729408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205729410 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205729411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205729411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205729411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:57:30.346133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13706): Terminating (SIGTERM) 20:57:30.386097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13709): Terminating (SIGTERM) 20:57:30.425717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13712): Terminating (SIGTERM) 20:57:30.465720 --- ParallelTerminationStrategy: PID 13706 died... 20:57:30.484635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13706): Terminated: ok {rc=0} 20:57:30.529194 --- ParallelTerminationStrategy: PID 13709 died... 20:57:30.547839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13709): Terminated: ok {rc=0} 20:57:30.591867 --- ParallelTerminationStrategy: PID 13712 died... 20:57:30.610485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13712): Terminated: ok {rc=0} 20:57:30.693834 bus /sierra_3: Setting Powered False 20:57:31.790787 bus /sierra_3: Setting Powered False 20:57:32.903229 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 20:57:34.129284 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:57:34.132873 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 20:57:34.163329 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 20:57:34.170085 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 20:57:34.204343 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 20:57:34.234093 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 20:57:34.240784 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 20:57:34.760635 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2349 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 20:57:34.765956 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 20:57:34.776851 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 20:57:34.820371 tst assert_extension.py: using LAC 16763 20:57:34.940500 tst assert_extension.py: using RAC 188 20:57:35.057330 tst assert_extension.py: using CellId 16763 20:57:35.173140 tst assert_extension.py: using BVCI 16764 20:57:35.280315 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 20:57:35.395291 tst assert_extension.py:10: start nitb and bts... 20:57:35.593659 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:57:36.202206 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13722): Launched 20:57:36.499882 run osmo-nitb_10.42.42.2(pid=13723): Launched 20:57:36.664817 run osmo-nitb_10.42.42.2(pid=13723): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13723)] 20:57:36.798657 run osmo-nitb_10.42.42.2(pid=13723): stdout: | (launched: 2022-12-08_20:57:36.445033) 20:57:36.933659 run osmo-nitb_10.42.42.2(pid=13723): stderr: | (launched: 2022-12-08_20:57:36.489200) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:57:37.068751 run osmo-nitb_10.42.42.2(pid=13723): stdout: | (launched: 2022-12-08_20:57:36.445033) 20:57:37.197548 run osmo-nitb_10.42.42.2(pid=13723): stderr: | (launched: 2022-12-08_20:57:36.489200) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8fda692268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13723): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13723) [trial-2349↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13723)] 20:57:37.611712 tst osmo-nitb_10.42.42.2(pid=13723): stdout: | (launched: 2022-12-08_20:57:36.445033) 20:57:37.731126 tst osmo-nitb_10.42.42.2(pid=13723): stderr: | (launched: 2022-12-08_20:57:36.489200) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:57:37.872372 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=13723): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13723) [trial-2349↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13723)] [trial-2349↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 20:57:37.881049 tst assert_extension.py:12: Test FAILED (3.1 sec) 20:57:37.887795 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13722): Terminating (SIGTERM) 20:57:38.096822 --- ParallelTerminationStrategy: PID 13722 died... 20:57:38.118195 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13722): Terminated: ok {rc=0} 20:57:38.203819 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 20:57:39.378964 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:57:39.384170 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 20:57:39.415048 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 20:57:39.442464 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 20:57:39.478831 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 20:57:39.509578 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 20:57:39.537221 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 20:57:40.067407 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2349 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 20:57:40.072719 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:40.084299 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 20:57:40.129394 tst assert_extension.py: using LAC 16764 20:57:40.253239 tst assert_extension.py: using RAC 189 20:57:40.370196 tst assert_extension.py: using CellId 16764 20:57:40.487794 tst assert_extension.py: using BVCI 16765 20:57:40.594255 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:40.604904 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:40.615509 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:40.626304 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:40.637343 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:40.648014 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 20:57:40.765321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:57:41.257611 run create_hlr_db(pid=13727): Launched 20:57:41.387030 bus /sierra_2: Setting Powered False 20:57:42.451335 run create_hlr_db(pid=13727): Terminated: ok {rc=0} 20:57:42.876729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13729): Launched 20:57:43.174058 run osmo-hlr_10.42.42.2(pid=13730): Launched 20:57:43.285782 run osmo-stp_10.42.42.5: Starting osmo-stp 20:57:43.813192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13732): Launched 20:57:44.110165 run osmo-stp_10.42.42.5(pid=13733): Launched 20:57:44.222349 run osmo-msc_10.42.42.6: Starting osmo-msc 20:57:44.755917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13735): Launched 20:57:45.051580 run osmo-msc_10.42.42.6(pid=13736): Launched 20:57:45.216689 run osmo-stp_10.42.42.5(pid=13733): ERR: Terminated: ERROR {rc=1} [trial-2349↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13733)] 20:57:45.342535 run osmo-stp_10.42.42.5(pid=13733): stdout: | (launched: 2022-12-08_20:57:44.055494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:45.468545 run osmo-stp_10.42.42.5(pid=13733): stderr: | [0;m[38;5;43m20221208205744223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205744223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205744223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205744223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205744224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205744224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205744224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:45.591720 run osmo-stp_10.42.42.5(pid=13733): stdout: | (launched: 2022-12-08_20:57:44.055494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:45.708737 run osmo-stp_10.42.42.5(pid=13733): stderr: | [0;m[38;5;43m20221208205744223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205744223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205744223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205744223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205744224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205744224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205744224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:45.851245 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=13733): Process ended prematurely: osmo-stp_10.42.42.5(pid=13733) [trial-2349↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13733)] [trial-2349↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 20:57:45.859808 tst assert_extension.py:17: Test FAILED (5.8 sec) 20:57:45.899135 run osmo-hlr_10.42.42.2(pid=13730): ERR: Terminated: ERROR {rc=237} [trial-2349↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13730)] 20:57:45.952399 run osmo-hlr_10.42.42.2(pid=13730): stdout: | (launched: 2022-12-08_20:57:43.119082) 20:57:46.008640 run osmo-hlr_10.42.42.2(pid=13730): stderr: | [0;m[1;31m20221208205743294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205743294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205743294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205743294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205743294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205743294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205743308 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205743317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205743317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205743317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:57:46.102605 run osmo-msc_10.42.42.6(pid=13736): ERR: Terminated: ERROR {rc=2} [trial-2349↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13736)] 20:57:46.151701 run osmo-msc_10.42.42.6(pid=13736): stdout: | (launched: 2022-12-08_20:57:44.997260) 20:57:46.202504 run osmo-msc_10.42.42.6(pid=13736): stderr: | [0;m[38;5;43m20221208205745268 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205745268 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd72a32cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205745268 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205745269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205745269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205745269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205745271 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205745271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205745271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205745271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:57:46.253996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13729): Terminating (SIGTERM) 20:57:46.296107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13732): Terminating (SIGTERM) 20:57:46.339176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13735): Terminating (SIGTERM) 20:57:46.381592 --- ParallelTerminationStrategy: PID 13729 died... 20:57:46.401260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13729): Terminated: ok {rc=0} 20:57:46.448403 --- ParallelTerminationStrategy: PID 13732 died... 20:57:46.467995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13732): Terminated: ok {rc=0} 20:57:46.515119 --- ParallelTerminationStrategy: PID 13735 died... 20:57:46.534775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13735): Terminated: ok {rc=0} 20:57:46.621991 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 20:57:47.824242 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:57:47.830725 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 20:57:47.860152 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 20:57:47.887042 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 20:57:47.938523 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 20:57:47.967638 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 20:57:47.994340 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 20:57:48.547113 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 20:57:48.596321 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:57:48.607658 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:57:48.673194 tst mo_mt_call.py: using LAC 16765 20:57:48.801534 tst mo_mt_call.py: using RAC 190 20:57:48.928314 tst mo_mt_call.py: using CellId 16765 20:57:49.060851 tst mo_mt_call.py: using BVCI 16766 20:57:49.172555 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:57:49.184024 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:57:49.195294 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:57:49.206958 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:57:49.218690 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:57:49.230584 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:57:49.351438 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:57:49.468025 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:57:49.934701 run create_hlr_db(pid=13741): Launched 20:57:50.050233 bus /sierra_2: Setting Powered False 20:57:51.110141 run create_hlr_db(pid=13741): Terminated: ok {rc=0} 20:57:51.553513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13743): Launched 20:57:51.877753 run osmo-hlr_10.42.42.2(pid=13744): Launched 20:57:52.064430 run osmo-stp_10.42.42.5: Starting osmo-stp 20:57:52.621605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13746): Launched 20:57:52.946832 run osmo-stp_10.42.42.5(pid=13747): Launched 20:57:53.070464 run osmo-msc_10.42.42.6: Starting osmo-msc 20:57:53.655088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13749): Launched 20:57:53.978928 run osmo-msc_10.42.42.6(pid=13750): Launched 20:57:54.159413 run osmo-stp_10.42.42.5(pid=13747): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13747)] 20:57:54.295791 run osmo-stp_10.42.42.5(pid=13747): stdout: | (launched: 2022-12-08_20:57:52.887415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:54.433819 run osmo-stp_10.42.42.5(pid=13747): stderr: | [0;m[38;5;43m20221208205753080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205753080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205753080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205753081 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205753081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205753081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205753081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:54.569493 run osmo-stp_10.42.42.5(pid=13747): stdout: | (launched: 2022-12-08_20:57:52.887415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:54.697469 run osmo-stp_10.42.42.5(pid=13747): stderr: | [0;m[38;5;43m20221208205753080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205753080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205753080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205753081 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205753081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205753081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205753081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:54.850630 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13747): Process ended prematurely: osmo-stp_10.42.42.5(pid=13747) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13747)] [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 20:57:54.860136 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:57:54.888005 run osmo-hlr_10.42.42.2(pid=13744): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13744)] 20:57:54.937884 run osmo-hlr_10.42.42.2(pid=13744): stdout: | (launched: 2022-12-08_20:57:51.818612) 20:57:54.989442 run osmo-hlr_10.42.42.2(pid=13744): stderr: | [0;m[1;31m20221208205752015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205752016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205752016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205752016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205752016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205752016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205752028 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205752038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205752038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205752039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:57:55.061567 run osmo-msc_10.42.42.6(pid=13750): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13750)] 20:57:55.111148 run osmo-msc_10.42.42.6(pid=13750): stdout: | (launched: 2022-12-08_20:57:53.919774) 20:57:55.162459 run osmo-msc_10.42.42.6(pid=13750): stderr: | [0;m[38;5;43m20221208205754240 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205754240 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f955f179c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205754240 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205754240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205754240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205754241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205754242 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205754243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205754243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205754243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:57:55.213998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13743): Terminating (SIGTERM) 20:57:55.255159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13746): Terminating (SIGTERM) 20:57:55.296685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13749): Terminating (SIGTERM) 20:57:55.338642 --- ParallelTerminationStrategy: PID 13743 died... 20:57:55.358298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13743): Terminated: ok {rc=0} 20:57:55.404078 --- ParallelTerminationStrategy: PID 13746 died... 20:57:55.423661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13746): Terminated: ok {rc=0} 20:57:55.469608 --- ParallelTerminationStrategy: PID 13749 died... 20:57:55.489161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13749): Terminated: ok {rc=0} 20:57:55.576169 bus /sierra_3: Setting Powered False 20:57:56.675002 bus /sierra_3: Setting Powered False 20:57:57.789665 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 20:57:58.937940 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:57:58.950332 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:57:59.019014 tst mo_mt_call_osmux.py: using LAC 16766 20:57:59.147405 tst mo_mt_call_osmux.py: using RAC 191 20:57:59.274546 tst mo_mt_call_osmux.py: using CellId 16766 20:57:59.402716 tst mo_mt_call_osmux.py: using BVCI 16767 20:57:59.522804 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:57:59.534664 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:57:59.546389 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:57:59.558092 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:57:59.569705 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:57:59.581317 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:57:59.695804 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:57:59.815331 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:58:00.318880 run create_hlr_db(pid=13752): Launched 20:58:00.451898 bus /sierra_2: Setting Powered False 20:58:01.516306 run create_hlr_db(pid=13752): Terminated: ok {rc=0} 20:58:01.982666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13754): Launched 20:58:02.311659 run osmo-hlr_10.42.42.2(pid=13755): Launched 20:58:02.435264 run osmo-stp_10.42.42.5: Starting osmo-stp 20:58:02.989581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13757): Launched 20:58:03.310817 run osmo-stp_10.42.42.5(pid=13758): Launched 20:58:03.432704 run osmo-msc_10.42.42.6: Starting osmo-msc 20:58:04.017453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13760): Launched 20:58:04.338973 run osmo-msc_10.42.42.6(pid=13761): Launched 20:58:04.518930 run osmo-stp_10.42.42.5(pid=13758): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13758)] 20:58:04.654000 run osmo-stp_10.42.42.5(pid=13758): stdout: | (launched: 2022-12-08_20:58:03.252336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:04.789615 run osmo-stp_10.42.42.5(pid=13758): stderr: | [0;m[38;5;43m20221208205803442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205803443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205803443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205803443 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205803444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205803444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205803444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:04.925171 run osmo-stp_10.42.42.5(pid=13758): stdout: | (launched: 2022-12-08_20:58:03.252336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:05.052754 run osmo-stp_10.42.42.5(pid=13758): stderr: | [0;m[38;5;43m20221208205803442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205803443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205803443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205803443 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205803444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205803444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205803444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:05.205626 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13758): Process ended prematurely: osmo-stp_10.42.42.5(pid=13758) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13758)] [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 20:58:05.215188 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:58:05.243150 run osmo-hlr_10.42.42.2(pid=13755): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13755)] 20:58:05.293126 run osmo-hlr_10.42.42.2(pid=13755): stdout: | (launched: 2022-12-08_20:58:02.253199) 20:58:05.344684 run osmo-hlr_10.42.42.2(pid=13755): stderr: | [0;m[1;31m20221208205802448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205802448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205802449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205802449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205802449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205802449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205802462 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205802470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205802470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205802470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:58:05.416557 run osmo-msc_10.42.42.6(pid=13761): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13761)] 20:58:05.466843 run osmo-msc_10.42.42.6(pid=13761): stdout: | (launched: 2022-12-08_20:58:04.280149) 20:58:05.518327 run osmo-msc_10.42.42.6(pid=13761): stderr: | [0;m[38;5;43m20221208205804602 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205804602 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f438bb98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205804602 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205804602 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205804602 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205804603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205804604 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205804605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205804605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205804605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:58:05.570071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13754): Terminating (SIGTERM) 20:58:05.611487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13757): Terminating (SIGTERM) 20:58:05.653166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13760): Terminating (SIGTERM) 20:58:05.695316 --- ParallelTerminationStrategy: PID 13754 died... 20:58:05.714633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13754): Terminated: ok {rc=0} 20:58:05.760643 --- ParallelTerminationStrategy: PID 13757 died... 20:58:05.780080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13757): Terminated: ok {rc=0} 20:58:05.825603 --- ParallelTerminationStrategy: PID 13760 died... 20:58:05.844940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13760): Terminated: ok {rc=0} 20:58:05.931490 bus /sierra_3: Setting Powered False 20:58:07.030368 bus /sierra_3: Setting Powered False 20:58:08.145355 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 20:58:09.392131 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:58:09.399232 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 20:58:09.429341 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 20:58:09.456582 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 20:58:09.510717 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 20:58:09.541136 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 20:58:09.568424 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 20:58:10.120788 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 20:58:10.171822 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:10.183552 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:58:10.251526 tst mo_mt_call.py: using LAC 16767 20:58:10.381539 tst mo_mt_call.py: using RAC 192 20:58:10.507689 tst mo_mt_call.py: using CellId 16767 20:58:10.635810 tst mo_mt_call.py: using BVCI 16768 20:58:10.753603 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:10.765338 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:10.776787 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:10.788264 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:10.799872 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:10.811475 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:58:10.927411 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:58:11.048603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:58:11.545633 run create_hlr_db(pid=13766): Launched 20:58:11.675278 bus /sierra_2: Setting Powered False 20:58:12.738537 run create_hlr_db(pid=13766): Terminated: ok {rc=0} 20:58:13.185889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13768): Launched 20:58:13.506787 run osmo-hlr_10.42.42.2(pid=13769): Launched 20:58:13.628062 run osmo-stp_10.42.42.5: Starting osmo-stp 20:58:14.179083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13771): Launched 20:58:14.501372 run osmo-stp_10.42.42.5(pid=13772): Launched 20:58:14.625129 run osmo-msc_10.42.42.6: Starting osmo-msc 20:58:15.213185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13774): Launched 20:58:15.534411 run osmo-msc_10.42.42.6(pid=13775): Launched 20:58:15.713188 run osmo-stp_10.42.42.5(pid=13772): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13772)] 20:58:15.847979 run osmo-stp_10.42.42.5(pid=13772): stdout: | (launched: 2022-12-08_20:58:14.442270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:16.106256 run osmo-stp_10.42.42.5(pid=13772): stderr: | [0;m[38;5;43m20221208205814633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205814633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205814633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205814634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205814634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205814634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205814634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:16.245922 run osmo-stp_10.42.42.5(pid=13772): stdout: | (launched: 2022-12-08_20:58:14.442270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:16.375429 run osmo-stp_10.42.42.5(pid=13772): stderr: | [0;m[38;5;43m20221208205814633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205814633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205814633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205814634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205814634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205814634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205814634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:16.530932 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13772): Process ended prematurely: osmo-stp_10.42.42.5(pid=13772) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13772)] [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 20:58:16.541066 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:58:16.569443 run osmo-hlr_10.42.42.2(pid=13769): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13769)] 20:58:16.619604 run osmo-hlr_10.42.42.2(pid=13769): stdout: | (launched: 2022-12-08_20:58:13.447935) 20:58:16.671627 run osmo-hlr_10.42.42.2(pid=13769): stderr: | [0;m[1;31m20221208205813643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205813644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205813644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205813644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205813644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205813644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205813656 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205813666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205813666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205813666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:58:16.744509 run osmo-msc_10.42.42.6(pid=13775): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13775)] 20:58:16.800919 run osmo-msc_10.42.42.6(pid=13775): stdout: | (launched: 2022-12-08_20:58:15.475704) 20:58:16.863838 run osmo-msc_10.42.42.6(pid=13775): stderr: | [0;m[38;5;43m20221208205815796 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205815796 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0e240e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205815796 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205815796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205815796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205815797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205815798 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205815799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205815799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205815799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:58:16.920391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13768): Terminating (SIGTERM) 20:58:16.963468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13771): Terminating (SIGTERM) 20:58:17.006447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13774): Terminating (SIGTERM) 20:58:17.049674 --- ParallelTerminationStrategy: PID 13768 died... 20:58:17.070109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13768): Terminated: ok {rc=0} 20:58:17.117700 --- ParallelTerminationStrategy: PID 13771 died... 20:58:17.138016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13771): Terminated: ok {rc=0} 20:58:17.192896 --- ParallelTerminationStrategy: PID 13774 died... 20:58:17.216718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13774): Terminated: ok {rc=0} 20:58:17.320651 bus /sierra_3: Setting Powered False 20:58:18.428763 bus /sierra_3: Setting Powered False 20:58:19.543326 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 20:58:20.691304 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:20.703613 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:58:20.772185 tst mo_mt_call_osmux.py: using LAC 16768 20:58:20.898327 tst mo_mt_call_osmux.py: using RAC 193 20:58:21.025409 tst mo_mt_call_osmux.py: using CellId 16768 20:58:21.151506 tst mo_mt_call_osmux.py: using BVCI 16769 20:58:21.261521 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:21.272886 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:21.284329 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:21.296127 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:21.307991 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:21.319588 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:58:21.440612 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:58:21.562177 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:58:22.060705 run create_hlr_db(pid=13777): Launched 20:58:22.191768 bus /sierra_2: Setting Powered False 20:58:23.256045 run create_hlr_db(pid=13777): Terminated: ok {rc=0} 20:58:23.684379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13779): Launched 20:58:23.984486 run osmo-hlr_10.42.42.2(pid=13780): Launched 20:58:24.099027 run osmo-stp_10.42.42.5: Starting osmo-stp 20:58:24.627730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13782): Launched 20:58:24.926724 run osmo-stp_10.42.42.5(pid=13783): Launched 20:58:25.040330 run osmo-msc_10.42.42.6: Starting osmo-msc 20:58:25.582894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13785): Launched 20:58:25.882294 run osmo-msc_10.42.42.6(pid=13786): Launched 20:58:26.049670 run osmo-stp_10.42.42.5(pid=13783): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13783)] 20:58:26.177136 run osmo-stp_10.42.42.5(pid=13783): stdout: | (launched: 2022-12-08_20:58:24.871924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:26.304023 run osmo-stp_10.42.42.5(pid=13783): stderr: | [0;m[38;5;43m20221208205825037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205825037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205825037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205825038 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205825038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205825038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205825038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:26.429101 run osmo-stp_10.42.42.5(pid=13783): stdout: | (launched: 2022-12-08_20:58:24.871924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:26.547808 run osmo-stp_10.42.42.5(pid=13783): stderr: | [0;m[38;5;43m20221208205825037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205825037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205825037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205825038 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205825038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205825038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205825038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:26.690697 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13783): Process ended prematurely: osmo-stp_10.42.42.5(pid=13783) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13783)] [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 20:58:26.699425 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 20:58:26.726312 run osmo-hlr_10.42.42.2(pid=13780): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13780)] 20:58:26.773936 run osmo-hlr_10.42.42.2(pid=13780): stdout: | (launched: 2022-12-08_20:58:23.929760) 20:58:26.823125 run osmo-hlr_10.42.42.2(pid=13780): stderr: | [0;m[1;31m20221208205824104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205824104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205824104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205824104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205824104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205824104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205824120 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205824130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205824130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205824130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:58:26.891560 run osmo-msc_10.42.42.6(pid=13786): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13786)] 20:58:26.938727 run osmo-msc_10.42.42.6(pid=13786): stdout: | (launched: 2022-12-08_20:58:25.827406) 20:58:26.987731 run osmo-msc_10.42.42.6(pid=13786): stderr: | [0;m[38;5;43m20221208205826096 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205826096 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa6245f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205826096 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205826096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205826096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205826096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205826098 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205826098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205826099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205826099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:58:27.037272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13779): Terminating (SIGTERM) 20:58:27.076857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13782): Terminating (SIGTERM) 20:58:27.116500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13785): Terminating (SIGTERM) 20:58:27.156532 --- ParallelTerminationStrategy: PID 13779 died... 20:58:27.175447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13779): Terminated: ok {rc=0} 20:58:27.220247 --- ParallelTerminationStrategy: PID 13782 died... 20:58:27.238847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13782): Terminated: ok {rc=0} 20:58:27.282835 --- ParallelTerminationStrategy: PID 13785 died... 20:58:27.301523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13785): Terminated: ok {rc=0} 20:58:27.384599 bus /sierra_3: Setting Powered False 20:58:28.483003 bus /sierra_3: Setting Powered False 20:58:29.598758 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 20:58:30.851025 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:58:30.859624 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 20:58:30.893444 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 20:58:30.934682 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 20:58:30.992030 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 20:58:31.023562 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 20:58:31.052517 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 20:58:31.598660 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 20:58:31.654151 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:31.666960 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:58:31.735108 tst mo_mt_call.py: using LAC 16769 20:58:31.866423 tst mo_mt_call.py: using RAC 194 20:58:32.022180 tst mo_mt_call.py: using CellId 16769 20:58:32.167372 tst mo_mt_call.py: using BVCI 16770 20:58:32.279261 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:32.292101 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:32.304039 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:32.316137 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:32.328236 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:32.340143 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:58:32.461669 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:58:32.579185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:58:33.042570 run create_hlr_db(pid=13791): Launched 20:58:33.156499 bus /sierra_2: Setting Powered False 20:58:34.215460 run create_hlr_db(pid=13791): Terminated: ok {rc=0} 20:58:34.632917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13793): Launched 20:58:34.932877 run osmo-hlr_10.42.42.2(pid=13794): Launched 20:58:35.047549 run osmo-stp_10.42.42.5: Starting osmo-stp 20:58:35.573384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13796): Launched 20:58:35.872484 run osmo-stp_10.42.42.5(pid=13797): Launched 20:58:35.986627 run osmo-msc_10.42.42.6: Starting osmo-msc 20:58:36.530306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13799): Launched 20:58:36.830913 run osmo-msc_10.42.42.6(pid=13800): Launched 20:58:36.998978 run osmo-stp_10.42.42.5(pid=13797): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13797)] 20:58:37.126325 run osmo-stp_10.42.42.5(pid=13797): stdout: | (launched: 2022-12-08_20:58:35.817738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:37.253922 run osmo-stp_10.42.42.5(pid=13797): stderr: | [0;m[38;5;43m20221208205835985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205835985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205835985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205835986 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205835986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205835986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205835987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:37.379582 run osmo-stp_10.42.42.5(pid=13797): stdout: | (launched: 2022-12-08_20:58:35.817738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:37.499099 run osmo-stp_10.42.42.5(pid=13797): stderr: | [0;m[38;5;43m20221208205835985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205835985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205835985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205835986 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205835986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205835986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205835987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:37.642266 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13797): Process ended prematurely: osmo-stp_10.42.42.5(pid=13797) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13797)] [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 20:58:37.651048 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 20:58:37.677729 run osmo-hlr_10.42.42.2(pid=13794): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13794)] 20:58:37.725386 run osmo-hlr_10.42.42.2(pid=13794): stdout: | (launched: 2022-12-08_20:58:34.878256) 20:58:37.774504 run osmo-hlr_10.42.42.2(pid=13794): stderr: | [0;m[1;31m20221208205835051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205835051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205835051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205835051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205835051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205835051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205835063 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205835071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205835072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205835072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:58:37.843208 run osmo-msc_10.42.42.6(pid=13800): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13800)] 20:58:37.890420 run osmo-msc_10.42.42.6(pid=13800): stdout: | (launched: 2022-12-08_20:58:36.775762) 20:58:37.939328 run osmo-msc_10.42.42.6(pid=13800): stderr: | [0;m[38;5;43m20221208205837045 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205837045 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7fefa7dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205837045 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205837045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205837046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205837046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205837047 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205837048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205837048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205837048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:58:37.988910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13793): Terminating (SIGTERM) 20:58:38.028329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13796): Terminating (SIGTERM) 20:58:38.068104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13799): Terminating (SIGTERM) 20:58:38.108481 --- ParallelTerminationStrategy: PID 13793 died... 20:58:38.127508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13793): Terminated: ok {rc=0} 20:58:38.171651 --- ParallelTerminationStrategy: PID 13796 died... 20:58:38.190264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13796): Terminated: ok {rc=0} 20:58:38.234251 --- ParallelTerminationStrategy: PID 13799 died... 20:58:38.252697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13799): Terminated: ok {rc=0} 20:58:38.335909 bus /sierra_3: Setting Powered False 20:58:39.433569 bus /sierra_3: Setting Powered False 20:58:40.548794 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 20:58:41.697250 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:41.709820 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:58:41.777405 tst mo_mt_call_osmux.py: using LAC 16770 20:58:41.896614 tst mo_mt_call_osmux.py: using RAC 195 20:58:42.013288 tst mo_mt_call_osmux.py: using CellId 16770 20:58:42.130620 tst mo_mt_call_osmux.py: using BVCI 16771 20:58:42.240262 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:42.251787 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:42.262995 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:42.274406 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:42.285781 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:42.297152 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:58:42.416478 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:58:42.533699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:58:43.033486 run create_hlr_db(pid=13803): Launched 20:58:43.164323 bus /sierra_2: Setting Powered False 20:58:44.228076 run create_hlr_db(pid=13803): Terminated: ok {rc=0} 20:58:44.677496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13805): Launched 20:58:44.999513 run osmo-hlr_10.42.42.2(pid=13806): Launched 20:58:45.121310 run osmo-stp_10.42.42.5: Starting osmo-stp 20:58:45.673041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13808): Launched 20:58:46.022083 run osmo-stp_10.42.42.5(pid=13809): Launched 20:58:46.258191 run osmo-msc_10.42.42.6: Starting osmo-msc 20:58:46.972417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13811): Launched 20:58:47.305793 run osmo-msc_10.42.42.6(pid=13812): Launched 20:58:47.485520 run osmo-stp_10.42.42.5(pid=13809): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13809)] 20:58:47.620522 run osmo-stp_10.42.42.5(pid=13809): stdout: | (launched: 2022-12-08_20:58:45.959618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:47.756676 run osmo-stp_10.42.42.5(pid=13809): stderr: | [0;m[38;5;43m20221208205846303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205846303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205846303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205846304 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205846304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205846304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205846304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:47.891879 run osmo-stp_10.42.42.5(pid=13809): stdout: | (launched: 2022-12-08_20:58:45.959618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:48.019860 run osmo-stp_10.42.42.5(pid=13809): stderr: | [0;m[38;5;43m20221208205846303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205846303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205846303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205846304 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205846304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205846304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205846304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:48.173044 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13809): Process ended prematurely: osmo-stp_10.42.42.5(pid=13809) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13809)] [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 20:58:48.182615 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 20:58:48.210723 run osmo-hlr_10.42.42.2(pid=13806): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13806)] 20:58:48.260935 run osmo-hlr_10.42.42.2(pid=13806): stdout: | (launched: 2022-12-08_20:58:44.940808) 20:58:48.312666 run osmo-hlr_10.42.42.2(pid=13806): stderr: | [0;m[1;31m20221208205845136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205845136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205845136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205845136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205845136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205845136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205845148 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205845156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205845157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205845157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:58:48.384936 run osmo-msc_10.42.42.6(pid=13812): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13812)] 20:58:48.434582 run osmo-msc_10.42.42.6(pid=13812): stdout: | (launched: 2022-12-08_20:58:47.246993) 20:58:48.486089 run osmo-msc_10.42.42.6(pid=13812): stderr: | [0;m[38;5;43m20221208205847568 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205847568 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f01a2ba2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205847568 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205847568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205847568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205847568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205847570 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205847571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205847571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205847571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:58:48.537829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13805): Terminating (SIGTERM) 20:58:48.578960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13808): Terminating (SIGTERM) 20:58:48.620485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13811): Terminating (SIGTERM) 20:58:48.662556 --- ParallelTerminationStrategy: PID 13805 died... 20:58:48.682474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13805): Terminated: ok {rc=0} 20:58:48.728803 --- ParallelTerminationStrategy: PID 13808 died... 20:58:48.748769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13808): Terminated: ok {rc=0} 20:58:48.795558 --- ParallelTerminationStrategy: PID 13811 died... 20:58:48.815367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13811): Terminated: ok {rc=0} 20:58:48.901779 bus /sierra_3: Setting Powered False 20:58:49.999736 bus /sierra_3: Setting Powered False 20:58:51.114485 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 20:58:52.363096 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:58:52.370168 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 20:58:52.400673 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 20:58:52.428511 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 20:58:52.481288 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 20:58:52.511487 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 20:58:52.539217 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 20:58:53.089963 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 20:58:53.138363 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:58:53.149601 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:58:53.214792 tst mo_mt_call.py: using LAC 16771 20:58:53.336026 tst mo_mt_call.py: using RAC 196 20:58:53.453657 tst mo_mt_call.py: using CellId 16771 20:58:53.583337 tst mo_mt_call.py: using BVCI 16772 20:58:53.701684 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:58:53.713612 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:58:53.725309 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:58:53.737184 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:58:53.749348 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:58:53.761330 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:58:53.879725 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:58:53.999829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:58:54.500545 run create_hlr_db(pid=13817): Launched 20:58:54.631079 bus /sierra_2: Setting Powered False 20:58:55.694564 run create_hlr_db(pid=13817): Terminated: ok {rc=0} 20:58:56.124515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13819): Launched 20:58:56.424166 run osmo-hlr_10.42.42.2(pid=13820): Launched 20:58:56.538517 run osmo-stp_10.42.42.5: Starting osmo-stp 20:58:57.066234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13822): Launched 20:58:57.365173 run osmo-stp_10.42.42.5(pid=13823): Launched 20:58:57.478380 run osmo-msc_10.42.42.6: Starting osmo-msc 20:58:58.018938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13825): Launched 20:58:58.318778 run osmo-msc_10.42.42.6(pid=13826): Launched 20:58:58.486648 run osmo-stp_10.42.42.5(pid=13823): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13823)] 20:58:58.614347 run osmo-stp_10.42.42.5(pid=13823): stdout: | (launched: 2022-12-08_20:58:57.310181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:58.741992 run osmo-stp_10.42.42.5(pid=13823): stderr: | [0;m[38;5;43m20221208205857480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205857480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205857480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205857480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205857481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205857481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205857481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:58.867508 run osmo-stp_10.42.42.5(pid=13823): stdout: | (launched: 2022-12-08_20:58:57.310181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:58.986760 run osmo-stp_10.42.42.5(pid=13823): stderr: | [0;m[38;5;43m20221208205857480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205857480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205857480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205857480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205857481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205857481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205857481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:59.129262 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13823): Process ended prematurely: osmo-stp_10.42.42.5(pid=13823) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13823)] [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 20:58:59.137939 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 20:58:59.164318 run osmo-hlr_10.42.42.2(pid=13820): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13820)] 20:58:59.211902 run osmo-hlr_10.42.42.2(pid=13820): stdout: | (launched: 2022-12-08_20:58:56.369617) 20:58:59.260817 run osmo-hlr_10.42.42.2(pid=13820): stderr: | [0;m[1;31m20221208205856544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205856544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205856544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205856544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205856544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205856544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205856556 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205856566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205856566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205856567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:58:59.329350 run osmo-msc_10.42.42.6(pid=13826): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13826)] 20:58:59.376487 run osmo-msc_10.42.42.6(pid=13826): stdout: | (launched: 2022-12-08_20:58:58.263442) 20:58:59.425190 run osmo-msc_10.42.42.6(pid=13826): stderr: | [0;m[38;5;43m20221208205858533 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205858534 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f80f64d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205858534 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205858534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205858534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205858534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205858536 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205858536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205858536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205858536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:58:59.474416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13819): Terminating (SIGTERM) 20:58:59.514119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13822): Terminating (SIGTERM) 20:58:59.554039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13825): Terminating (SIGTERM) 20:58:59.593883 --- ParallelTerminationStrategy: PID 13819 died... 20:58:59.612580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13819): Terminated: ok {rc=0} 20:58:59.656449 --- ParallelTerminationStrategy: PID 13822 died... 20:58:59.674900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13822): Terminated: ok {rc=0} 20:58:59.718637 --- ParallelTerminationStrategy: PID 13825 died... 20:58:59.736929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13825): Terminated: ok {rc=0} 20:58:59.822128 bus /sierra_3: Setting Powered False 20:59:00.923811 bus /sierra_3: Setting Powered False 20:59:02.043447 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 20:59:03.188354 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:59:03.200263 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:59:03.269992 tst mo_mt_call_osmux.py: using LAC 16772 20:59:03.387059 tst mo_mt_call_osmux.py: using RAC 197 20:59:03.502180 tst mo_mt_call_osmux.py: using CellId 16772 20:59:03.620786 tst mo_mt_call_osmux.py: using BVCI 16773 20:59:03.730911 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:59:03.742227 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:59:03.753406 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:59:03.764661 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:59:03.776014 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:59:03.787338 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:59:03.908142 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:59:04.026552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:59:04.489647 run create_hlr_db(pid=13828): Launched 20:59:04.604194 bus /sierra_2: Setting Powered False 20:59:05.664274 run create_hlr_db(pid=13828): Terminated: ok {rc=0} 20:59:06.102874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13830): Launched 20:59:06.424787 run osmo-hlr_10.42.42.2(pid=13831): Launched 20:59:06.547784 run osmo-stp_10.42.42.5: Starting osmo-stp 20:59:07.105056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13833): Launched 20:59:07.425831 run osmo-stp_10.42.42.5(pid=13834): Launched 20:59:07.549641 run osmo-msc_10.42.42.6: Starting osmo-msc 20:59:08.130519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13836): Launched 20:59:08.451691 run osmo-msc_10.42.42.6(pid=13837): Launched 20:59:08.631600 run osmo-stp_10.42.42.5(pid=13834): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13834)] 20:59:08.766592 run osmo-stp_10.42.42.5(pid=13834): stdout: | (launched: 2022-12-08_20:59:07.367148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:08.902148 run osmo-stp_10.42.42.5(pid=13834): stderr: | [0;m[38;5;43m20221208205907557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205907557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205907558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205907558 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205907559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205907559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205907559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:09.037659 run osmo-stp_10.42.42.5(pid=13834): stdout: | (launched: 2022-12-08_20:59:07.367148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:09.164904 run osmo-stp_10.42.42.5(pid=13834): stderr: | [0;m[38;5;43m20221208205907557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205907557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205907558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205907558 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205907559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205907559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205907559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:09.317610 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13834): Process ended prematurely: osmo-stp_10.42.42.5(pid=13834) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13834)] [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 20:59:09.327276 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 20:59:09.355039 run osmo-hlr_10.42.42.2(pid=13831): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13831)] 20:59:09.404924 run osmo-hlr_10.42.42.2(pid=13831): stdout: | (launched: 2022-12-08_20:59:06.366341) 20:59:09.456473 run osmo-hlr_10.42.42.2(pid=13831): stderr: | [0;m[1;31m20221208205906564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205906564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205906564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205906564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205906564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205906564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205906576 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205906584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205906584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205906585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:59:09.528905 run osmo-msc_10.42.42.6(pid=13837): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13837)] 20:59:09.578538 run osmo-msc_10.42.42.6(pid=13837): stdout: | (launched: 2022-12-08_20:59:08.392722) 20:59:09.629776 run osmo-msc_10.42.42.6(pid=13837): stderr: | [0;m[38;5;43m20221208205908715 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205908716 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fed4e5ebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205908716 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205908716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205908716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205908716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205908718 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205908719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205908719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205908719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:59:09.681351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13830): Terminating (SIGTERM) 20:59:09.722655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13833): Terminating (SIGTERM) 20:59:09.763999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13836): Terminating (SIGTERM) 20:59:09.805712 --- ParallelTerminationStrategy: PID 13830 died... 20:59:09.825771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13830): Terminated: ok {rc=0} 20:59:09.872010 --- ParallelTerminationStrategy: PID 13833 died... 20:59:09.891769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13833): Terminated: ok {rc=0} 20:59:09.937710 --- ParallelTerminationStrategy: PID 13836 died... 20:59:09.957453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13836): Terminated: ok {rc=0} 20:59:10.044614 bus /sierra_3: Setting Powered False 20:59:11.142378 bus /sierra_3: Setting Powered False 20:59:12.257408 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 20:59:13.497814 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:59:13.503954 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 20:59:13.533877 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 20:59:13.560229 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 20:59:13.612920 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 20:59:13.642416 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 20:59:13.668792 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 20:59:14.223950 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 20:59:14.276848 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:14.288924 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:59:14.355904 tst mo_mt_call.py: using LAC 16773 20:59:14.483772 tst mo_mt_call.py: using RAC 198 20:59:14.601824 tst mo_mt_call.py: using CellId 16773 20:59:14.729453 tst mo_mt_call.py: using BVCI 16774 20:59:14.840180 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:14.851524 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:14.862621 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:14.874568 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:14.885930 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:14.897249 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:59:15.017809 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:59:15.134197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:59:15.597231 run create_hlr_db(pid=13843): Launched 20:59:15.711718 bus /sierra_2: Setting Powered False 20:59:16.774406 run create_hlr_db(pid=13843): Terminated: ok {rc=0} 20:59:17.231234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13845): Launched 20:59:17.533126 run osmo-hlr_10.42.42.2(pid=13846): Launched 20:59:17.646943 run osmo-stp_10.42.42.5: Starting osmo-stp 20:59:18.173916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13848): Launched 20:59:18.473324 run osmo-stp_10.42.42.5(pid=13849): Launched 20:59:18.586914 run osmo-msc_10.42.42.6: Starting osmo-msc 20:59:19.128034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13851): Launched 20:59:19.428620 run osmo-msc_10.42.42.6(pid=13852): Launched 20:59:19.596095 run osmo-stp_10.42.42.5(pid=13849): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13849)] 20:59:19.726816 run osmo-stp_10.42.42.5(pid=13849): stdout: | (launched: 2022-12-08_20:59:18.418378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:19.854471 run osmo-stp_10.42.42.5(pid=13849): stderr: | [0;m[38;5;43m20221208205918587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205918587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205918588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205918588 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205918588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205918588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205918589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:19.979753 run osmo-stp_10.42.42.5(pid=13849): stdout: | (launched: 2022-12-08_20:59:18.418378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:20.098621 run osmo-stp_10.42.42.5(pid=13849): stderr: | [0;m[38;5;43m20221208205918587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205918587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205918588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205918588 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205918588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205918588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205918589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:20.241401 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13849): Process ended prematurely: osmo-stp_10.42.42.5(pid=13849) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13849)] [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 20:59:20.250157 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 20:59:20.276409 run osmo-hlr_10.42.42.2(pid=13846): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13846)] 20:59:20.323897 run osmo-hlr_10.42.42.2(pid=13846): stdout: | (launched: 2022-12-08_20:59:17.478106) 20:59:20.372746 run osmo-hlr_10.42.42.2(pid=13846): stderr: | [0;m[1;31m20221208205917650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205917650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205917650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205917650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205917651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205917651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205917663 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205917671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205917672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205917672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:59:20.441249 run osmo-msc_10.42.42.6(pid=13852): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13852)] 20:59:20.488536 run osmo-msc_10.42.42.6(pid=13852): stdout: | (launched: 2022-12-08_20:59:19.373424) 20:59:20.537487 run osmo-msc_10.42.42.6(pid=13852): stderr: | [0;m[38;5;43m20221208205919644 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205919644 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1d172dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205919644 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205919645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205919645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205919645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205919647 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205919648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205919648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205919648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:59:20.586886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13845): Terminating (SIGTERM) 20:59:20.626346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13848): Terminating (SIGTERM) 20:59:20.666054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13851): Terminating (SIGTERM) 20:59:20.705686 --- ParallelTerminationStrategy: PID 13845 died... 20:59:20.724268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13845): Terminated: ok {rc=0} 20:59:20.769369 --- ParallelTerminationStrategy: PID 13848 died... 20:59:20.787671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13848): Terminated: ok {rc=0} 20:59:20.831109 --- ParallelTerminationStrategy: PID 13851 died... 20:59:20.849389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13851): Terminated: ok {rc=0} 20:59:20.932208 bus /sierra_3: Setting Powered False 20:59:22.028175 bus /sierra_3: Setting Powered False 20:59:23.143894 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 20:59:24.286309 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:24.298159 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:59:24.364327 tst mo_mt_call_osmux.py: using LAC 16774 20:59:24.482234 tst mo_mt_call_osmux.py: using RAC 199 20:59:24.601403 tst mo_mt_call_osmux.py: using CellId 16774 20:59:24.718895 tst mo_mt_call_osmux.py: using BVCI 16775 20:59:24.829146 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:24.840325 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:24.852743 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:24.864117 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:24.875442 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:24.886763 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:59:25.002971 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:59:25.122247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:59:25.622985 run create_hlr_db(pid=13854): Launched 20:59:25.754562 bus /sierra_2: Setting Powered False 20:59:26.818741 run create_hlr_db(pid=13854): Terminated: ok {rc=0} 20:59:27.267771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13856): Launched 20:59:27.591721 run osmo-hlr_10.42.42.2(pid=13857): Launched 20:59:27.714323 run osmo-stp_10.42.42.5: Starting osmo-stp 20:59:28.268541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13859): Launched 20:59:28.590544 run osmo-stp_10.42.42.5(pid=13860): Launched 20:59:28.712776 run osmo-msc_10.42.42.6: Starting osmo-msc 20:59:29.296593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13862): Launched 20:59:29.619706 run osmo-msc_10.42.42.6(pid=13863): Launched 20:59:29.801621 run osmo-stp_10.42.42.5(pid=13860): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13860)] 20:59:29.937672 run osmo-stp_10.42.42.5(pid=13860): stdout: | (launched: 2022-12-08_20:59:28.531947) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:30.074584 run osmo-stp_10.42.42.5(pid=13860): stderr: | [0;m[38;5;43m20221208205928722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205928722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205928722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205928722 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205928723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205928723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205928723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:30.210643 run osmo-stp_10.42.42.5(pid=13860): stdout: | (launched: 2022-12-08_20:59:28.531947) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:30.338702 run osmo-stp_10.42.42.5(pid=13860): stderr: | [0;m[38;5;43m20221208205928722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205928722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205928722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205928722 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205928723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205928723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205928723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:30.492332 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13860): Process ended prematurely: osmo-stp_10.42.42.5(pid=13860) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13860)] [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 20:59:30.502275 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:59:30.530414 run osmo-hlr_10.42.42.2(pid=13857): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13857)] 20:59:30.580764 run osmo-hlr_10.42.42.2(pid=13857): stdout: | (launched: 2022-12-08_20:59:27.532655) 20:59:30.632617 run osmo-hlr_10.42.42.2(pid=13857): stderr: | [0;m[1;31m20221208205927730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205927730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205927730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205927730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205927730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205927730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205927742 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205927752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205927752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205927752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:59:30.704737 run osmo-msc_10.42.42.6(pid=13863): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13863)] 20:59:30.754658 run osmo-msc_10.42.42.6(pid=13863): stdout: | (launched: 2022-12-08_20:59:29.560710) 20:59:30.806201 run osmo-msc_10.42.42.6(pid=13863): stderr: | [0;m[38;5;43m20221208205929882 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205929882 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f36b52aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205929882 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205929882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205929882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205929882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205929884 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205929884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205929885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205929885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:59:30.860421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13856): Terminating (SIGTERM) 20:59:30.922457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13859): Terminating (SIGTERM) 20:59:30.966900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13862): Terminating (SIGTERM) 20:59:31.012298 --- ParallelTerminationStrategy: PID 13856 died... 20:59:31.034196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13856): Terminated: ok {rc=0} 20:59:31.081747 --- ParallelTerminationStrategy: PID 13859 died... 20:59:31.102179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13859): Terminated: ok {rc=0} 20:59:31.149949 --- ParallelTerminationStrategy: PID 13862 died... 20:59:31.170339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13862): Terminated: ok {rc=0} 20:59:31.258054 bus /sierra_3: Setting Powered False 20:59:32.356839 bus /sierra_3: Setting Powered False 20:59:33.473290 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:59:34.717108 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:59:34.724746 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:59:34.755937 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 20:59:34.783196 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:59:34.839787 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:59:34.871382 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 20:59:34.898804 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:59:35.449378 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 20:59:35.500543 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:59:35.512610 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:59:35.579809 tst mo_mt_call.py: using LAC 16775 20:59:35.707333 tst mo_mt_call.py: using RAC 200 20:59:35.834119 tst mo_mt_call.py: using CellId 16775 20:59:35.959130 tst mo_mt_call.py: using BVCI 16776 20:59:36.076108 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:59:36.087942 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:59:36.099783 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:59:36.111363 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:59:36.123040 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:59:36.134654 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:59:36.255488 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:59:36.371023 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:59:36.835246 run create_hlr_db(pid=13868): Launched 20:59:36.950768 bus /sierra_2: Setting Powered False 20:59:38.010915 run create_hlr_db(pid=13868): Terminated: ok {rc=0} 20:59:38.450605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13870): Launched 20:59:38.772850 run osmo-hlr_10.42.42.2(pid=13871): Launched 20:59:38.895196 run osmo-stp_10.42.42.5: Starting osmo-stp 20:59:39.449631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13873): Launched 20:59:39.771380 run osmo-stp_10.42.42.5(pid=13874): Launched 20:59:39.893212 run osmo-msc_10.42.42.6: Starting osmo-msc 20:59:40.475379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13876): Launched 20:59:40.798153 run osmo-msc_10.42.42.6(pid=13877): Launched 20:59:40.976864 run osmo-stp_10.42.42.5(pid=13874): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13874)] 20:59:41.112393 run osmo-stp_10.42.42.5(pid=13874): stdout: | (launched: 2022-12-08_20:59:39.712633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:41.249213 run osmo-stp_10.42.42.5(pid=13874): stderr: | [0;m[38;5;43m20221208205939904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205939904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205939904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205939904 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205939905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205939905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205939905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:41.384640 run osmo-stp_10.42.42.5(pid=13874): stdout: | (launched: 2022-12-08_20:59:39.712633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:41.512619 run osmo-stp_10.42.42.5(pid=13874): stderr: | [0;m[38;5;43m20221208205939904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205939904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205939904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205939904 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205939905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205939905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205939905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:41.665690 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13874): Process ended prematurely: osmo-stp_10.42.42.5(pid=13874) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13874)] [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 20:59:41.675079 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:59:41.702530 run osmo-hlr_10.42.42.2(pid=13871): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13871)] 20:59:41.751766 run osmo-hlr_10.42.42.2(pid=13871): stdout: | (launched: 2022-12-08_20:59:38.714048) 20:59:41.802730 run osmo-hlr_10.42.42.2(pid=13871): stderr: | [0;m[1;31m20221208205938910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205938910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205938910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205938910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205938910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205938911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205938923 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205938932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205938932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205938932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:59:41.873797 run osmo-msc_10.42.42.6(pid=13877): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13877)] 20:59:41.923406 run osmo-msc_10.42.42.6(pid=13877): stdout: | (launched: 2022-12-08_20:59:40.738777) 20:59:41.974026 run osmo-msc_10.42.42.6(pid=13877): stderr: | [0;m[38;5;43m20221208205941058 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205941058 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa6b4f59c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205941058 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205941058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205941058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205941058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205941060 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205941061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205941061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205941061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:59:42.025355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13870): Terminating (SIGTERM) 20:59:42.066418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13873): Terminating (SIGTERM) 20:59:42.107676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13876): Terminating (SIGTERM) 20:59:42.149268 --- ParallelTerminationStrategy: PID 13870 died... 20:59:42.168675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13870): Terminated: ok {rc=0} 20:59:42.214731 --- ParallelTerminationStrategy: PID 13873 died... 20:59:42.234238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13873): Terminated: ok {rc=0} 20:59:42.279990 --- ParallelTerminationStrategy: PID 13876 died... 20:59:42.299399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13876): Terminated: ok {rc=0} 20:59:42.385426 bus /sierra_3: Setting Powered False 20:59:43.482315 bus /sierra_3: Setting Powered False 20:59:44.598359 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 20:59:45.742968 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:59:45.755038 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:59:45.821846 tst mo_mt_call_osmux.py: using LAC 16776 20:59:45.959221 tst mo_mt_call_osmux.py: using RAC 201 20:59:46.080787 tst mo_mt_call_osmux.py: using CellId 16776 20:59:46.203763 tst mo_mt_call_osmux.py: using BVCI 16777 20:59:46.325101 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:59:46.337764 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:59:46.350168 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:59:46.363026 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:59:46.375979 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:59:46.388907 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:59:46.515502 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:59:46.666543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:59:47.165166 run create_hlr_db(pid=13879): Launched 20:59:47.313446 bus /sierra_2: Setting Powered False 20:59:48.373859 run create_hlr_db(pid=13879): Terminated: ok {rc=0} 20:59:48.814685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13881): Launched 20:59:49.137060 run osmo-hlr_10.42.42.2(pid=13882): Launched 20:59:49.259825 run osmo-stp_10.42.42.5: Starting osmo-stp 20:59:49.815442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13884): Launched 20:59:50.137978 run osmo-stp_10.42.42.5(pid=13885): Launched 20:59:50.260427 run osmo-msc_10.42.42.6: Starting osmo-msc 20:59:50.842869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13887): Launched 20:59:51.164206 run osmo-msc_10.42.42.6(pid=13888): Launched 20:59:51.343672 run osmo-stp_10.42.42.5(pid=13885): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13885)] 20:59:51.478935 run osmo-stp_10.42.42.5(pid=13885): stdout: | (launched: 2022-12-08_20:59:50.078961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:51.615490 run osmo-stp_10.42.42.5(pid=13885): stderr: | [0;m[38;5;43m20221208205950268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205950269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205950269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205950269 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205950270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205950270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205950270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:51.750504 run osmo-stp_10.42.42.5(pid=13885): stdout: | (launched: 2022-12-08_20:59:50.078961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:51.878219 run osmo-stp_10.42.42.5(pid=13885): stderr: | [0;m[38;5;43m20221208205950268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208205950269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208205950269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208205950269 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208205950270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208205950270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208205950270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:52.031202 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13885): Process ended prematurely: osmo-stp_10.42.42.5(pid=13885) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13885)] [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 20:59:52.040458 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:59:52.068057 run osmo-hlr_10.42.42.2(pid=13882): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13882)] 20:59:52.117657 run osmo-hlr_10.42.42.2(pid=13882): stdout: | (launched: 2022-12-08_20:59:49.078404) 20:59:52.168783 run osmo-hlr_10.42.42.2(pid=13882): stderr: | [0;m[1;31m20221208205949275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208205949275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208205949275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208205949275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208205949275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208205949275 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208205949302 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208205949313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208205949314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208205949314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:59:52.240572 run osmo-msc_10.42.42.6(pid=13888): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13888)] 20:59:52.290251 run osmo-msc_10.42.42.6(pid=13888): stdout: | (launched: 2022-12-08_20:59:51.105506) 20:59:52.341646 run osmo-msc_10.42.42.6(pid=13888): stderr: | [0;m[38;5;43m20221208205951427 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208205951427 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe8a6c7ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208205951427 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208205951427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208205951427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208205951427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208205951429 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208205951430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208205951430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208205951430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:59:52.393206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13881): Terminating (SIGTERM) 20:59:52.434269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13884): Terminating (SIGTERM) 20:59:52.475407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13887): Terminating (SIGTERM) 20:59:52.517276 --- ParallelTerminationStrategy: PID 13881 died... 20:59:52.536514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13881): Terminated: ok {rc=0} 20:59:52.582704 --- ParallelTerminationStrategy: PID 13884 died... 20:59:52.602217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13884): Terminated: ok {rc=0} 20:59:52.647895 --- ParallelTerminationStrategy: PID 13887 died... 20:59:52.667450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13887): Terminated: ok {rc=0} 20:59:52.754391 bus /sierra_3: Setting Powered False 20:59:53.853626 bus /sierra_3: Setting Powered False 20:59:54.969029 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:59:56.221473 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:59:56.227087 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:59:56.256867 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 20:59:56.283258 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 20:59:56.334695 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:59:56.363920 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 20:59:56.390140 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 20:59:56.942017 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 20:59:56.990594 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:59:57.001845 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:59:57.067732 tst mo_mt_call.py: using LAC 16777 20:59:57.196233 tst mo_mt_call.py: using RAC 202 20:59:57.322858 tst mo_mt_call.py: using CellId 16777 20:59:57.452079 tst mo_mt_call.py: using BVCI 16778 20:59:57.562624 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:59:57.573843 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:59:57.585095 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:59:57.596333 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:59:57.607669 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:59:57.619023 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:59:57.738569 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:59:57.858337 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:59:58.358551 run create_hlr_db(pid=13893): Launched 20:59:58.489972 bus /sierra_2: Setting Powered False 20:59:59.554564 run create_hlr_db(pid=13893): Terminated: ok {rc=0} 21:00:00.003285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13895): Launched 21:00:00.325270 run osmo-hlr_10.42.42.2(pid=13896): Launched 21:00:00.448675 run osmo-stp_10.42.42.5: Starting osmo-stp 21:00:01.030934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13898): Launched 21:00:01.350401 run osmo-stp_10.42.42.5(pid=13899): Launched 21:00:01.643404 run osmo-msc_10.42.42.6: Starting osmo-msc 21:00:02.362674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13914): Launched 21:00:02.713861 run osmo-msc_10.42.42.6(pid=13921): Launched 21:00:03.047342 run osmo-stp_10.42.42.5(pid=13899): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13899)] 21:00:03.295270 run osmo-stp_10.42.42.5(pid=13899): stdout: | (launched: 2022-12-08_21:00:01.290481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:03.527967 run osmo-stp_10.42.42.5(pid=13899): stderr: | [0;m[38;5;43m20221208210001539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210001539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210001539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210001540 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210001540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210001540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210001540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:03.667656 run osmo-stp_10.42.42.5(pid=13899): stdout: | (launched: 2022-12-08_21:00:01.290481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:03.804219 run osmo-stp_10.42.42.5(pid=13899): stderr: | [0;m[38;5;43m20221208210001539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210001539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210001539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210001540 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210001540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210001540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210001540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:03.968884 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13899): Process ended prematurely: osmo-stp_10.42.42.5(pid=13899) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13899)] [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 21:00:03.979157 tst mo_mt_call.py:8: Test FAILED (7.0 sec) 21:00:04.007704 run osmo-hlr_10.42.42.2(pid=13896): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13896)] 21:00:04.058021 run osmo-hlr_10.42.42.2(pid=13896): stdout: | (launched: 2022-12-08_21:00:00.266512) 21:00:04.109959 run osmo-hlr_10.42.42.2(pid=13896): stderr: | [0;m[1;31m20221208210000462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210000462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210000462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210000462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210000462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210000463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210000476 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210000486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210000486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210000486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:00:04.182252 run osmo-msc_10.42.42.6(pid=13921): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13921)] 21:00:04.232352 run osmo-msc_10.42.42.6(pid=13921): stdout: | (launched: 2022-12-08_21:00:02.650582) 21:00:04.284249 run osmo-msc_10.42.42.6(pid=13921): stderr: | [0;m[38;5;43m20221208210003174 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208210003175 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcacabf9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208210003175 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208210003175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208210003175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208210003175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208210003177 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208210003177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208210003178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208210003178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:00:04.336287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13895): Terminating (SIGTERM) 21:00:04.378192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13898): Terminating (SIGTERM) 21:00:04.419967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13914): Terminating (SIGTERM) 21:00:04.462441 --- ParallelTerminationStrategy: PID 13895 died... 21:00:04.482628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13895): Terminated: ok {rc=0} 21:00:04.529333 --- ParallelTerminationStrategy: PID 13898 died... 21:00:04.549117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13898): Terminated: ok {rc=0} 21:00:04.595451 --- ParallelTerminationStrategy: PID 13914 died... 21:00:04.615313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13914): Terminated: ok {rc=0} 21:00:04.703229 bus /sierra_3: Setting Powered False 21:00:05.802718 bus /sierra_3: Setting Powered False 21:00:06.918388 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 21:00:08.067534 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:00:08.079882 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:00:08.150410 tst mo_mt_call_osmux.py: using LAC 16778 21:00:08.281576 tst mo_mt_call_osmux.py: using RAC 203 21:00:08.410358 tst mo_mt_call_osmux.py: using CellId 16778 21:00:08.537806 tst mo_mt_call_osmux.py: using BVCI 16779 21:00:08.647957 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:00:08.659368 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:00:08.670520 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:00:08.682016 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:00:08.693525 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:00:08.704734 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:00:08.821297 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:00:08.941663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:00:09.454102 run create_hlr_db(pid=13946): Launched 21:00:09.588208 bus /sierra_2: Setting Powered False 21:00:10.653423 run create_hlr_db(pid=13946): Terminated: ok {rc=0} 21:00:11.087962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13948): Launched 21:00:11.416593 run osmo-hlr_10.42.42.2(pid=13949): Launched 21:00:11.541275 run osmo-stp_10.42.42.5: Starting osmo-stp 21:00:12.102041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13951): Launched 21:00:12.429180 run osmo-stp_10.42.42.5(pid=13952): Launched 21:00:12.554566 run osmo-msc_10.42.42.6: Starting osmo-msc 21:00:13.141597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13954): Launched 21:00:13.467754 run osmo-msc_10.42.42.6(pid=13955): Launched 21:00:13.650874 run osmo-stp_10.42.42.5(pid=13952): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13952)] 21:00:13.787952 run osmo-stp_10.42.42.5(pid=13952): stdout: | (launched: 2022-12-08_21:00:12.369594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:13.925962 run osmo-stp_10.42.42.5(pid=13952): stderr: | [0;m[38;5;43m20221208210012563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210012563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210012563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210012564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210012564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210012564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210012564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:14.062790 run osmo-stp_10.42.42.5(pid=13952): stdout: | (launched: 2022-12-08_21:00:12.369594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:14.192692 run osmo-stp_10.42.42.5(pid=13952): stderr: | [0;m[38;5;43m20221208210012563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210012563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210012563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210012564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210012564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210012564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210012564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:14.347744 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13952): Process ended prematurely: osmo-stp_10.42.42.5(pid=13952) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13952)] [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 21:00:14.357475 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:00:14.385509 run osmo-hlr_10.42.42.2(pid=13949): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13949)] 21:00:14.435680 run osmo-hlr_10.42.42.2(pid=13949): stdout: | (launched: 2022-12-08_21:00:11.356706) 21:00:14.487603 run osmo-hlr_10.42.42.2(pid=13949): stderr: | [0;m[1;31m20221208210011557 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210011558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210011558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210011558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210011558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210011558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210011570 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210011580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210011580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210011580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:00:14.560318 run osmo-msc_10.42.42.6(pid=13955): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13955)] 21:00:14.610116 run osmo-msc_10.42.42.6(pid=13955): stdout: | (launched: 2022-12-08_21:00:13.407775) 21:00:14.661401 run osmo-msc_10.42.42.6(pid=13955): stderr: | [0;m[38;5;43m20221208210013736 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208210013737 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0845d28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208210013737 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208210013737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208210013737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208210013737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208210013739 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208210013739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208210013740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208210013740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:00:14.712915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13948): Terminating (SIGTERM) 21:00:14.754477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13951): Terminating (SIGTERM) 21:00:14.796067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13954): Terminating (SIGTERM) 21:00:14.838351 --- ParallelTerminationStrategy: PID 13948 died... 21:00:14.858089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13948): Terminated: ok {rc=0} 21:00:14.904402 --- ParallelTerminationStrategy: PID 13951 died... 21:00:14.923959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13951): Terminated: ok {rc=0} 21:00:14.970362 --- ParallelTerminationStrategy: PID 13954 died... 21:00:14.990122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13954): Terminated: ok {rc=0} 21:00:15.077662 bus /sierra_3: Setting Powered False 21:00:16.178376 bus /sierra_3: Setting Powered False 21:00:17.310043 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 21:00:18.553987 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:00:18.559407 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 21:00:18.590024 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 21:00:18.617615 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 21:00:18.707086 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 21:00:18.737591 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 21:00:18.765397 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 21:00:19.350155 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2349 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 21:00:19.355766 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:19.367166 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:00:19.413516 tst emergency_mo_mt_call.py: using LAC 16779 21:00:19.538505 tst emergency_mo_mt_call.py: using RAC 204 21:00:19.664454 tst emergency_mo_mt_call.py: using CellId 16779 21:00:19.788669 tst emergency_mo_mt_call.py: using BVCI 16780 21:00:19.903772 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:19.915194 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:19.926349 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:19.937512 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:19.948697 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:19.959859 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:00:20.081028 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:00:20.197533 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:00:20.657603 run create_hlr_db(pid=13962): Launched 21:00:20.772799 bus /sierra_2: Setting Powered False 21:00:21.833164 run create_hlr_db(pid=13962): Terminated: ok {rc=0} 21:00:22.249166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13964): Launched 21:00:22.546315 run osmo-hlr_10.42.42.2(pid=13965): Launched 21:00:22.658886 run osmo-stp_10.42.42.5: Starting osmo-stp 21:00:23.181623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13967): Launched 21:00:23.479542 run osmo-stp_10.42.42.5(pid=13968): Launched 21:00:23.604209 tst emergency_mo_mt_call.py: using MSISDN 6849 21:00:23.755650 run osmo-msc_10.42.42.6: Starting osmo-msc 21:00:24.293119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13970): Launched 21:00:24.589776 run osmo-msc_10.42.42.6(pid=13971): Launched 21:00:24.757131 run osmo-stp_10.42.42.5(pid=13968): ERR: Terminated: ERROR {rc=1} [trial-2349↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13968)] 21:00:24.883300 run osmo-stp_10.42.42.5(pid=13968): stdout: | (launched: 2022-12-08_21:00:23.424466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:25.009721 run osmo-stp_10.42.42.5(pid=13968): stderr: | [0;m[38;5;43m20221208210023595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210023595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210023595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210023596 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210023596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210023596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210023596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:25.134392 run osmo-stp_10.42.42.5(pid=13968): stdout: | (launched: 2022-12-08_21:00:23.424466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:25.252492 run osmo-stp_10.42.42.5(pid=13968): stderr: | [0;m[38;5;43m20221208210023595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210023595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210023595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210023596 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210023596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210023596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210023596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:25.393911 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=13968): Process ended prematurely: osmo-stp_10.42.42.5(pid=13968) [trial-2349↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13968)] [trial-2349↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 21:00:25.402078 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 21:00:25.428582 run osmo-hlr_10.42.42.2(pid=13965): ERR: Terminated: ERROR {rc=237} [trial-2349↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13965)] 21:00:25.476838 run osmo-hlr_10.42.42.2(pid=13965): stdout: | (launched: 2022-12-08_21:00:22.491681) 21:00:25.526378 run osmo-hlr_10.42.42.2(pid=13965): stderr: | [0;m[1;31m20221208210022669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210022669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210022669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210022669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210022669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210022669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210022681 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210022690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210022691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210022691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:00:25.595508 run osmo-msc_10.42.42.6(pid=13971): ERR: Terminated: ERROR {rc=2} [trial-2349↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13971)] 21:00:25.642901 run osmo-msc_10.42.42.6(pid=13971): stdout: | (launched: 2022-12-08_21:00:24.535108) 21:00:25.691968 run osmo-msc_10.42.42.6(pid=13971): stderr: | [0;m[38;5;43m20221208210024809 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208210024809 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fab1fc31c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208210024809 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208210024810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208210024810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208210024810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208210024812 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208210024812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208210024812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208210024812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:00:25.741532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13964): Terminating (SIGTERM) 21:00:25.780730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13967): Terminating (SIGTERM) 21:00:25.820416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13970): Terminating (SIGTERM) 21:00:25.860408 --- ParallelTerminationStrategy: PID 13964 died... 21:00:25.879867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13964): Terminated: ok {rc=0} 21:00:25.924529 --- ParallelTerminationStrategy: PID 13967 died... 21:00:25.943247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13967): Terminated: ok {rc=0} 21:00:25.987021 --- ParallelTerminationStrategy: PID 13970 died... 21:00:26.005617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13970): Terminated: ok {rc=0} 21:00:26.091766 bus /sierra_3: Setting Powered False 21:00:27.189152 bus /sierra_3: Setting Powered False 21:00:28.303494 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 21:00:29.389980 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:29.401562 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:00:29.450481 tst emergency_preemptive_call.py: using LAC 16780 21:00:29.566431 tst emergency_preemptive_call.py: using RAC 205 21:00:29.681518 tst emergency_preemptive_call.py: using CellId 16780 21:00:29.795782 tst emergency_preemptive_call.py: using BVCI 16781 21:00:29.902780 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:29.913790 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:29.924479 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:29.935441 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:29.946435 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:29.957415 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:00:30.076588 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:00:30.193175 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:00:30.313374 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:00:30.430379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:00:30.908685 run create_hlr_db(pid=13973): Launched 21:00:31.067295 bus /sierra_2: Setting Powered False 21:00:32.131622 run create_hlr_db(pid=13973): Terminated: ok {rc=0} 21:00:32.581929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13975): Launched 21:00:32.900754 run osmo-hlr_10.42.42.2(pid=13976): Launched 21:00:33.021806 run osmo-stp_10.42.42.5: Starting osmo-stp 21:00:33.571537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13978): Launched 21:00:33.892308 run osmo-stp_10.42.42.5(pid=13979): Launched 21:00:34.025056 tst emergency_preemptive_call.py: using MSISDN 6850 21:00:34.189179 run osmo-msc_10.42.42.6: Starting osmo-msc 21:00:34.762731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13981): Launched 21:00:35.083670 run osmo-msc_10.42.42.6(pid=13982): Launched 21:00:35.260731 run osmo-stp_10.42.42.5(pid=13979): ERR: Terminated: ERROR {rc=1} [trial-2349↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13979)] 21:00:35.394807 run osmo-stp_10.42.42.5(pid=13979): stdout: | (launched: 2022-12-08_21:00:33.833922) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:35.529314 run osmo-stp_10.42.42.5(pid=13979): stderr: | [0;m[38;5;43m20221208210034026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210034026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210034026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210034027 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210034029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210034030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210034030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:35.663930 run osmo-stp_10.42.42.5(pid=13979): stdout: | (launched: 2022-12-08_21:00:33.833922) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:35.791119 run osmo-stp_10.42.42.5(pid=13979): stderr: | [0;m[38;5;43m20221208210034026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210034026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210034026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210034027 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210034029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210034030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210034030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:35.942961 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=13979): Process ended prematurely: osmo-stp_10.42.42.5(pid=13979) [trial-2349↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13979)] [trial-2349↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 21:00:35.951813 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 21:00:35.979380 run osmo-hlr_10.42.42.2(pid=13976): ERR: Terminated: ERROR {rc=237} [trial-2349↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13976)] 21:00:36.029406 run osmo-hlr_10.42.42.2(pid=13976): stdout: | (launched: 2022-12-08_21:00:32.842294) 21:00:36.081274 run osmo-hlr_10.42.42.2(pid=13976): stderr: | [0;m[1;31m20221208210033040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210033040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210033040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210033040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210033040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210033040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210033057 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210033066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210033067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210033067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:00:36.153355 run osmo-msc_10.42.42.6(pid=13982): ERR: Terminated: ERROR {rc=2} [trial-2349↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13982)] 21:00:36.202915 run osmo-msc_10.42.42.6(pid=13982): stdout: | (launched: 2022-12-08_21:00:35.025099) 21:00:36.254683 run osmo-msc_10.42.42.6(pid=13982): stderr: | [0;m[38;5;43m20221208210035348 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208210035348 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff1dda1ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208210035348 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208210035348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208210035349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208210035349 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208210035350 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208210035351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208210035351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208210035351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:00:36.306820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13975): Terminating (SIGTERM) 21:00:36.348279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13978): Terminating (SIGTERM) 21:00:36.389995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13981): Terminating (SIGTERM) 21:00:36.431875 --- ParallelTerminationStrategy: PID 13975 died... 21:00:36.451710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13975): Terminated: ok {rc=0} 21:00:36.497711 --- ParallelTerminationStrategy: PID 13978 died... 21:00:36.517370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13978): Terminated: ok {rc=0} 21:00:36.563886 --- ParallelTerminationStrategy: PID 13981 died... 21:00:36.583710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13981): Terminated: ok {rc=0} 21:00:36.670148 bus /sierra_9: Setting Powered False 21:00:37.768691 bus /sierra_9: Setting Powered False 21:00:38.886139 bus /sierra_8: Setting Powered False 21:00:39.984494 bus /sierra_8: Setting Powered False 21:00:41.102240 bus /sierra_3: Setting Powered False 21:00:42.201657 bus /sierra_3: Setting Powered False 21:00:43.317417 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 21:00:44.594133 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:00:44.598831 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 21:00:44.628855 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 21:00:44.668685 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 21:00:44.757848 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 21:00:44.788007 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 21:00:44.827537 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 21:00:45.416832 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 21:00:45.471220 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:45.482698 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:00:45.529308 tst cs_paging_gprs_active.py: using LAC 16781 21:00:45.658550 tst cs_paging_gprs_active.py: using RAC 206 21:00:45.787927 tst cs_paging_gprs_active.py: using CellId 16781 21:00:45.935844 tst cs_paging_gprs_active.py: using BVCI 16782 21:00:46.049498 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:46.061409 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:46.073130 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:46.087751 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:46.100522 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:46.112150 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:46.125050 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:46.138747 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:46.150435 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:00:46.272124 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:00:46.410230 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:00:46.645869 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:00:46.959794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13987): Launched 21:00:47.242194 run iperf3-srv_10.42.42.10(pid=13988): Launched 21:00:47.357753 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:00:47.561546 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:00:47.867855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13989): Launched 21:00:48.134873 run iperf3-srv_10.42.42.10(pid=13990): Launched 21:00:48.249254 tst cs_paging_gprs_active.py:38: start network... 21:00:48.451821 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:00:48.921354 run create_hlr_db(pid=13991): Launched 21:00:49.038801 bus /sierra_2: Setting Powered False 21:00:50.099830 run create_hlr_db(pid=13991): Terminated: ok {rc=0} 21:00:50.545796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13993): Launched 21:00:50.876928 run osmo-hlr_10.42.42.2(pid=13994): Launched 21:00:51.003119 run osmo-stp_10.42.42.5: Starting osmo-stp 21:00:51.570938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13996): Launched 21:00:51.900424 run osmo-stp_10.42.42.5(pid=13997): Launched 21:00:52.024707 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:00:52.588376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13999): Launched 21:00:52.715720 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:00:52.991783 run patchelf(pid=14000): Launched 21:00:53.175473 run osmo-stp_10.42.42.5(pid=13997): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13997)] 21:00:53.313616 run osmo-stp_10.42.42.5(pid=13997): stdout: | (launched: 2022-12-08_21:00:51.840290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:53.453475 run osmo-stp_10.42.42.5(pid=13997): stderr: | [0;m[38;5;43m20221208210052033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210052033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210052033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210052034 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210052036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210052036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210052036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:53.593930 run osmo-stp_10.42.42.5(pid=13997): stdout: | (launched: 2022-12-08_21:00:51.840290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:53.727723 run osmo-stp_10.42.42.5(pid=13997): stderr: | [0;m[38;5;43m20221208210052033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210052033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210052033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210052034 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210052036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210052036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210052036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:53.887322 run patchelf(pid=14000): Terminating (SIGINT) 21:00:54.070156 run patchelf(pid=14000): Terminated: ok {rc=0} 21:00:54.202082 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13997): Process ended prematurely: osmo-stp_10.42.42.5(pid=13997) [trial-2349↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13997)] [trial-2349↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 21:00:54.212260 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 21:00:54.240832 run osmo-hlr_10.42.42.2(pid=13994): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13994)] 21:00:54.290631 run osmo-hlr_10.42.42.2(pid=13994): stdout: | (launched: 2022-12-08_21:00:50.817221) 21:00:54.342273 run osmo-hlr_10.42.42.2(pid=13994): stderr: | [0;m[1;31m20221208210051018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210051018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210051018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210051018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210051018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210051018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210051030 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210051039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210051039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210051039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:00:54.394418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13987): Terminating (SIGTERM) 21:00:54.436321 run iperf3-srv_10.42.42.10(pid=13988): Terminating (SIGTERM) 21:00:54.478227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13989): Terminating (SIGTERM) 21:00:54.520489 run iperf3-srv_10.42.42.10(pid=13990): Terminating (SIGTERM) 21:00:54.562478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13993): Terminating (SIGTERM) 21:00:54.604371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13996): Terminating (SIGTERM) 21:00:54.646085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13999): Terminating (SIGTERM) 21:00:54.688340 --- ParallelTerminationStrategy: PID 13987 died... 21:00:54.708373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13987): Terminated: ok {rc=0} 21:00:54.754928 --- ParallelTerminationStrategy: PID 13988 died... 21:00:54.774598 run iperf3-srv_10.42.42.10(pid=13988): Terminated {rc=256} 21:00:54.820502 --- ParallelTerminationStrategy: PID 13989 died... 21:00:54.840179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13989): Terminated: ok {rc=0} 21:00:54.886156 --- ParallelTerminationStrategy: PID 13990 died... 21:00:54.905774 run iperf3-srv_10.42.42.10(pid=13990): Terminated {rc=256} 21:00:54.951422 --- ParallelTerminationStrategy: PID 13993 died... 21:00:54.971052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13993): Terminated: ok {rc=0} 21:00:55.016710 --- ParallelTerminationStrategy: PID 13996 died... 21:00:55.036371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13996): Terminated: ok {rc=0} 21:00:55.082357 --- ParallelTerminationStrategy: PID 13999 died... 21:00:55.101947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13999): Terminated: ok {rc=0} 21:00:55.188442 bus /gobi_0: Setting Powered False 21:00:56.287461 bus /gobi_0: Setting Powered False 21:00:57.403670 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 21:00:58.554131 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:58.566266 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:00:58.616645 tst iperf3.py: using LAC 16782 21:00:58.745107 tst iperf3.py: using RAC 207 21:00:58.873509 tst iperf3.py: using CellId 16782 21:00:58.994687 tst iperf3.py: using BVCI 16783 21:00:59.105429 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:59.116339 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:59.127159 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:59.138380 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:59.149567 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:59.160514 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:59.171991 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:59.182928 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:59.194157 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:00:59.312306 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:00:59.516029 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:00:59.820683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14001): Launched 21:01:00.086285 run iperf3-srv_10.42.42.10(pid=14002): Launched 21:01:00.200587 tst iperf3.py:8: start network... 21:01:00.404197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:01:00.877784 run create_hlr_db(pid=14003): Launched 21:01:01.066857 bus /gobi_6: Setting Powered False 21:01:02.152407 run create_hlr_db(pid=14003): Terminated: ok {rc=0} 21:01:02.612477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14005): Launched 21:01:02.939582 run osmo-hlr_10.42.42.2(pid=14006): Launched 21:01:03.065911 run osmo-stp_10.42.42.5: Starting osmo-stp 21:01:03.629746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14008): Launched 21:01:03.958538 run osmo-stp_10.42.42.5(pid=14009): Launched 21:01:04.085367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:01:04.650323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14011): Launched 21:01:04.775399 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:01:05.051739 run patchelf(pid=14012): Launched 21:01:05.235639 run osmo-stp_10.42.42.5(pid=14009): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14009)] 21:01:05.374335 run osmo-stp_10.42.42.5(pid=14009): stdout: | (launched: 2022-12-08_21:01:03.898666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:05.513667 run osmo-stp_10.42.42.5(pid=14009): stderr: | [0;m[38;5;43m20221208210104091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210104091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210104091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210104092 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210104092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210104092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210104092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:05.653925 run osmo-stp_10.42.42.5(pid=14009): stdout: | (launched: 2022-12-08_21:01:03.898666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:05.787848 run osmo-stp_10.42.42.5(pid=14009): stderr: | [0;m[38;5;43m20221208210104091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210104091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210104091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210104092 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210104092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210104092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210104092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:05.947223 run patchelf(pid=14012): Terminating (SIGINT) 21:01:06.131106 run patchelf(pid=14012): Terminated: ok {rc=0} 21:01:06.262888 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14009): Process ended prematurely: osmo-stp_10.42.42.5(pid=14009) [trial-2349↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14009)] [trial-2349↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 21:01:06.272825 tst iperf3.py:8: Test FAILED (7.8 sec) 21:01:06.301232 run osmo-hlr_10.42.42.2(pid=14006): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14006)] 21:01:06.351149 run osmo-hlr_10.42.42.2(pid=14006): stdout: | (launched: 2022-12-08_21:01:02.880000) 21:01:06.402560 run osmo-hlr_10.42.42.2(pid=14006): stderr: | [0;m[1;31m20221208210103079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210103079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210103079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210103079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210103079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210103079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210103091 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210103100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210103100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210103100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:01:06.454437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14001): Terminating (SIGTERM) 21:01:06.496391 run iperf3-srv_10.42.42.10(pid=14002): Terminating (SIGTERM) 21:01:06.538418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14005): Terminating (SIGTERM) 21:01:06.580369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14008): Terminating (SIGTERM) 21:01:06.622567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14011): Terminating (SIGTERM) 21:01:06.664676 --- ParallelTerminationStrategy: PID 14001 died... 21:01:06.685173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14001): Terminated: ok {rc=0} 21:01:06.732118 --- ParallelTerminationStrategy: PID 14002 died... 21:01:06.751891 run iperf3-srv_10.42.42.10(pid=14002): Terminated {rc=256} 21:01:06.798790 --- ParallelTerminationStrategy: PID 14005 died... 21:01:06.818660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14005): Terminated: ok {rc=0} 21:01:06.865081 --- ParallelTerminationStrategy: PID 14008 died... 21:01:06.884777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14008): Terminated: ok {rc=0} 21:01:06.931007 --- ParallelTerminationStrategy: PID 14011 died... 21:01:06.950766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14011): Terminated: ok {rc=0} 21:01:07.037706 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 21:01:08.183953 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:08.195497 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:01:08.241095 tst iperf3m4.py: using LAC 16783 21:01:08.366733 tst iperf3m4.py: using RAC 208 21:01:08.485654 tst iperf3m4.py: using CellId 16783 21:01:08.613348 tst iperf3m4.py: using BVCI 16784 21:01:08.731905 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:08.743517 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:08.754947 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:08.766504 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:08.777888 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:08.789298 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:08.800890 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:08.812085 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:08.823490 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:01:08.940272 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:01:09.061875 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:01:09.181157 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:01:09.305569 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:01:09.525579 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:01:09.852152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14013): Launched 21:01:10.136582 run iperf3-srv_10.42.42.10(pid=14014): Launched 21:01:10.259078 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:01:10.478865 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:01:10.807141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14015): Launched 21:01:11.091155 run iperf3-srv_10.42.42.10(pid=14016): Launched 21:01:11.213625 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:01:11.432535 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:01:11.760007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14017): Launched 21:01:12.044501 run iperf3-srv_10.42.42.10(pid=14018): Launched 21:01:12.167446 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:01:12.386991 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:01:12.715482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14019): Launched 21:01:13.002133 run iperf3-srv_10.42.42.10(pid=14020): Launched 21:01:13.126269 tst iperf3m4.py:8: start network... 21:01:13.346917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:01:13.853019 run create_hlr_db(pid=14021): Launched 21:01:13.985775 bus /gobi_6: Setting Powered False 21:01:15.050322 run create_hlr_db(pid=14021): Terminated: ok {rc=0} 21:01:15.483592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14023): Launched 21:01:15.787776 run osmo-hlr_10.42.42.2(pid=14024): Launched 21:01:16.002239 run osmo-stp_10.42.42.5: Starting osmo-stp 21:01:16.734059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14026): Launched 21:01:17.055059 run osmo-stp_10.42.42.5(pid=14027): Launched 21:01:17.197968 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:01:17.802231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14029): Launched 21:01:17.916458 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:01:18.168545 run patchelf(pid=14030): Launched 21:01:18.334070 run osmo-stp_10.42.42.5(pid=14027): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14027)] 21:01:18.460166 run osmo-stp_10.42.42.5(pid=14027): stdout: | (launched: 2022-12-08_21:01:16.996705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:18.587534 run osmo-stp_10.42.42.5(pid=14027): stderr: | [0;m[38;5;43m20221208210117331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210117331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210117331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210117332 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210117332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210117332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210117332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:18.714793 run osmo-stp_10.42.42.5(pid=14027): stdout: | (launched: 2022-12-08_21:01:16.996705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:18.836629 run osmo-stp_10.42.42.5(pid=14027): stderr: | [0;m[38;5;43m20221208210117331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210117331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210117331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210117332 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210117332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210117332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210117332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:18.981284 run patchelf(pid=14030): Terminating (SIGINT) 21:01:19.148785 run patchelf(pid=14030): Terminated: ok {rc=0} 21:01:19.269218 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14027): Process ended prematurely: osmo-stp_10.42.42.5(pid=14027) [trial-2349↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14027)] [trial-2349↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 21:01:19.278697 tst iperf3m4.py:8: Test FAILED (11.1 sec) 21:01:19.306477 run osmo-hlr_10.42.42.2(pid=14024): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14024)] 21:01:19.354368 run osmo-hlr_10.42.42.2(pid=14024): stdout: | (launched: 2022-12-08_21:01:15.731963) 21:01:19.403972 run osmo-hlr_10.42.42.2(pid=14024): stderr: | [0;m[1;31m20221208210115925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210115925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210115925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210115925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210115925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210115925 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210115948 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210115956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210115956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210115956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:01:19.453687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14013): Terminating (SIGTERM) 21:01:19.493514 run iperf3-srv_10.42.42.10(pid=14014): Terminating (SIGTERM) 21:01:19.533124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14015): Terminating (SIGTERM) 21:01:19.572664 run iperf3-srv_10.42.42.10(pid=14016): Terminating (SIGTERM) 21:01:19.612062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14017): Terminating (SIGTERM) 21:01:19.651689 run iperf3-srv_10.42.42.10(pid=14018): Terminating (SIGTERM) 21:01:19.691102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14019): Terminating (SIGTERM) 21:01:19.730640 run iperf3-srv_10.42.42.10(pid=14020): Terminating (SIGTERM) 21:01:19.770238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14023): Terminating (SIGTERM) 21:01:19.809856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14026): Terminating (SIGTERM) 21:01:19.849520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14029): Terminating (SIGTERM) 21:01:19.889382 --- ParallelTerminationStrategy: PID 14013 died... 21:01:19.908143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14013): Terminated: ok {rc=0} 21:01:19.952416 --- ParallelTerminationStrategy: PID 14014 died... 21:01:19.970865 run iperf3-srv_10.42.42.10(pid=14014): Terminated {rc=256} 21:01:20.014856 --- ParallelTerminationStrategy: PID 14015 died... 21:01:20.033572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14015): Terminated: ok {rc=0} 21:01:20.077513 --- ParallelTerminationStrategy: PID 14016 died... 21:01:20.096127 run iperf3-srv_10.42.42.10(pid=14016): Terminated {rc=256} 21:01:20.140847 --- ParallelTerminationStrategy: PID 14017 died... 21:01:20.159961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14017): Terminated: ok {rc=0} 21:01:20.204425 --- ParallelTerminationStrategy: PID 14018 died... 21:01:20.223147 run iperf3-srv_10.42.42.10(pid=14018): Terminated {rc=256} 21:01:20.267062 --- ParallelTerminationStrategy: PID 14019 died... 21:01:20.285620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14019): Terminated: ok {rc=0} 21:01:20.329720 --- ParallelTerminationStrategy: PID 14020 died... 21:01:20.348387 run iperf3-srv_10.42.42.10(pid=14020): Terminated {rc=256} 21:01:20.392175 --- ParallelTerminationStrategy: PID 14023 died... 21:01:20.410709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14023): Terminated: ok {rc=0} 21:01:20.454363 --- ParallelTerminationStrategy: PID 14026 died... 21:01:20.472715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14026): Terminated: ok {rc=0} 21:01:20.516383 --- ParallelTerminationStrategy: PID 14029 died... 21:01:20.534982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14029): Terminated: ok {rc=0} 21:01:20.620069 bus /gobi_4: Setting Powered False 21:01:21.718080 bus /gobi_4: Setting Powered False 21:01:22.832729 bus /gobi_1: Setting Powered False 21:01:23.930545 bus /gobi_1: Setting Powered False 21:01:25.045401 bus /gobi_0: Setting Powered False 21:01:26.142425 bus /gobi_0: Setting Powered False 21:01:27.258028 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 21:01:28.360179 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:28.372095 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:01:28.419628 tst ping.py: using LAC 16784 21:01:28.544847 tst ping.py: using RAC 209 21:01:28.669500 tst ping.py: using CellId 16784 21:01:28.791646 tst ping.py: using BVCI 16785 21:01:28.904554 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:28.915797 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:28.926881 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:28.937911 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:28.948639 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:28.959696 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:28.970886 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:28.981985 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:01:29.096094 tst ping.py:19: start network... 21:01:29.308089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:01:29.792709 run create_hlr_db(pid=14031): Launched 21:01:29.921275 bus /gobi_6: Setting Powered False 21:01:31.015394 run create_hlr_db(pid=14031): Terminated: ok {rc=0} 21:01:31.482969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14033): Launched 21:01:31.814871 run osmo-hlr_10.42.42.2(pid=14034): Launched 21:01:32.062024 run osmo-stp_10.42.42.5: Starting osmo-stp 21:01:32.619389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14036): Launched 21:01:32.912054 run osmo-stp_10.42.42.5(pid=14037): Launched 21:01:33.022354 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:01:33.524779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14039): Launched 21:01:33.636752 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:01:33.883414 run patchelf(pid=14040): Launched 21:01:34.046334 run osmo-stp_10.42.42.5(pid=14037): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14037)] 21:01:34.170772 run osmo-stp_10.42.42.5(pid=14037): stdout: | (launched: 2022-12-08_21:01:32.858536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:34.296304 run osmo-stp_10.42.42.5(pid=14037): stderr: | [0;m[38;5;43m20221208210133026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210133026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210133026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210133026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210133027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210133027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210133027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:34.421957 run osmo-stp_10.42.42.5(pid=14037): stdout: | (launched: 2022-12-08_21:01:32.858536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:34.541940 run osmo-stp_10.42.42.5(pid=14037): stderr: | [0;m[38;5;43m20221208210133026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210133026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210133026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210133026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210133027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210133027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210133027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:34.683927 run patchelf(pid=14040): Terminating (SIGINT) 21:01:34.848369 run patchelf(pid=14040): Terminated: ok {rc=0} 21:01:34.966849 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14037): Process ended prematurely: osmo-stp_10.42.42.5(pid=14037) [trial-2349↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14037)] [trial-2349↪gprs:trx-lms-limenet-micro↪ping.py:22] 21:01:34.975686 tst ping.py:22: Test FAILED (6.6 sec) 21:01:35.002415 run osmo-hlr_10.42.42.2(pid=14034): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14034)] 21:01:35.050232 run osmo-hlr_10.42.42.2(pid=14034): stdout: | (launched: 2022-12-08_21:01:31.756304) 21:01:35.099483 run osmo-hlr_10.42.42.2(pid=14034): stderr: | [0;m[1;31m20221208210132033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210132033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210132033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210132033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210132034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210132034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210132056 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210132071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210132071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210132071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:01:35.149260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14033): Terminating (SIGTERM) 21:01:35.188770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14036): Terminating (SIGTERM) 21:01:35.228296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14039): Terminating (SIGTERM) 21:01:35.268057 --- ParallelTerminationStrategy: PID 14033 died... 21:01:35.286939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14033): Terminated: ok {rc=0} 21:01:35.331543 --- ParallelTerminationStrategy: PID 14036 died... 21:01:35.349899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14036): Terminated: ok {rc=0} 21:01:35.393983 --- ParallelTerminationStrategy: PID 14039 died... 21:01:35.412354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14039): Terminated: ok {rc=0} 21:01:35.496290 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 21:01:36.583431 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:36.595787 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:01:36.643982 tst ping_idle_ping.py: using LAC 16785 21:01:36.765567 tst ping_idle_ping.py: using RAC 210 21:01:36.884254 tst ping_idle_ping.py: using CellId 16785 21:01:36.997396 tst ping_idle_ping.py: using BVCI 16786 21:01:37.103432 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:37.114205 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:37.124808 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:37.135800 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:37.146537 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:37.157299 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:37.168223 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:37.179139 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:01:37.297406 tst ping_idle_ping.py:24: start network... 21:01:37.509718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:01:38.000040 run create_hlr_db(pid=14043): Launched 21:01:38.128613 bus /gobi_6: Setting Powered False 21:01:39.191725 run create_hlr_db(pid=14043): Terminated: ok {rc=0} 21:01:39.614780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14045): Launched 21:01:39.910076 run osmo-hlr_10.42.42.2(pid=14046): Launched 21:01:40.021434 run osmo-stp_10.42.42.5: Starting osmo-stp 21:01:40.542780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14048): Launched 21:01:40.836930 run osmo-stp_10.42.42.5(pid=14049): Launched 21:01:40.948357 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:01:41.454768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14051): Launched 21:01:41.568372 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:01:41.818258 run patchelf(pid=14052): Launched 21:01:41.982323 run osmo-stp_10.42.42.5(pid=14049): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14049)] 21:01:42.107649 run osmo-stp_10.42.42.5(pid=14049): stdout: | (launched: 2022-12-08_21:01:40.782833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:42.234891 run osmo-stp_10.42.42.5(pid=14049): stderr: | [0;m[38;5;43m20221208210140953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210140953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210140953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210140953 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210140954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210140954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210140954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:42.361505 run osmo-stp_10.42.42.5(pid=14049): stdout: | (launched: 2022-12-08_21:01:40.782833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:42.482665 run osmo-stp_10.42.42.5(pid=14049): stderr: | [0;m[38;5;43m20221208210140953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210140953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210140953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210140953 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210140954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210140954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210140954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:42.625741 run patchelf(pid=14052): Terminating (SIGINT) 21:01:42.791231 run patchelf(pid=14052): Terminated: ok {rc=0} 21:01:42.910586 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14049): Process ended prematurely: osmo-stp_10.42.42.5(pid=14049) [trial-2349↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14049)] [trial-2349↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 21:01:42.919506 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 21:01:42.945873 run osmo-hlr_10.42.42.2(pid=14046): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14046)] 21:01:42.993626 run osmo-hlr_10.42.42.2(pid=14046): stdout: | (launched: 2022-12-08_21:01:39.855099) 21:01:43.042775 run osmo-hlr_10.42.42.2(pid=14046): stderr: | [0;m[1;31m20221208210140032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210140032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210140032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210140032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210140032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210140032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210140044 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210140054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210140055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210140055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:01:43.092476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14045): Terminating (SIGTERM) 21:01:43.132058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14048): Terminating (SIGTERM) 21:01:43.171558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14051): Terminating (SIGTERM) 21:01:43.211445 --- ParallelTerminationStrategy: PID 14045 died... 21:01:43.230327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14045): Terminated: ok {rc=0} 21:01:43.274087 --- ParallelTerminationStrategy: PID 14048 died... 21:01:43.292329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14048): Terminated: ok {rc=0} 21:01:43.336130 --- ParallelTerminationStrategy: PID 14051 died... 21:01:43.354624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14051): Terminated: ok {rc=0} 21:01:43.440797 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 21:01:44.736443 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:01:44.742037 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 21:01:44.771829 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 21:01:44.810236 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 21:01:44.896299 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 21:01:44.925168 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 21:01:44.963517 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 21:01:45.565570 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 21:01:45.619349 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:45.630905 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:01:45.680266 tst cs_paging_gprs_active.py: using LAC 16786 21:01:45.808128 tst cs_paging_gprs_active.py: using RAC 211 21:01:45.961545 tst cs_paging_gprs_active.py: using CellId 16786 21:01:46.085345 tst cs_paging_gprs_active.py: using BVCI 16787 21:01:46.241300 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:46.256651 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:46.272607 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:46.288753 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:46.303655 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:46.320031 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:46.332922 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:46.346865 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:46.360289 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:01:46.481160 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:01:46.600423 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:01:46.854515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:01:47.180374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14057): Launched 21:01:47.471521 run iperf3-srv_10.42.42.10(pid=14058): Launched 21:01:47.592069 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:01:47.807816 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:01:48.128803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14059): Launched 21:01:48.407438 run iperf3-srv_10.42.42.10(pid=14060): Launched 21:01:48.528937 tst cs_paging_gprs_active.py:38: start network... 21:01:48.744740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:01:49.240769 run create_hlr_db(pid=14061): Launched 21:01:49.370636 bus /gobi_6: Setting Powered False 21:01:50.430184 run create_hlr_db(pid=14061): Terminated: ok {rc=0} 21:01:50.877470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14063): Launched 21:01:51.199723 run osmo-hlr_10.42.42.2(pid=14064): Launched 21:01:51.321795 run osmo-stp_10.42.42.5: Starting osmo-stp 21:01:51.872551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14066): Launched 21:01:52.193903 run osmo-stp_10.42.42.5(pid=14067): Launched 21:01:52.315647 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:01:52.870662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14069): Launched 21:01:52.994585 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:01:53.265559 run patchelf(pid=14070): Launched 21:01:53.445533 run osmo-stp_10.42.42.5(pid=14067): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14067)] 21:01:53.581929 run osmo-stp_10.42.42.5(pid=14067): stdout: | (launched: 2022-12-08_21:01:52.134957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:53.719437 run osmo-stp_10.42.42.5(pid=14067): stderr: | [0;m[38;5;43m20221208210152329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210152329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210152330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210152330 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210152330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210152330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210152331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:53.856940 run osmo-stp_10.42.42.5(pid=14067): stdout: | (launched: 2022-12-08_21:01:52.134957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:53.988893 run osmo-stp_10.42.42.5(pid=14067): stderr: | [0;m[38;5;43m20221208210152329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210152329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210152330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210152330 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210152330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210152330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210152331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:54.144877 run patchelf(pid=14070): Terminating (SIGINT) 21:01:54.324811 run patchelf(pid=14070): Terminated: ok {rc=0} 21:01:54.454534 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14067): Process ended prematurely: osmo-stp_10.42.42.5(pid=14067) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14067)] [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 21:01:54.464506 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 21:01:54.492857 run osmo-hlr_10.42.42.2(pid=14064): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14064)] 21:01:54.542484 run osmo-hlr_10.42.42.2(pid=14064): stdout: | (launched: 2022-12-08_21:01:51.140748) 21:01:54.594475 run osmo-hlr_10.42.42.2(pid=14064): stderr: | [0;m[1;31m20221208210151340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210151340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210151340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210151340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210151340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210151340 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210151353 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210151361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210151361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210151361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:01:54.646617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14057): Terminating (SIGTERM) 21:01:54.688136 run iperf3-srv_10.42.42.10(pid=14058): Terminating (SIGTERM) 21:01:54.730129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14059): Terminating (SIGTERM) 21:01:54.772686 run iperf3-srv_10.42.42.10(pid=14060): Terminating (SIGTERM) 21:01:54.814357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14063): Terminating (SIGTERM) 21:01:54.855783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14066): Terminating (SIGTERM) 21:01:54.897537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14069): Terminating (SIGTERM) 21:01:54.939376 --- ParallelTerminationStrategy: PID 14057 died... 21:01:54.959329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14057): Terminated: ok {rc=0} 21:01:55.005915 --- ParallelTerminationStrategy: PID 14058 died... 21:01:55.025443 run iperf3-srv_10.42.42.10(pid=14058): Terminated {rc=256} 21:01:55.071286 --- ParallelTerminationStrategy: PID 14059 died... 21:01:55.090974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14059): Terminated: ok {rc=0} 21:01:55.136694 --- ParallelTerminationStrategy: PID 14060 died... 21:01:55.156242 run iperf3-srv_10.42.42.10(pid=14060): Terminated {rc=256} 21:01:55.201970 --- ParallelTerminationStrategy: PID 14063 died... 21:01:55.221398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14063): Terminated: ok {rc=0} 21:01:55.267307 --- ParallelTerminationStrategy: PID 14066 died... 21:01:55.286901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14066): Terminated: ok {rc=0} 21:01:55.332854 --- ParallelTerminationStrategy: PID 14069 died... 21:01:55.352761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14069): Terminated: ok {rc=0} 21:01:55.440933 bus /gobi_0: Setting Powered False 21:01:56.540824 bus /gobi_0: Setting Powered False 21:01:57.657816 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 21:01:58.806165 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:58.818308 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:01:58.866729 tst iperf3.py: using LAC 16787 21:01:58.993087 tst iperf3.py: using RAC 212 21:01:59.118751 tst iperf3.py: using CellId 16787 21:01:59.246037 tst iperf3.py: using BVCI 16788 21:01:59.363469 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:59.375033 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:59.386319 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:59.397657 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:59.408890 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:59.420219 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:59.431577 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:59.442786 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:59.454204 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:01:59.569737 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:01:59.769455 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:00.068746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14071): Launched 21:02:00.330141 run iperf3-srv_10.42.42.10(pid=14072): Launched 21:02:00.442580 tst iperf3.py:8: start network... 21:02:00.642259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:02:01.120376 run create_hlr_db(pid=14073): Launched 21:02:01.251072 bus /gobi_6: Setting Powered False 21:02:02.312081 run create_hlr_db(pid=14073): Terminated: ok {rc=0} 21:02:02.728812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14075): Launched 21:02:03.027230 run osmo-hlr_10.42.42.2(pid=14076): Launched 21:02:03.140661 run osmo-stp_10.42.42.5: Starting osmo-stp 21:02:03.663306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14078): Launched 21:02:03.987602 run osmo-stp_10.42.42.5(pid=14079): Launched 21:02:04.103250 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:02:04.687555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14081): Launched 21:02:04.814810 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:02:05.085166 run patchelf(pid=14082): Launched 21:02:05.268158 run osmo-stp_10.42.42.5(pid=14079): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14079)] 21:02:05.403387 run osmo-stp_10.42.42.5(pid=14079): stdout: | (launched: 2022-12-08_21:02:03.929508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:05.539684 run osmo-stp_10.42.42.5(pid=14079): stderr: | [0;m[38;5;43m20221208210204123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210204123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210204124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210204125 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210204125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210204125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210204125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:05.676703 run osmo-stp_10.42.42.5(pid=14079): stdout: | (launched: 2022-12-08_21:02:03.929508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:05.807376 run osmo-stp_10.42.42.5(pid=14079): stderr: | [0;m[38;5;43m20221208210204123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210204123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210204124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210204125 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210204125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210204125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210204125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:05.961753 run patchelf(pid=14082): Terminating (SIGINT) 21:02:06.140455 run patchelf(pid=14082): Terminated: ok {rc=0} 21:02:06.269393 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14079): Process ended prematurely: osmo-stp_10.42.42.5(pid=14079) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14079)] [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 21:02:06.279519 tst iperf3.py:8: Test FAILED (7.5 sec) 21:02:06.307778 run osmo-hlr_10.42.42.2(pid=14076): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14076)] 21:02:06.357614 run osmo-hlr_10.42.42.2(pid=14076): stdout: | (launched: 2022-12-08_21:02:02.971882) 21:02:06.409184 run osmo-hlr_10.42.42.2(pid=14076): stderr: | [0;m[1;31m20221208210203147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210203147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210203147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210203147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210203148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210203148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210203160 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210203169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210203169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210203169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:02:06.461182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14071): Terminating (SIGTERM) 21:02:06.502621 run iperf3-srv_10.42.42.10(pid=14072): Terminating (SIGTERM) 21:02:06.544301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14075): Terminating (SIGTERM) 21:02:06.586477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14078): Terminating (SIGTERM) 21:02:06.628066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14081): Terminating (SIGTERM) 21:02:06.669885 --- ParallelTerminationStrategy: PID 14071 died... 21:02:06.689585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14071): Terminated: ok {rc=0} 21:02:06.735509 --- ParallelTerminationStrategy: PID 14072 died... 21:02:06.754950 run iperf3-srv_10.42.42.10(pid=14072): Terminated {rc=256} 21:02:06.800355 --- ParallelTerminationStrategy: PID 14075 died... 21:02:06.819938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14075): Terminated: ok {rc=0} 21:02:06.865310 --- ParallelTerminationStrategy: PID 14078 died... 21:02:06.884622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14078): Terminated: ok {rc=0} 21:02:06.930711 --- ParallelTerminationStrategy: PID 14081 died... 21:02:06.950296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14081): Terminated: ok {rc=0} 21:02:07.037334 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 21:02:08.185781 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:08.198210 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:02:08.245644 tst iperf3m4.py: using LAC 16788 21:02:08.371351 tst iperf3m4.py: using RAC 213 21:02:08.498319 tst iperf3m4.py: using CellId 16788 21:02:08.625373 tst iperf3m4.py: using BVCI 16789 21:02:08.744764 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:08.756536 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:08.767901 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:08.779459 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:08.790912 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:08.802486 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:08.814105 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:08.826014 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:08.837646 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:02:08.963891 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:02:09.081125 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:02:09.197483 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:02:09.318289 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:02:09.535917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:09.858102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14083): Launched 21:02:10.137918 run iperf3-srv_10.42.42.10(pid=14084): Launched 21:02:10.258483 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:02:10.475233 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:10.797083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14085): Launched 21:02:11.075294 run iperf3-srv_10.42.42.10(pid=14086): Launched 21:02:11.195684 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:02:11.411016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:11.732477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14087): Launched 21:02:12.010742 run iperf3-srv_10.42.42.10(pid=14088): Launched 21:02:12.131900 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:02:12.347810 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:12.670585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14089): Launched 21:02:12.949174 run iperf3-srv_10.42.42.10(pid=14090): Launched 21:02:13.069158 tst iperf3m4.py:8: start network... 21:02:13.284513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:02:13.781508 run create_hlr_db(pid=14091): Launched 21:02:13.911426 bus /gobi_6: Setting Powered False 21:02:14.974298 run create_hlr_db(pid=14091): Terminated: ok {rc=0} 21:02:15.403299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14093): Launched 21:02:15.702477 run osmo-hlr_10.42.42.2(pid=14094): Launched 21:02:15.816630 run osmo-stp_10.42.42.5: Starting osmo-stp 21:02:16.484718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14096): Launched 21:02:16.800595 run osmo-stp_10.42.42.5(pid=14097): Launched 21:02:17.044532 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:02:17.674903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14099): Launched 21:02:17.797502 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:02:18.069518 run patchelf(pid=14100): Launched 21:02:18.249092 run osmo-stp_10.42.42.5(pid=14097): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14097)] 21:02:18.386238 run osmo-stp_10.42.42.5(pid=14097): stdout: | (launched: 2022-12-08_21:02:16.744844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:18.524491 run osmo-stp_10.42.42.5(pid=14097): stderr: | [0;m[38;5;43m20221208210217121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210217121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210217122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210217122 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210217124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210217124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210217133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:18.662766 run osmo-stp_10.42.42.5(pid=14097): stdout: | (launched: 2022-12-08_21:02:16.744844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:18.794937 run osmo-stp_10.42.42.5(pid=14097): stderr: | [0;m[38;5;43m20221208210217121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210217121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210217122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210217122 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210217124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210217124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210217133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:18.951822 run patchelf(pid=14100): Terminating (SIGINT) 21:02:19.132926 run patchelf(pid=14100): Terminated: ok {rc=0} 21:02:19.263197 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14097): Process ended prematurely: osmo-stp_10.42.42.5(pid=14097) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14097)] [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 21:02:19.273767 tst iperf3m4.py:8: Test FAILED (11.1 sec) 21:02:19.302669 run osmo-hlr_10.42.42.2(pid=14094): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14094)] 21:02:19.352633 run osmo-hlr_10.42.42.2(pid=14094): stdout: | (launched: 2022-12-08_21:02:15.647013) 21:02:19.404480 run osmo-hlr_10.42.42.2(pid=14094): stderr: | [0;m[1;31m20221208210215824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210215824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210215824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210215824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210215824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210215824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210215848 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210215870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210215870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210215871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:02:19.457389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14083): Terminating (SIGTERM) 21:02:19.499407 run iperf3-srv_10.42.42.10(pid=14084): Terminating (SIGTERM) 21:02:19.541399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14085): Terminating (SIGTERM) 21:02:19.583850 run iperf3-srv_10.42.42.10(pid=14086): Terminating (SIGTERM) 21:02:19.625766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14087): Terminating (SIGTERM) 21:02:19.667899 run iperf3-srv_10.42.42.10(pid=14088): Terminating (SIGTERM) 21:02:19.709976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14089): Terminating (SIGTERM) 21:02:19.752288 run iperf3-srv_10.42.42.10(pid=14090): Terminating (SIGTERM) 21:02:19.794283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14093): Terminating (SIGTERM) 21:02:19.836306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14096): Terminating (SIGTERM) 21:02:19.878252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14099): Terminating (SIGTERM) 21:02:19.920302 --- ParallelTerminationStrategy: PID 14083 died... 21:02:19.940307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14083): Terminated: ok {rc=0} 21:02:19.987040 --- ParallelTerminationStrategy: PID 14084 died... 21:02:20.006675 run iperf3-srv_10.42.42.10(pid=14084): Terminated {rc=256} 21:02:20.052839 --- ParallelTerminationStrategy: PID 14085 died... 21:02:20.072659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14085): Terminated: ok {rc=0} 21:02:20.118738 --- ParallelTerminationStrategy: PID 14086 died... 21:02:20.138289 run iperf3-srv_10.42.42.10(pid=14086): Terminated {rc=256} 21:02:20.184523 --- ParallelTerminationStrategy: PID 14087 died... 21:02:20.204057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14087): Terminated: ok {rc=0} 21:02:20.250368 --- ParallelTerminationStrategy: PID 14088 died... 21:02:20.270037 run iperf3-srv_10.42.42.10(pid=14088): Terminated {rc=256} 21:02:20.316180 --- ParallelTerminationStrategy: PID 14089 died... 21:02:20.335829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14089): Terminated: ok {rc=0} 21:02:20.382331 --- ParallelTerminationStrategy: PID 14090 died... 21:02:20.401816 run iperf3-srv_10.42.42.10(pid=14090): Terminated {rc=256} 21:02:20.448034 --- ParallelTerminationStrategy: PID 14093 died... 21:02:20.467809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14093): Terminated: ok {rc=0} 21:02:20.514422 --- ParallelTerminationStrategy: PID 14096 died... 21:02:20.534067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14096): Terminated: ok {rc=0} 21:02:20.579997 --- ParallelTerminationStrategy: PID 14099 died... 21:02:20.599929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14099): Terminated: ok {rc=0} 21:02:20.687599 bus /gobi_4: Setting Powered False 21:02:21.786852 bus /gobi_4: Setting Powered False 21:02:22.902999 bus /gobi_1: Setting Powered False 21:02:24.001711 bus /gobi_1: Setting Powered False 21:02:25.118177 bus /gobi_0: Setting Powered False 21:02:26.217694 bus /gobi_0: Setting Powered False 21:02:27.334386 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 21:02:28.438430 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:28.451272 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:02:28.498818 tst ping.py: using LAC 16789 21:02:28.619541 tst ping.py: using RAC 214 21:02:28.733625 tst ping.py: using CellId 16789 21:02:28.847076 tst ping.py: using BVCI 16790 21:02:28.952787 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:28.964097 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:28.975234 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:28.986443 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:28.997574 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:29.008555 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:29.019886 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:29.030903 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:02:29.148168 tst ping.py:19: start network... 21:02:29.361550 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:02:29.847411 run create_hlr_db(pid=14101): Launched 21:02:29.974814 bus /gobi_6: Setting Powered False 21:02:31.034366 run create_hlr_db(pid=14101): Terminated: ok {rc=0} 21:02:31.510581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14103): Launched 21:02:31.839125 run osmo-hlr_10.42.42.2(pid=14104): Launched 21:02:32.027961 run osmo-stp_10.42.42.5: Starting osmo-stp 21:02:32.633424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14106): Launched 21:02:32.948576 run osmo-stp_10.42.42.5(pid=14107): Launched 21:02:33.069323 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:02:33.611528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14109): Launched 21:02:33.732395 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:02:33.997946 run patchelf(pid=14110): Launched 21:02:34.174982 run osmo-stp_10.42.42.5(pid=14107): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14107)] 21:02:34.308720 run osmo-stp_10.42.42.5(pid=14107): stdout: | (launched: 2022-12-08_21:02:32.891419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:34.443820 run osmo-stp_10.42.42.5(pid=14107): stderr: | [0;m[38;5;43m20221208210233082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210233082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210233082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210233082 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210233083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210233083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210233083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:34.579326 run osmo-stp_10.42.42.5(pid=14107): stdout: | (launched: 2022-12-08_21:02:32.891419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:34.709451 run osmo-stp_10.42.42.5(pid=14107): stderr: | [0;m[38;5;43m20221208210233082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210233082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210233082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210233082 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210233083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210233083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210233083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:34.862052 run patchelf(pid=14110): Terminating (SIGINT) 21:02:35.038940 run patchelf(pid=14110): Terminated: ok {rc=0} 21:02:35.166800 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14107): Process ended prematurely: osmo-stp_10.42.42.5(pid=14107) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14107)] [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 21:02:35.176443 tst ping.py:22: Test FAILED (6.7 sec) 21:02:35.204537 run osmo-hlr_10.42.42.2(pid=14104): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14104)] 21:02:35.254861 run osmo-hlr_10.42.42.2(pid=14104): stdout: | (launched: 2022-12-08_21:02:31.781863) 21:02:35.307029 run osmo-hlr_10.42.42.2(pid=14104): stderr: | [0;m[1;31m20221208210232205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210232205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210232205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210232205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210232205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210232205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210232225 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210232233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210232233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210232233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:02:35.359622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14103): Terminating (SIGTERM) 21:02:35.401758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14106): Terminating (SIGTERM) 21:02:35.443912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14109): Terminating (SIGTERM) 21:02:35.486329 --- ParallelTerminationStrategy: PID 14103 died... 21:02:35.506410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14103): Terminated: ok {rc=0} 21:02:35.552880 --- ParallelTerminationStrategy: PID 14106 died... 21:02:35.573136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14106): Terminated: ok {rc=0} 21:02:35.619974 --- ParallelTerminationStrategy: PID 14109 died... 21:02:35.639600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14109): Terminated: ok {rc=0} 21:02:35.732149 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 21:02:36.821185 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:36.833931 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:02:36.887758 tst ping_idle_ping.py: using LAC 16790 21:02:37.010885 tst ping_idle_ping.py: using RAC 215 21:02:37.132578 tst ping_idle_ping.py: using CellId 16790 21:02:37.257996 tst ping_idle_ping.py: using BVCI 16791 21:02:37.372027 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:37.383632 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:37.394982 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:37.406628 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:37.418088 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:37.429487 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:37.441179 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:37.452583 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:02:37.569580 tst ping_idle_ping.py:24: start network... 21:02:37.766560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:02:38.222603 run create_hlr_db(pid=14112): Launched 21:02:38.336217 bus /gobi_6: Setting Powered False 21:02:39.399471 run create_hlr_db(pid=14112): Terminated: ok {rc=0} 21:02:39.841080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14114): Launched 21:02:40.157198 run osmo-hlr_10.42.42.2(pid=14115): Launched 21:02:40.276575 run osmo-stp_10.42.42.5: Starting osmo-stp 21:02:40.818787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14117): Launched 21:02:41.135422 run osmo-stp_10.42.42.5(pid=14118): Launched 21:02:41.255022 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:02:41.799201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14120): Launched 21:02:41.920848 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:02:42.187300 run patchelf(pid=14121): Launched 21:02:42.364336 run osmo-stp_10.42.42.5(pid=14118): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14118)] 21:02:42.498109 run osmo-stp_10.42.42.5(pid=14118): stdout: | (launched: 2022-12-08_21:02:41.077733) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:42.633972 run osmo-stp_10.42.42.5(pid=14118): stderr: | [0;m[38;5;43m20221208210241270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210241270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210241271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210241271 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210241271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210241271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210241272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:42.769443 run osmo-stp_10.42.42.5(pid=14118): stdout: | (launched: 2022-12-08_21:02:41.077733) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:42.898556 run osmo-stp_10.42.42.5(pid=14118): stderr: | [0;m[38;5;43m20221208210241270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210241270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210241271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210241271 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210241271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210241271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210241272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:43.051693 run patchelf(pid=14121): Terminating (SIGINT) 21:02:43.227937 run patchelf(pid=14121): Terminated: ok {rc=0} 21:02:43.355331 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14118): Process ended prematurely: osmo-stp_10.42.42.5(pid=14118) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14118)] [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 21:02:43.364879 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 21:02:43.392592 run osmo-hlr_10.42.42.2(pid=14115): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14115)] 21:02:43.442089 run osmo-hlr_10.42.42.2(pid=14115): stdout: | (launched: 2022-12-08_21:02:40.099743) 21:02:43.493379 run osmo-hlr_10.42.42.2(pid=14115): stderr: | [0;m[1;31m20221208210240298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210240298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210240298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210240298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210240298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210240299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210240312 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210240322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210240322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210240322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:02:43.544902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14114): Terminating (SIGTERM) 21:02:43.586379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14117): Terminating (SIGTERM) 21:02:43.628171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14120): Terminating (SIGTERM) 21:02:43.670144 --- ParallelTerminationStrategy: PID 14114 died... 21:02:43.689935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14114): Terminated: ok {rc=0} 21:02:43.735743 --- ParallelTerminationStrategy: PID 14117 died... 21:02:43.755027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14117): Terminated: ok {rc=0} 21:02:43.800648 --- ParallelTerminationStrategy: PID 14120 died... 21:02:43.820014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14120): Terminated: ok {rc=0} 21:02:43.907035 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 21:02:45.211674 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:02:45.218636 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 21:02:45.249136 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 21:02:45.288552 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 21:02:45.378811 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 21:02:45.409236 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 21:02:45.449093 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 21:02:46.047372 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 21:02:46.111106 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:46.123226 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:02:46.191471 tst cs_paging_gprs_active.py: using LAC 16791 21:02:46.348177 tst cs_paging_gprs_active.py: using RAC 216 21:02:46.472712 tst cs_paging_gprs_active.py: using CellId 16791 21:02:46.594730 tst cs_paging_gprs_active.py: using BVCI 16792 21:02:46.709309 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:46.721791 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:46.733870 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:46.748021 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:46.759930 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:46.772518 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:46.785802 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:46.799641 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:46.812576 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:02:46.936212 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:02:47.057404 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:02:47.282306 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:47.608454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14126): Launched 21:02:47.890700 run iperf3-srv_10.42.42.10(pid=14127): Launched 21:02:48.012489 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:02:48.228444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:48.550585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14128): Launched 21:02:48.832451 run iperf3-srv_10.42.42.10(pid=14129): Launched 21:02:48.953226 tst cs_paging_gprs_active.py:38: start network... 21:02:49.169690 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:02:49.669834 run create_hlr_db(pid=14130): Launched 21:02:49.801846 bus /gobi_6: Setting Powered False 21:02:50.865397 run create_hlr_db(pid=14130): Terminated: ok {rc=0} 21:02:51.295172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14132): Launched 21:02:51.596610 run osmo-hlr_10.42.42.2(pid=14133): Launched 21:02:51.711202 run osmo-stp_10.42.42.5: Starting osmo-stp 21:02:52.240899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14135): Launched 21:02:52.541428 run osmo-stp_10.42.42.5(pid=14136): Launched 21:02:52.655629 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:02:53.176415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14138): Launched 21:02:53.292657 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:02:53.546812 run patchelf(pid=14139): Launched 21:02:53.714619 run osmo-stp_10.42.42.5(pid=14136): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14136)] 21:02:53.842311 run osmo-stp_10.42.42.5(pid=14136): stdout: | (launched: 2022-12-08_21:02:52.486210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:53.971736 run osmo-stp_10.42.42.5(pid=14136): stderr: | [0;m[38;5;43m20221208210252658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210252658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210252658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210252659 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210252659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210252659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210252659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:54.101158 run osmo-stp_10.42.42.5(pid=14136): stdout: | (launched: 2022-12-08_21:02:52.486210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:54.224906 run osmo-stp_10.42.42.5(pid=14136): stderr: | [0;m[38;5;43m20221208210252658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210252658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210252658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210252659 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210252659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210252659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210252659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:54.371674 run patchelf(pid=14139): Terminating (SIGINT) 21:02:54.540624 run patchelf(pid=14139): Terminated: ok {rc=0} 21:02:54.663063 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14136): Process ended prematurely: osmo-stp_10.42.42.5(pid=14136) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14136)] [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 21:02:54.672353 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 21:02:54.699547 run osmo-hlr_10.42.42.2(pid=14133): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14133)] 21:02:54.747625 run osmo-hlr_10.42.42.2(pid=14133): stdout: | (launched: 2022-12-08_21:02:51.540773) 21:02:54.797190 run osmo-hlr_10.42.42.2(pid=14133): stderr: | [0;m[1;31m20221208210251718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210251718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210251718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210251718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210251718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210251718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210251730 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210251741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210251741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210251741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:02:54.847117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14126): Terminating (SIGTERM) 21:02:54.887023 run iperf3-srv_10.42.42.10(pid=14127): Terminating (SIGTERM) 21:02:54.926698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14128): Terminating (SIGTERM) 21:02:54.966506 run iperf3-srv_10.42.42.10(pid=14129): Terminating (SIGTERM) 21:02:55.006587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14132): Terminating (SIGTERM) 21:02:55.046570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14135): Terminating (SIGTERM) 21:02:55.086507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14138): Terminating (SIGTERM) 21:02:55.127414 --- ParallelTerminationStrategy: PID 14126 died... 21:02:55.146462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14126): Terminated: ok {rc=0} 21:02:55.190918 --- ParallelTerminationStrategy: PID 14127 died... 21:02:55.209555 run iperf3-srv_10.42.42.10(pid=14127): Terminated {rc=256} 21:02:55.253488 --- ParallelTerminationStrategy: PID 14128 died... 21:02:55.271950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14128): Terminated: ok {rc=0} 21:02:55.316537 --- ParallelTerminationStrategy: PID 14129 died... 21:02:55.334955 run iperf3-srv_10.42.42.10(pid=14129): Terminated {rc=256} 21:02:55.379008 --- ParallelTerminationStrategy: PID 14132 died... 21:02:55.397571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14132): Terminated: ok {rc=0} 21:02:55.441401 --- ParallelTerminationStrategy: PID 14135 died... 21:02:55.459805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14135): Terminated: ok {rc=0} 21:02:55.503980 --- ParallelTerminationStrategy: PID 14138 died... 21:02:55.522469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14138): Terminated: ok {rc=0} 21:02:55.607691 bus /gobi_0: Setting Powered False 21:02:56.706425 bus /gobi_0: Setting Powered False 21:02:57.820679 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 21:02:58.965290 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:58.977105 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:02:59.045239 tst iperf3.py: using LAC 16792 21:02:59.164776 tst iperf3.py: using RAC 217 21:02:59.283664 tst iperf3.py: using CellId 16792 21:02:59.402825 tst iperf3.py: using BVCI 16793 21:02:59.513133 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:59.524169 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:59.535195 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:59.546357 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:59.557514 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:59.568641 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:59.579941 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:59.591002 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:59.602445 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:02:59.719792 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:02:59.938151 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:00.259509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14140): Launched 21:03:00.538914 run iperf3-srv_10.42.42.10(pid=14141): Launched 21:03:00.660587 tst iperf3.py:8: start network... 21:03:00.897322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:03:01.383813 run create_hlr_db(pid=14143): Launched 21:03:01.504463 bus /gobi_6: Setting Powered False 21:03:02.564323 run create_hlr_db(pid=14143): Terminated: ok {rc=0} 21:03:03.004108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14145): Launched 21:03:03.303335 run osmo-hlr_10.42.42.2(pid=14146): Launched 21:03:03.417678 run osmo-stp_10.42.42.5: Starting osmo-stp 21:03:03.951610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14148): Launched 21:03:04.250416 run osmo-stp_10.42.42.5(pid=14149): Launched 21:03:04.364406 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:03:04.881746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14151): Launched 21:03:04.997106 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:03:05.250937 run patchelf(pid=14152): Launched 21:03:05.420360 run osmo-stp_10.42.42.5(pid=14149): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14149)] 21:03:05.548374 run osmo-stp_10.42.42.5(pid=14149): stdout: | (launched: 2022-12-08_21:03:04.195646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:05.677277 run osmo-stp_10.42.42.5(pid=14149): stderr: | [0;m[38;5;43m20221208210304365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210304366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210304366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210304366 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210304367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210304367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210304367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:05.806258 run osmo-stp_10.42.42.5(pid=14149): stdout: | (launched: 2022-12-08_21:03:04.195646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:05.929609 run osmo-stp_10.42.42.5(pid=14149): stderr: | [0;m[38;5;43m20221208210304365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210304366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210304366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210304366 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210304367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210304367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210304367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:06.075640 run patchelf(pid=14152): Terminating (SIGINT) 21:03:06.246097 run patchelf(pid=14152): Terminated: ok {rc=0} 21:03:06.368165 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14149): Process ended prematurely: osmo-stp_10.42.42.5(pid=14149) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14149)] [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 21:03:06.377881 tst iperf3.py:8: Test FAILED (7.4 sec) 21:03:06.405488 run osmo-hlr_10.42.42.2(pid=14146): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14146)] 21:03:06.453497 run osmo-hlr_10.42.42.2(pid=14146): stdout: | (launched: 2022-12-08_21:03:03.247631) 21:03:06.503077 run osmo-hlr_10.42.42.2(pid=14146): stderr: | [0;m[1;31m20221208210303425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210303425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210303425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210303425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210303425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210303425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210303437 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210303446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210303446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210303446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:03:06.553443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14140): Terminating (SIGTERM) 21:03:06.593653 run iperf3-srv_10.42.42.10(pid=14141): Terminating (SIGTERM) 21:03:06.633600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14145): Terminating (SIGTERM) 21:03:06.673495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14148): Terminating (SIGTERM) 21:03:06.713249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14151): Terminating (SIGTERM) 21:03:06.753984 --- ParallelTerminationStrategy: PID 14140 died... 21:03:06.772901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14140): Terminated: ok {rc=0} 21:03:06.816686 --- ParallelTerminationStrategy: PID 14141 died... 21:03:06.835530 run iperf3-srv_10.42.42.10(pid=14141): Terminated {rc=256} 21:03:06.879430 --- ParallelTerminationStrategy: PID 14145 died... 21:03:06.897821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14145): Terminated: ok {rc=0} 21:03:06.941448 --- ParallelTerminationStrategy: PID 14148 died... 21:03:06.959632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14148): Terminated: ok {rc=0} 21:03:07.003522 --- ParallelTerminationStrategy: PID 14151 died... 21:03:07.021977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14151): Terminated: ok {rc=0} 21:03:07.104743 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 21:03:08.253797 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:08.266126 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:03:08.335545 tst iperf3m4.py: using LAC 16793 21:03:08.462978 tst iperf3m4.py: using RAC 218 21:03:08.591930 tst iperf3m4.py: using CellId 16793 21:03:08.723324 tst iperf3m4.py: using BVCI 16794 21:03:08.843438 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:08.855234 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:08.866998 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:08.879054 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:08.892406 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:08.905607 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:08.916666 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:08.927614 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:08.939080 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:03:09.059779 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:03:09.183433 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:03:09.299787 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:03:09.420620 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:03:09.638346 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:09.960680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14153): Launched 21:03:10.241688 run iperf3-srv_10.42.42.10(pid=14154): Launched 21:03:10.362631 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:03:10.579921 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:10.903338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14155): Launched 21:03:11.183757 run iperf3-srv_10.42.42.10(pid=14156): Launched 21:03:11.304596 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:03:11.521682 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:11.845531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14157): Launched 21:03:12.125595 run iperf3-srv_10.42.42.10(pid=14158): Launched 21:03:12.246279 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:03:12.463277 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:12.787833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14159): Launched 21:03:13.068506 run iperf3-srv_10.42.42.10(pid=14160): Launched 21:03:13.189078 tst iperf3m4.py:8: start network... 21:03:13.405937 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:03:13.904014 run create_hlr_db(pid=14161): Launched 21:03:14.033788 bus /gobi_6: Setting Powered False 21:03:15.097082 run create_hlr_db(pid=14161): Terminated: ok {rc=0} 21:03:15.545632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14163): Launched 21:03:15.888077 run osmo-hlr_10.42.42.2(pid=14164): Launched 21:03:16.026669 run osmo-stp_10.42.42.5: Starting osmo-stp 21:03:16.840102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14166): Launched 21:03:17.158402 run osmo-stp_10.42.42.5(pid=14167): Launched 21:03:17.359448 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:03:17.927366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14169): Launched 21:03:18.050350 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:03:18.322212 run patchelf(pid=14170): Launched 21:03:18.503144 run osmo-stp_10.42.42.5(pid=14167): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14167)] 21:03:18.640099 run osmo-stp_10.42.42.5(pid=14167): stdout: | (launched: 2022-12-08_21:03:17.102122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:18.777575 run osmo-stp_10.42.42.5(pid=14167): stderr: | [0;m[38;5;43m20221208210317469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210317469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210317470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210317470 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210317471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210317471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210317471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:18.915344 run osmo-stp_10.42.42.5(pid=14167): stdout: | (launched: 2022-12-08_21:03:17.102122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:19.047752 run osmo-stp_10.42.42.5(pid=14167): stderr: | [0;m[38;5;43m20221208210317469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210317469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210317470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210317470 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210317471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210317471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210317471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:19.203949 run patchelf(pid=14170): Terminating (SIGINT) 21:03:19.384516 run patchelf(pid=14170): Terminated: ok {rc=0} 21:03:19.514565 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14167): Process ended prematurely: osmo-stp_10.42.42.5(pid=14167) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14167)] [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 21:03:19.524810 tst iperf3m4.py:8: Test FAILED (11.3 sec) 21:03:19.553438 run osmo-hlr_10.42.42.2(pid=14164): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14164)] 21:03:19.603343 run osmo-hlr_10.42.42.2(pid=14164): stdout: | (launched: 2022-12-08_21:03:15.808816) 21:03:19.655347 run osmo-hlr_10.42.42.2(pid=14164): stderr: | [0;m[1;31m20221208210316179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210316179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210316179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210316179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210316179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210316179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210316200 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210316217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210316217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210316217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:03:19.707399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14153): Terminating (SIGTERM) 21:03:19.749134 run iperf3-srv_10.42.42.10(pid=14154): Terminating (SIGTERM) 21:03:19.790831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14155): Terminating (SIGTERM) 21:03:19.832687 run iperf3-srv_10.42.42.10(pid=14156): Terminating (SIGTERM) 21:03:19.874294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14157): Terminating (SIGTERM) 21:03:19.916016 run iperf3-srv_10.42.42.10(pid=14158): Terminating (SIGTERM) 21:03:19.957558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14159): Terminating (SIGTERM) 21:03:19.999339 run iperf3-srv_10.42.42.10(pid=14160): Terminating (SIGTERM) 21:03:20.040802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14163): Terminating (SIGTERM) 21:03:20.082623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14166): Terminating (SIGTERM) 21:03:20.124367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14169): Terminating (SIGTERM) 21:03:20.166191 --- ParallelTerminationStrategy: PID 14153 died... 21:03:20.186102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14153): Terminated: ok {rc=0} 21:03:20.232182 --- ParallelTerminationStrategy: PID 14154 died... 21:03:20.252144 run iperf3-srv_10.42.42.10(pid=14154): Terminated {rc=256} 21:03:20.298219 --- ParallelTerminationStrategy: PID 14155 died... 21:03:20.317860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14155): Terminated: ok {rc=0} 21:03:20.363913 --- ParallelTerminationStrategy: PID 14156 died... 21:03:20.384083 run iperf3-srv_10.42.42.10(pid=14156): Terminated {rc=256} 21:03:20.429669 --- ParallelTerminationStrategy: PID 14157 died... 21:03:20.449254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14157): Terminated: ok {rc=0} 21:03:20.495128 --- ParallelTerminationStrategy: PID 14158 died... 21:03:20.514808 run iperf3-srv_10.42.42.10(pid=14158): Terminated {rc=256} 21:03:20.560812 --- ParallelTerminationStrategy: PID 14159 died... 21:03:20.580768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14159): Terminated: ok {rc=0} 21:03:20.627318 --- ParallelTerminationStrategy: PID 14160 died... 21:03:20.646963 run iperf3-srv_10.42.42.10(pid=14160): Terminated {rc=256} 21:03:20.692866 --- ParallelTerminationStrategy: PID 14163 died... 21:03:20.712803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14163): Terminated: ok {rc=0} 21:03:20.758711 --- ParallelTerminationStrategy: PID 14166 died... 21:03:20.778384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14166): Terminated: ok {rc=0} 21:03:20.824237 --- ParallelTerminationStrategy: PID 14169 died... 21:03:20.843913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14169): Terminated: ok {rc=0} 21:03:20.931176 bus /gobi_4: Setting Powered False 21:03:22.030176 bus /gobi_4: Setting Powered False 21:03:23.145884 bus /gobi_1: Setting Powered False 21:03:24.241361 bus /gobi_1: Setting Powered False 21:03:25.355176 bus /gobi_0: Setting Powered False 21:03:26.452874 bus /gobi_0: Setting Powered False 21:03:27.569736 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 21:03:28.671284 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:28.683082 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:03:28.752037 tst ping.py: using LAC 16794 21:03:28.867450 tst ping.py: using RAC 219 21:03:28.990842 tst ping.py: using CellId 16794 21:03:29.112813 tst ping.py: using BVCI 16795 21:03:29.226551 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:29.238491 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:29.250055 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:29.261674 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:29.272815 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:29.284202 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:29.295783 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:29.307124 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:03:29.421468 tst ping.py:19: start network... 21:03:29.619242 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:03:30.072408 run create_hlr_db(pid=14171): Launched 21:03:30.184867 bus /gobi_6: Setting Powered False 21:03:31.253816 run create_hlr_db(pid=14171): Terminated: ok {rc=0} 21:03:31.701641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14173): Launched 21:03:32.032849 run osmo-hlr_10.42.42.2(pid=14174): Launched 21:03:32.226912 run osmo-stp_10.42.42.5: Starting osmo-stp 21:03:32.774530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14176): Launched 21:03:33.091575 run osmo-stp_10.42.42.5(pid=14177): Launched 21:03:33.210382 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:03:33.754666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14179): Launched 21:03:33.875447 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:03:34.141710 run patchelf(pid=14180): Launched 21:03:34.317076 run osmo-stp_10.42.42.5(pid=14177): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14177)] 21:03:34.451016 run osmo-stp_10.42.42.5(pid=14177): stdout: | (launched: 2022-12-08_21:03:33.033734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:34.586330 run osmo-stp_10.42.42.5(pid=14177): stderr: | [0;m[38;5;43m20221208210333224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210333224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210333224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210333224 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210333227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210333227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210333227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:34.721859 run osmo-stp_10.42.42.5(pid=14177): stdout: | (launched: 2022-12-08_21:03:33.033734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:34.850841 run osmo-stp_10.42.42.5(pid=14177): stderr: | [0;m[38;5;43m20221208210333224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210333224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210333224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210333224 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210333227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210333227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210333227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:35.003738 run patchelf(pid=14180): Terminating (SIGINT) 21:03:35.181585 run patchelf(pid=14180): Terminated: ok {rc=0} 21:03:35.309172 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14177): Process ended prematurely: osmo-stp_10.42.42.5(pid=14177) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14177)] [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 21:03:35.318484 tst ping.py:22: Test FAILED (6.6 sec) 21:03:35.346379 run osmo-hlr_10.42.42.2(pid=14174): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14174)] 21:03:35.396192 run osmo-hlr_10.42.42.2(pid=14174): stdout: | (launched: 2022-12-08_21:03:31.975045) 21:03:35.447826 run osmo-hlr_10.42.42.2(pid=14174): stderr: | [0;m[1;31m20221208210332234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210332234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210332234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210332234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210332234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210332234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210332247 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210332258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210332258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210332258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:03:35.499605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14173): Terminating (SIGTERM) 21:03:35.541392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14176): Terminating (SIGTERM) 21:03:35.583460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14179): Terminating (SIGTERM) 21:03:35.625800 --- ParallelTerminationStrategy: PID 14173 died... 21:03:35.645795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14173): Terminated: ok {rc=0} 21:03:35.691923 --- ParallelTerminationStrategy: PID 14176 died... 21:03:35.711479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14176): Terminated: ok {rc=0} 21:03:35.758573 --- ParallelTerminationStrategy: PID 14179 died... 21:03:35.777851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14179): Terminated: ok {rc=0} 21:03:35.864302 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 21:03:36.952545 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:36.964853 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:03:37.033674 tst ping_idle_ping.py: using LAC 16795 21:03:37.158162 tst ping_idle_ping.py: using RAC 220 21:03:37.283291 tst ping_idle_ping.py: using CellId 16795 21:03:37.406937 tst ping_idle_ping.py: using BVCI 16796 21:03:37.521263 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:37.532886 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:37.544297 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:37.555905 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:37.567185 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:37.578875 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:37.590530 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:37.602157 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:03:37.718771 tst ping_idle_ping.py:24: start network... 21:03:37.917747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:03:38.377601 run create_hlr_db(pid=14181): Launched 21:03:38.491105 bus /gobi_6: Setting Powered False 21:03:39.550563 run create_hlr_db(pid=14181): Terminated: ok {rc=0} 21:03:39.985049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14183): Launched 21:03:40.301242 run osmo-hlr_10.42.42.2(pid=14184): Launched 21:03:40.421866 run osmo-stp_10.42.42.5: Starting osmo-stp 21:03:40.969571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14186): Launched 21:03:41.286119 run osmo-stp_10.42.42.5(pid=14187): Launched 21:03:41.406226 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:03:41.951705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14189): Launched 21:03:42.073015 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:03:42.340561 run patchelf(pid=14190): Launched 21:03:42.516776 run osmo-stp_10.42.42.5(pid=14187): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14187)] 21:03:42.651553 run osmo-stp_10.42.42.5(pid=14187): stdout: | (launched: 2022-12-08_21:03:41.227954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:42.787638 run osmo-stp_10.42.42.5(pid=14187): stderr: | [0;m[38;5;43m20221208210341421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210341421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210341421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210341422 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210341422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210341422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210341422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:42.923556 run osmo-stp_10.42.42.5(pid=14187): stdout: | (launched: 2022-12-08_21:03:41.227954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:43.053158 run osmo-stp_10.42.42.5(pid=14187): stderr: | [0;m[38;5;43m20221208210341421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210341421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210341421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210341422 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210341422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210341422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210341422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:43.207273 run patchelf(pid=14190): Terminating (SIGINT) 21:03:43.385809 run patchelf(pid=14190): Terminated: ok {rc=0} 21:03:43.513813 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14187): Process ended prematurely: osmo-stp_10.42.42.5(pid=14187) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14187)] [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 21:03:43.523175 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 21:03:43.551010 run osmo-hlr_10.42.42.2(pid=14184): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14184)] 21:03:43.600615 run osmo-hlr_10.42.42.2(pid=14184): stdout: | (launched: 2022-12-08_21:03:40.243596) 21:03:43.652470 run osmo-hlr_10.42.42.2(pid=14184): stderr: | [0;m[1;31m20221208210340441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210340441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210340441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210340441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210340441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210340441 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210340454 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210340464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210340464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210340464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:03:43.704877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14183): Terminating (SIGTERM) 21:03:43.746405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14186): Terminating (SIGTERM) 21:03:43.788011 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14189): Terminating (SIGTERM) 21:03:43.829861 --- ParallelTerminationStrategy: PID 14183 died... 21:03:43.849792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14183): Terminated: ok {rc=0} 21:03:43.895795 --- ParallelTerminationStrategy: PID 14186 died... 21:03:43.915173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14186): Terminated: ok {rc=0} 21:03:43.961090 --- ParallelTerminationStrategy: PID 14189 died... 21:03:43.980529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14189): Terminated: ok {rc=0} 21:03:44.067092 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:03:45.373460 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:03:45.380284 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:03:45.410623 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 21:03:45.450290 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 21:03:45.538359 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:03:45.568340 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 21:03:45.607592 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 21:03:46.208003 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 21:03:46.277547 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:46.292903 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:03:46.375688 tst cs_paging_gprs_active.py: using LAC 16796 21:03:46.498121 tst cs_paging_gprs_active.py: using RAC 221 21:03:46.624061 tst cs_paging_gprs_active.py: using CellId 16796 21:03:46.746936 tst cs_paging_gprs_active.py: using BVCI 16797 21:03:46.866282 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:46.878294 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:46.890274 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:46.902398 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:46.914422 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:46.926443 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:46.938527 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:46.950770 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:46.962983 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:03:47.085970 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:03:47.210727 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:03:47.428799 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:47.751444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14195): Launched 21:03:48.031424 run iperf3-srv_10.42.42.10(pid=14196): Launched 21:03:48.152140 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:03:48.368737 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:48.691798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14197): Launched 21:03:48.972120 run iperf3-srv_10.42.42.10(pid=14198): Launched 21:03:49.093137 tst cs_paging_gprs_active.py:38: start network... 21:03:49.310424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:03:49.810513 run create_hlr_db(pid=14199): Launched 21:03:49.926529 bus /gobi_6: Setting Powered False 21:03:50.985948 run create_hlr_db(pid=14199): Terminated: ok {rc=0} 21:03:51.429146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14201): Launched 21:03:51.752683 run osmo-hlr_10.42.42.2(pid=14202): Launched 21:03:51.875201 run osmo-stp_10.42.42.5: Starting osmo-stp 21:03:52.435159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14204): Launched 21:03:52.759684 run osmo-stp_10.42.42.5(pid=14205): Launched 21:03:52.882896 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:03:53.438727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14207): Launched 21:03:53.563558 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:03:53.842533 run patchelf(pid=14208): Launched 21:03:54.023328 run osmo-stp_10.42.42.5(pid=14205): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14205)] 21:03:54.159944 run osmo-stp_10.42.42.5(pid=14205): stdout: | (launched: 2022-12-08_21:03:52.700437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:54.298240 run osmo-stp_10.42.42.5(pid=14205): stderr: | [0;m[38;5;43m20221208210352893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210352893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210352894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210352894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210352894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210352894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210352895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:54.435922 run osmo-stp_10.42.42.5(pid=14205): stdout: | (launched: 2022-12-08_21:03:52.700437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:54.568082 run osmo-stp_10.42.42.5(pid=14205): stderr: | [0;m[38;5;43m20221208210352893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210352893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210352894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210352894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210352894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210352894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210352895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:54.725378 run patchelf(pid=14208): Terminating (SIGINT) 21:03:54.906101 run patchelf(pid=14208): Terminated: ok {rc=0} 21:03:55.036220 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14205): Process ended prematurely: osmo-stp_10.42.42.5(pid=14205) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14205)] [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 21:03:55.046472 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 21:03:55.074803 run osmo-hlr_10.42.42.2(pid=14202): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14202)] 21:03:55.124463 run osmo-hlr_10.42.42.2(pid=14202): stdout: | (launched: 2022-12-08_21:03:51.693243) 21:03:55.176066 run osmo-hlr_10.42.42.2(pid=14202): stderr: | [0;m[1;31m20221208210351894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210351894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210351894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210351894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210351894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210351894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210351907 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210351916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210351916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210351916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:03:55.228434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14195): Terminating (SIGTERM) 21:03:55.270465 run iperf3-srv_10.42.42.10(pid=14196): Terminating (SIGTERM) 21:03:55.311936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14197): Terminating (SIGTERM) 21:03:55.353761 run iperf3-srv_10.42.42.10(pid=14198): Terminating (SIGTERM) 21:03:55.395227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14201): Terminating (SIGTERM) 21:03:55.436583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14204): Terminating (SIGTERM) 21:03:55.478028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14207): Terminating (SIGTERM) 21:03:55.519718 --- ParallelTerminationStrategy: PID 14195 died... 21:03:55.539599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14195): Terminated: ok {rc=0} 21:03:55.585558 --- ParallelTerminationStrategy: PID 14196 died... 21:03:55.604712 run iperf3-srv_10.42.42.10(pid=14196): Terminated {rc=256} 21:03:55.650792 --- ParallelTerminationStrategy: PID 14197 died... 21:03:55.670281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14197): Terminated: ok {rc=0} 21:03:55.716035 --- ParallelTerminationStrategy: PID 14198 died... 21:03:55.735478 run iperf3-srv_10.42.42.10(pid=14198): Terminated {rc=256} 21:03:55.781485 --- ParallelTerminationStrategy: PID 14201 died... 21:03:55.800690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14201): Terminated: ok {rc=0} 21:03:55.847004 --- ParallelTerminationStrategy: PID 14204 died... 21:03:55.866491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14204): Terminated: ok {rc=0} 21:03:55.912586 --- ParallelTerminationStrategy: PID 14207 died... 21:03:55.932043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14207): Terminated: ok {rc=0} 21:03:56.018420 bus /gobi_0: Setting Powered False 21:03:57.117435 bus /gobi_0: Setting Powered False 21:03:58.233636 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 21:03:59.382084 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:59.394220 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:03:59.462379 tst iperf3.py: using LAC 16797 21:03:59.590039 tst iperf3.py: using RAC 222 21:03:59.719189 tst iperf3.py: using CellId 16797 21:03:59.846344 tst iperf3.py: using BVCI 16798 21:03:59.964377 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:59.976057 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:59.987537 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:03:59.998913 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:00.010335 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:00.021719 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:00.033345 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:00.044656 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:00.056209 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:04:00.176164 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:04:00.392917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:04:00.714710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14209): Launched 21:04:01.000773 run iperf3-srv_10.42.42.10(pid=14210): Launched 21:04:01.134757 tst iperf3.py:8: start network... 21:04:01.341376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:04:01.822133 run create_hlr_db(pid=14211): Launched 21:04:01.993485 bus /gobi_6: Setting Powered False 21:04:03.053340 run create_hlr_db(pid=14211): Terminated: ok {rc=0} 21:04:03.494082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14213): Launched 21:04:03.817051 run osmo-hlr_10.42.42.2(pid=14214): Launched 21:04:03.940121 run osmo-stp_10.42.42.5: Starting osmo-stp 21:04:04.493983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14216): Launched 21:04:04.816884 run osmo-stp_10.42.42.5(pid=14217): Launched 21:04:04.939238 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:04:05.495565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14219): Launched 21:04:05.619186 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:04:05.892317 run patchelf(pid=14220): Launched 21:04:06.071166 run osmo-stp_10.42.42.5(pid=14217): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14217)] 21:04:06.207988 run osmo-stp_10.42.42.5(pid=14217): stdout: | (launched: 2022-12-08_21:04:04.757615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:06.346010 run osmo-stp_10.42.42.5(pid=14217): stderr: | [0;m[38;5;43m20221208210404950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210404950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210404951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210404951 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210404951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210404952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210404952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:06.484206 run osmo-stp_10.42.42.5(pid=14217): stdout: | (launched: 2022-12-08_21:04:04.757615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:06.616404 run osmo-stp_10.42.42.5(pid=14217): stderr: | [0;m[38;5;43m20221208210404950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210404950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210404951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210404951 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210404951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210404952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210404952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:06.774187 run patchelf(pid=14220): Terminating (SIGINT) 21:04:06.955371 run patchelf(pid=14220): Terminated: ok {rc=0} 21:04:07.085398 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14217): Process ended prematurely: osmo-stp_10.42.42.5(pid=14217) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14217)] [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 21:04:07.095508 tst iperf3.py:8: Test FAILED (7.8 sec) 21:04:07.123948 run osmo-hlr_10.42.42.2(pid=14214): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14214)] 21:04:07.173669 run osmo-hlr_10.42.42.2(pid=14214): stdout: | (launched: 2022-12-08_21:04:03.758689) 21:04:07.225256 run osmo-hlr_10.42.42.2(pid=14214): stderr: | [0;m[1;31m20221208210403957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210403957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210403957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210403957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210403957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210403957 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210403969 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210403977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210403977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210403978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:04:07.277112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14209): Terminating (SIGTERM) 21:04:07.318921 run iperf3-srv_10.42.42.10(pid=14210): Terminating (SIGTERM) 21:04:07.360761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14213): Terminating (SIGTERM) 21:04:07.402347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14216): Terminating (SIGTERM) 21:04:07.443962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14219): Terminating (SIGTERM) 21:04:07.485744 --- ParallelTerminationStrategy: PID 14209 died... 21:04:07.505698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14209): Terminated: ok {rc=0} 21:04:07.551764 --- ParallelTerminationStrategy: PID 14210 died... 21:04:07.571279 run iperf3-srv_10.42.42.10(pid=14210): Terminated {rc=256} 21:04:07.616898 --- ParallelTerminationStrategy: PID 14213 died... 21:04:07.637010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14213): Terminated: ok {rc=0} 21:04:07.682679 --- ParallelTerminationStrategy: PID 14216 died... 21:04:07.702336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14216): Terminated: ok {rc=0} 21:04:07.748127 --- ParallelTerminationStrategy: PID 14219 died... 21:04:07.767736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14219): Terminated: ok {rc=0} 21:04:07.854955 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 21:04:09.005537 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:09.017861 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:04:09.086491 tst iperf3m4.py: using LAC 16798 21:04:09.211979 tst iperf3m4.py: using RAC 223 21:04:09.338195 tst iperf3m4.py: using CellId 16798 21:04:09.464401 tst iperf3m4.py: using BVCI 16799 21:04:09.581269 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:09.592782 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:09.604254 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:09.615646 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:09.627061 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:09.638792 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:09.650892 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:09.662413 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:09.674150 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:04:09.796889 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:04:09.918507 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:04:10.040620 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:04:10.162277 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:04:10.379185 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:04:10.701678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14221): Launched 21:04:10.982160 run iperf3-srv_10.42.42.10(pid=14222): Launched 21:04:11.104563 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:04:11.321750 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:04:11.646090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14223): Launched 21:04:11.933738 run iperf3-srv_10.42.42.10(pid=14224): Launched 21:04:12.061946 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:04:12.262805 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:04:12.563986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14225): Launched 21:04:12.825756 run iperf3-srv_10.42.42.10(pid=14226): Launched 21:04:12.938108 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:04:13.138331 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:04:13.438451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14227): Launched 21:04:13.699608 run iperf3-srv_10.42.42.10(pid=14228): Launched 21:04:13.812073 tst iperf3m4.py:8: start network... 21:04:14.012547 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:04:14.476890 run create_hlr_db(pid=14229): Launched 21:04:14.611222 bus /gobi_6: Setting Powered False 21:04:15.674957 run create_hlr_db(pid=14229): Terminated: ok {rc=0} 21:04:16.136871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14231): Launched 21:04:16.467096 run osmo-hlr_10.42.42.2(pid=14232): Launched 21:04:16.680757 run osmo-stp_10.42.42.5: Starting osmo-stp 21:04:17.494783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14234): Launched 21:04:17.798390 run osmo-stp_10.42.42.5(pid=14235): Launched 21:04:17.913936 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:04:18.444525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14237): Launched 21:04:18.559953 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:04:18.814268 run patchelf(pid=14238): Launched 21:04:18.984223 run osmo-stp_10.42.42.5(pid=14235): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14235)] 21:04:19.111244 run osmo-stp_10.42.42.5(pid=14235): stdout: | (launched: 2022-12-08_21:04:17.743230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:19.239712 run osmo-stp_10.42.42.5(pid=14235): stderr: | [0;m[38;5;43m20221208210417912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210417912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210417913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210417913 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210417914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210417914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210417914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:19.368415 run osmo-stp_10.42.42.5(pid=14235): stdout: | (launched: 2022-12-08_21:04:17.743230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:19.492408 run osmo-stp_10.42.42.5(pid=14235): stderr: | [0;m[38;5;43m20221208210417912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210417912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210417913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210417913 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210417914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210417914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210417914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:19.638728 run patchelf(pid=14238): Terminating (SIGINT) 21:04:19.808040 run patchelf(pid=14238): Terminated: ok {rc=0} 21:04:19.929402 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14235): Process ended prematurely: osmo-stp_10.42.42.5(pid=14235) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14235)] [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 21:04:19.939158 tst iperf3m4.py:8: Test FAILED (11.0 sec) 21:04:19.967065 run osmo-hlr_10.42.42.2(pid=14232): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14232)] 21:04:20.015327 run osmo-hlr_10.42.42.2(pid=14232): stdout: | (launched: 2022-12-08_21:04:16.406559) 21:04:20.065327 run osmo-hlr_10.42.42.2(pid=14232): stderr: | [0;m[1;31m20221208210416812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210416812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210416812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210416812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210416813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210416813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210416843 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210416867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210416867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210416867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:04:20.115437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14221): Terminating (SIGTERM) 21:04:20.155564 run iperf3-srv_10.42.42.10(pid=14222): Terminating (SIGTERM) 21:04:20.195452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14223): Terminating (SIGTERM) 21:04:20.235627 run iperf3-srv_10.42.42.10(pid=14224): Terminating (SIGTERM) 21:04:20.275561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14225): Terminating (SIGTERM) 21:04:20.315686 run iperf3-srv_10.42.42.10(pid=14226): Terminating (SIGTERM) 21:04:20.355466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14227): Terminating (SIGTERM) 21:04:20.395604 run iperf3-srv_10.42.42.10(pid=14228): Terminating (SIGTERM) 21:04:20.435538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14231): Terminating (SIGTERM) 21:04:20.475619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14234): Terminating (SIGTERM) 21:04:20.515638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14237): Terminating (SIGTERM) 21:04:20.555615 --- ParallelTerminationStrategy: PID 14221 died... 21:04:20.574825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14221): Terminated: ok {rc=0} 21:04:20.619919 --- ParallelTerminationStrategy: PID 14222 died... 21:04:20.638722 run iperf3-srv_10.42.42.10(pid=14222): Terminated {rc=256} 21:04:20.683370 --- ParallelTerminationStrategy: PID 14223 died... 21:04:20.702191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14223): Terminated: ok {rc=0} 21:04:20.746536 --- ParallelTerminationStrategy: PID 14224 died... 21:04:20.765267 run iperf3-srv_10.42.42.10(pid=14224): Terminated {rc=256} 21:04:20.809383 --- ParallelTerminationStrategy: PID 14225 died... 21:04:20.827960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14225): Terminated: ok {rc=0} 21:04:20.872374 --- ParallelTerminationStrategy: PID 14226 died... 21:04:20.891025 run iperf3-srv_10.42.42.10(pid=14226): Terminated {rc=256} 21:04:20.934992 --- ParallelTerminationStrategy: PID 14227 died... 21:04:20.953601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14227): Terminated: ok {rc=0} 21:04:20.997802 --- ParallelTerminationStrategy: PID 14228 died... 21:04:21.016561 run iperf3-srv_10.42.42.10(pid=14228): Terminated {rc=256} 21:04:21.060802 --- ParallelTerminationStrategy: PID 14231 died... 21:04:21.079885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14231): Terminated: ok {rc=0} 21:04:21.124935 --- ParallelTerminationStrategy: PID 14234 died... 21:04:21.144108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14234): Terminated: ok {rc=0} 21:04:21.188779 --- ParallelTerminationStrategy: PID 14237 died... 21:04:21.207537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14237): Terminated: ok {rc=0} 21:04:21.293251 bus /gobi_4: Setting Powered False 21:04:22.392797 bus /gobi_4: Setting Powered False 21:04:23.508509 bus /gobi_1: Setting Powered False 21:04:24.606781 bus /gobi_1: Setting Powered False 21:04:25.721504 bus /gobi_0: Setting Powered False 21:04:26.819382 bus /gobi_0: Setting Powered False 21:04:27.936514 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 21:04:29.039046 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:29.051313 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:04:29.119947 tst ping.py: using LAC 16799 21:04:29.244711 tst ping.py: using RAC 224 21:04:29.370549 tst ping.py: using CellId 16799 21:04:29.495559 tst ping.py: using BVCI 16800 21:04:29.611835 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:29.623470 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:29.634900 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:29.646449 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:29.658277 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:29.669854 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:29.681352 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:29.692620 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:04:29.810629 tst ping.py:19: start network... 21:04:30.022794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:04:30.509375 run create_hlr_db(pid=14239): Launched 21:04:30.637609 bus /gobi_6: Setting Powered False 21:04:31.710189 run create_hlr_db(pid=14239): Terminated: ok {rc=0} 21:04:32.159705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14241): Launched 21:04:32.457403 run osmo-hlr_10.42.42.2(pid=14242): Launched 21:04:32.574127 run osmo-stp_10.42.42.5: Starting osmo-stp 21:04:33.082714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14244): Launched 21:04:33.377407 run osmo-stp_10.42.42.5(pid=14245): Launched 21:04:33.490148 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:04:34.000823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14247): Launched 21:04:34.115184 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:04:34.365069 run patchelf(pid=14248): Launched 21:04:34.530395 run osmo-stp_10.42.42.5(pid=14245): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14245)] 21:04:34.655972 run osmo-stp_10.42.42.5(pid=14245): stdout: | (launched: 2022-12-08_21:04:33.323168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:34.783039 run osmo-stp_10.42.42.5(pid=14245): stderr: | [0;m[38;5;43m20221208210433492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210433492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210433493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210433493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210433493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210433494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210433494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:34.910019 run osmo-stp_10.42.42.5(pid=14245): stdout: | (launched: 2022-12-08_21:04:33.323168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:35.031980 run osmo-stp_10.42.42.5(pid=14245): stderr: | [0;m[38;5;43m20221208210433492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210433492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210433493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210433493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210433493 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210433494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210433494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:35.175770 run patchelf(pid=14248): Terminating (SIGINT) 21:04:35.341824 run patchelf(pid=14248): Terminated: ok {rc=0} 21:04:35.461206 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14245): Process ended prematurely: osmo-stp_10.42.42.5(pid=14245) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14245)] [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 21:04:35.470092 tst ping.py:22: Test FAILED (6.4 sec) 21:04:35.496680 run osmo-hlr_10.42.42.2(pid=14242): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14242)] 21:04:35.544924 run osmo-hlr_10.42.42.2(pid=14242): stdout: | (launched: 2022-12-08_21:04:32.403198) 21:04:35.594353 run osmo-hlr_10.42.42.2(pid=14242): stderr: | [0;m[1;31m20221208210432579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210432579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210432579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210432579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210432579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210432579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210432591 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210432602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210432602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210432602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:04:35.644187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14241): Terminating (SIGTERM) 21:04:35.683847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14244): Terminating (SIGTERM) 21:04:35.723425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14247): Terminating (SIGTERM) 21:04:35.763432 --- ParallelTerminationStrategy: PID 14241 died... 21:04:35.782520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14241): Terminated: ok {rc=0} 21:04:35.827100 --- ParallelTerminationStrategy: PID 14244 died... 21:04:35.845595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14244): Terminated: ok {rc=0} 21:04:35.889903 --- ParallelTerminationStrategy: PID 14247 died... 21:04:35.908601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14247): Terminated: ok {rc=0} 21:04:35.991603 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 21:04:37.077864 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:37.090741 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:04:37.162050 tst ping_idle_ping.py: using LAC 16800 21:04:37.289059 tst ping_idle_ping.py: using RAC 225 21:04:37.413398 tst ping_idle_ping.py: using CellId 16800 21:04:37.537394 tst ping_idle_ping.py: using BVCI 16801 21:04:37.653626 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:37.665569 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:37.677235 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:37.689530 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:37.701673 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:37.713702 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:37.725749 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:37.737654 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:04:37.857733 tst ping_idle_ping.py:24: start network... 21:04:38.071999 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:04:38.563480 run create_hlr_db(pid=14249): Launched 21:04:38.692913 bus /gobi_6: Setting Powered False 21:04:39.756549 run create_hlr_db(pid=14249): Terminated: ok {rc=0} 21:04:40.179824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14251): Launched 21:04:40.476111 run osmo-hlr_10.42.42.2(pid=14252): Launched 21:04:40.590131 run osmo-stp_10.42.42.5: Starting osmo-stp 21:04:41.115166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14254): Launched 21:04:41.410390 run osmo-stp_10.42.42.5(pid=14255): Launched 21:04:41.523712 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:04:42.048898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14257): Launched 21:04:42.164119 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:04:42.415193 run patchelf(pid=14258): Launched 21:04:42.581247 run osmo-stp_10.42.42.5(pid=14255): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14255)] 21:04:42.707635 run osmo-stp_10.42.42.5(pid=14255): stdout: | (launched: 2022-12-08_21:04:41.356102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:42.835201 run osmo-stp_10.42.42.5(pid=14255): stderr: | [0;m[38;5;43m20221208210441525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210441525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210441525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210441526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210441526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210441526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210441526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:42.962888 run osmo-stp_10.42.42.5(pid=14255): stdout: | (launched: 2022-12-08_21:04:41.356102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:43.084282 run osmo-stp_10.42.42.5(pid=14255): stderr: | [0;m[38;5;43m20221208210441525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210441525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210441525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210441526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210441526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210441526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210441526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:43.228462 run patchelf(pid=14258): Terminating (SIGINT) 21:04:43.395427 run patchelf(pid=14258): Terminated: ok {rc=0} 21:04:43.515659 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14255): Process ended prematurely: osmo-stp_10.42.42.5(pid=14255) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14255)] [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 21:04:43.524818 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 21:04:43.551952 run osmo-hlr_10.42.42.2(pid=14252): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14252)] 21:04:43.600438 run osmo-hlr_10.42.42.2(pid=14252): stdout: | (launched: 2022-12-08_21:04:40.421737) 21:04:43.650220 run osmo-hlr_10.42.42.2(pid=14252): stderr: | [0;m[1;31m20221208210440598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210440598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210440598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210440598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210440598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210440598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210440611 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210440621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210440621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210440621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:04:43.700528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14251): Terminating (SIGTERM) 21:04:43.740771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14254): Terminating (SIGTERM) 21:04:43.780844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14257): Terminating (SIGTERM) 21:04:43.821707 --- ParallelTerminationStrategy: PID 14251 died... 21:04:43.840923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14251): Terminated: ok {rc=0} 21:04:43.885988 --- ParallelTerminationStrategy: PID 14254 died... 21:04:43.904514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14254): Terminated: ok {rc=0} 21:04:43.949298 --- ParallelTerminationStrategy: PID 14257 died... 21:04:43.968113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14257): Terminated: ok {rc=0} 21:04:44.051746 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:04:45.356302 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:04:45.363488 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:04:45.394092 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 21:04:45.430063 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:04:45.484221 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:04:45.514089 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 21:04:45.549713 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:04:46.142751 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2349 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 21:04:46.148230 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:04:46.159885 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:04:46.227800 tst switch_tch_pdch.py: using LAC 16801 21:04:46.355446 tst switch_tch_pdch.py: using RAC 226 21:04:46.485212 tst switch_tch_pdch.py: using CellId 16801 21:04:46.612165 tst switch_tch_pdch.py: using BVCI 16802 21:04:46.726773 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:04:46.739215 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:04:46.752655 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:04:46.765084 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:04:46.778680 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:04:46.791852 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:04:46.806522 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:04:46.818781 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:04:46.949192 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:04:47.084046 tst switch_tch_pdch.py:51: start network... 21:04:47.300809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:04:47.792322 run create_hlr_db(pid=14262): Launched 21:04:47.921976 bus /gobi_6: Setting Powered False 21:04:48.984754 run create_hlr_db(pid=14262): Terminated: ok {rc=0} 21:04:49.426692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14264): Launched 21:04:49.745256 run osmo-hlr_10.42.42.2(pid=14265): Launched 21:04:49.866181 run osmo-stp_10.42.42.5: Starting osmo-stp 21:04:50.412920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14267): Launched 21:04:50.729239 run osmo-stp_10.42.42.5(pid=14268): Launched 21:04:50.850378 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:04:51.394601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14270): Launched 21:04:51.517553 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:04:51.786265 run patchelf(pid=14271): Launched 21:04:51.964181 run osmo-stp_10.42.42.5(pid=14268): ERR: Terminated: ERROR {rc=1} [trial-2349↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14268)] 21:04:52.098866 run osmo-stp_10.42.42.5(pid=14268): stdout: | (launched: 2022-12-08_21:04:50.671390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:52.234580 run osmo-stp_10.42.42.5(pid=14268): stderr: | [0;m[38;5;43m20221208210450863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210450863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210450863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210450864 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210450864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210450864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210450864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:52.370571 run osmo-stp_10.42.42.5(pid=14268): stdout: | (launched: 2022-12-08_21:04:50.671390) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:52.500374 run osmo-stp_10.42.42.5(pid=14268): stderr: | [0;m[38;5;43m20221208210450863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210450863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210450863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210450864 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210450864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210450864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210450864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:52.654672 run patchelf(pid=14271): Terminating (SIGINT) 21:04:52.833153 run patchelf(pid=14271): Terminated: ok {rc=0} 21:04:52.961186 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14268): Process ended prematurely: osmo-stp_10.42.42.5(pid=14268) [trial-2349↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14268)] [trial-2349↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 21:04:52.970836 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 21:04:52.998418 run osmo-hlr_10.42.42.2(pid=14265): ERR: Terminated: ERROR {rc=237} [trial-2349↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14265)] 21:04:53.048082 run osmo-hlr_10.42.42.2(pid=14265): stdout: | (launched: 2022-12-08_21:04:49.687498) 21:04:53.099946 run osmo-hlr_10.42.42.2(pid=14265): stderr: | [0;m[1;31m20221208210449884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210449884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210449884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210449884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210449884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210449885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210449897 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210449906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210449906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210449907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:04:53.151863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14264): Terminating (SIGTERM) 21:04:53.193299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14267): Terminating (SIGTERM) 21:04:53.235189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14270): Terminating (SIGTERM) 21:04:53.277267 --- ParallelTerminationStrategy: PID 14264 died... 21:04:53.297214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14264): Terminated: ok {rc=0} 21:04:53.343547 --- ParallelTerminationStrategy: PID 14267 died... 21:04:53.363270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14267): Terminated: ok {rc=0} 21:04:53.409159 --- ParallelTerminationStrategy: PID 14270 died... 21:04:53.428767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14270): Terminated: ok {rc=0} 21:04:53.517147 bus /gobi_0: Setting Powered False 21:04:54.616431 bus /gobi_0: Setting Powered False 21:04:55.733152 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 21:04:56.990379 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:04:56.996596 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 21:04:57.027000 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 21:04:57.063077 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 21:04:57.118361 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 21:04:57.147715 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 21:04:57.182009 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 21:04:57.742156 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2349 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 21:04:57.747609 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:04:57.759289 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 21:04:57.826249 tst switch_tch_pdch.py: using LAC 16802 21:04:57.948785 tst switch_tch_pdch.py: using RAC 227 21:04:58.071127 tst switch_tch_pdch.py: using CellId 16802 21:04:58.193806 tst switch_tch_pdch.py: using BVCI 16803 21:04:58.307472 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:04:58.319069 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:04:58.330535 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:04:58.342036 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:04:58.353427 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:04:58.364786 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:04:58.376321 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:04:58.387728 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 21:04:58.504108 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 21:04:58.623072 tst switch_tch_pdch.py:51: start network... 21:04:58.820037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:04:59.249571 run create_hlr_db(pid=14275): Launched 21:04:59.363040 bus /gobi_6: Setting Powered False 21:05:00.421594 run create_hlr_db(pid=14275): Terminated: ok {rc=0} 21:05:00.831104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14277): Launched 21:05:01.185590 run osmo-hlr_10.42.42.2(pid=14281): Launched 21:05:01.445713 run osmo-stp_10.42.42.5: Starting osmo-stp 21:05:02.026333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14283): Launched 21:05:02.338915 run osmo-stp_10.42.42.5(pid=14284): Launched 21:05:02.452712 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:05:02.954706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14286): Launched 21:05:03.068033 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:05:03.317784 run patchelf(pid=14287): Launched 21:05:03.482858 run osmo-stp_10.42.42.5(pid=14284): ERR: Terminated: ERROR {rc=1} [trial-2349↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14284)] 21:05:03.609131 run osmo-stp_10.42.42.5(pid=14284): stdout: | (launched: 2022-12-08_21:05:02.283322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:03.736835 run osmo-stp_10.42.42.5(pid=14284): stderr: | [0;m[38;5;43m20221208210502490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210502490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210502490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210502491 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210502491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210502491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210502491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:03.864709 run osmo-stp_10.42.42.5(pid=14284): stdout: | (launched: 2022-12-08_21:05:02.283322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:03.986525 run osmo-stp_10.42.42.5(pid=14284): stderr: | [0;m[38;5;43m20221208210502490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210502490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210502490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210502491 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210502491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210502491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210502491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:04.130294 run patchelf(pid=14287): Terminating (SIGINT) 21:05:04.297993 run patchelf(pid=14287): Terminated: ok {rc=0} 21:05:04.418734 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14284): Process ended prematurely: osmo-stp_10.42.42.5(pid=14284) [trial-2349↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14284)] [trial-2349↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 21:05:04.427771 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 21:05:04.454573 run osmo-hlr_10.42.42.2(pid=14281): ERR: Terminated: ERROR {rc=237} [trial-2349↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14281)] 21:05:04.502689 run osmo-hlr_10.42.42.2(pid=14281): stdout: | (launched: 2022-12-08_21:05:01.129946) 21:05:04.552258 run osmo-hlr_10.42.42.2(pid=14281): stderr: | [0;m[1;31m20221208210501406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210501407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210501407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210501407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210501407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210501407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210501419 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210501427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210501427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210501427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:05:04.602105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14277): Terminating (SIGTERM) 21:05:04.641907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14283): Terminating (SIGTERM) 21:05:04.682072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14286): Terminating (SIGTERM) 21:05:04.722273 --- ParallelTerminationStrategy: PID 14277 died... 21:05:04.741420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14277): Terminated: ok {rc=0} 21:05:04.786211 --- ParallelTerminationStrategy: PID 14283 died... 21:05:04.804686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14283): Terminated: ok {rc=0} 21:05:04.849224 --- ParallelTerminationStrategy: PID 14286 died... 21:05:04.867831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14286): Terminated: ok {rc=0} 21:05:04.954309 bus /gobi_0: Setting Powered False 21:05:06.053870 bus /gobi_0: Setting Powered False 21:05:07.169259 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 nitb_sms:nanobts --------------------------------------------------------------------- 21:05:08.414414 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:05:08.419349 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 21:05:08.444166 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 21:05:08.451699 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 21:05:08.506542 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 21:05:08.531600 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 21:05:08.538683 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 21:05:09.074528 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 21:05:09.079964 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 21:05:09.091387 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 21:05:09.129555 tst mo_mt_sms.py: using LAC 16803 21:05:09.255106 tst mo_mt_sms.py: using RAC 228 21:05:09.378973 tst mo_mt_sms.py: using CellId 16803 21:05:09.504642 tst mo_mt_sms.py: using BVCI 16804 21:05:09.620621 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 21:05:09.740383 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 21:05:09.859832 tst mo_mt_sms.py:9: start nitb and bts... 21:05:10.073689 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:05:10.718319 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14291): Launched 21:05:11.036418 run osmo-nitb_10.42.42.2(pid=14292): Launched 21:05:11.211950 run osmo-nitb_10.42.42.2(pid=14292): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14292)] 21:05:11.354546 run osmo-nitb_10.42.42.2(pid=14292): stdout: | (launched: 2022-12-08_21:05:10.978256) 21:05:11.498607 run osmo-nitb_10.42.42.2(pid=14292): stderr: | (launched: 2022-12-08_21:05:11.025566) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:05:11.642769 run osmo-nitb_10.42.42.2(pid=14292): stdout: | (launched: 2022-12-08_21:05:10.978256) 21:05:11.780779 run osmo-nitb_10.42.42.2(pid=14292): stderr: | (launched: 2022-12-08_21:05:11.025566) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8fda692268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14292): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14292) [trial-2349↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14292)] 21:05:12.155668 tst osmo-nitb_10.42.42.2(pid=14292): stdout: | (launched: 2022-12-08_21:05:10.978256) 21:05:12.283318 tst osmo-nitb_10.42.42.2(pid=14292): stderr: | (launched: 2022-12-08_21:05:11.025566) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:05:12.433745 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=14292): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14292) [trial-2349↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14292)] [trial-2349↪nitb_sms:nanobts↪mo_mt_sms.py:11] 21:05:12.442810 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 21:05:12.450002 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14291): Terminating (SIGTERM) 21:05:12.660273 --- ParallelTerminationStrategy: PID 14291 died... 21:05:12.681797 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14291): Terminated: ok {rc=0} 21:05:12.769428 bus /sierra_3: Setting Powered False 21:05:13.868232 bus /sierra_3: Setting Powered False 21:05:14.984548 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 sms:nanobts+band-1900 --------------------------------------------------------------------- 21:05:16.196599 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:05:16.204847 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 21:05:16.241259 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 21:05:16.277013 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 21:05:16.341113 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 21:05:16.381638 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 21:05:16.416261 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 21:05:16.958821 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 21:05:16.968442 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:16.987424 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:05:17.042062 tst mo_mt_sms.py: using LAC 16804 21:05:17.158350 tst mo_mt_sms.py: using RAC 229 21:05:17.276134 tst mo_mt_sms.py: using CellId 16804 21:05:17.391873 tst mo_mt_sms.py: using BVCI 16805 21:05:17.498960 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:17.509794 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:17.520371 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:17.531620 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:17.542980 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:17.554532 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 21:05:17.675639 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 21:05:17.792311 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:05:18.250098 run create_hlr_db(pid=14296): Launched 21:05:18.364005 bus /sierra_2: Setting Powered False 21:05:19.423868 run create_hlr_db(pid=14296): Terminated: ok {rc=0} 21:05:19.857213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14298): Launched 21:05:20.175075 run osmo-hlr_10.42.42.2(pid=14299): Launched 21:05:20.297116 run osmo-stp_10.42.42.5: Starting osmo-stp 21:05:20.844017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14301): Launched 21:05:21.159855 run osmo-stp_10.42.42.5(pid=14302): Launched 21:05:21.280353 run osmo-msc_10.42.42.6: Starting osmo-msc 21:05:21.850632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14304): Launched 21:05:22.169676 run osmo-msc_10.42.42.6(pid=14305): Launched 21:05:22.345995 run osmo-stp_10.42.42.5(pid=14302): ERR: Terminated: ERROR {rc=1} [trial-2349↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14302)] 21:05:22.479201 run osmo-stp_10.42.42.5(pid=14302): stdout: | (launched: 2022-12-08_21:05:21.102242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:22.613149 run osmo-stp_10.42.42.5(pid=14302): stderr: | [0;m[38;5;43m20221208210521292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210521292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210521292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210521293 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210521293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210521293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210521293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:22.746990 run osmo-stp_10.42.42.5(pid=14302): stdout: | (launched: 2022-12-08_21:05:21.102242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:22.873157 run osmo-stp_10.42.42.5(pid=14302): stderr: | [0;m[38;5;43m20221208210521292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210521292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210521292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210521293 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210521293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210521293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210521293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:23.024709 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=14302): Process ended prematurely: osmo-stp_10.42.42.5(pid=14302) [trial-2349↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14302)] [trial-2349↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 21:05:23.033820 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 21:05:23.061328 run osmo-hlr_10.42.42.2(pid=14299): ERR: Terminated: ERROR {rc=237} [trial-2349↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14299)] 21:05:23.111483 run osmo-hlr_10.42.42.2(pid=14299): stdout: | (launched: 2022-12-08_21:05:20.117681) 21:05:23.163363 run osmo-hlr_10.42.42.2(pid=14299): stderr: | [0;m[1;31m20221208210520317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210520317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210520317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210520317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210520317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210520317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210520330 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210520338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210520338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210520338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:05:23.235281 run osmo-msc_10.42.42.6(pid=14305): ERR: Terminated: ERROR {rc=2} [trial-2349↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14305)] 21:05:23.285774 run osmo-msc_10.42.42.6(pid=14305): stdout: | (launched: 2022-12-08_21:05:22.111602) 21:05:23.337232 run osmo-msc_10.42.42.6(pid=14305): stderr: | [0;m[38;5;43m20221208210522431 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208210522431 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f89f3289c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208210522432 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208210522432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208210522432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208210522432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208210522435 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208210522436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208210522436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208210522436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:05:23.389128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14298): Terminating (SIGTERM) 21:05:23.431095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14301): Terminating (SIGTERM) 21:05:23.472996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14304): Terminating (SIGTERM) 21:05:23.515036 --- ParallelTerminationStrategy: PID 14298 died... 21:05:23.534647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14298): Terminated: ok {rc=0} 21:05:23.581256 --- ParallelTerminationStrategy: PID 14301 died... 21:05:23.600898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14301): Terminated: ok {rc=0} 21:05:23.647169 --- ParallelTerminationStrategy: PID 14304 died... 21:05:23.666854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14304): Terminated: ok {rc=0} 21:05:23.755028 bus /sierra_3: Setting Powered False 21:05:24.853727 bus /sierra_3: Setting Powered False 21:05:25.970527 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 21:05:27.198914 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:05:27.204002 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 21:05:27.228681 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 21:05:27.235709 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 21:05:27.272648 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 21:05:27.296447 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 21:05:27.303893 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 21:05:27.824066 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2349 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 21:05:27.829297 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 21:05:27.840478 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:05:27.878847 tst assert_extension.py: using LAC 16805 21:05:28.005214 tst assert_extension.py: using RAC 230 21:05:28.130148 tst assert_extension.py: using CellId 16805 21:05:28.254509 tst assert_extension.py: using BVCI 16806 21:05:28.368896 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 21:05:28.483469 tst assert_extension.py:10: start nitb and bts... 21:05:28.680579 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:05:29.282697 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14310): Launched 21:05:29.577679 run osmo-nitb_10.42.42.2(pid=14311): Launched 21:05:29.741627 run osmo-nitb_10.42.42.2(pid=14311): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14311)] 21:05:29.874992 run osmo-nitb_10.42.42.2(pid=14311): stdout: | (launched: 2022-12-08_21:05:29.523509) 21:05:30.009947 run osmo-nitb_10.42.42.2(pid=14311): stderr: | (launched: 2022-12-08_21:05:29.567415) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:05:30.144718 run osmo-nitb_10.42.42.2(pid=14311): stdout: | (launched: 2022-12-08_21:05:29.523509) 21:05:30.273300 run osmo-nitb_10.42.42.2(pid=14311): stderr: | (launched: 2022-12-08_21:05:29.567415) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8fda692268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14311): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14311) [trial-2349↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14311)] 21:05:30.688916 tst osmo-nitb_10.42.42.2(pid=14311): stdout: | (launched: 2022-12-08_21:05:29.523509) 21:05:30.807644 tst osmo-nitb_10.42.42.2(pid=14311): stderr: | (launched: 2022-12-08_21:05:29.567415) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:05:30.962550 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=14311): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14311) [trial-2349↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14311)] [trial-2349↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 21:05:30.971880 tst assert_extension.py:12: Test FAILED (3.1 sec) 21:05:30.979426 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14310): Terminating (SIGTERM) 21:05:31.190501 --- ParallelTerminationStrategy: PID 14310 died... 21:05:31.210922 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14310): Terminated: ok {rc=0} 21:05:31.302860 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 ussd:nanobts+band-1900 --------------------------------------------------------------------- 21:05:32.481715 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:05:32.486992 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 21:05:32.511891 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 21:05:32.539257 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 21:05:32.574785 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 21:05:32.599232 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 21:05:32.626340 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 21:05:33.157577 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2349 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 21:05:33.162669 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:33.173984 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:05:33.213885 tst assert_extension.py: using LAC 16806 21:05:33.337922 tst assert_extension.py: using RAC 231 21:05:33.462543 tst assert_extension.py: using CellId 16806 21:05:33.588506 tst assert_extension.py: using BVCI 16807 21:05:33.703168 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:33.714439 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:33.725600 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:33.736802 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:33.747897 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:33.758967 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 21:05:33.875177 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:05:34.362827 run create_hlr_db(pid=14318): Launched 21:05:34.492085 bus /sierra_2: Setting Powered False 21:05:35.555696 run create_hlr_db(pid=14318): Terminated: ok {rc=0} 21:05:35.978214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14320): Launched 21:05:36.275611 run osmo-hlr_10.42.42.2(pid=14321): Launched 21:05:36.390730 run osmo-stp_10.42.42.5: Starting osmo-stp 21:05:36.917383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14323): Launched 21:05:37.212010 run osmo-stp_10.42.42.5(pid=14324): Launched 21:05:37.323705 run osmo-msc_10.42.42.6: Starting osmo-msc 21:05:37.854709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14326): Launched 21:05:38.150319 run osmo-msc_10.42.42.6(pid=14327): Launched 21:05:38.315259 run osmo-stp_10.42.42.5(pid=14324): ERR: Terminated: ERROR {rc=1} [trial-2349↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14324)] 21:05:38.440868 run osmo-stp_10.42.42.5(pid=14324): stdout: | (launched: 2022-12-08_21:05:37.157908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:38.567083 run osmo-stp_10.42.42.5(pid=14324): stderr: | [0;m[38;5;43m20221208210537328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210537328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210537328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210537329 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210537329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210537329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210537329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:38.690644 run osmo-stp_10.42.42.5(pid=14324): stdout: | (launched: 2022-12-08_21:05:37.157908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:38.807871 run osmo-stp_10.42.42.5(pid=14324): stderr: | [0;m[38;5;43m20221208210537328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210537328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210537328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210537329 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210537329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210537329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210537329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:38.948153 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=14324): Process ended prematurely: osmo-stp_10.42.42.5(pid=14324) [trial-2349↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14324)] [trial-2349↪ussd:nanobts+band-1900↪assert_extension.py:17] 21:05:38.956369 tst assert_extension.py:17: Test FAILED (5.8 sec) 21:05:38.982347 run osmo-hlr_10.42.42.2(pid=14321): ERR: Terminated: ERROR {rc=237} [trial-2349↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14321)] 21:05:39.030008 run osmo-hlr_10.42.42.2(pid=14321): stdout: | (launched: 2022-12-08_21:05:36.221578) 21:05:39.079304 run osmo-hlr_10.42.42.2(pid=14321): stderr: | [0;m[1;31m20221208210536396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210536396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210536396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210536396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210536396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210536396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210536408 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210536416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210536416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210536417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:05:39.147872 run osmo-msc_10.42.42.6(pid=14327): ERR: Terminated: ERROR {rc=2} [trial-2349↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14327)] 21:05:39.195156 run osmo-msc_10.42.42.6(pid=14327): stdout: | (launched: 2022-12-08_21:05:38.096214) 21:05:39.244280 run osmo-msc_10.42.42.6(pid=14327): stderr: | [0;m[38;5;43m20221208210538366 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208210538366 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd6b01d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208210538367 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208210538367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208210538367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208210538368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208210538369 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208210538370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208210538370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208210538370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:05:39.294015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14320): Terminating (SIGTERM) 21:05:39.333594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14323): Terminating (SIGTERM) 21:05:39.373797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14326): Terminating (SIGTERM) 21:05:39.413711 --- ParallelTerminationStrategy: PID 14320 died... 21:05:39.432516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14320): Terminated: ok {rc=0} 21:05:39.476453 --- ParallelTerminationStrategy: PID 14323 died... 21:05:39.495342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14323): Terminated: ok {rc=0} 21:05:39.539261 --- ParallelTerminationStrategy: PID 14326 died... 21:05:39.557625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14326): Terminated: ok {rc=0} 21:05:39.640181 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 21:05:40.836334 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:05:40.843467 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 21:05:40.867670 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 21:05:40.894613 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 21:05:40.946995 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 21:05:40.971295 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 21:05:40.997950 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 21:05:41.547893 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 21:05:41.596767 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:41.608017 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:05:41.667933 tst mo_mt_call.py: using LAC 16807 21:05:41.785974 tst mo_mt_call.py: using RAC 232 21:05:41.904158 tst mo_mt_call.py: using CellId 16807 21:05:42.023559 tst mo_mt_call.py: using BVCI 16808 21:05:42.134481 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:42.145738 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:42.156706 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:42.168007 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:42.179447 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:42.190794 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:05:42.305040 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:05:42.425118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:05:42.923450 run create_hlr_db(pid=14332): Launched 21:05:43.054401 bus /sierra_2: Setting Powered False 21:05:44.118864 run create_hlr_db(pid=14332): Terminated: ok {rc=0} 21:05:44.548005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14334): Launched 21:05:44.849153 run osmo-hlr_10.42.42.2(pid=14335): Launched 21:05:44.963688 run osmo-stp_10.42.42.5: Starting osmo-stp 21:05:45.483157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14337): Launched 21:05:45.783195 run osmo-stp_10.42.42.5(pid=14338): Launched 21:05:45.988006 run osmo-msc_10.42.42.6: Starting osmo-msc 21:05:46.656706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14340): Launched 21:05:47.001397 run osmo-msc_10.42.42.6(pid=14341): Launched 21:05:47.325294 run osmo-stp_10.42.42.5(pid=14338): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14338)] 21:05:47.452672 run osmo-stp_10.42.42.5(pid=14338): stdout: | (launched: 2022-12-08_21:05:45.728238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:47.578344 run osmo-stp_10.42.42.5(pid=14338): stderr: | [0;m[38;5;43m20221208210545960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210545961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210545961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210545962 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210545962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210545962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210545962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:47.704085 run osmo-stp_10.42.42.5(pid=14338): stdout: | (launched: 2022-12-08_21:05:45.728238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:47.823393 run osmo-stp_10.42.42.5(pid=14338): stderr: | [0;m[38;5;43m20221208210545960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210545961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210545961 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210545962 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210545962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210545962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210545962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:47.966209 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14338): Process ended prematurely: osmo-stp_10.42.42.5(pid=14338) [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14338)] [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 21:05:47.974962 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 21:05:48.001529 run osmo-hlr_10.42.42.2(pid=14335): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14335)] 21:05:48.049686 run osmo-hlr_10.42.42.2(pid=14335): stdout: | (launched: 2022-12-08_21:05:44.793998) 21:05:48.099095 run osmo-hlr_10.42.42.2(pid=14335): stderr: | [0;m[1;31m20221208210544971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210544971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210544971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210544971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210544971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210544971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210544983 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210544992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210544992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210544993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:05:48.168705 run osmo-msc_10.42.42.6(pid=14341): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14341)] 21:05:48.216726 run osmo-msc_10.42.42.6(pid=14341): stdout: | (launched: 2022-12-08_21:05:46.939630) 21:05:48.265812 run osmo-msc_10.42.42.6(pid=14341): stderr: | [0;m[38;5;43m20221208210547292 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208210547292 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3816cbfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208210547292 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208210547292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208210547293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208210547293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208210547294 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208210547295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208210547295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208210547295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:05:48.315253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14334): Terminating (SIGTERM) 21:05:48.354684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14337): Terminating (SIGTERM) 21:05:48.394331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14340): Terminating (SIGTERM) 21:05:48.434075 --- ParallelTerminationStrategy: PID 14334 died... 21:05:48.453131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14334): Terminated: ok {rc=0} 21:05:48.497420 --- ParallelTerminationStrategy: PID 14337 died... 21:05:48.515655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14337): Terminated: ok {rc=0} 21:05:48.559840 --- ParallelTerminationStrategy: PID 14340 died... 21:05:48.578426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14340): Terminated: ok {rc=0} 21:05:48.664305 bus /sierra_3: Setting Powered False 21:05:49.762432 bus /sierra_3: Setting Powered False 21:05:50.874461 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 21:05:52.022705 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:52.035128 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:05:52.097156 tst mo_mt_call_osmux.py: using LAC 16808 21:05:52.224528 tst mo_mt_call_osmux.py: using RAC 233 21:05:52.352854 tst mo_mt_call_osmux.py: using CellId 16808 21:05:52.479321 tst mo_mt_call_osmux.py: using BVCI 16809 21:05:52.597561 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:52.609289 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:52.620756 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:52.632395 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:52.644046 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:52.655534 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:05:52.773486 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:05:52.889230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:05:53.353524 run create_hlr_db(pid=14343): Launched 21:05:53.469512 bus /sierra_2: Setting Powered False 21:05:54.529858 run create_hlr_db(pid=14343): Terminated: ok {rc=0} 21:05:54.948362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14345): Launched 21:05:55.248703 run osmo-hlr_10.42.42.2(pid=14346): Launched 21:05:55.363571 run osmo-stp_10.42.42.5: Starting osmo-stp 21:05:55.893625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14348): Launched 21:05:56.195879 run osmo-stp_10.42.42.5(pid=14349): Launched 21:05:56.311043 run osmo-msc_10.42.42.6: Starting osmo-msc 21:05:56.855749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14351): Launched 21:05:57.156240 run osmo-msc_10.42.42.6(pid=14352): Launched 21:05:57.323912 run osmo-stp_10.42.42.5(pid=14349): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14349)] 21:05:57.452068 run osmo-stp_10.42.42.5(pid=14349): stdout: | (launched: 2022-12-08_21:05:56.139529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:57.580499 run osmo-stp_10.42.42.5(pid=14349): stderr: | [0;m[38;5;43m20221208210556311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210556311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210556311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210556312 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210556312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210556312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210556312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:57.706590 run osmo-stp_10.42.42.5(pid=14349): stdout: | (launched: 2022-12-08_21:05:56.139529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:57.826159 run osmo-stp_10.42.42.5(pid=14349): stderr: | [0;m[38;5;43m20221208210556311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210556311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210556311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210556312 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210556312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210556312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210556312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:57.969163 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14349): Process ended prematurely: osmo-stp_10.42.42.5(pid=14349) [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14349)] [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 21:05:57.977967 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 21:05:58.004334 run osmo-hlr_10.42.42.2(pid=14346): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14346)] 21:05:58.052172 run osmo-hlr_10.42.42.2(pid=14346): stdout: | (launched: 2022-12-08_21:05:55.193719) 21:05:58.101627 run osmo-hlr_10.42.42.2(pid=14346): stderr: | [0;m[1;31m20221208210555369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210555369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210555369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210555369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210555369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210555369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210555382 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210555390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210555391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210555391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:05:58.170785 run osmo-msc_10.42.42.6(pid=14352): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14352)] 21:05:58.218686 run osmo-msc_10.42.42.6(pid=14352): stdout: | (launched: 2022-12-08_21:05:57.100889) 21:05:58.267917 run osmo-msc_10.42.42.6(pid=14352): stderr: | [0;m[38;5;43m20221208210557374 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208210557374 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe57987cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208210557375 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208210557375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208210557375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208210557375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208210557377 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208210557378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208210557378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208210557378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:05:58.317551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14345): Terminating (SIGTERM) 21:05:58.357145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14348): Terminating (SIGTERM) 21:05:58.396475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14351): Terminating (SIGTERM) 21:05:58.436216 --- ParallelTerminationStrategy: PID 14345 died... 21:05:58.455216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14345): Terminated: ok {rc=0} 21:05:58.499381 --- ParallelTerminationStrategy: PID 14348 died... 21:05:58.517836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14348): Terminated: ok {rc=0} 21:05:58.562149 --- ParallelTerminationStrategy: PID 14351 died... 21:05:58.580641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14351): Terminated: ok {rc=0} 21:05:58.664481 bus /sierra_3: Setting Powered False 21:05:59.759376 bus /sierra_3: Setting Powered False 21:06:00.889844 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 21:06:02.139292 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:06:02.147635 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 21:06:02.175301 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 21:06:02.202560 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 21:06:02.253442 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 21:06:02.277450 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 21:06:02.306339 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 21:06:02.863173 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 21:06:02.918578 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:02.930410 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:06:02.994232 tst mo_mt_call.py: using LAC 16809 21:06:03.123948 tst mo_mt_call.py: using RAC 234 21:06:03.250612 tst mo_mt_call.py: using CellId 16809 21:06:03.375540 tst mo_mt_call.py: using BVCI 16810 21:06:03.494647 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:03.506381 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:03.517887 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:03.529976 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:03.542515 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:03.554516 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:06:03.671514 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:06:03.789302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:06:04.255780 run create_hlr_db(pid=14357): Launched 21:06:04.371240 bus /sierra_2: Setting Powered False 21:06:05.430819 run create_hlr_db(pid=14357): Terminated: ok {rc=0} 21:06:05.870661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14359): Launched 21:06:06.192630 run osmo-hlr_10.42.42.2(pid=14360): Launched 21:06:06.317086 run osmo-stp_10.42.42.5: Starting osmo-stp 21:06:06.875073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14362): Launched 21:06:07.198144 run osmo-stp_10.42.42.5(pid=14363): Launched 21:06:07.320293 run osmo-msc_10.42.42.6: Starting osmo-msc 21:06:07.902139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14365): Launched 21:06:08.224257 run osmo-msc_10.42.42.6(pid=14366): Launched 21:06:08.403799 run osmo-stp_10.42.42.5(pid=14363): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14363)] 21:06:08.539258 run osmo-stp_10.42.42.5(pid=14363): stdout: | (launched: 2022-12-08_21:06:07.139354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:08.675652 run osmo-stp_10.42.42.5(pid=14363): stderr: | [0;m[38;5;43m20221208210607332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210607332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210607332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210607333 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210607333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210607333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210607333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:08.811406 run osmo-stp_10.42.42.5(pid=14363): stdout: | (launched: 2022-12-08_21:06:07.139354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:08.938805 run osmo-stp_10.42.42.5(pid=14363): stderr: | [0;m[38;5;43m20221208210607332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210607332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210607332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210607333 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210607333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210607333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210607333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:09.091612 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14363): Process ended prematurely: osmo-stp_10.42.42.5(pid=14363) [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14363)] [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 21:06:09.101181 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 21:06:09.128610 run osmo-hlr_10.42.42.2(pid=14360): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14360)] 21:06:09.178214 run osmo-hlr_10.42.42.2(pid=14360): stdout: | (launched: 2022-12-08_21:06:06.133844) 21:06:09.229856 run osmo-hlr_10.42.42.2(pid=14360): stderr: | [0;m[1;31m20221208210606333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210606333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210606333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210606333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210606333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210606333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210606345 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210606353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210606354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210606354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:06:09.301671 run osmo-msc_10.42.42.6(pid=14366): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14366)] 21:06:09.352125 run osmo-msc_10.42.42.6(pid=14366): stdout: | (launched: 2022-12-08_21:06:08.165261) 21:06:09.403343 run osmo-msc_10.42.42.6(pid=14366): stderr: | [0;m[38;5;43m20221208210608489 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208210608489 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0c9a1bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208210608489 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208210608489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208210608489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208210608490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208210608491 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208210608492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208210608492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208210608492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:06:09.454927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14359): Terminating (SIGTERM) 21:06:09.496252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14362): Terminating (SIGTERM) 21:06:09.537464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14365): Terminating (SIGTERM) 21:06:09.578938 --- ParallelTerminationStrategy: PID 14359 died... 21:06:09.598694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14359): Terminated: ok {rc=0} 21:06:09.645046 --- ParallelTerminationStrategy: PID 14362 died... 21:06:09.664176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14362): Terminated: ok {rc=0} 21:06:09.710260 --- ParallelTerminationStrategy: PID 14365 died... 21:06:09.729457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14365): Terminated: ok {rc=0} 21:06:09.816720 bus /sierra_3: Setting Powered False 21:06:10.916899 bus /sierra_3: Setting Powered False 21:06:12.035239 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 21:06:13.179791 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:13.191533 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:06:13.256355 tst mo_mt_call_osmux.py: using LAC 16810 21:06:13.374201 tst mo_mt_call_osmux.py: using RAC 235 21:06:13.491070 tst mo_mt_call_osmux.py: using CellId 16810 21:06:13.609680 tst mo_mt_call_osmux.py: using BVCI 16811 21:06:13.720178 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:13.731523 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:13.742809 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:13.754193 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:13.765636 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:13.776727 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:06:13.892207 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:06:14.006673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:06:14.474096 run create_hlr_db(pid=14368): Launched 21:06:14.588866 bus /sierra_2: Setting Powered False 21:06:15.648780 run create_hlr_db(pid=14368): Terminated: ok {rc=0} 21:06:16.117758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14370): Launched 21:06:16.511224 run osmo-hlr_10.42.42.2(pid=14371): Launched 21:06:16.796523 run osmo-stp_10.42.42.5: Starting osmo-stp 21:06:17.508521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14373): Launched 21:06:17.830595 run osmo-stp_10.42.42.5(pid=14374): Launched 21:06:17.953738 run osmo-msc_10.42.42.6: Starting osmo-msc 21:06:18.535244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14376): Launched 21:06:18.859285 run osmo-msc_10.42.42.6(pid=14377): Launched 21:06:19.038687 run osmo-stp_10.42.42.5(pid=14374): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14374)] 21:06:19.174706 run osmo-stp_10.42.42.5(pid=14374): stdout: | (launched: 2022-12-08_21:06:17.771794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:19.311496 run osmo-stp_10.42.42.5(pid=14374): stderr: | [0;m[38;5;43m20221208210617963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210617963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210617963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210617964 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210617964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210617964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210617964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:19.447408 run osmo-stp_10.42.42.5(pid=14374): stdout: | (launched: 2022-12-08_21:06:17.771794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:19.575989 run osmo-stp_10.42.42.5(pid=14374): stderr: | [0;m[38;5;43m20221208210617963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210617963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210617963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210617964 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210617964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210617964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210617964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:19.729844 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14374): Process ended prematurely: osmo-stp_10.42.42.5(pid=14374) [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14374)] [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 21:06:19.739418 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 21:06:19.767191 run osmo-hlr_10.42.42.2(pid=14371): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14371)] 21:06:19.817124 run osmo-hlr_10.42.42.2(pid=14371): stdout: | (launched: 2022-12-08_21:06:16.447177) 21:06:19.868702 run osmo-hlr_10.42.42.2(pid=14371): stderr: | [0;m[1;31m20221208210616746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210616746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210616746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210616746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210616747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210616747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210616764 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210616786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210616786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210616786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:06:19.940827 run osmo-msc_10.42.42.6(pid=14377): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14377)] 21:06:19.990621 run osmo-msc_10.42.42.6(pid=14377): stdout: | (launched: 2022-12-08_21:06:18.799438) 21:06:20.042010 run osmo-msc_10.42.42.6(pid=14377): stderr: | [0;m[38;5;43m20221208210619125 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208210619125 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f515a4a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208210619125 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208210619125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208210619126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208210619126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208210619127 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208210619128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208210619128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208210619128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:06:20.093746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14370): Terminating (SIGTERM) 21:06:20.135294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14373): Terminating (SIGTERM) 21:06:20.176790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14376): Terminating (SIGTERM) 21:06:20.218789 --- ParallelTerminationStrategy: PID 14370 died... 21:06:20.238700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14370): Terminated: ok {rc=0} 21:06:20.285102 --- ParallelTerminationStrategy: PID 14373 died... 21:06:20.304606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14373): Terminated: ok {rc=0} 21:06:20.350568 --- ParallelTerminationStrategy: PID 14376 died... 21:06:20.370276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14376): Terminated: ok {rc=0} 21:06:20.458188 bus /sierra_3: Setting Powered False 21:06:21.556471 bus /sierra_3: Setting Powered False 21:06:22.673708 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 21:06:23.916513 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:06:23.924422 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 21:06:23.948904 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 21:06:23.976768 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 21:06:24.031152 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 21:06:24.056122 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 21:06:24.084056 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 21:06:24.635914 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 21:06:24.687909 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:24.699585 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:06:24.762494 tst mo_mt_call.py: using LAC 16811 21:06:24.889451 tst mo_mt_call.py: using RAC 236 21:06:25.016932 tst mo_mt_call.py: using CellId 16811 21:06:25.142930 tst mo_mt_call.py: using BVCI 16812 21:06:25.262568 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:25.274330 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:25.285924 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:25.297468 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:25.309087 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:25.320566 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:06:25.435830 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:06:25.554585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:06:26.054427 run create_hlr_db(pid=14382): Launched 21:06:26.186083 bus /sierra_2: Setting Powered False 21:06:27.249656 run create_hlr_db(pid=14382): Terminated: ok {rc=0} 21:06:27.677690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14384): Launched 21:06:27.978180 run osmo-hlr_10.42.42.2(pid=14385): Launched 21:06:28.094277 run osmo-stp_10.42.42.5: Starting osmo-stp 21:06:28.609395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14387): Launched 21:06:28.910538 run osmo-stp_10.42.42.5(pid=14388): Launched 21:06:29.025458 run osmo-msc_10.42.42.6: Starting osmo-msc 21:06:29.568592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14390): Launched 21:06:29.870919 run osmo-msc_10.42.42.6(pid=14391): Launched 21:06:30.041454 run osmo-stp_10.42.42.5(pid=14388): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14388)] 21:06:30.169278 run osmo-stp_10.42.42.5(pid=14388): stdout: | (launched: 2022-12-08_21:06:28.854612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:30.297839 run osmo-stp_10.42.42.5(pid=14388): stderr: | [0;m[38;5;43m20221208210629026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210629026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210629026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210629026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210629027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210629027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210629027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:30.423665 run osmo-stp_10.42.42.5(pid=14388): stdout: | (launched: 2022-12-08_21:06:28.854612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:30.543442 run osmo-stp_10.42.42.5(pid=14388): stderr: | [0;m[38;5;43m20221208210629026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210629026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210629026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210629026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210629027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210629027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210629027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:30.686509 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14388): Process ended prematurely: osmo-stp_10.42.42.5(pid=14388) [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14388)] [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 21:06:30.695262 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 21:06:30.722268 run osmo-hlr_10.42.42.2(pid=14385): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14385)] 21:06:30.769928 run osmo-hlr_10.42.42.2(pid=14385): stdout: | (launched: 2022-12-08_21:06:27.922829) 21:06:30.819167 run osmo-hlr_10.42.42.2(pid=14385): stderr: | [0;m[1;31m20221208210628101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210628101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210628101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210628101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210628101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210628101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210628134 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210628145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210628145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210628145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:06:30.915334 run osmo-msc_10.42.42.6(pid=14391): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14391)] 21:06:30.967601 run osmo-msc_10.42.42.6(pid=14391): stdout: | (launched: 2022-12-08_21:06:29.815392) 21:06:31.022154 run osmo-msc_10.42.42.6(pid=14391): stderr: | [0;m[38;5;43m20221208210630087 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208210630087 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdd98a13c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208210630088 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208210630088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208210630088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208210630088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208210630090 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208210630090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208210630091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208210630091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:06:31.077650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14384): Terminating (SIGTERM) 21:06:31.123290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14387): Terminating (SIGTERM) 21:06:31.169589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14390): Terminating (SIGTERM) 21:06:31.215736 --- ParallelTerminationStrategy: PID 14384 died... 21:06:31.237156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14384): Terminated: ok {rc=0} 21:06:31.287731 --- ParallelTerminationStrategy: PID 14387 died... 21:06:31.309553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14387): Terminated: ok {rc=0} 21:06:31.359182 --- ParallelTerminationStrategy: PID 14390 died... 21:06:31.380044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14390): Terminated: ok {rc=0} 21:06:31.471183 bus /sierra_3: Setting Powered False 21:06:32.572490 bus /sierra_3: Setting Powered False 21:06:33.688003 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 21:06:34.836701 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:34.849270 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:06:34.912895 tst mo_mt_call_osmux.py: using LAC 16812 21:06:35.041404 tst mo_mt_call_osmux.py: using RAC 237 21:06:35.167993 tst mo_mt_call_osmux.py: using CellId 16812 21:06:35.294658 tst mo_mt_call_osmux.py: using BVCI 16813 21:06:35.413655 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:35.425550 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:35.437123 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:35.448617 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:35.460295 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:35.471967 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:06:35.589954 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:06:35.705199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:06:36.206569 run create_hlr_db(pid=14393): Launched 21:06:36.338702 bus /sierra_2: Setting Powered False 21:06:37.402382 run create_hlr_db(pid=14393): Terminated: ok {rc=0} 21:06:37.851856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14395): Launched 21:06:38.173680 run osmo-hlr_10.42.42.2(pid=14396): Launched 21:06:38.297826 run osmo-stp_10.42.42.5: Starting osmo-stp 21:06:38.852528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14398): Launched 21:06:39.174532 run osmo-stp_10.42.42.5(pid=14399): Launched 21:06:39.296286 run osmo-msc_10.42.42.6: Starting osmo-msc 21:06:39.884137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14401): Launched 21:06:40.193082 run osmo-msc_10.42.42.6(pid=14402): Launched 21:06:40.363851 run osmo-stp_10.42.42.5(pid=14399): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14399)] 21:06:40.492598 run osmo-stp_10.42.42.5(pid=14399): stdout: | (launched: 2022-12-08_21:06:39.115796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:40.622031 run osmo-stp_10.42.42.5(pid=14399): stderr: | [0;m[38;5;43m20221208210639308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210639308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210639309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210639309 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210639310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210639310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210639310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:40.748023 run osmo-stp_10.42.42.5(pid=14399): stdout: | (launched: 2022-12-08_21:06:39.115796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:40.867625 run osmo-stp_10.42.42.5(pid=14399): stderr: | [0;m[38;5;43m20221208210639308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210639308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210639309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210639309 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210639310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210639310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210639310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:41.010882 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14399): Process ended prematurely: osmo-stp_10.42.42.5(pid=14399) [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14399)] [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 21:06:41.019823 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 21:06:41.046399 run osmo-hlr_10.42.42.2(pid=14396): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14396)] 21:06:41.094242 run osmo-hlr_10.42.42.2(pid=14396): stdout: | (launched: 2022-12-08_21:06:38.114992) 21:06:41.143857 run osmo-hlr_10.42.42.2(pid=14396): stderr: | [0;m[1;31m20221208210638313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210638313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210638313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210638313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210638314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210638314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210638335 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210638345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210638346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210638346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:06:41.212241 run osmo-msc_10.42.42.6(pid=14402): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14402)] 21:06:41.259650 run osmo-msc_10.42.42.6(pid=14402): stdout: | (launched: 2022-12-08_21:06:40.137346) 21:06:41.308463 run osmo-msc_10.42.42.6(pid=14402): stderr: | [0;m[38;5;43m20221208210640408 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208210640408 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe6aec25c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208210640408 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208210640408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208210640408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208210640409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208210640410 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208210640411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208210640411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208210640411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:06:41.357940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14395): Terminating (SIGTERM) 21:06:41.397242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14398): Terminating (SIGTERM) 21:06:41.436942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14401): Terminating (SIGTERM) 21:06:41.476991 --- ParallelTerminationStrategy: PID 14395 died... 21:06:41.496008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14395): Terminated: ok {rc=0} 21:06:41.540325 --- ParallelTerminationStrategy: PID 14398 died... 21:06:41.558960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14398): Terminated: ok {rc=0} 21:06:41.602926 --- ParallelTerminationStrategy: PID 14401 died... 21:06:41.621590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14401): Terminated: ok {rc=0} 21:06:41.705241 bus /sierra_3: Setting Powered False 21:06:42.803126 bus /sierra_3: Setting Powered False 21:06:43.919836 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 21:06:45.162885 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:06:45.171326 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 21:06:45.194940 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 21:06:45.222685 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 21:06:45.275505 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 21:06:45.300226 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 21:06:45.328401 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 21:06:45.905465 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 21:06:45.958337 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:06:45.970614 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:06:46.035019 tst mo_mt_call.py: using LAC 16813 21:06:46.200327 tst mo_mt_call.py: using RAC 238 21:06:46.355217 tst mo_mt_call.py: using CellId 16813 21:06:46.478074 tst mo_mt_call.py: using BVCI 16814 21:06:46.625785 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:06:46.641446 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:06:46.655087 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:06:46.667698 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:06:46.680505 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:06:46.692866 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:06:46.817810 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:06:46.968526 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:06:47.475045 run create_hlr_db(pid=14408): Launched 21:06:47.607732 bus /sierra_2: Setting Powered False 21:06:48.670953 run create_hlr_db(pid=14408): Terminated: ok {rc=0} 21:06:49.118623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14410): Launched 21:06:49.441220 run osmo-hlr_10.42.42.2(pid=14411): Launched 21:06:49.564572 run osmo-stp_10.42.42.5: Starting osmo-stp 21:06:50.120931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14413): Launched 21:06:50.442127 run osmo-stp_10.42.42.5(pid=14414): Launched 21:06:50.565718 run osmo-msc_10.42.42.6: Starting osmo-msc 21:06:51.147274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14416): Launched 21:06:51.471150 run osmo-msc_10.42.42.6(pid=14417): Launched 21:06:51.650697 run osmo-stp_10.42.42.5(pid=14414): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14414)] 21:06:51.787449 run osmo-stp_10.42.42.5(pid=14414): stdout: | (launched: 2022-12-08_21:06:50.383696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:51.924172 run osmo-stp_10.42.42.5(pid=14414): stderr: | [0;m[38;5;43m20221208210650574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210650574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210650575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210650575 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210650577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210650578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210650578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:52.059912 run osmo-stp_10.42.42.5(pid=14414): stdout: | (launched: 2022-12-08_21:06:50.383696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:52.187773 run osmo-stp_10.42.42.5(pid=14414): stderr: | [0;m[38;5;43m20221208210650574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210650574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210650575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210650575 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210650577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210650578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210650578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:52.341198 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14414): Process ended prematurely: osmo-stp_10.42.42.5(pid=14414) [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14414)] [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 21:06:52.350578 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 21:06:52.377987 run osmo-hlr_10.42.42.2(pid=14411): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14411)] 21:06:52.427555 run osmo-hlr_10.42.42.2(pid=14411): stdout: | (launched: 2022-12-08_21:06:49.382827) 21:06:52.478801 run osmo-hlr_10.42.42.2(pid=14411): stderr: | [0;m[1;31m20221208210649583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210649583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210649583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210649584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210649584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210649584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210649599 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210649608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210649608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210649608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:06:52.550527 run osmo-msc_10.42.42.6(pid=14417): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14417)] 21:06:52.600150 run osmo-msc_10.42.42.6(pid=14417): stdout: | (launched: 2022-12-08_21:06:51.412030) 21:06:52.652000 run osmo-msc_10.42.42.6(pid=14417): stderr: | [0;m[38;5;43m20221208210651735 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208210651735 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7da349ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208210651735 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208210651735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208210651735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208210651735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208210651739 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208210651739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208210651740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208210651740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:06:52.703846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14410): Terminating (SIGTERM) 21:06:52.745619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14413): Terminating (SIGTERM) 21:06:52.787153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14416): Terminating (SIGTERM) 21:06:52.828901 --- ParallelTerminationStrategy: PID 14410 died... 21:06:52.848868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14410): Terminated: ok {rc=0} 21:06:52.894638 --- ParallelTerminationStrategy: PID 14413 died... 21:06:52.914005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14413): Terminated: ok {rc=0} 21:06:52.960178 --- ParallelTerminationStrategy: PID 14416 died... 21:06:52.979643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14416): Terminated: ok {rc=0} 21:06:53.066951 bus /sierra_3: Setting Powered False 21:06:54.166662 bus /sierra_3: Setting Powered False 21:06:55.282336 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 21:06:56.430778 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:06:56.443204 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:06:56.505158 tst mo_mt_call_osmux.py: using LAC 16814 21:06:56.632701 tst mo_mt_call_osmux.py: using RAC 239 21:06:56.760072 tst mo_mt_call_osmux.py: using CellId 16814 21:06:56.886317 tst mo_mt_call_osmux.py: using BVCI 16815 21:06:57.004406 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:06:57.016278 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:06:57.027811 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:06:57.039348 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:06:57.051114 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:06:57.062760 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:06:57.178534 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:06:57.300025 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:06:57.800464 run create_hlr_db(pid=14419): Launched 21:06:57.930819 bus /sierra_2: Setting Powered False 21:06:58.994603 run create_hlr_db(pid=14419): Terminated: ok {rc=0} 21:06:59.425604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14421): Launched 21:06:59.727666 run osmo-hlr_10.42.42.2(pid=14422): Launched 21:06:59.842643 run osmo-stp_10.42.42.5: Starting osmo-stp 21:07:00.376714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14424): Launched 21:07:00.702393 run osmo-stp_10.42.42.5(pid=14425): Launched 21:07:00.827577 run osmo-msc_10.42.42.6: Starting osmo-msc 21:07:01.546804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14427): Launched 21:07:01.883721 run osmo-msc_10.42.42.6(pid=14428): Launched 21:07:02.207793 run osmo-stp_10.42.42.5(pid=14425): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14425)] 21:07:02.453322 run osmo-stp_10.42.42.5(pid=14425): stdout: | (launched: 2022-12-08_21:07:00.643128) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:02.591296 run osmo-stp_10.42.42.5(pid=14425): stderr: | [0;m[38;5;43m20221208210700866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210700867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210700867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210700867 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210700868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210700868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210700868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:02.728490 run osmo-stp_10.42.42.5(pid=14425): stdout: | (launched: 2022-12-08_21:07:00.643128) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:02.857110 run osmo-stp_10.42.42.5(pid=14425): stderr: | [0;m[38;5;43m20221208210700866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210700867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210700867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210700867 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210700868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210700868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210700868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:03.010850 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14425): Process ended prematurely: osmo-stp_10.42.42.5(pid=14425) [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14425)] [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 21:07:03.020401 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 21:07:03.048157 run osmo-hlr_10.42.42.2(pid=14422): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14422)] 21:07:03.098156 run osmo-hlr_10.42.42.2(pid=14422): stdout: | (launched: 2022-12-08_21:06:59.672130) 21:07:03.149650 run osmo-hlr_10.42.42.2(pid=14422): stderr: | [0;m[1;31m20221208210659850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210659850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210659850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210659850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210659850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210659850 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210659863 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210659872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210659872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210659872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:07:03.222033 run osmo-msc_10.42.42.6(pid=14428): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14428)] 21:07:03.272028 run osmo-msc_10.42.42.6(pid=14428): stdout: | (launched: 2022-12-08_21:07:01.823793) 21:07:03.323631 run osmo-msc_10.42.42.6(pid=14428): stderr: | [0;m[38;5;43m20221208210702392 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208210702392 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f688311dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208210702392 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208210702392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208210702392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208210702393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208210702394 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208210702395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208210702395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208210702395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:07:03.375537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14421): Terminating (SIGTERM) 21:07:03.417249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14424): Terminating (SIGTERM) 21:07:03.458990 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14427): Terminating (SIGTERM) 21:07:03.501386 --- ParallelTerminationStrategy: PID 14421 died... 21:07:03.520876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14421): Terminated: ok {rc=0} 21:07:03.567018 --- ParallelTerminationStrategy: PID 14424 died... 21:07:03.586528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14424): Terminated: ok {rc=0} 21:07:03.632271 --- ParallelTerminationStrategy: PID 14427 died... 21:07:03.651847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14427): Terminated: ok {rc=0} 21:07:03.739181 bus /sierra_3: Setting Powered False 21:07:04.836495 bus /sierra_3: Setting Powered False 21:07:05.951671 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:07:07.192407 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:07:07.200312 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:07:07.224786 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 21:07:07.252064 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:07:07.304832 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:07:07.329929 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 21:07:07.357780 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:07:07.912547 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 21:07:07.964018 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:07.975726 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:07:08.036747 tst mo_mt_call.py: using LAC 16815 21:07:08.162263 tst mo_mt_call.py: using RAC 240 21:07:08.289671 tst mo_mt_call.py: using CellId 16815 21:07:08.416616 tst mo_mt_call.py: using BVCI 16816 21:07:08.533594 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:08.545345 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:08.556742 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:08.568320 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:08.580063 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:08.591676 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:07:08.706921 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:07:08.822900 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:07:09.289095 run create_hlr_db(pid=14433): Launched 21:07:09.404586 bus /sierra_2: Setting Powered False 21:07:10.464648 run create_hlr_db(pid=14433): Terminated: ok {rc=0} 21:07:10.884119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14435): Launched 21:07:11.185455 run osmo-hlr_10.42.42.2(pid=14436): Launched 21:07:11.300423 run osmo-stp_10.42.42.5: Starting osmo-stp 21:07:11.832132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14438): Launched 21:07:12.132682 run osmo-stp_10.42.42.5(pid=14439): Launched 21:07:12.248416 run osmo-msc_10.42.42.6: Starting osmo-msc 21:07:12.796719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14441): Launched 21:07:13.099026 run osmo-msc_10.42.42.6(pid=14442): Launched 21:07:13.267943 run osmo-stp_10.42.42.5(pid=14439): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14439)] 21:07:13.402964 run osmo-stp_10.42.42.5(pid=14439): stdout: | (launched: 2022-12-08_21:07:12.076710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:13.543560 run osmo-stp_10.42.42.5(pid=14439): stderr: | [0;m[38;5;43m20221208210712245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210712245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210712246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210712246 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210712248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210712248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210712248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:13.669740 run osmo-stp_10.42.42.5(pid=14439): stdout: | (launched: 2022-12-08_21:07:12.076710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:13.789506 run osmo-stp_10.42.42.5(pid=14439): stderr: | [0;m[38;5;43m20221208210712245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210712245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210712246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210712246 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210712248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210712248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210712248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:13.932634 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14439): Process ended prematurely: osmo-stp_10.42.42.5(pid=14439) [trial-2349↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14439)] [trial-2349↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 21:07:13.942000 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 21:07:13.968605 run osmo-hlr_10.42.42.2(pid=14436): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14436)] 21:07:14.016588 run osmo-hlr_10.42.42.2(pid=14436): stdout: | (launched: 2022-12-08_21:07:11.130354) 21:07:14.066095 run osmo-hlr_10.42.42.2(pid=14436): stderr: | [0;m[1;31m20221208210711308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210711308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210711308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210711308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210711308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210711308 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210711321 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210711331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210711331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210711331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:07:14.135358 run osmo-msc_10.42.42.6(pid=14442): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14442)] 21:07:14.183041 run osmo-msc_10.42.42.6(pid=14442): stdout: | (launched: 2022-12-08_21:07:13.043709) 21:07:14.232345 run osmo-msc_10.42.42.6(pid=14442): stderr: | [0;m[38;5;43m20221208210713313 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208210713314 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f55e81ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208210713314 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208210713314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208210713314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208210713314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208210713316 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208210713316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208210713316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208210713316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:07:14.282275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14435): Terminating (SIGTERM) 21:07:14.322020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14438): Terminating (SIGTERM) 21:07:14.361937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14441): Terminating (SIGTERM) 21:07:14.402041 --- ParallelTerminationStrategy: PID 14435 died... 21:07:14.421105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14435): Terminated: ok {rc=0} 21:07:14.465522 --- ParallelTerminationStrategy: PID 14438 died... 21:07:14.484049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14438): Terminated: ok {rc=0} 21:07:14.528092 --- ParallelTerminationStrategy: PID 14441 died... 21:07:14.546637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14441): Terminated: ok {rc=0} 21:07:14.632251 bus /sierra_3: Setting Powered False 21:07:15.729905 bus /sierra_3: Setting Powered False 21:07:16.849122 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 21:07:17.993519 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:18.005395 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:07:18.065840 tst mo_mt_call_osmux.py: using LAC 16816 21:07:18.188243 tst mo_mt_call_osmux.py: using RAC 241 21:07:18.315321 tst mo_mt_call_osmux.py: using CellId 16816 21:07:18.440649 tst mo_mt_call_osmux.py: using BVCI 16817 21:07:18.550167 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:18.561469 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:18.572707 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:18.584630 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:18.596051 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:18.607317 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:07:18.728610 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:07:18.845981 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:07:19.311700 run create_hlr_db(pid=14444): Launched 21:07:19.425555 bus /sierra_2: Setting Powered False 21:07:20.485964 run create_hlr_db(pid=14444): Terminated: ok {rc=0} 21:07:20.926426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14446): Launched 21:07:21.250165 run osmo-hlr_10.42.42.2(pid=14447): Launched 21:07:21.374831 run osmo-stp_10.42.42.5: Starting osmo-stp 21:07:21.929336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14449): Launched 21:07:22.253595 run osmo-stp_10.42.42.5(pid=14450): Launched 21:07:22.377847 run osmo-msc_10.42.42.6: Starting osmo-msc 21:07:22.963486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14452): Launched 21:07:23.287444 run osmo-msc_10.42.42.6(pid=14453): Launched 21:07:23.467825 run osmo-stp_10.42.42.5(pid=14450): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14450)] 21:07:23.604278 run osmo-stp_10.42.42.5(pid=14450): stdout: | (launched: 2022-12-08_21:07:22.194386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:23.741529 run osmo-stp_10.42.42.5(pid=14450): stderr: | [0;m[38;5;43m20221208210722387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210722387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210722387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210722387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210722388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210722388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210722388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:23.877372 run osmo-stp_10.42.42.5(pid=14450): stdout: | (launched: 2022-12-08_21:07:22.194386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:24.005235 run osmo-stp_10.42.42.5(pid=14450): stderr: | [0;m[38;5;43m20221208210722387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210722387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210722387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210722387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210722388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210722388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210722388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:24.158532 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14450): Process ended prematurely: osmo-stp_10.42.42.5(pid=14450) [trial-2349↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14450)] [trial-2349↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 21:07:24.168004 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 21:07:24.195754 run osmo-hlr_10.42.42.2(pid=14447): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14447)] 21:07:24.245755 run osmo-hlr_10.42.42.2(pid=14447): stdout: | (launched: 2022-12-08_21:07:21.191569) 21:07:24.297437 run osmo-hlr_10.42.42.2(pid=14447): stderr: | [0;m[1;31m20221208210721392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210721392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210721392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210721392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210721392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210721392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210721403 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210721413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210721414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210721414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:07:24.369476 run osmo-msc_10.42.42.6(pid=14453): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14453)] 21:07:24.419499 run osmo-msc_10.42.42.6(pid=14453): stdout: | (launched: 2022-12-08_21:07:23.227920) 21:07:24.471151 run osmo-msc_10.42.42.6(pid=14453): stderr: | [0;m[38;5;43m20221208210723550 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208210723550 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f242ceb8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208210723550 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208210723550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208210723551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208210723551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208210723552 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208210723553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208210723553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208210723553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:07:24.523030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14446): Terminating (SIGTERM) 21:07:24.564386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14449): Terminating (SIGTERM) 21:07:24.605794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14452): Terminating (SIGTERM) 21:07:24.647492 --- ParallelTerminationStrategy: PID 14446 died... 21:07:24.667536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14446): Terminated: ok {rc=0} 21:07:24.713489 --- ParallelTerminationStrategy: PID 14449 died... 21:07:24.732893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14449): Terminated: ok {rc=0} 21:07:24.778998 --- ParallelTerminationStrategy: PID 14452 died... 21:07:24.798637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14452): Terminated: ok {rc=0} 21:07:24.886301 bus /sierra_3: Setting Powered False 21:07:25.985144 bus /sierra_3: Setting Powered False 21:07:27.101903 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 emergency:nanobts+band-1900 --------------------------------------------------------------------- 21:07:28.341950 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:07:28.347033 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 21:07:28.370659 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 21:07:28.398844 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 21:07:28.483136 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 21:07:28.506777 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 21:07:28.533400 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 21:07:29.118152 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2349 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 21:07:29.123379 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:29.134227 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:07:29.173551 tst emergency_mo_mt_call.py: using LAC 16817 21:07:29.298869 tst emergency_mo_mt_call.py: using RAC 242 21:07:29.423210 tst emergency_mo_mt_call.py: using CellId 16817 21:07:29.547229 tst emergency_mo_mt_call.py: using BVCI 16818 21:07:29.661878 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:29.673466 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:29.684462 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:29.695518 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:29.706679 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:29.718007 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:07:29.834843 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:07:29.953147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:07:30.443097 run create_hlr_db(pid=14458): Launched 21:07:30.571316 bus /sierra_2: Setting Powered False 21:07:31.632299 run create_hlr_db(pid=14458): Terminated: ok {rc=0} 21:07:32.081897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14460): Launched 21:07:32.412019 run osmo-hlr_10.42.42.2(pid=14461): Launched 21:07:32.532506 run osmo-stp_10.42.42.5: Starting osmo-stp 21:07:33.080180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14463): Launched 21:07:33.397712 run osmo-stp_10.42.42.5(pid=14464): Launched 21:07:33.527188 tst emergency_mo_mt_call.py: using MSISDN 6851 21:07:33.689319 run osmo-msc_10.42.42.6: Starting osmo-msc 21:07:34.260648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14466): Launched 21:07:34.578196 run osmo-msc_10.42.42.6(pid=14467): Launched 21:07:34.756109 run osmo-stp_10.42.42.5(pid=14464): ERR: Terminated: ERROR {rc=1} [trial-2349↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14464)] 21:07:34.890129 run osmo-stp_10.42.42.5(pid=14464): stdout: | (launched: 2022-12-08_21:07:33.339116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:35.025241 run osmo-stp_10.42.42.5(pid=14464): stderr: | [0;m[38;5;43m20221208210733533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210733533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210733533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210733534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210733534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210733534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210733534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:35.159316 run osmo-stp_10.42.42.5(pid=14464): stdout: | (launched: 2022-12-08_21:07:33.339116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:35.285768 run osmo-stp_10.42.42.5(pid=14464): stderr: | [0;m[38;5;43m20221208210733533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210733533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210733533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210733534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210733534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210733534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210733534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:35.436399 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=14464): Process ended prematurely: osmo-stp_10.42.42.5(pid=14464) [trial-2349↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14464)] [trial-2349↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 21:07:35.445548 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 21:07:35.472913 run osmo-hlr_10.42.42.2(pid=14461): ERR: Terminated: ERROR {rc=237} [trial-2349↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14461)] 21:07:35.522780 run osmo-hlr_10.42.42.2(pid=14461): stdout: | (launched: 2022-12-08_21:07:32.354326) 21:07:35.574632 run osmo-hlr_10.42.42.2(pid=14461): stderr: | [0;m[1;31m20221208210732554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210732554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210732554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210732555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210732555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210732555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210732568 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210732576 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210732577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210732577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:07:35.646467 run osmo-msc_10.42.42.6(pid=14467): ERR: Terminated: ERROR {rc=2} [trial-2349↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14467)] 21:07:35.696369 run osmo-msc_10.42.42.6(pid=14467): stdout: | (launched: 2022-12-08_21:07:34.520182) 21:07:35.748459 run osmo-msc_10.42.42.6(pid=14467): stderr: | [0;m[38;5;43m20221208210734842 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208210734842 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0b5a275c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208210734842 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208210734842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208210734843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208210734843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208210734846 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208210734847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208210734847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208210734847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:07:35.800490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14460): Terminating (SIGTERM) 21:07:35.841997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14463): Terminating (SIGTERM) 21:07:35.883500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14466): Terminating (SIGTERM) 21:07:35.925299 --- ParallelTerminationStrategy: PID 14460 died... 21:07:35.944931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14460): Terminated: ok {rc=0} 21:07:35.990844 --- ParallelTerminationStrategy: PID 14463 died... 21:07:36.010235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14463): Terminated: ok {rc=0} 21:07:36.056072 --- ParallelTerminationStrategy: PID 14466 died... 21:07:36.075530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14466): Terminated: ok {rc=0} 21:07:36.162859 bus /sierra_3: Setting Powered False 21:07:37.261213 bus /sierra_3: Setting Powered False 21:07:38.377492 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 21:07:39.463853 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:39.475891 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:07:39.519318 tst emergency_preemptive_call.py: using LAC 16818 21:07:39.644019 tst emergency_preemptive_call.py: using RAC 243 21:07:39.762841 tst emergency_preemptive_call.py: using CellId 16818 21:07:39.878456 tst emergency_preemptive_call.py: using BVCI 16819 21:07:39.986297 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:39.997252 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:40.008040 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:40.019153 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:40.030191 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:40.041584 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:07:40.161087 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:07:40.279680 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:07:40.398159 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:07:40.512601 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:07:41.006249 run create_hlr_db(pid=14471): Launched 21:07:41.138096 bus /sierra_2: Setting Powered False 21:07:42.201055 run create_hlr_db(pid=14471): Terminated: ok {rc=0} 21:07:42.624449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14473): Launched 21:07:42.920245 run osmo-hlr_10.42.42.2(pid=14474): Launched 21:07:43.032251 run osmo-stp_10.42.42.5: Starting osmo-stp 21:07:43.583062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14476): Launched 21:07:43.902041 run osmo-stp_10.42.42.5(pid=14477): Launched 21:07:44.025933 tst emergency_preemptive_call.py: using MSISDN 6852 21:07:44.183227 run osmo-msc_10.42.42.6: Starting osmo-msc 21:07:44.713422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14479): Launched 21:07:45.009628 run osmo-msc_10.42.42.6(pid=14480): Launched 21:07:45.175656 run osmo-stp_10.42.42.5(pid=14477): ERR: Terminated: ERROR {rc=1} [trial-2349↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14477)] 21:07:45.302128 run osmo-stp_10.42.42.5(pid=14477): stdout: | (launched: 2022-12-08_21:07:43.843413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:45.429092 run osmo-stp_10.42.42.5(pid=14477): stderr: | [0;m[38;5;43m20221208210744020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210744020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210744020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210744021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210744021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210744022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210744022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:45.553100 run osmo-stp_10.42.42.5(pid=14477): stdout: | (launched: 2022-12-08_21:07:43.843413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:45.670919 run osmo-stp_10.42.42.5(pid=14477): stderr: | [0;m[38;5;43m20221208210744020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210744020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210744020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210744021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210744021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210744022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210744022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:45.812179 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=14477): Process ended prematurely: osmo-stp_10.42.42.5(pid=14477) [trial-2349↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14477)] [trial-2349↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 21:07:45.820452 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 21:07:45.861788 run osmo-hlr_10.42.42.2(pid=14474): ERR: Terminated: ERROR {rc=237} [trial-2349↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14474)] 21:07:45.913824 run osmo-hlr_10.42.42.2(pid=14474): stdout: | (launched: 2022-12-08_21:07:42.865688) 21:07:45.964729 run osmo-hlr_10.42.42.2(pid=14474): stderr: | [0;m[1;31m20221208210743043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210743043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210743043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210743043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210743043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210743043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210743057 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210743065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210743065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210743065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:07:46.035320 run osmo-msc_10.42.42.6(pid=14480): ERR: Terminated: ERROR {rc=2} [trial-2349↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14480)] 21:07:46.085584 run osmo-msc_10.42.42.6(pid=14480): stdout: | (launched: 2022-12-08_21:07:44.955103) 21:07:46.137506 run osmo-msc_10.42.42.6(pid=14480): stderr: | [0;m[38;5;43m20221208210745227 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208210745228 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fac67614c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208210745228 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208210745228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208210745228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208210745228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208210745230 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208210745231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208210745231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208210745231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:07:46.189830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14473): Terminating (SIGTERM) 21:07:46.232157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14476): Terminating (SIGTERM) 21:07:46.276582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14479): Terminating (SIGTERM) 21:07:46.319092 --- ParallelTerminationStrategy: PID 14473 died... 21:07:46.339933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14473): Terminated: ok {rc=0} 21:07:46.387345 --- ParallelTerminationStrategy: PID 14476 died... 21:07:46.407174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14476): Terminated: ok {rc=0} 21:07:46.454192 --- ParallelTerminationStrategy: PID 14479 died... 21:07:46.473865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14479): Terminated: ok {rc=0} 21:07:46.560591 bus /sierra_9: Setting Powered False 21:07:47.658472 bus /sierra_9: Setting Powered False 21:07:48.771019 bus /sierra_8: Setting Powered False 21:07:49.868603 bus /sierra_8: Setting Powered False 21:07:50.986977 bus /sierra_3: Setting Powered False 21:07:52.087009 bus /sierra_3: Setting Powered False 21:07:53.202516 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:nanobts+band-1900 --------------------------------------------------------------------- 21:07:54.478579 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:07:54.484358 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 21:07:54.508846 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 21:07:54.548848 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 21:07:54.637439 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 21:07:54.661736 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 21:07:54.701517 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 21:07:55.293591 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 21:07:55.344057 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:07:55.355014 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:07:55.392674 tst cs_paging_gprs_active.py: using LAC 16819 21:07:55.519521 tst cs_paging_gprs_active.py: using RAC 244 21:07:55.645134 tst cs_paging_gprs_active.py: using CellId 16819 21:07:55.775252 tst cs_paging_gprs_active.py: using BVCI 16820 21:07:55.894222 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:07:55.905468 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:07:55.916348 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:07:55.927376 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:07:55.938328 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:07:55.949247 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:07:55.960354 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:07:55.971262 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:07:55.982474 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:07:56.098257 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:07:56.218207 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:07:56.438240 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:07:56.764638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14485): Launched 21:07:57.047256 run iperf3-srv_10.42.42.10(pid=14486): Launched 21:07:57.171287 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:07:57.390003 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:07:57.715673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14487): Launched 21:07:57.998042 run iperf3-srv_10.42.42.10(pid=14488): Launched 21:07:58.121384 tst cs_paging_gprs_active.py:38: start network... 21:07:58.339637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:07:58.842801 run create_hlr_db(pid=14489): Launched 21:07:58.975401 bus /sierra_2: Setting Powered False 21:08:00.039084 run create_hlr_db(pid=14489): Terminated: ok {rc=0} 21:08:00.470335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14491): Launched 21:08:00.773522 run osmo-hlr_10.42.42.2(pid=14492): Launched 21:08:00.950650 run osmo-stp_10.42.42.5: Starting osmo-stp 21:08:01.716572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14531): Launched 21:08:02.109785 run osmo-stp_10.42.42.5(pid=14545): Launched 21:08:02.351511 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:08:03.195036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14603): Launched 21:08:03.375749 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:08:03.733995 run patchelf(pid=14644): Launched 21:08:03.960152 run osmo-stp_10.42.42.5(pid=14545): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14545)] 21:08:04.118352 run osmo-stp_10.42.42.5(pid=14545): stdout: | (launched: 2022-12-08_21:08:02.042874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:04.282165 run osmo-stp_10.42.42.5(pid=14545): stderr: | [0;m[38;5;43m20221208210802408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210802408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210802415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210802415 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210802420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210802420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210802420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:04.444538 run osmo-stp_10.42.42.5(pid=14545): stdout: | (launched: 2022-12-08_21:08:02.042874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:04.599365 run osmo-stp_10.42.42.5(pid=14545): stderr: | [0;m[38;5;43m20221208210802408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210802408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210802415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210802415 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210802420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210802420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210802420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:04.792825 run patchelf(pid=14644): Terminating (SIGINT) 21:08:04.991887 run patchelf(pid=14644): Terminated: ok {rc=0} 21:08:05.129115 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14545): Process ended prematurely: osmo-stp_10.42.42.5(pid=14545) [trial-2349↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14545)] [trial-2349↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 21:08:05.140625 tst cs_paging_gprs_active.py:38: Test FAILED (9.8 sec) 21:08:05.170353 run osmo-hlr_10.42.42.2(pid=14492): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14492)] 21:08:05.223064 run osmo-hlr_10.42.42.2(pid=14492): stdout: | (launched: 2022-12-08_21:08:00.717542) 21:08:05.276275 run osmo-hlr_10.42.42.2(pid=14492): stderr: | [0;m[1;31m20221208210800934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210800934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210800934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210800934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210800934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210800934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210800958 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210800979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210800979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210800979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:08:05.330269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14485): Terminating (SIGTERM) 21:08:05.374201 run iperf3-srv_10.42.42.10(pid=14486): Terminating (SIGTERM) 21:08:05.420584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14487): Terminating (SIGTERM) 21:08:05.465187 run iperf3-srv_10.42.42.10(pid=14488): Terminating (SIGTERM) 21:08:05.508340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14491): Terminating (SIGTERM) 21:08:05.552855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14531): Terminating (SIGTERM) 21:08:05.598732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14603): Terminating (SIGTERM) 21:08:05.644453 --- ParallelTerminationStrategy: PID 14485 died... 21:08:05.666221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14485): Terminated: ok {rc=0} 21:08:05.716074 --- ParallelTerminationStrategy: PID 14486 died... 21:08:05.736756 run iperf3-srv_10.42.42.10(pid=14486): Terminated {rc=256} 21:08:05.784938 --- ParallelTerminationStrategy: PID 14487 died... 21:08:05.805814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14487): Terminated: ok {rc=0} 21:08:05.854389 --- ParallelTerminationStrategy: PID 14488 died... 21:08:05.875058 run iperf3-srv_10.42.42.10(pid=14488): Terminated {rc=256} 21:08:05.922774 --- ParallelTerminationStrategy: PID 14491 died... 21:08:05.943587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14491): Terminated: ok {rc=0} 21:08:05.991517 --- ParallelTerminationStrategy: PID 14531 died... 21:08:06.012042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14531): Terminated: ok {rc=0} 21:08:06.059490 --- ParallelTerminationStrategy: PID 14603 died... 21:08:06.080141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14603): Terminated: ok {rc=0} 21:08:06.172697 bus /gobi_0: Setting Powered False 21:08:07.273568 bus /gobi_0: Setting Powered False 21:08:08.391804 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 21:08:09.540773 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:09.553004 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:08:09.597713 tst iperf3.py: using LAC 16820 21:08:09.722531 tst iperf3.py: using RAC 245 21:08:09.848096 tst iperf3.py: using CellId 16820 21:08:09.970988 tst iperf3.py: using BVCI 16821 21:08:10.087135 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:10.098961 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:10.111656 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:10.124414 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:10.138024 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:10.150366 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:10.163004 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:10.175869 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:10.187576 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:08:10.313697 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:08:10.522092 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:08:10.834929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14771): Launched 21:08:11.119133 run iperf3-srv_10.42.42.10(pid=14772): Launched 21:08:11.252390 tst iperf3.py:8: start network... 21:08:11.459400 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:08:11.942978 run create_hlr_db(pid=14773): Launched 21:08:12.104418 bus /gobi_6: Setting Powered False 21:08:13.166246 run create_hlr_db(pid=14773): Terminated: ok {rc=0} 21:08:13.602464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14775): Launched 21:08:13.929774 run osmo-hlr_10.42.42.2(pid=14776): Launched 21:08:14.168804 run osmo-stp_10.42.42.5: Starting osmo-stp 21:08:14.900681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14778): Launched 21:08:15.235321 run osmo-stp_10.42.42.5(pid=14779): Launched 21:08:15.472133 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:08:16.183211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14781): Launched 21:08:16.335360 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:08:16.654036 run patchelf(pid=14782): Launched 21:08:16.910914 run osmo-stp_10.42.42.5(pid=14779): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14779)] 21:08:17.051243 run osmo-stp_10.42.42.5(pid=14779): stdout: | (launched: 2022-12-08_21:08:15.170853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:17.192544 run osmo-stp_10.42.42.5(pid=14779): stderr: | [0;m[38;5;43m20221208210815505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210815505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210815506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210815506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210815507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210815507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210815507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:17.337445 run osmo-stp_10.42.42.5(pid=14779): stdout: | (launched: 2022-12-08_21:08:15.170853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:17.473246 run osmo-stp_10.42.42.5(pid=14779): stderr: | [0;m[38;5;43m20221208210815505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210815505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210815506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210815506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210815507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210815507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210815507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:17.634413 run patchelf(pid=14782): Terminating (SIGINT) 21:08:17.821075 run patchelf(pid=14782): Terminated: ok {rc=0} 21:08:17.955096 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14779): Process ended prematurely: osmo-stp_10.42.42.5(pid=14779) [trial-2349↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14779)] [trial-2349↪gprs:nanobts+band-1900↪iperf3.py:8] 21:08:17.965968 tst iperf3.py:8: Test FAILED (8.5 sec) 21:08:17.995530 run osmo-hlr_10.42.42.2(pid=14776): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14776)] 21:08:18.047140 run osmo-hlr_10.42.42.2(pid=14776): stdout: | (launched: 2022-12-08_21:08:13.871335) 21:08:18.100487 run osmo-hlr_10.42.42.2(pid=14776): stderr: | [0;m[1;31m20221208210814212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210814212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210814212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210814212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210814212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210814212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210814237 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210814255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210814255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210814255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:08:18.154345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14771): Terminating (SIGTERM) 21:08:18.197313 run iperf3-srv_10.42.42.10(pid=14772): Terminating (SIGTERM) 21:08:18.239898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14775): Terminating (SIGTERM) 21:08:18.283554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14778): Terminating (SIGTERM) 21:08:18.327655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14781): Terminating (SIGTERM) 21:08:18.371303 --- ParallelTerminationStrategy: PID 14771 died... 21:08:18.392360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14771): Terminated: ok {rc=0} 21:08:18.441477 --- ParallelTerminationStrategy: PID 14772 died... 21:08:18.461983 run iperf3-srv_10.42.42.10(pid=14772): Terminated {rc=256} 21:08:18.508721 --- ParallelTerminationStrategy: PID 14775 died... 21:08:18.528798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14775): Terminated: ok {rc=0} 21:08:18.575680 --- ParallelTerminationStrategy: PID 14778 died... 21:08:18.596252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14778): Terminated: ok {rc=0} 21:08:18.643360 --- ParallelTerminationStrategy: PID 14781 died... 21:08:18.663990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14781): Terminated: ok {rc=0} 21:08:18.754265 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 21:08:19.913529 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:19.926353 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:08:19.967591 tst iperf3m4.py: using LAC 16821 21:08:20.096144 tst iperf3m4.py: using RAC 246 21:08:20.229335 tst iperf3m4.py: using CellId 16821 21:08:20.360903 tst iperf3m4.py: using BVCI 16822 21:08:20.483462 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:20.495990 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:20.509232 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:20.521293 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:20.533501 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:20.546914 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:20.559464 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:20.572433 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:20.584824 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:08:20.712121 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:08:20.843096 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:08:20.971091 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:08:21.096296 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:08:21.326866 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:08:21.664793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14783): Launched 21:08:21.968182 run iperf3-srv_10.42.42.10(pid=14784): Launched 21:08:22.108280 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:08:22.334919 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:08:22.672604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14785): Launched 21:08:22.979514 run iperf3-srv_10.42.42.10(pid=14786): Launched 21:08:23.118306 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:08:23.344100 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:08:23.680857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14787): Launched 21:08:23.982708 run iperf3-srv_10.42.42.10(pid=14788): Launched 21:08:24.121408 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:08:24.348156 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:08:24.684812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14789): Launched 21:08:24.990284 run iperf3-srv_10.42.42.10(pid=14790): Launched 21:08:25.128416 tst iperf3m4.py:8: start network... 21:08:25.355459 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:08:25.874539 run create_hlr_db(pid=14791): Launched 21:08:26.042308 bus /gobi_6: Setting Powered False 21:08:27.103094 run create_hlr_db(pid=14791): Terminated: ok {rc=0} 21:08:27.549723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14794): Launched 21:08:27.875936 run osmo-hlr_10.42.42.2(pid=14795): Launched 21:08:27.999424 run osmo-stp_10.42.42.5: Starting osmo-stp 21:08:28.562288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14797): Launched 21:08:28.889040 run osmo-stp_10.42.42.5(pid=14798): Launched 21:08:29.011371 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:08:29.569414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14800): Launched 21:08:29.693206 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:08:29.968670 run patchelf(pid=14801): Launched 21:08:30.151140 run osmo-stp_10.42.42.5(pid=14798): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14798)] 21:08:30.288298 run osmo-stp_10.42.42.5(pid=14798): stdout: | (launched: 2022-12-08_21:08:28.829442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:30.426744 run osmo-stp_10.42.42.5(pid=14798): stderr: | [0;m[38;5;43m20221208210829025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210829025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210829025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210829026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210829026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210829027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210829027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:30.565338 run osmo-stp_10.42.42.5(pid=14798): stdout: | (launched: 2022-12-08_21:08:28.829442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:30.698236 run osmo-stp_10.42.42.5(pid=14798): stderr: | [0;m[38;5;43m20221208210829025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210829025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210829025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210829026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210829026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210829027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210829027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:30.856476 run patchelf(pid=14801): Terminating (SIGINT) 21:08:31.055081 run patchelf(pid=14801): Terminated: ok {rc=0} 21:08:31.197130 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14798): Process ended prematurely: osmo-stp_10.42.42.5(pid=14798) [trial-2349↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14798)] [trial-2349↪gprs:nanobts+band-1900↪iperf3m4.py:8] 21:08:31.207694 tst iperf3m4.py:8: Test FAILED (11.3 sec) 21:08:31.238525 run osmo-hlr_10.42.42.2(pid=14795): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14795)] 21:08:31.288912 run osmo-hlr_10.42.42.2(pid=14795): stdout: | (launched: 2022-12-08_21:08:27.816165) 21:08:31.341964 run osmo-hlr_10.42.42.2(pid=14795): stderr: | [0;m[1;31m20221208210828015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210828015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210828016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210828016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210828016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210828016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210828028 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210828036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210828036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210828036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:08:31.395026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14783): Terminating (SIGTERM) 21:08:31.437623 run iperf3-srv_10.42.42.10(pid=14784): Terminating (SIGTERM) 21:08:31.479604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14785): Terminating (SIGTERM) 21:08:31.523503 run iperf3-srv_10.42.42.10(pid=14786): Terminating (SIGTERM) 21:08:31.565694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14787): Terminating (SIGTERM) 21:08:31.608383 run iperf3-srv_10.42.42.10(pid=14788): Terminating (SIGTERM) 21:08:31.653901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14789): Terminating (SIGTERM) 21:08:31.697518 run iperf3-srv_10.42.42.10(pid=14790): Terminating (SIGTERM) 21:08:31.742458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14794): Terminating (SIGTERM) 21:08:31.785554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14797): Terminating (SIGTERM) 21:08:31.830571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14800): Terminating (SIGTERM) 21:08:31.875402 --- ParallelTerminationStrategy: PID 14783 died... 21:08:31.908540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14783): Terminated: ok {rc=0} 21:08:31.970248 --- ParallelTerminationStrategy: PID 14784 died... 21:08:31.994645 run iperf3-srv_10.42.42.10(pid=14784): Terminated {rc=256} 21:08:32.042517 --- ParallelTerminationStrategy: PID 14785 died... 21:08:32.062257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14785): Terminated: ok {rc=0} 21:08:32.110944 --- ParallelTerminationStrategy: PID 14786 died... 21:08:32.130520 run iperf3-srv_10.42.42.10(pid=14786): Terminated {rc=256} 21:08:32.178749 --- ParallelTerminationStrategy: PID 14787 died... 21:08:32.198743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14787): Terminated: ok {rc=0} 21:08:32.245644 --- ParallelTerminationStrategy: PID 14788 died... 21:08:32.266084 run iperf3-srv_10.42.42.10(pid=14788): Terminated {rc=256} 21:08:32.313501 --- ParallelTerminationStrategy: PID 14789 died... 21:08:32.332420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14789): Terminated: ok {rc=0} 21:08:32.378267 --- ParallelTerminationStrategy: PID 14790 died... 21:08:32.397266 run iperf3-srv_10.42.42.10(pid=14790): Terminated {rc=256} 21:08:32.442924 --- ParallelTerminationStrategy: PID 14794 died... 21:08:32.461821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14794): Terminated: ok {rc=0} 21:08:32.507338 --- ParallelTerminationStrategy: PID 14797 died... 21:08:32.526742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14797): Terminated: ok {rc=0} 21:08:32.572294 --- ParallelTerminationStrategy: PID 14800 died... 21:08:32.591337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14800): Terminated: ok {rc=0} 21:08:32.678870 bus /gobi_4: Setting Powered False 21:08:33.779336 bus /gobi_4: Setting Powered False 21:08:34.897354 bus /gobi_1: Setting Powered False 21:08:35.995440 bus /gobi_1: Setting Powered False 21:08:37.111130 bus /gobi_0: Setting Powered False 21:08:38.209013 bus /gobi_0: Setting Powered False 21:08:39.325000 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 21:08:40.427387 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:40.438840 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:08:40.482940 tst ping.py: using LAC 16822 21:08:40.598400 tst ping.py: using RAC 247 21:08:40.712164 tst ping.py: using CellId 16822 21:08:40.825666 tst ping.py: using BVCI 16823 21:08:40.931295 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:40.942007 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:40.952491 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:40.963341 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:40.974144 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:40.984779 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:40.995698 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:41.006733 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:08:41.124926 tst ping.py:19: start network... 21:08:41.339208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:08:41.830263 run create_hlr_db(pid=14802): Launched 21:08:41.958715 bus /gobi_6: Setting Powered False 21:08:43.017625 run create_hlr_db(pid=14802): Terminated: ok {rc=0} 21:08:43.462043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14804): Launched 21:08:43.780818 run osmo-hlr_10.42.42.2(pid=14805): Launched 21:08:43.902766 run osmo-stp_10.42.42.5: Starting osmo-stp 21:08:44.453238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14807): Launched 21:08:44.770629 run osmo-stp_10.42.42.5(pid=14808): Launched 21:08:44.892428 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:08:45.439533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14810): Launched 21:08:45.562175 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:08:45.837794 run patchelf(pid=14811): Launched 21:08:46.017815 run osmo-stp_10.42.42.5(pid=14808): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14808)] 21:08:46.149302 run osmo-stp_10.42.42.5(pid=14808): stdout: | (launched: 2022-12-08_21:08:44.712741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:46.281366 run osmo-stp_10.42.42.5(pid=14808): stderr: | [0;m[38;5;43m20221208210844904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210844904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210844905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210844905 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210844905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210844906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210844906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:46.414938 run osmo-stp_10.42.42.5(pid=14808): stdout: | (launched: 2022-12-08_21:08:44.712741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:46.541997 run osmo-stp_10.42.42.5(pid=14808): stderr: | [0;m[38;5;43m20221208210844904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210844904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210844905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210844905 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210844905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210844906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210844906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:46.703857 run patchelf(pid=14811): Terminating (SIGINT) 21:08:46.879949 run patchelf(pid=14811): Terminated: ok {rc=0} 21:08:47.005728 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14808): Process ended prematurely: osmo-stp_10.42.42.5(pid=14808) [trial-2349↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14808)] [trial-2349↪gprs:nanobts+band-1900↪ping.py:22] 21:08:47.015660 tst ping.py:22: Test FAILED (6.6 sec) 21:08:47.045795 run osmo-hlr_10.42.42.2(pid=14805): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14805)] 21:08:47.096246 run osmo-hlr_10.42.42.2(pid=14805): stdout: | (launched: 2022-12-08_21:08:43.722869) 21:08:47.148890 run osmo-hlr_10.42.42.2(pid=14805): stderr: | [0;m[1;31m20221208210843920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210843920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210843920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210843920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210843920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210843920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210843930 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210843939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210843939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210843939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:08:47.202017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14804): Terminating (SIGTERM) 21:08:47.244052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14807): Terminating (SIGTERM) 21:08:47.284472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14810): Terminating (SIGTERM) 21:08:47.325287 --- ParallelTerminationStrategy: PID 14804 died... 21:08:47.344508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14804): Terminated: ok {rc=0} 21:08:47.390022 --- ParallelTerminationStrategy: PID 14807 died... 21:08:47.408770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14807): Terminated: ok {rc=0} 21:08:47.454613 --- ParallelTerminationStrategy: PID 14810 died... 21:08:47.473362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14810): Terminated: ok {rc=0} 21:08:47.560616 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 21:08:48.649611 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:48.661573 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:08:48.704514 tst ping_idle_ping.py: using LAC 16823 21:08:48.832057 tst ping_idle_ping.py: using RAC 248 21:08:48.958806 tst ping_idle_ping.py: using CellId 16823 21:08:49.084163 tst ping_idle_ping.py: using BVCI 16824 21:08:49.199997 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:49.211563 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:49.222952 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:49.234606 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:49.246125 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:49.257662 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:49.269353 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:49.280840 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:08:49.398940 tst ping_idle_ping.py:24: start network... 21:08:49.599022 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:08:50.060078 run create_hlr_db(pid=14812): Launched 21:08:50.176459 bus /gobi_6: Setting Powered False 21:08:51.236133 run create_hlr_db(pid=14812): Terminated: ok {rc=0} 21:08:51.674031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14814): Launched 21:08:51.995772 run osmo-hlr_10.42.42.2(pid=14815): Launched 21:08:52.117712 run osmo-stp_10.42.42.5: Starting osmo-stp 21:08:52.665717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14817): Launched 21:08:52.986311 run osmo-stp_10.42.42.5(pid=14818): Launched 21:08:53.109298 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:08:53.661556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14820): Launched 21:08:53.787300 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:08:54.059141 run patchelf(pid=14821): Launched 21:08:54.237402 run osmo-stp_10.42.42.5(pid=14818): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14818)] 21:08:54.373932 run osmo-stp_10.42.42.5(pid=14818): stdout: | (launched: 2022-12-08_21:08:52.928084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:54.511465 run osmo-stp_10.42.42.5(pid=14818): stderr: | [0;m[38;5;43m20221208210853119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210853119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210853120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210853120 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210853120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210853121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210853121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:54.649292 run osmo-stp_10.42.42.5(pid=14818): stdout: | (launched: 2022-12-08_21:08:52.928084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:54.781215 run osmo-stp_10.42.42.5(pid=14818): stderr: | [0;m[38;5;43m20221208210853119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210853119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210853120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210853120 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210853120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210853121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210853121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:54.937033 run patchelf(pid=14821): Terminating (SIGINT) 21:08:55.117140 run patchelf(pid=14821): Terminated: ok {rc=0} 21:08:55.246386 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14818): Process ended prematurely: osmo-stp_10.42.42.5(pid=14818) [trial-2349↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14818)] [trial-2349↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 21:08:55.255914 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 21:08:55.284023 run osmo-hlr_10.42.42.2(pid=14815): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14815)] 21:08:55.334339 run osmo-hlr_10.42.42.2(pid=14815): stdout: | (launched: 2022-12-08_21:08:51.937522) 21:08:55.386024 run osmo-hlr_10.42.42.2(pid=14815): stderr: | [0;m[1;31m20221208210852135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210852135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210852135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210852135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210852135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210852135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210852147 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210852155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210852155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210852155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:08:55.437877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14814): Terminating (SIGTERM) 21:08:55.479630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14817): Terminating (SIGTERM) 21:08:55.521338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14820): Terminating (SIGTERM) 21:08:55.563287 --- ParallelTerminationStrategy: PID 14814 died... 21:08:55.583383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14814): Terminated: ok {rc=0} 21:08:55.629900 --- ParallelTerminationStrategy: PID 14817 died... 21:08:55.649420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14817): Terminated: ok {rc=0} 21:08:55.695335 --- ParallelTerminationStrategy: PID 14820 died... 21:08:55.714941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14820): Terminated: ok {rc=0} 21:08:55.801577 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 21:08:57.096294 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:08:57.102608 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 21:08:57.126859 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 21:08:57.166347 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 21:08:57.251933 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 21:08:57.275469 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 21:08:57.313727 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 21:08:57.918056 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 21:08:57.970554 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:08:57.982198 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:08:58.022290 tst cs_paging_gprs_active.py: using LAC 16824 21:08:58.149450 tst cs_paging_gprs_active.py: using RAC 249 21:08:58.276916 tst cs_paging_gprs_active.py: using CellId 16824 21:08:58.404124 tst cs_paging_gprs_active.py: using BVCI 16825 21:08:58.522181 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:08:58.533929 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:08:58.545415 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:08:58.557154 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:08:58.568493 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:08:58.580348 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:08:58.592140 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:08:58.603663 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:08:58.615529 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:08:58.733725 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:08:58.850441 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:08:59.053002 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:08:59.356852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14825): Launched 21:08:59.620169 run iperf3-srv_10.42.42.10(pid=14826): Launched 21:08:59.734575 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:08:59.937514 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:00.241852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14827): Launched 21:09:00.504732 run iperf3-srv_10.42.42.10(pid=14828): Launched 21:09:00.618477 tst cs_paging_gprs_active.py:38: start network... 21:09:00.819871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:09:01.420624 run create_hlr_db(pid=14829): Launched 21:09:01.584596 bus /gobi_6: Setting Powered False 21:09:02.649584 run create_hlr_db(pid=14829): Terminated: ok {rc=0} 21:09:03.082676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14831): Launched 21:09:03.386893 run osmo-hlr_10.42.42.2(pid=14832): Launched 21:09:03.505887 run osmo-stp_10.42.42.5: Starting osmo-stp 21:09:04.025636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14834): Launched 21:09:04.329646 run osmo-stp_10.42.42.5(pid=14835): Launched 21:09:04.444934 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:09:04.966514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14837): Launched 21:09:05.084336 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:09:05.339197 run patchelf(pid=14838): Launched 21:09:05.507207 run osmo-stp_10.42.42.5(pid=14835): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14835)] 21:09:05.634654 run osmo-stp_10.42.42.5(pid=14835): stdout: | (launched: 2022-12-08_21:09:04.273436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:05.764464 run osmo-stp_10.42.42.5(pid=14835): stderr: | [0;m[38;5;43m20221208210904446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210904446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210904446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210904447 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210904447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210904447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210904447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:05.893942 run osmo-stp_10.42.42.5(pid=14835): stdout: | (launched: 2022-12-08_21:09:04.273436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:06.017697 run osmo-stp_10.42.42.5(pid=14835): stderr: | [0;m[38;5;43m20221208210904446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210904446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210904446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210904447 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210904447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210904447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210904447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:06.164136 run patchelf(pid=14838): Terminating (SIGINT) 21:09:06.333394 run patchelf(pid=14838): Terminated: ok {rc=0} 21:09:06.455287 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14835): Process ended prematurely: osmo-stp_10.42.42.5(pid=14835) [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14835)] [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 21:09:06.464743 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 21:09:06.491946 run osmo-hlr_10.42.42.2(pid=14832): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14832)] 21:09:06.539777 run osmo-hlr_10.42.42.2(pid=14832): stdout: | (launched: 2022-12-08_21:09:03.331329) 21:09:06.589043 run osmo-hlr_10.42.42.2(pid=14832): stderr: | [0;m[1;31m20221208210903509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210903509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210903509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210903509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210903510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210903510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210903522 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210903531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210903532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210903532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:09:06.638796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14825): Terminating (SIGTERM) 21:09:06.678437 run iperf3-srv_10.42.42.10(pid=14826): Terminating (SIGTERM) 21:09:06.717984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14827): Terminating (SIGTERM) 21:09:06.757703 run iperf3-srv_10.42.42.10(pid=14828): Terminating (SIGTERM) 21:09:06.797303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14831): Terminating (SIGTERM) 21:09:06.837592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14834): Terminating (SIGTERM) 21:09:06.877278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14837): Terminating (SIGTERM) 21:09:06.917352 --- ParallelTerminationStrategy: PID 14825 died... 21:09:06.936268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14825): Terminated: ok {rc=0} 21:09:06.980316 --- ParallelTerminationStrategy: PID 14826 died... 21:09:06.998905 run iperf3-srv_10.42.42.10(pid=14826): Terminated {rc=256} 21:09:07.042764 --- ParallelTerminationStrategy: PID 14827 died... 21:09:07.061337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14827): Terminated: ok {rc=0} 21:09:07.105141 --- ParallelTerminationStrategy: PID 14828 died... 21:09:07.123557 run iperf3-srv_10.42.42.10(pid=14828): Terminated {rc=256} 21:09:07.167260 --- ParallelTerminationStrategy: PID 14831 died... 21:09:07.185745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14831): Terminated: ok {rc=0} 21:09:07.229423 --- ParallelTerminationStrategy: PID 14834 died... 21:09:07.247966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14834): Terminated: ok {rc=0} 21:09:07.291762 --- ParallelTerminationStrategy: PID 14837 died... 21:09:07.310452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14837): Terminated: ok {rc=0} 21:09:07.395410 bus /gobi_0: Setting Powered False 21:09:08.493312 bus /gobi_0: Setting Powered False 21:09:09.609855 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 21:09:10.759164 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:10.771174 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:09:10.816589 tst iperf3.py: using LAC 16825 21:09:10.943809 tst iperf3.py: using RAC 250 21:09:11.063511 tst iperf3.py: using CellId 16825 21:09:11.181953 tst iperf3.py: using BVCI 16826 21:09:11.291409 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:11.302703 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:11.313714 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:11.324646 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:11.336188 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:11.347433 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:11.358543 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:11.369193 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:11.380788 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:11.498129 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:09:11.700757 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:12.005038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14839): Launched 21:09:12.268230 run iperf3-srv_10.42.42.10(pid=14840): Launched 21:09:12.382123 tst iperf3.py:8: start network... 21:09:12.585099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:09:13.051642 run create_hlr_db(pid=14841): Launched 21:09:13.166563 bus /gobi_6: Setting Powered False 21:09:14.227254 run create_hlr_db(pid=14841): Terminated: ok {rc=0} 21:09:14.669214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14843): Launched 21:09:14.995569 run osmo-hlr_10.42.42.2(pid=14844): Launched 21:09:15.120889 run osmo-stp_10.42.42.5: Starting osmo-stp 21:09:15.681594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14846): Launched 21:09:16.019177 run osmo-stp_10.42.42.5(pid=14847): Launched 21:09:16.314107 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:09:16.889844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14849): Launched 21:09:17.015832 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:09:17.294594 run patchelf(pid=14850): Launched 21:09:17.486934 run osmo-stp_10.42.42.5(pid=14847): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14847)] 21:09:17.624440 run osmo-stp_10.42.42.5(pid=14847): stdout: | (launched: 2022-12-08_21:09:15.952437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:17.763170 run osmo-stp_10.42.42.5(pid=14847): stderr: | [0;m[38;5;43m20221208210916193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210916193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210916194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210916194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210916194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210916195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210916195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:17.902862 run osmo-stp_10.42.42.5(pid=14847): stdout: | (launched: 2022-12-08_21:09:15.952437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:18.035763 run osmo-stp_10.42.42.5(pid=14847): stderr: | [0;m[38;5;43m20221208210916193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210916193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210916194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210916194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210916194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210916195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210916195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:18.193545 run patchelf(pid=14850): Terminating (SIGINT) 21:09:18.376179 run patchelf(pid=14850): Terminated: ok {rc=0} 21:09:18.507400 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14847): Process ended prematurely: osmo-stp_10.42.42.5(pid=14847) [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14847)] [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 21:09:18.517510 tst iperf3.py:8: Test FAILED (7.8 sec) 21:09:18.545710 run osmo-hlr_10.42.42.2(pid=14844): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14844)] 21:09:18.595427 run osmo-hlr_10.42.42.2(pid=14844): stdout: | (launched: 2022-12-08_21:09:14.936324) 21:09:18.646429 run osmo-hlr_10.42.42.2(pid=14844): stderr: | [0;m[1;31m20221208210915136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210915136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210915136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210915136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210915136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210915136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210915148 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210915157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210915157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210915157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:09:18.698228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14839): Terminating (SIGTERM) 21:09:18.739826 run iperf3-srv_10.42.42.10(pid=14840): Terminating (SIGTERM) 21:09:18.781812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14843): Terminating (SIGTERM) 21:09:18.823657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14846): Terminating (SIGTERM) 21:09:18.865253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14849): Terminating (SIGTERM) 21:09:18.907241 --- ParallelTerminationStrategy: PID 14839 died... 21:09:18.927116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14839): Terminated: ok {rc=0} 21:09:18.973109 --- ParallelTerminationStrategy: PID 14840 died... 21:09:18.992556 run iperf3-srv_10.42.42.10(pid=14840): Terminated {rc=256} 21:09:19.038457 --- ParallelTerminationStrategy: PID 14843 died... 21:09:19.058060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14843): Terminated: ok {rc=0} 21:09:19.103825 --- ParallelTerminationStrategy: PID 14846 died... 21:09:19.123653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14846): Terminated: ok {rc=0} 21:09:19.169404 --- ParallelTerminationStrategy: PID 14849 died... 21:09:19.188825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14849): Terminated: ok {rc=0} 21:09:19.275914 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 21:09:20.420736 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:20.432295 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:09:20.473186 tst iperf3m4.py: using LAC 16826 21:09:20.592285 tst iperf3m4.py: using RAC 251 21:09:20.710786 tst iperf3m4.py: using CellId 16826 21:09:20.838811 tst iperf3m4.py: using BVCI 16827 21:09:20.957108 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:20.968775 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:20.980237 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:20.991774 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:21.003186 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:21.014518 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:21.026071 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:21.037297 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:21.048658 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:21.164372 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:21.287519 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:21.404614 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:21.525782 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:09:21.745638 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:22.072185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14851): Launched 21:09:22.355034 run iperf3-srv_10.42.42.10(pid=14852): Launched 21:09:22.478537 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:09:22.697553 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:23.024463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14853): Launched 21:09:23.306709 run iperf3-srv_10.42.42.10(pid=14854): Launched 21:09:23.430008 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:09:23.648655 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:23.975653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14855): Launched 21:09:24.259466 run iperf3-srv_10.42.42.10(pid=14856): Launched 21:09:24.382684 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:09:24.602249 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:24.928504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14857): Launched 21:09:25.210987 run iperf3-srv_10.42.42.10(pid=14858): Launched 21:09:25.333904 tst iperf3m4.py:8: start network... 21:09:25.552332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:09:26.058761 run create_hlr_db(pid=14859): Launched 21:09:26.192444 bus /gobi_6: Setting Powered False 21:09:27.256798 run create_hlr_db(pid=14859): Terminated: ok {rc=0} 21:09:27.691053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14861): Launched 21:09:27.994075 run osmo-hlr_10.42.42.2(pid=14862): Launched 21:09:28.109251 run osmo-stp_10.42.42.5: Starting osmo-stp 21:09:28.648402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14864): Launched 21:09:28.951245 run osmo-stp_10.42.42.5(pid=14865): Launched 21:09:29.067751 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:09:29.588938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14867): Launched 21:09:29.713516 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:09:29.991319 run patchelf(pid=14868): Launched 21:09:30.173022 run osmo-stp_10.42.42.5(pid=14865): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14865)] 21:09:30.310855 run osmo-stp_10.42.42.5(pid=14865): stdout: | (launched: 2022-12-08_21:09:28.895420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:30.450169 run osmo-stp_10.42.42.5(pid=14865): stderr: | [0;m[38;5;43m20221208210929067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210929067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210929067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210929067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210929068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210929068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210929068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:30.589720 run osmo-stp_10.42.42.5(pid=14865): stdout: | (launched: 2022-12-08_21:09:28.895420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:30.723316 run osmo-stp_10.42.42.5(pid=14865): stderr: | [0;m[38;5;43m20221208210929067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210929067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210929067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210929067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210929068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210929068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210929068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:30.900637 run patchelf(pid=14868): Terminating (SIGINT) 21:09:31.099573 run patchelf(pid=14868): Terminated: ok {rc=0} 21:09:31.234327 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14865): Process ended prematurely: osmo-stp_10.42.42.5(pid=14865) [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14865)] [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 21:09:31.245278 tst iperf3m4.py:8: Test FAILED (10.9 sec) 21:09:31.275460 run osmo-hlr_10.42.42.2(pid=14862): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14862)] 21:09:31.326396 run osmo-hlr_10.42.42.2(pid=14862): stdout: | (launched: 2022-12-08_21:09:27.938552) 21:09:31.379310 run osmo-hlr_10.42.42.2(pid=14862): stderr: | [0;m[1;31m20221208210928113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210928113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210928113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210928114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210928114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210928114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210928126 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210928137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210928138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210928138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:09:31.432744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14851): Terminating (SIGTERM) 21:09:31.475291 run iperf3-srv_10.42.42.10(pid=14852): Terminating (SIGTERM) 21:09:31.519184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14853): Terminating (SIGTERM) 21:09:31.562378 run iperf3-srv_10.42.42.10(pid=14854): Terminating (SIGTERM) 21:09:31.606103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14855): Terminating (SIGTERM) 21:09:31.648857 run iperf3-srv_10.42.42.10(pid=14856): Terminating (SIGTERM) 21:09:31.691267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14857): Terminating (SIGTERM) 21:09:31.733763 run iperf3-srv_10.42.42.10(pid=14858): Terminating (SIGTERM) 21:09:31.776195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14861): Terminating (SIGTERM) 21:09:31.819732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14864): Terminating (SIGTERM) 21:09:31.864491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14867): Terminating (SIGTERM) 21:09:31.909663 --- ParallelTerminationStrategy: PID 14851 died... 21:09:31.929933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14851): Terminated: ok {rc=0} 21:09:31.976848 --- ParallelTerminationStrategy: PID 14852 died... 21:09:31.996781 run iperf3-srv_10.42.42.10(pid=14852): Terminated {rc=256} 21:09:32.043749 --- ParallelTerminationStrategy: PID 14853 died... 21:09:32.063906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14853): Terminated: ok {rc=0} 21:09:32.110817 --- ParallelTerminationStrategy: PID 14854 died... 21:09:32.130916 run iperf3-srv_10.42.42.10(pid=14854): Terminated {rc=256} 21:09:32.177284 --- ParallelTerminationStrategy: PID 14855 died... 21:09:32.197295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14855): Terminated: ok {rc=0} 21:09:32.243928 --- ParallelTerminationStrategy: PID 14856 died... 21:09:32.263542 run iperf3-srv_10.42.42.10(pid=14856): Terminated {rc=256} 21:09:32.309184 --- ParallelTerminationStrategy: PID 14857 died... 21:09:32.328557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14857): Terminated: ok {rc=0} 21:09:32.374569 --- ParallelTerminationStrategy: PID 14858 died... 21:09:32.393911 run iperf3-srv_10.42.42.10(pid=14858): Terminated {rc=256} 21:09:32.439496 --- ParallelTerminationStrategy: PID 14861 died... 21:09:32.459021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14861): Terminated: ok {rc=0} 21:09:32.504745 --- ParallelTerminationStrategy: PID 14864 died... 21:09:32.524432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14864): Terminated: ok {rc=0} 21:09:32.570124 --- ParallelTerminationStrategy: PID 14867 died... 21:09:32.589755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14867): Terminated: ok {rc=0} 21:09:32.677156 bus /gobi_4: Setting Powered False 21:09:33.776725 bus /gobi_4: Setting Powered False 21:09:34.894386 bus /gobi_1: Setting Powered False 21:09:35.995820 bus /gobi_1: Setting Powered False 21:09:37.113309 bus /gobi_0: Setting Powered False 21:09:38.212355 bus /gobi_0: Setting Powered False 21:09:39.327631 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 21:09:40.430272 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:40.442528 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:09:40.484731 tst ping.py: using LAC 16827 21:09:40.611083 tst ping.py: using RAC 252 21:09:40.741419 tst ping.py: using CellId 16827 21:09:40.866279 tst ping.py: using BVCI 16828 21:09:40.973958 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:40.985154 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:40.996215 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:41.007209 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:41.018899 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:41.030238 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:41.041780 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:41.053138 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:41.172764 tst ping.py:19: start network... 21:09:41.387539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:09:41.879270 run create_hlr_db(pid=14870): Launched 21:09:42.008724 bus /gobi_6: Setting Powered False 21:09:43.072067 run create_hlr_db(pid=14870): Terminated: ok {rc=0} 21:09:43.495866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14872): Launched 21:09:43.793359 run osmo-hlr_10.42.42.2(pid=14873): Launched 21:09:43.906377 run osmo-stp_10.42.42.5: Starting osmo-stp 21:09:44.418790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14875): Launched 21:09:44.715540 run osmo-stp_10.42.42.5(pid=14876): Launched 21:09:44.830481 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:09:45.342469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14878): Launched 21:09:45.456649 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:09:45.707776 run patchelf(pid=14879): Launched 21:09:45.895967 run osmo-stp_10.42.42.5(pid=14876): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14876)] 21:09:46.034909 run osmo-stp_10.42.42.5(pid=14876): stdout: | (launched: 2022-12-08_21:09:44.661428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:46.174982 run osmo-stp_10.42.42.5(pid=14876): stderr: | [0;m[38;5;43m20221208210944829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210944830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210944830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210944830 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210944831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210944831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210944831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:46.316055 run osmo-stp_10.42.42.5(pid=14876): stdout: | (launched: 2022-12-08_21:09:44.661428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:46.450113 run osmo-stp_10.42.42.5(pid=14876): stderr: | [0;m[38;5;43m20221208210944829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210944830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210944830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210944830 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210944831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210944831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210944831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:46.607940 run patchelf(pid=14879): Terminating (SIGINT) 21:09:46.791287 run patchelf(pid=14879): Terminated: ok {rc=0} 21:09:46.924097 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14876): Process ended prematurely: osmo-stp_10.42.42.5(pid=14876) [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14876)] [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 21:09:46.934428 tst ping.py:22: Test FAILED (6.5 sec) 21:09:46.964416 run osmo-hlr_10.42.42.2(pid=14873): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14873)] 21:09:47.016043 run osmo-hlr_10.42.42.2(pid=14873): stdout: | (launched: 2022-12-08_21:09:43.738604) 21:09:47.069361 run osmo-hlr_10.42.42.2(pid=14873): stderr: | [0;m[1;31m20221208210943915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210943915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210943915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210943915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210943915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210943915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210943927 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210943935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210943936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210943936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:09:47.123433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14872): Terminating (SIGTERM) 21:09:47.166875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14875): Terminating (SIGTERM) 21:09:47.211764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14878): Terminating (SIGTERM) 21:09:47.258037 --- ParallelTerminationStrategy: PID 14872 died... 21:09:47.278196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14872): Terminated: ok {rc=0} 21:09:47.324392 --- ParallelTerminationStrategy: PID 14875 died... 21:09:47.344162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14875): Terminated: ok {rc=0} 21:09:47.390083 --- ParallelTerminationStrategy: PID 14878 died... 21:09:47.409662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14878): Terminated: ok {rc=0} 21:09:47.497558 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 21:09:48.581859 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:48.593445 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:09:48.641346 tst ping_idle_ping.py: using LAC 16828 21:09:48.763746 tst ping_idle_ping.py: using RAC 253 21:09:48.880012 tst ping_idle_ping.py: using CellId 16828 21:09:48.995488 tst ping_idle_ping.py: using BVCI 16829 21:09:49.103208 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:49.114325 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:49.125115 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:49.136618 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:49.148157 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:49.159621 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:49.171351 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:49.182819 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:49.303517 tst ping_idle_ping.py:24: start network... 21:09:49.520139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:09:50.022124 run create_hlr_db(pid=14880): Launched 21:09:50.154894 bus /gobi_6: Setting Powered False 21:09:51.218500 run create_hlr_db(pid=14880): Terminated: ok {rc=0} 21:09:51.645434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14882): Launched 21:09:51.944329 run osmo-hlr_10.42.42.2(pid=14883): Launched 21:09:52.057898 run osmo-stp_10.42.42.5: Starting osmo-stp 21:09:52.581755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14885): Launched 21:09:52.879435 run osmo-stp_10.42.42.5(pid=14886): Launched 21:09:52.993533 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:09:53.506008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14888): Launched 21:09:53.623170 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:09:53.874455 run patchelf(pid=14889): Launched 21:09:54.039834 run osmo-stp_10.42.42.5(pid=14886): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14886)] 21:09:54.166245 run osmo-stp_10.42.42.5(pid=14886): stdout: | (launched: 2022-12-08_21:09:52.824756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:54.294078 run osmo-stp_10.42.42.5(pid=14886): stderr: | [0;m[38;5;43m20221208210952995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210952995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210952995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210952996 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210952996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210952996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210952996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:54.421594 run osmo-stp_10.42.42.5(pid=14886): stdout: | (launched: 2022-12-08_21:09:52.824756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:54.543493 run osmo-stp_10.42.42.5(pid=14886): stderr: | [0;m[38;5;43m20221208210952995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208210952995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208210952995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208210952996 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208210952996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208210952996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208210952996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:54.687842 run patchelf(pid=14889): Terminating (SIGINT) 21:09:54.855680 run patchelf(pid=14889): Terminated: ok {rc=0} 21:09:54.976469 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14886): Process ended prematurely: osmo-stp_10.42.42.5(pid=14886) [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14886)] [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 21:09:54.985386 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 21:09:55.012099 run osmo-hlr_10.42.42.2(pid=14883): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14883)] 21:09:55.059783 run osmo-hlr_10.42.42.2(pid=14883): stdout: | (launched: 2022-12-08_21:09:51.889174) 21:09:55.108661 run osmo-hlr_10.42.42.2(pid=14883): stderr: | [0;m[1;31m20221208210952065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208210952065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208210952065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208210952066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208210952066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208210952066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208210952078 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208210952086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208210952087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208210952087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:09:55.158129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14882): Terminating (SIGTERM) 21:09:55.197975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14885): Terminating (SIGTERM) 21:09:55.237680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14888): Terminating (SIGTERM) 21:09:55.277608 --- ParallelTerminationStrategy: PID 14882 died... 21:09:55.296438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14882): Terminated: ok {rc=0} 21:09:55.340793 --- ParallelTerminationStrategy: PID 14885 died... 21:09:55.359249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14885): Terminated: ok {rc=0} 21:09:55.403053 --- ParallelTerminationStrategy: PID 14888 died... 21:09:55.421434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14888): Terminated: ok {rc=0} 21:09:55.504042 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 21:09:56.801184 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:09:56.808624 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 21:09:56.833900 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 21:09:56.874014 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 21:09:56.963101 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 21:09:56.987673 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 21:09:57.026932 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 21:09:57.630502 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 21:09:57.684235 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:09:57.695653 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:09:57.755534 tst cs_paging_gprs_active.py: using LAC 16829 21:09:57.884370 tst cs_paging_gprs_active.py: using RAC 254 21:09:58.002772 tst cs_paging_gprs_active.py: using CellId 16829 21:09:58.121394 tst cs_paging_gprs_active.py: using BVCI 16830 21:09:58.232634 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:09:58.243629 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:09:58.254746 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:09:58.265896 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:09:58.276763 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:09:58.287772 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:09:58.298900 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:09:58.309985 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:09:58.321157 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:09:58.439222 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:09:58.556473 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:09:58.759539 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:59.063228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14893): Launched 21:09:59.327223 run iperf3-srv_10.42.42.10(pid=14894): Launched 21:09:59.441130 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:09:59.643470 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:59.947523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14895): Launched 21:10:00.211474 run iperf3-srv_10.42.42.10(pid=14896): Launched 21:10:00.325227 tst cs_paging_gprs_active.py:38: start network... 21:10:00.527741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:10:01.022040 run create_hlr_db(pid=14897): Launched 21:10:01.204738 bus /gobi_6: Setting Powered False 21:10:02.266444 run create_hlr_db(pid=14897): Terminated: ok {rc=0} 21:10:02.770905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14902): Launched 21:10:03.097674 run osmo-hlr_10.42.42.2(pid=14903): Launched 21:10:03.221292 run osmo-stp_10.42.42.5: Starting osmo-stp 21:10:03.779936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14905): Launched 21:10:04.105933 run osmo-stp_10.42.42.5(pid=14906): Launched 21:10:04.229007 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:10:04.789722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14908): Launched 21:10:04.916126 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:10:05.190977 run patchelf(pid=14909): Launched 21:10:05.373729 run osmo-stp_10.42.42.5(pid=14906): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14906)] 21:10:05.511708 run osmo-stp_10.42.42.5(pid=14906): stdout: | (launched: 2022-12-08_21:10:04.046064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:05.651188 run osmo-stp_10.42.42.5(pid=14906): stderr: | [0;m[38;5;43m20221208211004240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211004240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211004241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211004241 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211004242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211004242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211004242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:05.791170 run osmo-stp_10.42.42.5(pid=14906): stdout: | (launched: 2022-12-08_21:10:04.046064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:05.924854 run osmo-stp_10.42.42.5(pid=14906): stderr: | [0;m[38;5;43m20221208211004240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211004240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211004241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211004241 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211004242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211004242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211004242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:06.083201 run patchelf(pid=14909): Terminating (SIGINT) 21:10:06.266065 run patchelf(pid=14909): Terminated: ok {rc=0} 21:10:06.397653 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14906): Process ended prematurely: osmo-stp_10.42.42.5(pid=14906) [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14906)] [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 21:10:06.408086 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 21:10:06.437075 run osmo-hlr_10.42.42.2(pid=14903): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14903)] 21:10:06.487415 run osmo-hlr_10.42.42.2(pid=14903): stdout: | (launched: 2022-12-08_21:10:03.038048) 21:10:06.539382 run osmo-hlr_10.42.42.2(pid=14903): stderr: | [0;m[1;31m20221208211003238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211003238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211003238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211003238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211003238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211003238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211003250 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211003258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211003258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211003258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:10:06.591963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14893): Terminating (SIGTERM) 21:10:06.634233 run iperf3-srv_10.42.42.10(pid=14894): Terminating (SIGTERM) 21:10:06.676460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14895): Terminating (SIGTERM) 21:10:06.718824 run iperf3-srv_10.42.42.10(pid=14896): Terminating (SIGTERM) 21:10:06.761041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14902): Terminating (SIGTERM) 21:10:06.803127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14905): Terminating (SIGTERM) 21:10:06.845517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14908): Terminating (SIGTERM) 21:10:06.887923 --- ParallelTerminationStrategy: PID 14893 died... 21:10:06.908124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14893): Terminated: ok {rc=0} 21:10:06.954616 --- ParallelTerminationStrategy: PID 14894 died... 21:10:06.974211 run iperf3-srv_10.42.42.10(pid=14894): Terminated {rc=256} 21:10:07.020024 --- ParallelTerminationStrategy: PID 14895 died... 21:10:07.039659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14895): Terminated: ok {rc=0} 21:10:07.085661 --- ParallelTerminationStrategy: PID 14896 died... 21:10:07.104799 run iperf3-srv_10.42.42.10(pid=14896): Terminated {rc=256} 21:10:07.151773 --- ParallelTerminationStrategy: PID 14902 died... 21:10:07.171235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14902): Terminated: ok {rc=0} 21:10:07.217119 --- ParallelTerminationStrategy: PID 14905 died... 21:10:07.236609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14905): Terminated: ok {rc=0} 21:10:07.282361 --- ParallelTerminationStrategy: PID 14908 died... 21:10:07.301941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14908): Terminated: ok {rc=0} 21:10:07.389179 bus /gobi_0: Setting Powered False 21:10:08.488264 bus /gobi_0: Setting Powered False 21:10:09.602526 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 21:10:10.750807 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:10.762919 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:10:10.827304 tst iperf3.py: using LAC 16830 21:10:10.954087 tst iperf3.py: using RAC 255 21:10:11.080577 tst iperf3.py: using CellId 16830 21:10:11.208056 tst iperf3.py: using BVCI 16831 21:10:11.320902 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:11.332055 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:11.342939 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:11.354643 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:11.365842 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:11.376910 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:11.388167 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:11.399196 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:11.410404 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:11.530009 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:10:11.749008 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:10:12.075463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14911): Launched 21:10:12.358402 run iperf3-srv_10.42.42.10(pid=14912): Launched 21:10:12.481814 tst iperf3.py:8: start network... 21:10:12.699929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:10:13.202285 run create_hlr_db(pid=14913): Launched 21:10:13.335472 bus /gobi_6: Setting Powered False 21:10:14.399577 run create_hlr_db(pid=14913): Terminated: ok {rc=0} 21:10:14.850711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14915): Launched 21:10:15.174508 run osmo-hlr_10.42.42.2(pid=14916): Launched 21:10:15.299782 run osmo-stp_10.42.42.5: Starting osmo-stp 21:10:15.886722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14918): Launched 21:10:16.251927 run osmo-stp_10.42.42.5(pid=14919): Launched 21:10:16.482155 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:10:17.153276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14921): Launched 21:10:17.286978 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:10:17.543786 run patchelf(pid=14922): Launched 21:10:17.713426 run osmo-stp_10.42.42.5(pid=14919): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14919)] 21:10:17.841834 run osmo-stp_10.42.42.5(pid=14919): stdout: | (launched: 2022-12-08_21:10:16.184653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:17.971101 run osmo-stp_10.42.42.5(pid=14919): stderr: | [0;m[38;5;43m20221208211016483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211016483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211016484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211016484 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211016490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211016490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211016491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:18.101216 run osmo-stp_10.42.42.5(pid=14919): stdout: | (launched: 2022-12-08_21:10:16.184653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:18.224925 run osmo-stp_10.42.42.5(pid=14919): stderr: | [0;m[38;5;43m20221208211016483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211016483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211016484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211016484 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211016490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211016490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211016491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:18.372407 run patchelf(pid=14922): Terminating (SIGINT) 21:10:18.543155 run patchelf(pid=14922): Terminated: ok {rc=0} 21:10:18.665949 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14919): Process ended prematurely: osmo-stp_10.42.42.5(pid=14919) [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14919)] [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 21:10:18.675495 tst iperf3.py:8: Test FAILED (8.0 sec) 21:10:18.702976 run osmo-hlr_10.42.42.2(pid=14916): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14916)] 21:10:18.750637 run osmo-hlr_10.42.42.2(pid=14916): stdout: | (launched: 2022-12-08_21:10:15.115569) 21:10:18.800072 run osmo-hlr_10.42.42.2(pid=14916): stderr: | [0;m[1;31m20221208211015317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211015317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211015317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211015318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211015318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211015318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211015330 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211015338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211015338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211015338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:10:18.850022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14911): Terminating (SIGTERM) 21:10:18.889905 run iperf3-srv_10.42.42.10(pid=14912): Terminating (SIGTERM) 21:10:18.929598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14915): Terminating (SIGTERM) 21:10:18.969339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14918): Terminating (SIGTERM) 21:10:19.008906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14921): Terminating (SIGTERM) 21:10:19.048910 --- ParallelTerminationStrategy: PID 14911 died... 21:10:19.068013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14911): Terminated: ok {rc=0} 21:10:19.112730 --- ParallelTerminationStrategy: PID 14912 died... 21:10:19.131734 run iperf3-srv_10.42.42.10(pid=14912): Terminated {rc=256} 21:10:19.175805 --- ParallelTerminationStrategy: PID 14915 died... 21:10:19.194450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14915): Terminated: ok {rc=0} 21:10:19.238406 --- ParallelTerminationStrategy: PID 14918 died... 21:10:19.257114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14918): Terminated: ok {rc=0} 21:10:19.301225 --- ParallelTerminationStrategy: PID 14921 died... 21:10:19.319694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14921): Terminated: ok {rc=0} 21:10:19.405923 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 21:10:20.551890 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:20.563737 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:10:20.623655 tst iperf3m4.py: using LAC 16831 21:10:20.742882 tst iperf3m4.py: using RAC 1 21:10:20.863350 tst iperf3m4.py: using CellId 16831 21:10:20.983715 tst iperf3m4.py: using BVCI 16832 21:10:21.094354 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:21.105420 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:21.116255 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:21.127582 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:21.138675 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:21.149713 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:21.160469 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:21.171601 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:21.182792 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:21.303556 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:21.424834 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:21.545181 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:21.666365 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:10:21.886765 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:10:22.211243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14923): Launched 21:10:22.495212 run iperf3-srv_10.42.42.10(pid=14924): Launched 21:10:22.617181 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:10:22.835184 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:10:23.160115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14925): Launched 21:10:23.442602 run iperf3-srv_10.42.42.10(pid=14926): Launched 21:10:23.563898 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:10:23.782352 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:10:24.107750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14934): Launched 21:10:24.389820 run iperf3-srv_10.42.42.10(pid=14935): Launched 21:10:24.512748 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:10:24.729872 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:10:25.054609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14936): Launched 21:10:25.337189 run iperf3-srv_10.42.42.10(pid=14937): Launched 21:10:25.458156 tst iperf3m4.py:8: start network... 21:10:25.675297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:10:26.177814 run create_hlr_db(pid=14938): Launched 21:10:26.310427 bus /gobi_6: Setting Powered False 21:10:27.375148 run create_hlr_db(pid=14938): Terminated: ok {rc=0} 21:10:27.825549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14940): Launched 21:10:28.149976 run osmo-hlr_10.42.42.2(pid=14941): Launched 21:10:28.274325 run osmo-stp_10.42.42.5: Starting osmo-stp 21:10:28.837265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14943): Launched 21:10:29.161161 run osmo-stp_10.42.42.5(pid=14944): Launched 21:10:29.285948 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:10:29.845411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14946): Launched 21:10:29.969626 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:10:30.244690 run patchelf(pid=14947): Launched 21:10:30.426959 run osmo-stp_10.42.42.5(pid=14944): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14944)] 21:10:30.564153 run osmo-stp_10.42.42.5(pid=14944): stdout: | (launched: 2022-12-08_21:10:29.101855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:30.703182 run osmo-stp_10.42.42.5(pid=14944): stderr: | [0;m[38;5;43m20221208211029296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211029296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211029296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211029296 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211029297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211029297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211029297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:30.845910 run osmo-stp_10.42.42.5(pid=14944): stdout: | (launched: 2022-12-08_21:10:29.101855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:30.988385 run osmo-stp_10.42.42.5(pid=14944): stderr: | [0;m[38;5;43m20221208211029296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211029296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211029296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211029296 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211029297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211029297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211029297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:31.144366 run patchelf(pid=14947): Terminating (SIGINT) 21:10:31.320465 run patchelf(pid=14947): Terminated: ok {rc=0} 21:10:31.447938 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14944): Process ended prematurely: osmo-stp_10.42.42.5(pid=14944) [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14944)] [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 21:10:31.458523 tst iperf3m4.py:8: Test FAILED (10.9 sec) 21:10:31.488580 run osmo-hlr_10.42.42.2(pid=14941): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14941)] 21:10:31.541398 run osmo-hlr_10.42.42.2(pid=14941): stdout: | (launched: 2022-12-08_21:10:28.090375) 21:10:31.594055 run osmo-hlr_10.42.42.2(pid=14941): stderr: | [0;m[1;31m20221208211028290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211028290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211028290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211028290 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211028291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211028291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211028303 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211028312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211028312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211028312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:10:31.646577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14923): Terminating (SIGTERM) 21:10:31.689823 run iperf3-srv_10.42.42.10(pid=14924): Terminating (SIGTERM) 21:10:31.736216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14925): Terminating (SIGTERM) 21:10:31.779831 run iperf3-srv_10.42.42.10(pid=14926): Terminating (SIGTERM) 21:10:31.825340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14934): Terminating (SIGTERM) 21:10:31.868912 run iperf3-srv_10.42.42.10(pid=14935): Terminating (SIGTERM) 21:10:31.914881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14936): Terminating (SIGTERM) 21:10:31.958839 run iperf3-srv_10.42.42.10(pid=14937): Terminating (SIGTERM) 21:10:32.004477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14940): Terminating (SIGTERM) 21:10:32.047104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14943): Terminating (SIGTERM) 21:10:32.091126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14946): Terminating (SIGTERM) 21:10:32.136159 --- ParallelTerminationStrategy: PID 14923 died... 21:10:32.156358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14923): Terminated: ok {rc=0} 21:10:32.202866 --- ParallelTerminationStrategy: PID 14924 died... 21:10:32.221618 run iperf3-srv_10.42.42.10(pid=14924): Terminated {rc=256} 21:10:32.267724 --- ParallelTerminationStrategy: PID 14925 died... 21:10:32.286580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14925): Terminated: ok {rc=0} 21:10:32.331956 --- ParallelTerminationStrategy: PID 14926 died... 21:10:32.350815 run iperf3-srv_10.42.42.10(pid=14926): Terminated {rc=256} 21:10:32.396702 --- ParallelTerminationStrategy: PID 14934 died... 21:10:32.415535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14934): Terminated: ok {rc=0} 21:10:32.461070 --- ParallelTerminationStrategy: PID 14935 died... 21:10:32.479737 run iperf3-srv_10.42.42.10(pid=14935): Terminated {rc=256} 21:10:32.525377 --- ParallelTerminationStrategy: PID 14936 died... 21:10:32.544120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14936): Terminated: ok {rc=0} 21:10:32.589637 --- ParallelTerminationStrategy: PID 14937 died... 21:10:32.608375 run iperf3-srv_10.42.42.10(pid=14937): Terminated {rc=256} 21:10:32.653771 --- ParallelTerminationStrategy: PID 14940 died... 21:10:32.672671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14940): Terminated: ok {rc=0} 21:10:32.718541 --- ParallelTerminationStrategy: PID 14943 died... 21:10:32.737457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14943): Terminated: ok {rc=0} 21:10:32.782907 --- ParallelTerminationStrategy: PID 14946 died... 21:10:32.801810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14946): Terminated: ok {rc=0} 21:10:32.889739 bus /gobi_4: Setting Powered False 21:10:33.988935 bus /gobi_4: Setting Powered False 21:10:35.103405 bus /gobi_1: Setting Powered False 21:10:36.201545 bus /gobi_1: Setting Powered False 21:10:37.316077 bus /gobi_0: Setting Powered False 21:10:38.410746 bus /gobi_0: Setting Powered False 21:10:39.527597 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 21:10:40.631382 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:40.643486 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:10:40.705482 tst ping.py: using LAC 16832 21:10:40.830337 tst ping.py: using RAC 2 21:10:40.957378 tst ping.py: using CellId 16832 21:10:41.083184 tst ping.py: using BVCI 16833 21:10:41.200663 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:41.212318 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:41.223626 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:41.235044 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:41.246360 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:41.257714 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:41.269129 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:41.280426 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:41.399128 tst ping.py:19: start network... 21:10:41.614192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:10:42.108743 run create_hlr_db(pid=14949): Launched 21:10:42.239288 bus /gobi_6: Setting Powered False 21:10:43.302537 run create_hlr_db(pid=14949): Terminated: ok {rc=0} 21:10:43.728743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14951): Launched 21:10:44.026607 run osmo-hlr_10.42.42.2(pid=14952): Launched 21:10:44.139865 run osmo-stp_10.42.42.5: Starting osmo-stp 21:10:44.674738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14954): Launched 21:10:44.972343 run osmo-stp_10.42.42.5(pid=14955): Launched 21:10:45.085015 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:10:45.595838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14957): Launched 21:10:45.709958 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:10:45.973803 run patchelf(pid=14958): Launched 21:10:46.162914 run osmo-stp_10.42.42.5(pid=14955): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14955)] 21:10:46.291530 run osmo-stp_10.42.42.5(pid=14955): stdout: | (launched: 2022-12-08_21:10:44.917728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:46.423063 run osmo-stp_10.42.42.5(pid=14955): stderr: | [0;m[38;5;43m20221208211045086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211045086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211045086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211045087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211045089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211045089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211045089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:46.554389 run osmo-stp_10.42.42.5(pid=14955): stdout: | (launched: 2022-12-08_21:10:44.917728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:46.679766 run osmo-stp_10.42.42.5(pid=14955): stderr: | [0;m[38;5;43m20221208211045086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211045086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211045086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211045087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211045089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211045089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211045089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:46.827939 run patchelf(pid=14958): Terminating (SIGINT) 21:10:46.999058 run patchelf(pid=14958): Terminated: ok {rc=0} 21:10:47.121973 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14955): Process ended prematurely: osmo-stp_10.42.42.5(pid=14955) [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14955)] [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 21:10:47.131399 tst ping.py:22: Test FAILED (6.5 sec) 21:10:47.159299 run osmo-hlr_10.42.42.2(pid=14952): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14952)] 21:10:47.207838 run osmo-hlr_10.42.42.2(pid=14952): stdout: | (launched: 2022-12-08_21:10:43.972066) 21:10:47.256821 run osmo-hlr_10.42.42.2(pid=14952): stderr: | [0;m[1;31m20221208211044146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211044146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211044147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211044147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211044147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211044147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211044159 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211044169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211044170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211044170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:10:47.306248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14951): Terminating (SIGTERM) 21:10:47.345890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14954): Terminating (SIGTERM) 21:10:47.385267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14957): Terminating (SIGTERM) 21:10:47.425045 --- ParallelTerminationStrategy: PID 14951 died... 21:10:47.443977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14951): Terminated: ok {rc=0} 21:10:47.488739 --- ParallelTerminationStrategy: PID 14954 died... 21:10:47.507259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14954): Terminated: ok {rc=0} 21:10:47.550993 --- ParallelTerminationStrategy: PID 14957 died... 21:10:47.569353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14957): Terminated: ok {rc=0} 21:10:47.654898 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 21:10:48.744034 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:48.756068 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:10:48.817131 tst ping_idle_ping.py: using LAC 16833 21:10:48.934620 tst ping_idle_ping.py: using RAC 3 21:10:49.053332 tst ping_idle_ping.py: using CellId 16833 21:10:49.173443 tst ping_idle_ping.py: using BVCI 16834 21:10:49.291877 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:49.303643 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:49.315135 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:49.327328 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:49.339355 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:49.351527 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:49.363815 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:49.375975 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:49.493637 tst ping_idle_ping.py:24: start network... 21:10:49.693895 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:10:50.156767 run create_hlr_db(pid=14959): Launched 21:10:50.270461 bus /gobi_6: Setting Powered False 21:10:51.330390 run create_hlr_db(pid=14959): Terminated: ok {rc=0} 21:10:51.768046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14961): Launched 21:10:52.087708 run osmo-hlr_10.42.42.2(pid=14962): Launched 21:10:52.209405 run osmo-stp_10.42.42.5: Starting osmo-stp 21:10:52.756732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14964): Launched 21:10:53.075227 run osmo-stp_10.42.42.5(pid=14965): Launched 21:10:53.197228 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:10:53.747381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14967): Launched 21:10:53.870316 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:10:54.139957 run patchelf(pid=14968): Launched 21:10:54.317186 run osmo-stp_10.42.42.5(pid=14965): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14965)] 21:10:54.452140 run osmo-stp_10.42.42.5(pid=14965): stdout: | (launched: 2022-12-08_21:10:53.017193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:54.589209 run osmo-stp_10.42.42.5(pid=14965): stderr: | [0;m[38;5;43m20221208211053208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211053208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211053208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211053209 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211053209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211053209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211053209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:54.725445 run osmo-stp_10.42.42.5(pid=14965): stdout: | (launched: 2022-12-08_21:10:53.017193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:54.855828 run osmo-stp_10.42.42.5(pid=14965): stderr: | [0;m[38;5;43m20221208211053208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211053208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211053208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211053209 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211053209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211053209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211053209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:55.010227 run patchelf(pid=14968): Terminating (SIGINT) 21:10:55.189268 run patchelf(pid=14968): Terminated: ok {rc=0} 21:10:55.318418 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14965): Process ended prematurely: osmo-stp_10.42.42.5(pid=14965) [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14965)] [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 21:10:55.327840 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 21:10:55.355737 run osmo-hlr_10.42.42.2(pid=14962): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14962)] 21:10:55.405498 run osmo-hlr_10.42.42.2(pid=14962): stdout: | (launched: 2022-12-08_21:10:52.029274) 21:10:55.457071 run osmo-hlr_10.42.42.2(pid=14962): stderr: | [0;m[1;31m20221208211052228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211052228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211052228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211052228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211052228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211052228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211052241 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211052251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211052251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211052251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:10:55.508877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14961): Terminating (SIGTERM) 21:10:55.550460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14964): Terminating (SIGTERM) 21:10:55.592410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14967): Terminating (SIGTERM) 21:10:55.634410 --- ParallelTerminationStrategy: PID 14961 died... 21:10:55.654253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14961): Terminated: ok {rc=0} 21:10:55.700268 --- ParallelTerminationStrategy: PID 14964 died... 21:10:55.719570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14964): Terminated: ok {rc=0} 21:10:55.765845 --- ParallelTerminationStrategy: PID 14967 died... 21:10:55.785312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14967): Terminated: ok {rc=0} 21:10:55.873498 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 21:10:57.164170 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:10:57.171996 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:10:57.198327 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 21:10:57.233651 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:10:57.287601 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:10:57.312152 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 21:10:57.347618 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:10:57.912381 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2349 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 21:10:57.917711 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:10:57.929799 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:10:57.990568 tst switch_tch_pdch.py: using LAC 16834 21:10:58.114414 tst switch_tch_pdch.py: using RAC 4 21:10:58.240287 tst switch_tch_pdch.py: using CellId 16834 21:10:58.366220 tst switch_tch_pdch.py: using BVCI 16835 21:10:58.482819 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:10:58.494973 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:10:58.506900 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:10:58.518811 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:10:58.530757 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:10:58.542679 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:10:58.554632 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:10:58.566667 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:10:58.683566 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:10:58.799420 tst switch_tch_pdch.py:51: start network... 21:10:58.998656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:10:59.455917 run create_hlr_db(pid=14972): Launched 21:10:59.569748 bus /gobi_6: Setting Powered False 21:11:00.629409 run create_hlr_db(pid=14972): Terminated: ok {rc=0} 21:11:01.049733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14974): Launched 21:11:01.358425 run osmo-hlr_10.42.42.2(pid=14975): Launched 21:11:01.588015 run osmo-stp_10.42.42.5: Starting osmo-stp 21:11:02.298231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14977): Launched 21:11:02.610651 run osmo-stp_10.42.42.5(pid=14978): Launched 21:11:02.724671 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:11:03.237287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14980): Launched 21:11:03.351109 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:11:03.601519 run patchelf(pid=14981): Launched 21:11:03.767261 run osmo-stp_10.42.42.5(pid=14978): ERR: Terminated: ERROR {rc=1} [trial-2349↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14978)] 21:11:03.893643 run osmo-stp_10.42.42.5(pid=14978): stdout: | (launched: 2022-12-08_21:11:02.555674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:04.021067 run osmo-stp_10.42.42.5(pid=14978): stderr: | [0;m[38;5;43m20221208211102724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211102724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211102724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211102725 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211102726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211102726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211102726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:04.148515 run osmo-stp_10.42.42.5(pid=14978): stdout: | (launched: 2022-12-08_21:11:02.555674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:04.270163 run osmo-stp_10.42.42.5(pid=14978): stderr: | [0;m[38;5;43m20221208211102724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211102724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211102724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211102725 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211102726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211102726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211102726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:04.414332 run patchelf(pid=14981): Terminating (SIGINT) 21:11:04.581294 run patchelf(pid=14981): Terminated: ok {rc=0} 21:11:04.702347 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14978): Process ended prematurely: osmo-stp_10.42.42.5(pid=14978) [trial-2349↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14978)] [trial-2349↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 21:11:04.711243 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 21:11:04.738360 run osmo-hlr_10.42.42.2(pid=14975): ERR: Terminated: ERROR {rc=237} [trial-2349↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14975)] 21:11:04.785781 run osmo-hlr_10.42.42.2(pid=14975): stdout: | (launched: 2022-12-08_21:11:01.302912) 21:11:04.835408 run osmo-hlr_10.42.42.2(pid=14975): stderr: | [0;m[1;31m20221208211101638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211101638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211101638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211101638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211101638 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211101639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211101654 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211101672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211101675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211101677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:11:04.885439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14974): Terminating (SIGTERM) 21:11:04.925402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14977): Terminating (SIGTERM) 21:11:04.965093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14980): Terminating (SIGTERM) 21:11:05.004993 --- ParallelTerminationStrategy: PID 14974 died... 21:11:05.023921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14974): Terminated: ok {rc=0} 21:11:05.068532 --- ParallelTerminationStrategy: PID 14977 died... 21:11:05.087046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14977): Terminated: ok {rc=0} 21:11:05.130880 --- ParallelTerminationStrategy: PID 14980 died... 21:11:05.149333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14980): Terminated: ok {rc=0} 21:11:05.232637 bus /gobi_0: Setting Powered False 21:11:06.329677 bus /gobi_0: Setting Powered False 21:11:07.444813 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 sms:nanobts+band-900 --------------------------------------------------------------------- 21:11:08.691274 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:11:08.696434 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 21:11:08.729696 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 21:11:08.757103 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 21:11:08.810589 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 21:11:08.843846 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 21:11:08.871721 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 21:11:09.418860 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 21:11:09.423999 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:09.435068 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 21:11:09.481945 tst mo_mt_sms.py: using LAC 16835 21:11:09.605758 tst mo_mt_sms.py: using RAC 5 21:11:09.733491 tst mo_mt_sms.py: using CellId 16835 21:11:09.850789 tst mo_mt_sms.py: using BVCI 16836 21:11:09.959072 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:09.969905 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:09.980819 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:09.991776 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:10.002743 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:10.013613 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 21:11:10.133609 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 21:11:10.255528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:11:10.748436 run create_hlr_db(pid=14985): Launched 21:11:10.878096 bus /gobi_6: Setting Powered False 21:11:11.941632 run create_hlr_db(pid=14985): Terminated: ok {rc=0} 21:11:12.366490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14987): Launched 21:11:12.663076 run osmo-hlr_10.42.42.2(pid=14988): Launched 21:11:12.776807 run osmo-stp_10.42.42.5: Starting osmo-stp 21:11:13.302246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14990): Launched 21:11:13.599125 run osmo-stp_10.42.42.5(pid=14991): Launched 21:11:13.712031 run osmo-msc_10.42.42.6: Starting osmo-msc 21:11:14.247150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14993): Launched 21:11:14.545143 run osmo-msc_10.42.42.6(pid=14994): Launched 21:11:14.711236 run osmo-stp_10.42.42.5(pid=14991): ERR: Terminated: ERROR {rc=1} [trial-2349↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14991)] 21:11:14.837285 run osmo-stp_10.42.42.5(pid=14991): stdout: | (launched: 2022-12-08_21:11:13.544004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:14.963365 run osmo-stp_10.42.42.5(pid=14991): stderr: | [0;m[38;5;43m20221208211113711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211113711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211113711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211113712 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211113714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211113714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211113714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:15.087382 run osmo-stp_10.42.42.5(pid=14991): stdout: | (launched: 2022-12-08_21:11:13.544004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:15.205590 run osmo-stp_10.42.42.5(pid=14991): stderr: | [0;m[38;5;43m20221208211113711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211113711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211113711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211113712 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211113714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211113714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211113714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:15.347110 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=14991): Process ended prematurely: osmo-stp_10.42.42.5(pid=14991) [trial-2349↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14991)] [trial-2349↪sms:nanobts+band-900↪mo_mt_sms.py:16] 21:11:15.355253 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 21:11:15.381200 run osmo-hlr_10.42.42.2(pid=14988): ERR: Terminated: ERROR {rc=237} [trial-2349↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14988)] 21:11:15.429060 run osmo-hlr_10.42.42.2(pid=14988): stdout: | (launched: 2022-12-08_21:11:12.608750) 21:11:15.478187 run osmo-hlr_10.42.42.2(pid=14988): stderr: | [0;m[1;31m20221208211112786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211112786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211112786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211112786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211112786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211112786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211112802 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211112811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211112811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211112811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:11:15.546736 run osmo-msc_10.42.42.6(pid=14994): ERR: Terminated: ERROR {rc=2} [trial-2349↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14994)] 21:11:15.594427 run osmo-msc_10.42.42.6(pid=14994): stdout: | (launched: 2022-12-08_21:11:14.490007) 21:11:15.643263 run osmo-msc_10.42.42.6(pid=14994): stderr: | [0;m[38;5;43m20221208211114763 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211114763 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fae56778c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211114764 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211114764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211114764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211114764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211114766 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211114766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211114766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211114766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:11:15.692688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14987): Terminating (SIGTERM) 21:11:15.732187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14990): Terminating (SIGTERM) 21:11:15.771714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14993): Terminating (SIGTERM) 21:11:15.811559 --- ParallelTerminationStrategy: PID 14987 died... 21:11:15.831026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14987): Terminated: ok {rc=0} 21:11:15.876407 --- ParallelTerminationStrategy: PID 14990 died... 21:11:15.900160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14990): Terminated: ok {rc=0} 21:11:15.945146 --- ParallelTerminationStrategy: PID 14993 died... 21:11:15.964065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14993): Terminated: ok {rc=0} 21:11:16.063836 bus /sierra_3: Setting Powered False 21:11:17.164354 bus /sierra_3: Setting Powered False 21:11:18.283503 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 21:11:19.515004 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:11:19.519574 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 21:11:19.551707 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 21:11:19.558477 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 21:11:19.593096 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 21:11:19.625195 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 21:11:19.631779 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 21:11:20.151421 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2349 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 21:11:20.156262 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 21:11:20.167100 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 21:11:20.214563 tst assert_extension.py: using LAC 16836 21:11:20.333334 tst assert_extension.py: using RAC 6 21:11:20.458748 tst assert_extension.py: using CellId 16836 21:11:20.585334 tst assert_extension.py: using BVCI 16837 21:11:20.702369 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 21:11:20.819235 tst assert_extension.py:10: start nitb and bts... 21:11:21.034799 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:11:21.682840 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15000): Launched 21:11:22.002096 run osmo-nitb_10.42.42.2(pid=15001): Launched 21:11:22.179970 run osmo-nitb_10.42.42.2(pid=15001): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15001)] 21:11:22.323384 run osmo-nitb_10.42.42.2(pid=15001): stdout: | (launched: 2022-12-08_21:11:21.944147) 21:11:22.468033 run osmo-nitb_10.42.42.2(pid=15001): stderr: | (launched: 2022-12-08_21:11:21.991557) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:11:22.612844 run osmo-nitb_10.42.42.2(pid=15001): stdout: | (launched: 2022-12-08_21:11:21.944147) 21:11:22.750923 run osmo-nitb_10.42.42.2(pid=15001): stderr: | (launched: 2022-12-08_21:11:21.991557) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8fda692268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15001): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15001) [trial-2349↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15001)] 21:11:23.123427 tst osmo-nitb_10.42.42.2(pid=15001): stdout: | (launched: 2022-12-08_21:11:21.944147) 21:11:23.251332 tst osmo-nitb_10.42.42.2(pid=15001): stderr: | (launched: 2022-12-08_21:11:21.991557) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:11:23.402569 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=15001): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15001) [trial-2349↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15001)] [trial-2349↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 21:11:23.411458 tst assert_extension.py:12: Test FAILED (3.2 sec) 21:11:23.418481 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15000): Terminating (SIGTERM) 21:11:23.628490 --- ParallelTerminationStrategy: PID 15000 died... 21:11:23.649821 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15000): Terminated: ok {rc=0} 21:11:23.736479 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 ussd:nanobts+band-900 --------------------------------------------------------------------- 21:11:24.914651 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:11:24.919822 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 21:11:24.952739 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 21:11:24.979232 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 21:11:25.015345 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 21:11:25.048594 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 21:11:25.076110 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 21:11:25.602038 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2349 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 21:11:25.608325 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:25.620573 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 21:11:25.667928 tst assert_extension.py: using LAC 16837 21:11:25.791547 tst assert_extension.py: using RAC 7 21:11:25.916246 tst assert_extension.py: using CellId 16837 21:11:26.044204 tst assert_extension.py: using BVCI 16838 21:11:26.159003 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:26.170167 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:26.181173 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:26.192143 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:26.203166 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:26.214131 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 21:11:26.331018 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:11:26.790031 run create_hlr_db(pid=15005): Launched 21:11:26.906320 bus /sierra_2: Setting Powered False 21:11:27.966040 run create_hlr_db(pid=15005): Terminated: ok {rc=0} 21:11:28.381258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15007): Launched 21:11:28.678168 run osmo-hlr_10.42.42.2(pid=15008): Launched 21:11:28.791901 run osmo-stp_10.42.42.5: Starting osmo-stp 21:11:29.318296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15010): Launched 21:11:29.618174 run osmo-stp_10.42.42.5(pid=15011): Launched 21:11:29.732201 run osmo-msc_10.42.42.6: Starting osmo-msc 21:11:30.267453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15013): Launched 21:11:30.564839 run osmo-msc_10.42.42.6(pid=15014): Launched 21:11:30.731369 run osmo-stp_10.42.42.5(pid=15011): ERR: Terminated: ERROR {rc=1} [trial-2349↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15011)] 21:11:30.904693 run osmo-stp_10.42.42.5(pid=15011): stdout: | (launched: 2022-12-08_21:11:29.562868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:31.070821 run osmo-stp_10.42.42.5(pid=15011): stderr: | [0;m[38;5;43m20221208211129733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211129733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211129733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211129734 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211129734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211129734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211129734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:31.198963 run osmo-stp_10.42.42.5(pid=15011): stdout: | (launched: 2022-12-08_21:11:29.562868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:31.320653 run osmo-stp_10.42.42.5(pid=15011): stderr: | [0;m[38;5;43m20221208211129733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211129733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211129733 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211129734 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211129734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211129734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211129734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:31.466522 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=15011): Process ended prematurely: osmo-stp_10.42.42.5(pid=15011) [trial-2349↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15011)] [trial-2349↪ussd:nanobts+band-900↪assert_extension.py:17] 21:11:31.475843 tst assert_extension.py:17: Test FAILED (5.9 sec) 21:11:31.505381 run osmo-hlr_10.42.42.2(pid=15008): ERR: Terminated: ERROR {rc=237} [trial-2349↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15008)] 21:11:31.555764 run osmo-hlr_10.42.42.2(pid=15008): stdout: | (launched: 2022-12-08_21:11:28.623622) 21:11:31.607837 run osmo-hlr_10.42.42.2(pid=15008): stderr: | [0;m[1;31m20221208211128799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211128799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211128799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211128799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211128799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211128799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211128824 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211128834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211128834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211128834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:11:31.680025 run osmo-msc_10.42.42.6(pid=15014): ERR: Terminated: ERROR {rc=2} [trial-2349↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15014)] 21:11:31.730250 run osmo-msc_10.42.42.6(pid=15014): stdout: | (launched: 2022-12-08_21:11:30.509694) 21:11:31.782349 run osmo-msc_10.42.42.6(pid=15014): stderr: | [0;m[38;5;43m20221208211130781 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211130782 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1a1c572c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211130782 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211130782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211130782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211130783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211130784 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211130785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211130785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211130785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:11:31.834930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15007): Terminating (SIGTERM) 21:11:31.877701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15010): Terminating (SIGTERM) 21:11:31.920511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15013): Terminating (SIGTERM) 21:11:31.964907 --- ParallelTerminationStrategy: PID 15007 died... 21:11:31.984903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15007): Terminated: ok {rc=0} 21:11:32.033926 --- ParallelTerminationStrategy: PID 15010 died... 21:11:32.053478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15010): Terminated: ok {rc=0} 21:11:32.101107 --- ParallelTerminationStrategy: PID 15013 died... 21:11:32.120477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15013): Terminated: ok {rc=0} 21:11:32.209362 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 21:11:33.425203 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:11:33.433488 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 21:11:33.466617 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 21:11:33.493954 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 21:11:33.545768 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 21:11:33.579476 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 21:11:33.606702 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 21:11:34.162654 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 21:11:34.214583 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:34.226013 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:11:34.291268 tst mo_mt_call.py: using LAC 16838 21:11:34.408883 tst mo_mt_call.py: using RAC 8 21:11:34.527042 tst mo_mt_call.py: using CellId 16838 21:11:34.654894 tst mo_mt_call.py: using BVCI 16839 21:11:34.772078 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:34.783991 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:34.795538 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:34.807167 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:34.818804 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:34.830344 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:11:34.951920 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:11:35.067890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:11:35.534608 run create_hlr_db(pid=15019): Launched 21:11:35.650779 bus /sierra_2: Setting Powered False 21:11:36.711383 run create_hlr_db(pid=15019): Terminated: ok {rc=0} 21:11:37.154961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15021): Launched 21:11:37.480645 run osmo-hlr_10.42.42.2(pid=15022): Launched 21:11:37.607652 run osmo-stp_10.42.42.5: Starting osmo-stp 21:11:38.165503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15024): Launched 21:11:38.489761 run osmo-stp_10.42.42.5(pid=15025): Launched 21:11:38.614106 run osmo-msc_10.42.42.6: Starting osmo-msc 21:11:39.200734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15027): Launched 21:11:39.525792 run osmo-msc_10.42.42.6(pid=15028): Launched 21:11:39.707161 run osmo-stp_10.42.42.5(pid=15025): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15025)] 21:11:39.843992 run osmo-stp_10.42.42.5(pid=15025): stdout: | (launched: 2022-12-08_21:11:38.430277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:39.983481 run osmo-stp_10.42.42.5(pid=15025): stderr: | [0;m[38;5;43m20221208211138625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211138625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211138625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211138626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211138626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211138626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211138626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:40.119675 run osmo-stp_10.42.42.5(pid=15025): stdout: | (launched: 2022-12-08_21:11:38.430277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:40.247994 run osmo-stp_10.42.42.5(pid=15025): stderr: | [0;m[38;5;43m20221208211138625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211138625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211138625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211138626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211138626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211138626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211138626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:40.402025 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15025): Process ended prematurely: osmo-stp_10.42.42.5(pid=15025) [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15025)] [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 21:11:40.411520 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 21:11:40.439261 run osmo-hlr_10.42.42.2(pid=15022): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15022)] 21:11:40.489070 run osmo-hlr_10.42.42.2(pid=15022): stdout: | (launched: 2022-12-08_21:11:37.421669) 21:11:40.540257 run osmo-hlr_10.42.42.2(pid=15022): stderr: | [0;m[1;31m20221208211137622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211137622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211137622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211137622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211137622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211137622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211137635 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211137643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211137644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211137644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:11:40.612320 run osmo-msc_10.42.42.6(pid=15028): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15028)] 21:11:40.661935 run osmo-msc_10.42.42.6(pid=15028): stdout: | (launched: 2022-12-08_21:11:39.466526) 21:11:40.713226 run osmo-msc_10.42.42.6(pid=15028): stderr: | [0;m[38;5;43m20221208211139791 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211139791 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f822d712c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211139792 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211139792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211139792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211139792 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211139794 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211139794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211139794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211139794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:11:40.764627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15021): Terminating (SIGTERM) 21:11:40.806264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15024): Terminating (SIGTERM) 21:11:40.847972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15027): Terminating (SIGTERM) 21:11:40.890350 --- ParallelTerminationStrategy: PID 15021 died... 21:11:40.910609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15021): Terminated: ok {rc=0} 21:11:40.957267 --- ParallelTerminationStrategy: PID 15024 died... 21:11:40.976658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15024): Terminated: ok {rc=0} 21:11:41.022956 --- ParallelTerminationStrategy: PID 15027 died... 21:11:41.042529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15027): Terminated: ok {rc=0} 21:11:41.130716 bus /sierra_3: Setting Powered False 21:11:42.230466 bus /sierra_3: Setting Powered False 21:11:43.348992 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 21:11:44.498308 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:44.510625 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:11:44.579971 tst mo_mt_call_osmux.py: using LAC 16839 21:11:44.707215 tst mo_mt_call_osmux.py: using RAC 9 21:11:44.835679 tst mo_mt_call_osmux.py: using CellId 16839 21:11:44.963662 tst mo_mt_call_osmux.py: using BVCI 16840 21:11:45.083146 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:45.094887 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:45.106445 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:45.118011 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:45.129679 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:45.141239 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:11:45.262211 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:11:45.381323 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:11:45.851339 run create_hlr_db(pid=15030): Launched 21:11:46.021814 bus /sierra_2: Setting Powered False 21:11:47.081927 run create_hlr_db(pid=15030): Terminated: ok {rc=0} 21:11:47.535243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15032): Launched 21:11:47.839587 run osmo-hlr_10.42.42.2(pid=15033): Launched 21:11:47.955447 run osmo-stp_10.42.42.5: Starting osmo-stp 21:11:48.485837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15035): Launched 21:11:48.789424 run osmo-stp_10.42.42.5(pid=15036): Launched 21:11:48.904638 run osmo-msc_10.42.42.6: Starting osmo-msc 21:11:49.450883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15038): Launched 21:11:49.754232 run osmo-msc_10.42.42.6(pid=15039): Launched 21:11:49.926077 run osmo-stp_10.42.42.5(pid=15036): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15036)] 21:11:50.055776 run osmo-stp_10.42.42.5(pid=15036): stdout: | (launched: 2022-12-08_21:11:48.733160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:50.185346 run osmo-stp_10.42.42.5(pid=15036): stderr: | [0;m[38;5;43m20221208211148905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211148905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211148905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211148906 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211148906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211148906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211148906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:50.311744 run osmo-stp_10.42.42.5(pid=15036): stdout: | (launched: 2022-12-08_21:11:48.733160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:50.431508 run osmo-stp_10.42.42.5(pid=15036): stderr: | [0;m[38;5;43m20221208211148905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211148905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211148905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211148906 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211148906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211148906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211148906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:50.575019 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15036): Process ended prematurely: osmo-stp_10.42.42.5(pid=15036) [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15036)] [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 21:11:50.583896 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 21:11:50.610731 run osmo-hlr_10.42.42.2(pid=15033): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15033)] 21:11:50.658291 run osmo-hlr_10.42.42.2(pid=15033): stdout: | (launched: 2022-12-08_21:11:47.783919) 21:11:50.707428 run osmo-hlr_10.42.42.2(pid=15033): stderr: | [0;m[1;31m20221208211147961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211147961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211147961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211147961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211147961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211147961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211147973 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211147982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211147983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211147983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:11:50.776355 run osmo-msc_10.42.42.6(pid=15039): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15039)] 21:11:50.824038 run osmo-msc_10.42.42.6(pid=15039): stdout: | (launched: 2022-12-08_21:11:49.698436) 21:11:50.873378 run osmo-msc_10.42.42.6(pid=15039): stderr: | [0;m[38;5;43m20221208211149970 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211149970 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f94e0a4ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211149970 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211149970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211149971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211149971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211149972 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211149973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211149973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211149973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:11:50.922825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15032): Terminating (SIGTERM) 21:11:50.962849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15035): Terminating (SIGTERM) 21:11:51.002832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15038): Terminating (SIGTERM) 21:11:51.042957 --- ParallelTerminationStrategy: PID 15032 died... 21:11:51.062011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15032): Terminated: ok {rc=0} 21:11:51.106177 --- ParallelTerminationStrategy: PID 15035 died... 21:11:51.124860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15035): Terminated: ok {rc=0} 21:11:51.169103 --- ParallelTerminationStrategy: PID 15038 died... 21:11:51.187720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15038): Terminated: ok {rc=0} 21:11:51.273105 bus /sierra_3: Setting Powered False 21:11:52.373379 bus /sierra_3: Setting Powered False 21:11:53.487248 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 21:11:54.736751 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:11:54.743971 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 21:11:54.776647 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 21:11:54.803210 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 21:11:54.854579 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 21:11:54.886411 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 21:11:54.912673 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 21:11:55.465251 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 21:11:55.513778 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:11:55.524919 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:11:55.591265 tst mo_mt_call.py: using LAC 16840 21:11:55.709140 tst mo_mt_call.py: using RAC 10 21:11:55.828890 tst mo_mt_call.py: using CellId 16840 21:11:55.946493 tst mo_mt_call.py: using BVCI 16841 21:11:56.055652 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:11:56.066886 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:11:56.078014 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:11:56.089244 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:11:56.100557 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:11:56.111857 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:11:56.233496 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:11:56.351931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:11:56.818508 run create_hlr_db(pid=15044): Launched 21:11:56.936025 bus /sierra_2: Setting Powered False 21:11:57.997325 run create_hlr_db(pid=15044): Terminated: ok {rc=0} 21:11:58.440185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15046): Launched 21:11:58.764827 run osmo-hlr_10.42.42.2(pid=15047): Launched 21:11:58.890329 run osmo-stp_10.42.42.5: Starting osmo-stp 21:11:59.452407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15049): Launched 21:11:59.777148 run osmo-stp_10.42.42.5(pid=15050): Launched 21:11:59.901455 run osmo-msc_10.42.42.6: Starting osmo-msc 21:12:00.488299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15052): Launched 21:12:00.812322 run osmo-msc_10.42.42.6(pid=15053): Launched 21:12:01.139469 run osmo-stp_10.42.42.5(pid=15050): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15050)] 21:12:01.366253 run osmo-stp_10.42.42.5(pid=15050): stdout: | (launched: 2022-12-08_21:11:59.717524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:01.612335 run osmo-stp_10.42.42.5(pid=15050): stderr: | [0;m[38;5;43m20221208211159912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211159912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211159912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211159913 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211159913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211159913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211159913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:01.751378 run osmo-stp_10.42.42.5(pid=15050): stdout: | (launched: 2022-12-08_21:11:59.717524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:01.883909 run osmo-stp_10.42.42.5(pid=15050): stderr: | [0;m[38;5;43m20221208211159912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211159912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211159912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211159913 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211159913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211159913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211159913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:02.041393 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15050): Process ended prematurely: osmo-stp_10.42.42.5(pid=15050) [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15050)] [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 21:12:02.051452 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 21:12:02.080341 run osmo-hlr_10.42.42.2(pid=15047): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15047)] 21:12:02.131311 run osmo-hlr_10.42.42.2(pid=15047): stdout: | (launched: 2022-12-08_21:11:58.705952) 21:12:02.183793 run osmo-hlr_10.42.42.2(pid=15047): stderr: | [0;m[1;31m20221208211158903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211158903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211158904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211158904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211158904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211158904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211158916 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211158925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211158925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211158925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:12:02.256337 run osmo-msc_10.42.42.6(pid=15053): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15053)] 21:12:02.306869 run osmo-msc_10.42.42.6(pid=15053): stdout: | (launched: 2022-12-08_21:12:00.753067) 21:12:02.358056 run osmo-msc_10.42.42.6(pid=15053): stderr: | [0;m[38;5;43m20221208211201310 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211201310 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6e4ffc6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211201310 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211201310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211201310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211201311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211201312 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211201313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211201313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211201313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:12:02.409716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15046): Terminating (SIGTERM) 21:12:02.451243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15049): Terminating (SIGTERM) 21:12:02.492748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15052): Terminating (SIGTERM) 21:12:02.534806 --- ParallelTerminationStrategy: PID 15046 died... 21:12:02.554655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15046): Terminated: ok {rc=0} 21:12:02.601114 --- ParallelTerminationStrategy: PID 15049 died... 21:12:02.621271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15049): Terminated: ok {rc=0} 21:12:02.667344 --- ParallelTerminationStrategy: PID 15052 died... 21:12:02.686793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15052): Terminated: ok {rc=0} 21:12:02.774484 bus /sierra_3: Setting Powered False 21:12:03.874197 bus /sierra_3: Setting Powered False 21:12:04.989280 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 21:12:06.138795 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:12:06.151238 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:12:06.219776 tst mo_mt_call_osmux.py: using LAC 16841 21:12:06.346717 tst mo_mt_call_osmux.py: using RAC 11 21:12:06.474621 tst mo_mt_call_osmux.py: using CellId 16841 21:12:06.602960 tst mo_mt_call_osmux.py: using BVCI 16842 21:12:06.722489 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:12:06.734277 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:12:06.745807 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:12:06.757324 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:12:06.768832 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:12:06.780367 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:12:06.896595 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:12:07.017134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:12:07.522616 run create_hlr_db(pid=15055): Launched 21:12:07.656186 bus /sierra_2: Setting Powered False 21:12:08.721238 run create_hlr_db(pid=15055): Terminated: ok {rc=0} 21:12:09.174135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15057): Launched 21:12:09.500201 run osmo-hlr_10.42.42.2(pid=15058): Launched 21:12:09.623548 run osmo-stp_10.42.42.5: Starting osmo-stp 21:12:10.181369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15060): Launched 21:12:10.506502 run osmo-stp_10.42.42.5(pid=15061): Launched 21:12:10.633951 run osmo-msc_10.42.42.6: Starting osmo-msc 21:12:11.216406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15063): Launched 21:12:11.537636 run osmo-msc_10.42.42.6(pid=15064): Launched 21:12:11.715947 run osmo-stp_10.42.42.5(pid=15061): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15061)] 21:12:11.850951 run osmo-stp_10.42.42.5(pid=15061): stdout: | (launched: 2022-12-08_21:12:10.446914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:11.987640 run osmo-stp_10.42.42.5(pid=15061): stderr: | [0;m[38;5;43m20221208211210643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211210643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211210643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211210644 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211210644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211210644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211210644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:12.122545 run osmo-stp_10.42.42.5(pid=15061): stdout: | (launched: 2022-12-08_21:12:10.446914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:12.250081 run osmo-stp_10.42.42.5(pid=15061): stderr: | [0;m[38;5;43m20221208211210643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211210643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211210643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211210644 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211210644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211210644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211210644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:12.402700 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15061): Process ended prematurely: osmo-stp_10.42.42.5(pid=15061) [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15061)] [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 21:12:12.412090 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:12:12.439427 run osmo-hlr_10.42.42.2(pid=15058): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15058)] 21:12:12.489151 run osmo-hlr_10.42.42.2(pid=15058): stdout: | (launched: 2022-12-08_21:12:09.440457) 21:12:12.540332 run osmo-hlr_10.42.42.2(pid=15058): stderr: | [0;m[1;31m20221208211209643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211209643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211209643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211209643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211209643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211209643 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211209656 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211209665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211209665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211209665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:12:12.611956 run osmo-msc_10.42.42.6(pid=15064): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15064)] 21:12:12.661259 run osmo-msc_10.42.42.6(pid=15064): stdout: | (launched: 2022-12-08_21:12:11.479028) 21:12:12.712296 run osmo-msc_10.42.42.6(pid=15064): stderr: | [0;m[38;5;43m20221208211211802 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211211802 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fba07db8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211211802 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211211802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211211802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211211802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211211804 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211211804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211211805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211211805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:12:12.763486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15057): Terminating (SIGTERM) 21:12:12.805010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15060): Terminating (SIGTERM) 21:12:12.846882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15063): Terminating (SIGTERM) 21:12:12.888859 --- ParallelTerminationStrategy: PID 15057 died... 21:12:12.908379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15057): Terminated: ok {rc=0} 21:12:12.954312 --- ParallelTerminationStrategy: PID 15060 died... 21:12:12.973687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15060): Terminated: ok {rc=0} 21:12:13.019205 --- ParallelTerminationStrategy: PID 15063 died... 21:12:13.038556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15063): Terminated: ok {rc=0} 21:12:13.124547 bus /sierra_3: Setting Powered False 21:12:14.221212 bus /sierra_3: Setting Powered False 21:12:15.336031 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 21:12:16.619711 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:12:16.631960 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 21:12:16.681885 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 21:12:16.725066 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 21:12:16.790023 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 21:12:16.830527 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 21:12:16.866897 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 21:12:17.400776 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 21:12:17.450946 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:17.462308 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:12:17.529129 tst mo_mt_call.py: using LAC 16842 21:12:17.648038 tst mo_mt_call.py: using RAC 12 21:12:17.776318 tst mo_mt_call.py: using CellId 16842 21:12:17.903508 tst mo_mt_call.py: using BVCI 16843 21:12:18.022478 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:18.034326 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:18.046005 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:18.057674 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:18.069665 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:18.081217 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:12:18.201665 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:12:18.317172 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:12:18.779319 run create_hlr_db(pid=15069): Launched 21:12:18.894879 bus /sierra_2: Setting Powered False 21:12:19.954539 run create_hlr_db(pid=15069): Terminated: ok {rc=0} 21:12:20.394437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15071): Launched 21:12:20.717326 run osmo-hlr_10.42.42.2(pid=15072): Launched 21:12:20.839940 run osmo-stp_10.42.42.5: Starting osmo-stp 21:12:21.395395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15074): Launched 21:12:21.717523 run osmo-stp_10.42.42.5(pid=15075): Launched 21:12:21.839767 run osmo-msc_10.42.42.6: Starting osmo-msc 21:12:22.423658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15077): Launched 21:12:22.749739 run osmo-msc_10.42.42.6(pid=15078): Launched 21:12:22.919885 run osmo-stp_10.42.42.5(pid=15075): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15075)] 21:12:23.048726 run osmo-stp_10.42.42.5(pid=15075): stdout: | (launched: 2022-12-08_21:12:21.658684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:23.180817 run osmo-stp_10.42.42.5(pid=15075): stderr: | [0;m[38;5;43m20221208211221851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211221851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211221852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211221852 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211221853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211221853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211221853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:23.307281 run osmo-stp_10.42.42.5(pid=15075): stdout: | (launched: 2022-12-08_21:12:21.658684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:23.427043 run osmo-stp_10.42.42.5(pid=15075): stderr: | [0;m[38;5;43m20221208211221851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211221851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211221852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211221852 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211221853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211221853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211221853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:23.570316 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15075): Process ended prematurely: osmo-stp_10.42.42.5(pid=15075) [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15075)] [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 21:12:23.579335 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 21:12:23.606762 run osmo-hlr_10.42.42.2(pid=15072): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15072)] 21:12:23.655014 run osmo-hlr_10.42.42.2(pid=15072): stdout: | (launched: 2022-12-08_21:12:20.658377) 21:12:23.704454 run osmo-hlr_10.42.42.2(pid=15072): stderr: | [0;m[1;31m20221208211220857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211220857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211220857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211220857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211220857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211220857 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211220870 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211220878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211220878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211220878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:12:23.773633 run osmo-msc_10.42.42.6(pid=15078): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15078)] 21:12:23.821360 run osmo-msc_10.42.42.6(pid=15078): stdout: | (launched: 2022-12-08_21:12:22.687566) 21:12:23.870468 run osmo-msc_10.42.42.6(pid=15078): stderr: | [0;m[38;5;43m20221208211222967 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211222967 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7c5a4a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211222967 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211222967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211222967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211222968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211222971 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211222972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211222972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211222972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:12:23.920460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15071): Terminating (SIGTERM) 21:12:23.960007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15074): Terminating (SIGTERM) 21:12:23.999544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15077): Terminating (SIGTERM) 21:12:24.039683 --- ParallelTerminationStrategy: PID 15071 died... 21:12:24.058809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15071): Terminated: ok {rc=0} 21:12:24.103130 --- ParallelTerminationStrategy: PID 15074 died... 21:12:24.121847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15074): Terminated: ok {rc=0} 21:12:24.166447 --- ParallelTerminationStrategy: PID 15077 died... 21:12:24.185022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15077): Terminated: ok {rc=0} 21:12:24.271207 bus /sierra_3: Setting Powered False 21:12:25.370385 bus /sierra_3: Setting Powered False 21:12:26.484802 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 21:12:27.630307 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:27.642184 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:12:27.709249 tst mo_mt_call_osmux.py: using LAC 16843 21:12:27.828289 tst mo_mt_call_osmux.py: using RAC 13 21:12:27.946975 tst mo_mt_call_osmux.py: using CellId 16843 21:12:28.071039 tst mo_mt_call_osmux.py: using BVCI 16844 21:12:28.181291 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:28.192533 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:28.203666 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:28.214858 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:28.226162 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:28.237518 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:12:28.357092 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:12:28.481626 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:12:28.981790 run create_hlr_db(pid=15080): Launched 21:12:29.113681 bus /sierra_2: Setting Powered False 21:12:30.177584 run create_hlr_db(pid=15080): Terminated: ok {rc=0} 21:12:30.607824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15082): Launched 21:12:30.925935 run osmo-hlr_10.42.42.2(pid=15083): Launched 21:12:31.081268 run osmo-stp_10.42.42.5: Starting osmo-stp 21:12:31.785776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15085): Launched 21:12:32.099070 run osmo-stp_10.42.42.5(pid=15086): Launched 21:12:32.298781 run osmo-msc_10.42.42.6: Starting osmo-msc 21:12:32.883420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15088): Launched 21:12:33.207127 run osmo-msc_10.42.42.6(pid=15089): Launched 21:12:33.389218 run osmo-stp_10.42.42.5(pid=15086): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15086)] 21:12:33.526512 run osmo-stp_10.42.42.5(pid=15086): stdout: | (launched: 2022-12-08_21:12:32.040262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:33.662710 run osmo-stp_10.42.42.5(pid=15086): stderr: | [0;m[38;5;43m20221208211232405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211232406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211232406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211232406 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211232407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211232407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211232407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:33.798466 run osmo-stp_10.42.42.5(pid=15086): stdout: | (launched: 2022-12-08_21:12:32.040262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:33.926848 run osmo-stp_10.42.42.5(pid=15086): stderr: | [0;m[38;5;43m20221208211232405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211232406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211232406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211232406 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211232407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211232407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211232407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:34.080157 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15086): Process ended prematurely: osmo-stp_10.42.42.5(pid=15086) [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15086)] [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 21:12:34.089767 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 21:12:34.117021 run osmo-hlr_10.42.42.2(pid=15083): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15083)] 21:12:34.166119 run osmo-hlr_10.42.42.2(pid=15083): stdout: | (launched: 2022-12-08_21:12:30.855020) 21:12:34.216899 run osmo-hlr_10.42.42.2(pid=15083): stderr: | [0;m[1;31m20221208211231224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211231224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211231224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211231224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211231224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211231224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211231250 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211231272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211231272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211231272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:12:34.287884 run osmo-msc_10.42.42.6(pid=15089): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15089)] 21:12:34.336916 run osmo-msc_10.42.42.6(pid=15089): stdout: | (launched: 2022-12-08_21:12:33.147436) 21:12:34.387780 run osmo-msc_10.42.42.6(pid=15089): stderr: | [0;m[38;5;43m20221208211233472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211233472 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f259667fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211233472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211233472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211233472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211233472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211233474 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211233474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211233475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211233475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:12:34.438844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15082): Terminating (SIGTERM) 21:12:34.480122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15085): Terminating (SIGTERM) 21:12:34.521545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15088): Terminating (SIGTERM) 21:12:34.563144 --- ParallelTerminationStrategy: PID 15082 died... 21:12:34.583009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15082): Terminated: ok {rc=0} 21:12:34.628609 --- ParallelTerminationStrategy: PID 15085 died... 21:12:34.648013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15085): Terminated: ok {rc=0} 21:12:34.694010 --- ParallelTerminationStrategy: PID 15088 died... 21:12:34.713447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15088): Terminated: ok {rc=0} 21:12:34.800142 bus /sierra_3: Setting Powered False 21:12:35.897909 bus /sierra_3: Setting Powered False 21:12:37.012585 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 21:12:38.264285 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:12:38.271334 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 21:12:38.303686 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 21:12:38.330041 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 21:12:38.382552 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 21:12:38.414836 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 21:12:38.441136 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 21:12:38.991486 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 21:12:39.039885 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:12:39.051099 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:12:39.117291 tst mo_mt_call.py: using LAC 16844 21:12:39.235763 tst mo_mt_call.py: using RAC 14 21:12:39.354099 tst mo_mt_call.py: using CellId 16844 21:12:39.473685 tst mo_mt_call.py: using BVCI 16845 21:12:39.593156 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:12:39.605007 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:12:39.616596 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:12:39.628812 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:12:39.641063 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:12:39.653207 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:12:39.771695 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:12:39.887710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:12:40.352022 run create_hlr_db(pid=15096): Launched 21:12:40.467706 bus /sierra_2: Setting Powered False 21:12:41.527130 run create_hlr_db(pid=15096): Terminated: ok {rc=0} 21:12:41.967280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15098): Launched 21:12:42.290028 run osmo-hlr_10.42.42.2(pid=15099): Launched 21:12:42.413064 run osmo-stp_10.42.42.5: Starting osmo-stp 21:12:42.971378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15101): Launched 21:12:43.293598 run osmo-stp_10.42.42.5(pid=15102): Launched 21:12:43.417661 run osmo-msc_10.42.42.6: Starting osmo-msc 21:12:44.001984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15104): Launched 21:12:44.323812 run osmo-msc_10.42.42.6(pid=15105): Launched 21:12:44.503035 run osmo-stp_10.42.42.5(pid=15102): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15102)] 21:12:44.638550 run osmo-stp_10.42.42.5(pid=15102): stdout: | (launched: 2022-12-08_21:12:43.234886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:44.774161 run osmo-stp_10.42.42.5(pid=15102): stderr: | [0;m[38;5;43m20221208211243428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211243428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211243428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211243429 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211243431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211243431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211243431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:44.909594 run osmo-stp_10.42.42.5(pid=15102): stdout: | (launched: 2022-12-08_21:12:43.234886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:45.037086 run osmo-stp_10.42.42.5(pid=15102): stderr: | [0;m[38;5;43m20221208211243428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211243428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211243428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211243429 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211243431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211243431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211243431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:45.189443 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15102): Process ended prematurely: osmo-stp_10.42.42.5(pid=15102) [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15102)] [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 21:12:45.198992 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 21:12:45.226819 run osmo-hlr_10.42.42.2(pid=15099): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15099)] 21:12:45.276550 run osmo-hlr_10.42.42.2(pid=15099): stdout: | (launched: 2022-12-08_21:12:42.231161) 21:12:45.328358 run osmo-hlr_10.42.42.2(pid=15099): stderr: | [0;m[1;31m20221208211242431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211242431 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211242432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211242432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211242432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211242432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211242444 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211242452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211242452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211242452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:12:45.400173 run osmo-msc_10.42.42.6(pid=15105): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15105)] 21:12:45.450300 run osmo-msc_10.42.42.6(pid=15105): stdout: | (launched: 2022-12-08_21:12:44.264826) 21:12:45.501532 run osmo-msc_10.42.42.6(pid=15105): stderr: | [0;m[38;5;43m20221208211244587 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211244587 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb619461c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211244587 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211244587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211244587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211244588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211244589 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211244590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211244590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211244590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:12:45.553135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15098): Terminating (SIGTERM) 21:12:45.594491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15101): Terminating (SIGTERM) 21:12:45.635906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15104): Terminating (SIGTERM) 21:12:45.677727 --- ParallelTerminationStrategy: PID 15098 died... 21:12:45.697769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15098): Terminated: ok {rc=0} 21:12:45.743866 --- ParallelTerminationStrategy: PID 15101 died... 21:12:45.763502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15101): Terminated: ok {rc=0} 21:12:45.809401 --- ParallelTerminationStrategy: PID 15104 died... 21:12:45.829811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15104): Terminated: ok {rc=0} 21:12:45.953354 bus /sierra_3: Setting Powered False 21:12:47.050405 bus /sierra_3: Setting Powered False 21:12:48.167271 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 21:12:49.311329 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:12:49.323164 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:12:49.389892 tst mo_mt_call_osmux.py: using LAC 16845 21:12:49.507613 tst mo_mt_call_osmux.py: using RAC 15 21:12:49.626644 tst mo_mt_call_osmux.py: using CellId 16845 21:12:49.747860 tst mo_mt_call_osmux.py: using BVCI 16846 21:12:49.866963 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:12:49.878818 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:12:49.890510 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:12:49.902783 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:12:49.914701 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:12:49.926369 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:12:50.043745 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:12:50.163864 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:12:50.664338 run create_hlr_db(pid=15107): Launched 21:12:50.795081 bus /sierra_2: Setting Powered False 21:12:51.859189 run create_hlr_db(pid=15107): Terminated: ok {rc=0} 21:12:52.307276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15109): Launched 21:12:52.608065 run osmo-hlr_10.42.42.2(pid=15110): Launched 21:12:52.722407 run osmo-stp_10.42.42.5: Starting osmo-stp 21:12:53.239181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15112): Launched 21:12:53.540162 run osmo-stp_10.42.42.5(pid=15113): Launched 21:12:53.654694 run osmo-msc_10.42.42.6: Starting osmo-msc 21:12:54.196383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15115): Launched 21:12:54.496551 run osmo-msc_10.42.42.6(pid=15116): Launched 21:12:54.664762 run osmo-stp_10.42.42.5(pid=15113): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15113)] 21:12:54.792875 run osmo-stp_10.42.42.5(pid=15113): stdout: | (launched: 2022-12-08_21:12:53.484447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:54.921306 run osmo-stp_10.42.42.5(pid=15113): stderr: | [0;m[38;5;43m20221208211253658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211253658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211253659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211253659 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211253659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211253660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211253660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:55.046834 run osmo-stp_10.42.42.5(pid=15113): stdout: | (launched: 2022-12-08_21:12:53.484447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:55.165736 run osmo-stp_10.42.42.5(pid=15113): stderr: | [0;m[38;5;43m20221208211253658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211253658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211253659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211253659 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211253659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211253660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211253660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:55.308417 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15113): Process ended prematurely: osmo-stp_10.42.42.5(pid=15113) [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15113)] [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 21:12:55.317317 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 21:12:55.343685 run osmo-hlr_10.42.42.2(pid=15110): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15110)] 21:12:55.391862 run osmo-hlr_10.42.42.2(pid=15110): stdout: | (launched: 2022-12-08_21:12:52.552517) 21:12:55.441215 run osmo-hlr_10.42.42.2(pid=15110): stderr: | [0;m[1;31m20221208211252728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211252728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211252728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211252728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211252728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211252728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211252741 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211252751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211252751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211252751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:12:55.509982 run osmo-msc_10.42.42.6(pid=15116): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15116)] 21:12:55.557628 run osmo-msc_10.42.42.6(pid=15116): stdout: | (launched: 2022-12-08_21:12:54.440928) 21:12:55.606558 run osmo-msc_10.42.42.6(pid=15116): stderr: | [0;m[38;5;43m20221208211254713 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211254713 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8a5dcccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211254713 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211254713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211254713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211254713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211254715 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211254715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211254716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211254716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:12:55.655937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15109): Terminating (SIGTERM) 21:12:55.695498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15112): Terminating (SIGTERM) 21:12:55.735002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15115): Terminating (SIGTERM) 21:12:55.774685 --- ParallelTerminationStrategy: PID 15109 died... 21:12:55.793499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15109): Terminated: ok {rc=0} 21:12:55.837503 --- ParallelTerminationStrategy: PID 15112 died... 21:12:55.855918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15112): Terminated: ok {rc=0} 21:12:55.899655 --- ParallelTerminationStrategy: PID 15115 died... 21:12:55.918142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15115): Terminated: ok {rc=0} 21:12:56.000688 bus /sierra_3: Setting Powered False 21:12:57.098293 bus /sierra_3: Setting Powered False 21:12:58.214619 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:12:59.462426 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:12:59.469548 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:12:59.502327 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 21:12:59.529210 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:12:59.580503 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:12:59.612519 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 21:12:59.639039 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:13:00.192097 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 21:13:00.245835 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:00.257656 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:13:00.326575 tst mo_mt_call.py: using LAC 16846 21:13:00.454067 tst mo_mt_call.py: using RAC 16 21:13:00.581736 tst mo_mt_call.py: using CellId 16846 21:13:00.709826 tst mo_mt_call.py: using BVCI 16847 21:13:00.826494 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:00.839313 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:00.851594 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:00.864219 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:00.876559 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:00.888599 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:13:01.011622 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:13:01.165953 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:13:01.675515 run create_hlr_db(pid=15121): Launched 21:13:01.838890 bus /sierra_2: Setting Powered False 21:13:02.903398 run create_hlr_db(pid=15121): Terminated: ok {rc=0} 21:13:03.352717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15123): Launched 21:13:03.675614 run osmo-hlr_10.42.42.2(pid=15124): Launched 21:13:03.798053 run osmo-stp_10.42.42.5: Starting osmo-stp 21:13:04.355076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15126): Launched 21:13:04.677553 run osmo-stp_10.42.42.5(pid=15127): Launched 21:13:04.800632 run osmo-msc_10.42.42.6: Starting osmo-msc 21:13:05.382790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15129): Launched 21:13:05.703969 run osmo-msc_10.42.42.6(pid=15130): Launched 21:13:05.881849 run osmo-stp_10.42.42.5(pid=15127): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15127)] 21:13:06.017684 run osmo-stp_10.42.42.5(pid=15127): stdout: | (launched: 2022-12-08_21:13:04.618671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:06.153346 run osmo-stp_10.42.42.5(pid=15127): stderr: | [0;m[38;5;43m20221208211304811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211304811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211304811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211304812 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211304812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211304812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211304812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:06.288323 run osmo-stp_10.42.42.5(pid=15127): stdout: | (launched: 2022-12-08_21:13:04.618671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:06.415699 run osmo-stp_10.42.42.5(pid=15127): stderr: | [0;m[38;5;43m20221208211304811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211304811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211304811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211304812 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211304812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211304812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211304812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:06.567981 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15127): Process ended prematurely: osmo-stp_10.42.42.5(pid=15127) [trial-2349↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15127)] [trial-2349↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 21:13:06.577347 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 21:13:06.604726 run osmo-hlr_10.42.42.2(pid=15124): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15124)] 21:13:06.654014 run osmo-hlr_10.42.42.2(pid=15124): stdout: | (launched: 2022-12-08_21:13:03.616664) 21:13:06.704876 run osmo-hlr_10.42.42.2(pid=15124): stderr: | [0;m[1;31m20221208211303818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211303818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211303818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211303818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211303818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211303818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211303831 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211303840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211303841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211303841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:13:06.776077 run osmo-msc_10.42.42.6(pid=15130): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15130)] 21:13:06.825179 run osmo-msc_10.42.42.6(pid=15130): stdout: | (launched: 2022-12-08_21:13:05.645234) 21:13:06.875997 run osmo-msc_10.42.42.6(pid=15130): stderr: | [0;m[38;5;43m20221208211305969 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211305969 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f002cc38c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211305969 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211305969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211305970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211305970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211305971 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211305972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211305972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211305972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:13:06.927902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15123): Terminating (SIGTERM) 21:13:06.969255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15126): Terminating (SIGTERM) 21:13:07.010552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15129): Terminating (SIGTERM) 21:13:07.051905 --- ParallelTerminationStrategy: PID 15123 died... 21:13:07.071371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15123): Terminated: ok {rc=0} 21:13:07.117180 --- ParallelTerminationStrategy: PID 15126 died... 21:13:07.136413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15126): Terminated: ok {rc=0} 21:13:07.182092 --- ParallelTerminationStrategy: PID 15129 died... 21:13:07.201527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15129): Terminated: ok {rc=0} 21:13:07.287465 bus /sierra_3: Setting Powered False 21:13:08.384590 bus /sierra_3: Setting Powered False 21:13:09.501178 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 21:13:10.646159 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:10.658252 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:13:10.726447 tst mo_mt_call_osmux.py: using LAC 16847 21:13:10.845272 tst mo_mt_call_osmux.py: using RAC 17 21:13:10.963611 tst mo_mt_call_osmux.py: using CellId 16847 21:13:11.083875 tst mo_mt_call_osmux.py: using BVCI 16848 21:13:11.193175 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:11.204553 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:11.215651 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:11.227229 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:11.238972 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:11.250518 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:13:11.369754 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:13:11.486467 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:13:11.953757 run create_hlr_db(pid=15132): Launched 21:13:12.068563 bus /sierra_2: Setting Powered False 21:13:13.129232 run create_hlr_db(pid=15132): Terminated: ok {rc=0} 21:13:13.570273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15134): Launched 21:13:13.893973 run osmo-hlr_10.42.42.2(pid=15135): Launched 21:13:14.017275 run osmo-stp_10.42.42.5: Starting osmo-stp 21:13:14.575370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15137): Launched 21:13:14.898109 run osmo-stp_10.42.42.5(pid=15138): Launched 21:13:15.022111 run osmo-msc_10.42.42.6: Starting osmo-msc 21:13:15.606190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15140): Launched 21:13:15.939220 run osmo-msc_10.42.42.6(pid=15141): Launched 21:13:16.504032 run osmo-stp_10.42.42.5(pid=15138): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15138)] 21:13:16.770018 run osmo-stp_10.42.42.5(pid=15138): stdout: | (launched: 2022-12-08_21:13:14.839251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:16.908808 run osmo-stp_10.42.42.5(pid=15138): stderr: | [0;m[38;5;43m20221208211315031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211315032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211315032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211315032 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211315033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211315033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211315033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:17.045948 run osmo-stp_10.42.42.5(pid=15138): stdout: | (launched: 2022-12-08_21:13:14.839251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:17.176053 run osmo-stp_10.42.42.5(pid=15138): stderr: | [0;m[38;5;43m20221208211315031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211315032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211315032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211315032 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211315033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211315033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211315033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:17.331013 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15138): Process ended prematurely: osmo-stp_10.42.42.5(pid=15138) [trial-2349↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15138)] [trial-2349↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 21:13:17.340594 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 21:13:17.368542 run osmo-hlr_10.42.42.2(pid=15135): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15135)] 21:13:17.418491 run osmo-hlr_10.42.42.2(pid=15135): stdout: | (launched: 2022-12-08_21:13:13.835181) 21:13:17.470153 run osmo-hlr_10.42.42.2(pid=15135): stderr: | [0;m[1;31m20221208211314032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211314032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211314032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211314033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211314033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211314033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211314045 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211314053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211314054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211314054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:13:17.542404 run osmo-msc_10.42.42.6(pid=15141): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15141)] 21:13:17.590616 run osmo-msc_10.42.42.6(pid=15141): stdout: | (launched: 2022-12-08_21:13:15.871131) 21:13:17.640195 run osmo-msc_10.42.42.6(pid=15141): stderr: | [0;m[38;5;43m20221208211316413 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211316413 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f627b063c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211316414 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211316414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211316415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211316416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211316420 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211316421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211316421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211316422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:13:17.690398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15134): Terminating (SIGTERM) 21:13:17.730469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15137): Terminating (SIGTERM) 21:13:17.770751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15140): Terminating (SIGTERM) 21:13:17.811205 --- ParallelTerminationStrategy: PID 15134 died... 21:13:17.830215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15134): Terminated: ok {rc=0} 21:13:17.875526 --- ParallelTerminationStrategy: PID 15137 died... 21:13:17.894129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15137): Terminated: ok {rc=0} 21:13:17.939214 --- ParallelTerminationStrategy: PID 15140 died... 21:13:17.957828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15140): Terminated: ok {rc=0} 21:13:18.043903 bus /sierra_3: Setting Powered False 21:13:19.143094 bus /sierra_3: Setting Powered False 21:13:20.258430 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 21:13:21.505858 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:13:21.512490 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 21:13:21.545163 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 21:13:21.571808 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 21:13:21.623172 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 21:13:21.655324 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 21:13:21.681806 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 21:13:22.239277 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 21:13:22.287547 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:22.298933 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:13:22.346822 tst mo_mt_call.py: using LAC 16848 21:13:22.465575 tst mo_mt_call.py: using RAC 18 21:13:22.591058 tst mo_mt_call.py: using CellId 16848 21:13:22.716816 tst mo_mt_call.py: using BVCI 16849 21:13:22.836348 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:22.848197 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:22.859844 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:22.871658 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:22.883412 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:22.895076 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 21:13:23.016853 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 21:13:23.138727 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:13:23.638295 run create_hlr_db(pid=15146): Launched 21:13:23.770092 bus /sierra_2: Setting Powered False 21:13:24.834045 run create_hlr_db(pid=15146): Terminated: ok {rc=0} 21:13:25.264007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15148): Launched 21:13:25.563984 run osmo-hlr_10.42.42.2(pid=15149): Launched 21:13:25.678947 run osmo-stp_10.42.42.5: Starting osmo-stp 21:13:26.208242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15151): Launched 21:13:26.507744 run osmo-stp_10.42.42.5(pid=15152): Launched 21:13:26.621941 run osmo-msc_10.42.42.6: Starting osmo-msc 21:13:27.162772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15154): Launched 21:13:27.463375 run osmo-msc_10.42.42.6(pid=15155): Launched 21:13:27.631394 run osmo-stp_10.42.42.5(pid=15152): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15152)] 21:13:27.759017 run osmo-stp_10.42.42.5(pid=15152): stdout: | (launched: 2022-12-08_21:13:26.452633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:27.886433 run osmo-stp_10.42.42.5(pid=15152): stderr: | [0;m[38;5;43m20221208211326624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211326624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211326624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211326625 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211326625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211326625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211326625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:28.011558 run osmo-stp_10.42.42.5(pid=15152): stdout: | (launched: 2022-12-08_21:13:26.452633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:28.130222 run osmo-stp_10.42.42.5(pid=15152): stderr: | [0;m[38;5;43m20221208211326624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211326624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211326624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211326625 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211326625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211326625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211326625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:28.272753 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15152): Process ended prematurely: osmo-stp_10.42.42.5(pid=15152) [trial-2349↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15152)] [trial-2349↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 21:13:28.281515 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 21:13:28.308049 run osmo-hlr_10.42.42.2(pid=15149): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15149)] 21:13:28.355295 run osmo-hlr_10.42.42.2(pid=15149): stdout: | (launched: 2022-12-08_21:13:25.508870) 21:13:28.404138 run osmo-hlr_10.42.42.2(pid=15149): stderr: | [0;m[1;31m20221208211325684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211325684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211325684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211325684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211325684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211325684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211325697 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211325706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211325706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211325706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:13:28.472844 run osmo-msc_10.42.42.6(pid=15155): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15155)] 21:13:28.520002 run osmo-msc_10.42.42.6(pid=15155): stdout: | (launched: 2022-12-08_21:13:27.407664) 21:13:28.568722 run osmo-msc_10.42.42.6(pid=15155): stderr: | [0;m[38;5;43m20221208211327680 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211327680 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcc725b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211327680 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211327680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211327680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211327681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211327683 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211327683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211327683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211327684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:13:28.618101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15148): Terminating (SIGTERM) 21:13:28.657582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15151): Terminating (SIGTERM) 21:13:28.697236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15154): Terminating (SIGTERM) 21:13:28.736894 --- ParallelTerminationStrategy: PID 15148 died... 21:13:28.756006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15148): Terminated: ok {rc=0} 21:13:28.800241 --- ParallelTerminationStrategy: PID 15151 died... 21:13:28.818866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15151): Terminated: ok {rc=0} 21:13:28.863000 --- ParallelTerminationStrategy: PID 15154 died... 21:13:28.881569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15154): Terminated: ok {rc=0} 21:13:28.965133 bus /sierra_3: Setting Powered False 21:13:30.059734 bus /sierra_3: Setting Powered False 21:13:31.187700 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 21:13:32.353495 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:32.365581 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:13:32.416360 tst mo_mt_call_osmux.py: using LAC 16849 21:13:32.535750 tst mo_mt_call_osmux.py: using RAC 19 21:13:32.654382 tst mo_mt_call_osmux.py: using CellId 16849 21:13:32.773378 tst mo_mt_call_osmux.py: using BVCI 16850 21:13:32.882668 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:32.894177 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:32.905562 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:32.916933 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:32.928522 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:32.940078 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 21:13:33.055969 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 21:13:33.176822 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:13:33.677616 run create_hlr_db(pid=15157): Launched 21:13:33.808855 bus /sierra_2: Setting Powered False 21:13:34.873074 run create_hlr_db(pid=15157): Terminated: ok {rc=0} 21:13:35.323593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15159): Launched 21:13:35.645696 run osmo-hlr_10.42.42.2(pid=15160): Launched 21:13:35.767534 run osmo-stp_10.42.42.5: Starting osmo-stp 21:13:36.326769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15162): Launched 21:13:36.649823 run osmo-stp_10.42.42.5(pid=15163): Launched 21:13:36.771954 run osmo-msc_10.42.42.6: Starting osmo-msc 21:13:37.354938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15165): Launched 21:13:37.678233 run osmo-msc_10.42.42.6(pid=15166): Launched 21:13:37.859194 run osmo-stp_10.42.42.5(pid=15163): ERR: Terminated: ERROR {rc=1} [trial-2349↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15163)] 21:13:37.996512 run osmo-stp_10.42.42.5(pid=15163): stdout: | (launched: 2022-12-08_21:13:36.590646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:38.133957 run osmo-stp_10.42.42.5(pid=15163): stderr: | [0;m[38;5;43m20221208211336783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211336784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211336784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211336784 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211336785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211336785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211336785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:38.269603 run osmo-stp_10.42.42.5(pid=15163): stdout: | (launched: 2022-12-08_21:13:36.590646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:38.397483 run osmo-stp_10.42.42.5(pid=15163): stderr: | [0;m[38;5;43m20221208211336783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211336784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211336784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211336784 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211336785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211336785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211336785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:38.550612 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15163): Process ended prematurely: osmo-stp_10.42.42.5(pid=15163) [trial-2349↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15163)] [trial-2349↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 21:13:38.560153 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 21:13:38.588020 run osmo-hlr_10.42.42.2(pid=15160): ERR: Terminated: ERROR {rc=237} [trial-2349↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15160)] 21:13:38.637763 run osmo-hlr_10.42.42.2(pid=15160): stdout: | (launched: 2022-12-08_21:13:35.586796) 21:13:38.689441 run osmo-hlr_10.42.42.2(pid=15160): stderr: | [0;m[1;31m20221208211335785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211335785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211335785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211335786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211335786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211335786 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211335798 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211335806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211335807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211335807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:13:38.761432 run osmo-msc_10.42.42.6(pid=15166): ERR: Terminated: ERROR {rc=2} [trial-2349↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15166)] 21:13:38.811186 run osmo-msc_10.42.42.6(pid=15166): stdout: | (launched: 2022-12-08_21:13:37.618861) 21:13:38.862834 run osmo-msc_10.42.42.6(pid=15166): stderr: | [0;m[38;5;43m20221208211337941 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211337941 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6797955c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211337941 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211337941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211337941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211337942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211337943 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211337944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211337944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211337944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:13:38.914723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15159): Terminating (SIGTERM) 21:13:38.956522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15162): Terminating (SIGTERM) 21:13:38.998455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15165): Terminating (SIGTERM) 21:13:39.040424 --- ParallelTerminationStrategy: PID 15159 died... 21:13:39.060299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15159): Terminated: ok {rc=0} 21:13:39.106328 --- ParallelTerminationStrategy: PID 15162 died... 21:13:39.125863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15162): Terminated: ok {rc=0} 21:13:39.171754 --- ParallelTerminationStrategy: PID 15165 died... 21:13:39.191183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15165): Terminated: ok {rc=0} 21:13:39.278373 bus /sierra_3: Setting Powered False 21:13:40.375444 bus /sierra_3: Setting Powered False 21:13:41.490792 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 emergency:nanobts+band-900 --------------------------------------------------------------------- 21:13:42.746646 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:13:42.752644 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 21:13:42.785525 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 21:13:42.811919 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 21:13:42.896527 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 21:13:42.928363 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 21:13:42.954486 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 21:13:43.538554 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2349 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 21:13:43.543427 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:13:43.554180 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 21:13:43.604918 tst emergency_mo_mt_call.py: using LAC 16850 21:13:43.719424 tst emergency_mo_mt_call.py: using RAC 20 21:13:43.833171 tst emergency_mo_mt_call.py: using CellId 16850 21:13:43.947458 tst emergency_mo_mt_call.py: using BVCI 16851 21:13:44.053251 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:13:44.063943 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:13:44.074514 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:13:44.085361 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:13:44.096004 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:13:44.106794 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 21:13:44.225857 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 21:13:44.344391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:13:44.835945 run create_hlr_db(pid=15171): Launched 21:13:44.965427 bus /sierra_2: Setting Powered False 21:13:46.044937 run create_hlr_db(pid=15171): Terminated: ok {rc=0} 21:13:46.548273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15173): Launched 21:13:46.880285 run osmo-hlr_10.42.42.2(pid=15174): Launched 21:13:47.136307 run osmo-stp_10.42.42.5: Starting osmo-stp 21:13:47.683518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15176): Launched 21:13:47.978838 run osmo-stp_10.42.42.5(pid=15177): Launched 21:13:48.101029 tst emergency_mo_mt_call.py: using MSISDN 6853 21:13:48.251425 run osmo-msc_10.42.42.6: Starting osmo-msc 21:13:48.782992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15179): Launched 21:13:49.088435 run osmo-msc_10.42.42.6(pid=15180): Launched 21:13:49.253928 run osmo-stp_10.42.42.5(pid=15177): ERR: Terminated: ERROR {rc=1} [trial-2349↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15177)] 21:13:49.379673 run osmo-stp_10.42.42.5(pid=15177): stdout: | (launched: 2022-12-08_21:13:47.924170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:49.506025 run osmo-stp_10.42.42.5(pid=15177): stderr: | [0;m[38;5;43m20221208211348092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211348092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211348092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211348093 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211348093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211348093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211348093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:49.629414 run osmo-stp_10.42.42.5(pid=15177): stdout: | (launched: 2022-12-08_21:13:47.924170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:49.746328 run osmo-stp_10.42.42.5(pid=15177): stderr: | [0;m[38;5;43m20221208211348092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211348092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211348092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211348093 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211348093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211348093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211348093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:49.886508 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=15177): Process ended prematurely: osmo-stp_10.42.42.5(pid=15177) [trial-2349↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15177)] [trial-2349↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 21:13:49.894768 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 21:13:49.920845 run osmo-hlr_10.42.42.2(pid=15174): ERR: Terminated: ERROR {rc=237} [trial-2349↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15174)] 21:13:49.969191 run osmo-hlr_10.42.42.2(pid=15174): stdout: | (launched: 2022-12-08_21:13:46.821244) 21:13:50.018470 run osmo-hlr_10.42.42.2(pid=15174): stderr: | [0;m[1;31m20221208211347069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211347069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211347069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211347069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211347070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211347070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211347092 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211347104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211347104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211347104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:13:50.087162 run osmo-msc_10.42.42.6(pid=15180): ERR: Terminated: ERROR {rc=2} [trial-2349↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15180)] 21:13:50.134761 run osmo-msc_10.42.42.6(pid=15180): stdout: | (launched: 2022-12-08_21:13:49.034058) 21:13:50.184073 run osmo-msc_10.42.42.6(pid=15180): stderr: | [0;m[38;5;43m20221208211349306 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211349306 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd776c2dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211349306 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211349306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211349306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211349306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211349308 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211349309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211349309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211349309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:13:50.233765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15173): Terminating (SIGTERM) 21:13:50.273428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15176): Terminating (SIGTERM) 21:13:50.313063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15179): Terminating (SIGTERM) 21:13:50.353020 --- ParallelTerminationStrategy: PID 15173 died... 21:13:50.372053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15173): Terminated: ok {rc=0} 21:13:50.416360 --- ParallelTerminationStrategy: PID 15176 died... 21:13:50.434982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15176): Terminated: ok {rc=0} 21:13:50.479064 --- ParallelTerminationStrategy: PID 15179 died... 21:13:50.497557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15179): Terminated: ok {rc=0} 21:13:50.582696 bus /sierra_3: Setting Powered False 21:13:51.680129 bus /sierra_3: Setting Powered False 21:13:52.792085 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 21:13:53.875303 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:13:53.886725 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 21:13:53.938718 tst emergency_preemptive_call.py: using LAC 16851 21:13:54.054642 tst emergency_preemptive_call.py: using RAC 21 21:13:54.168371 tst emergency_preemptive_call.py: using CellId 16851 21:13:54.282322 tst emergency_preemptive_call.py: using BVCI 16852 21:13:54.399243 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:13:54.410799 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:13:54.421995 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:13:54.433385 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:13:54.444613 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:13:54.456050 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 21:13:54.573583 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 21:13:54.693809 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 21:13:54.815001 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 21:13:54.929366 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:13:55.386521 run create_hlr_db(pid=15182): Launched 21:13:55.499317 bus /sierra_2: Setting Powered False 21:13:56.558845 run create_hlr_db(pid=15182): Terminated: ok {rc=0} 21:13:56.991862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15184): Launched 21:13:57.308320 run osmo-hlr_10.42.42.2(pid=15185): Launched 21:13:57.429116 run osmo-stp_10.42.42.5: Starting osmo-stp 21:13:57.976857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15187): Launched 21:13:58.294171 run osmo-stp_10.42.42.5(pid=15188): Launched 21:13:58.424079 tst emergency_preemptive_call.py: using MSISDN 6854 21:13:58.585981 run osmo-msc_10.42.42.6: Starting osmo-msc 21:13:59.156090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15190): Launched 21:13:59.473957 run osmo-msc_10.42.42.6(pid=15191): Launched 21:13:59.650494 run osmo-stp_10.42.42.5(pid=15188): ERR: Terminated: ERROR {rc=1} [trial-2349↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15188)] 21:13:59.784096 run osmo-stp_10.42.42.5(pid=15188): stdout: | (launched: 2022-12-08_21:13:58.235873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:59.918193 run osmo-stp_10.42.42.5(pid=15188): stderr: | [0;m[38;5;43m20221208211358427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211358427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211358427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211358428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211358428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211358428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211358428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:00.053569 run osmo-stp_10.42.42.5(pid=15188): stdout: | (launched: 2022-12-08_21:13:58.235873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:00.180025 run osmo-stp_10.42.42.5(pid=15188): stderr: | [0;m[38;5;43m20221208211358427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211358427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211358427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211358428 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211358428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211358428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211358428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:00.331520 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=15188): Process ended prematurely: osmo-stp_10.42.42.5(pid=15188) [trial-2349↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15188)] [trial-2349↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 21:14:00.340469 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 21:14:00.368407 run osmo-hlr_10.42.42.2(pid=15185): ERR: Terminated: ERROR {rc=237} [trial-2349↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15185)] 21:14:00.418688 run osmo-hlr_10.42.42.2(pid=15185): stdout: | (launched: 2022-12-08_21:13:57.250438) 21:14:00.470471 run osmo-hlr_10.42.42.2(pid=15185): stderr: | [0;m[1;31m20221208211357448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211357448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211357448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211357448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211357448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211357448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211357462 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211357470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211357470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211357470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:14:00.542984 run osmo-msc_10.42.42.6(pid=15191): ERR: Terminated: ERROR {rc=2} [trial-2349↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15191)] 21:14:00.593229 run osmo-msc_10.42.42.6(pid=15191): stdout: | (launched: 2022-12-08_21:13:59.415589) 21:14:00.644804 run osmo-msc_10.42.42.6(pid=15191): stderr: | [0;m[38;5;43m20221208211359738 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211359738 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1cefb3dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211359739 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211359739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211359739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211359739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211359741 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211359741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211359741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211359741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:14:00.696579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15184): Terminating (SIGTERM) 21:14:00.738657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15187): Terminating (SIGTERM) 21:14:00.781007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15190): Terminating (SIGTERM) 21:14:00.823536 --- ParallelTerminationStrategy: PID 15184 died... 21:14:00.851618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15184): Terminated: ok {rc=0} 21:14:00.910996 --- ParallelTerminationStrategy: PID 15187 died... 21:14:00.931740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15187): Terminated: ok {rc=0} 21:14:00.979174 --- ParallelTerminationStrategy: PID 15190 died... 21:14:00.999655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15190): Terminated: ok {rc=0} 21:14:01.111871 bus /sierra_9: Setting Powered False 21:14:02.215064 bus /sierra_9: Setting Powered False 21:14:03.328684 bus /sierra_8: Setting Powered False 21:14:04.425899 bus /sierra_8: Setting Powered False 21:14:05.540287 bus /sierra_3: Setting Powered False 21:14:06.638165 bus /sierra_3: Setting Powered False 21:14:07.754646 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:nanobts+band-900 --------------------------------------------------------------------- 21:14:09.036504 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:14:09.042282 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 21:14:09.075932 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 21:14:09.115908 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 21:14:09.205620 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 21:14:09.239427 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 21:14:09.278874 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 21:14:09.871265 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 21:14:09.924153 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:09.935856 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 21:14:09.984883 tst cs_paging_gprs_active.py: using LAC 16852 21:14:10.113150 tst cs_paging_gprs_active.py: using RAC 22 21:14:10.240338 tst cs_paging_gprs_active.py: using CellId 16852 21:14:10.369281 tst cs_paging_gprs_active.py: using BVCI 16853 21:14:10.486986 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:10.498224 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:10.509181 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:10.520263 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:10.531380 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:10.542536 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:10.554048 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:10.565513 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:10.576792 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:14:10.696193 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:14:10.816691 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:14:11.036559 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:14:11.361714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15196): Launched 21:14:11.643476 run iperf3-srv_10.42.42.10(pid=15197): Launched 21:14:11.765102 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:14:11.983333 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:14:12.308294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15198): Launched 21:14:12.589012 run iperf3-srv_10.42.42.10(pid=15199): Launched 21:14:12.710215 tst cs_paging_gprs_active.py:38: start network... 21:14:12.927930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:14:13.428484 run create_hlr_db(pid=15200): Launched 21:14:13.559214 bus /sierra_2: Setting Powered False 21:14:14.622948 run create_hlr_db(pid=15200): Terminated: ok {rc=0} 21:14:15.054269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15202): Launched 21:14:15.356914 run osmo-hlr_10.42.42.2(pid=15203): Launched 21:14:15.472354 run osmo-stp_10.42.42.5: Starting osmo-stp 21:14:16.030095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15205): Launched 21:14:16.352743 run osmo-stp_10.42.42.5(pid=15206): Launched 21:14:16.590384 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:14:17.279663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15208): Launched 21:14:17.396064 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:14:17.651651 run patchelf(pid=15209): Launched 21:14:17.820261 run osmo-stp_10.42.42.5(pid=15206): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15206)] 21:14:17.948208 run osmo-stp_10.42.42.5(pid=15206): stdout: | (launched: 2022-12-08_21:14:16.293577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:18.077988 run osmo-stp_10.42.42.5(pid=15206): stderr: | [0;m[38;5;43m20221208211416628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211416628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211416628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211416629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211416629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211416629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211416629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:18.208118 run osmo-stp_10.42.42.5(pid=15206): stdout: | (launched: 2022-12-08_21:14:16.293577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:18.332697 run osmo-stp_10.42.42.5(pid=15206): stderr: | [0;m[38;5;43m20221208211416628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211416628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211416628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211416629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211416629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211416629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211416629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:18.479554 run patchelf(pid=15209): Terminating (SIGINT) 21:14:18.649985 run patchelf(pid=15209): Terminated: ok {rc=0} 21:14:18.772579 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15206): Process ended prematurely: osmo-stp_10.42.42.5(pid=15206) [trial-2349↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15206)] [trial-2349↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 21:14:18.782143 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 21:14:18.809871 run osmo-hlr_10.42.42.2(pid=15203): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15203)] 21:14:18.857800 run osmo-hlr_10.42.42.2(pid=15203): stdout: | (launched: 2022-12-08_21:14:15.300252) 21:14:18.907299 run osmo-hlr_10.42.42.2(pid=15203): stderr: | [0;m[1;31m20221208211415478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211415479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211415479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211415479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211415479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211415479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211415491 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211415501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211415501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211415501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:14:18.957688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15196): Terminating (SIGTERM) 21:14:18.997628 run iperf3-srv_10.42.42.10(pid=15197): Terminating (SIGTERM) 21:14:19.037562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15198): Terminating (SIGTERM) 21:14:19.077879 run iperf3-srv_10.42.42.10(pid=15199): Terminating (SIGTERM) 21:14:19.117900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15202): Terminating (SIGTERM) 21:14:19.158105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15205): Terminating (SIGTERM) 21:14:19.198211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15208): Terminating (SIGTERM) 21:14:19.238585 --- ParallelTerminationStrategy: PID 15196 died... 21:14:19.257856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15196): Terminated: ok {rc=0} 21:14:19.302717 --- ParallelTerminationStrategy: PID 15197 died... 21:14:19.321938 run iperf3-srv_10.42.42.10(pid=15197): Terminated {rc=256} 21:14:19.366282 --- ParallelTerminationStrategy: PID 15198 died... 21:14:19.385035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15198): Terminated: ok {rc=0} 21:14:19.429147 --- ParallelTerminationStrategy: PID 15199 died... 21:14:19.447656 run iperf3-srv_10.42.42.10(pid=15199): Terminated {rc=256} 21:14:19.491728 --- ParallelTerminationStrategy: PID 15202 died... 21:14:19.510357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15202): Terminated: ok {rc=0} 21:14:19.554764 --- ParallelTerminationStrategy: PID 15205 died... 21:14:19.573646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15205): Terminated: ok {rc=0} 21:14:19.618287 --- ParallelTerminationStrategy: PID 15208 died... 21:14:19.636861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15208): Terminated: ok {rc=0} 21:14:19.722912 bus /gobi_0: Setting Powered False 21:14:20.820318 bus /gobi_0: Setting Powered False 21:14:21.935105 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 21:14:23.079574 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:23.091034 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 21:14:23.142021 tst iperf3.py: using LAC 16853 21:14:23.262556 tst iperf3.py: using RAC 23 21:14:23.382544 tst iperf3.py: using CellId 16853 21:14:23.502308 tst iperf3.py: using BVCI 16854 21:14:23.613953 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:23.624603 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:23.635218 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:23.646100 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:23.656908 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:23.668210 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:23.679446 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:23.690337 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:23.701634 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:14:23.821247 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:14:24.039136 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:14:24.363786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15210): Launched 21:14:24.644890 run iperf3-srv_10.42.42.10(pid=15211): Launched 21:14:24.765848 tst iperf3.py:8: start network... 21:14:24.983197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:14:25.483194 run create_hlr_db(pid=15212): Launched 21:14:25.615315 bus /gobi_6: Setting Powered False 21:14:26.679118 run create_hlr_db(pid=15212): Terminated: ok {rc=0} 21:14:27.129653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15214): Launched 21:14:27.453541 run osmo-hlr_10.42.42.2(pid=15215): Launched 21:14:27.578168 run osmo-stp_10.42.42.5: Starting osmo-stp 21:14:28.137227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15217): Launched 21:14:28.460030 run osmo-stp_10.42.42.5(pid=15218): Launched 21:14:28.583069 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:14:29.138742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15220): Launched 21:14:29.262378 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:14:29.535322 run patchelf(pid=15221): Launched 21:14:29.715438 run osmo-stp_10.42.42.5(pid=15218): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15218)] 21:14:29.851540 run osmo-stp_10.42.42.5(pid=15218): stdout: | (launched: 2022-12-08_21:14:28.400918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:29.989576 run osmo-stp_10.42.42.5(pid=15218): stderr: | [0;m[38;5;43m20221208211428596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211428596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211428596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211428597 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211428597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211428597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211428597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:30.127835 run osmo-stp_10.42.42.5(pid=15218): stdout: | (launched: 2022-12-08_21:14:28.400918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:30.260524 run osmo-stp_10.42.42.5(pid=15218): stderr: | [0;m[38;5;43m20221208211428596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211428596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211428596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211428597 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211428597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211428597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211428597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:30.417871 run patchelf(pid=15221): Terminating (SIGINT) 21:14:30.599447 run patchelf(pid=15221): Terminated: ok {rc=0} 21:14:30.729790 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15218): Process ended prematurely: osmo-stp_10.42.42.5(pid=15218) [trial-2349↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15218)] [trial-2349↪gprs:nanobts+band-900↪iperf3.py:8] 21:14:30.739954 tst iperf3.py:8: Test FAILED (7.7 sec) 21:14:30.768485 run osmo-hlr_10.42.42.2(pid=15215): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15215)] 21:14:30.818337 run osmo-hlr_10.42.42.2(pid=15215): stdout: | (launched: 2022-12-08_21:14:27.394045) 21:14:30.881253 run osmo-hlr_10.42.42.2(pid=15215): stderr: | [0;m[1;31m20221208211427593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211427593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211427593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211427593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211427593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211427593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211427606 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211427614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211427614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211427614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:14:30.939739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15210): Terminating (SIGTERM) 21:14:30.982936 run iperf3-srv_10.42.42.10(pid=15211): Terminating (SIGTERM) 21:14:31.025419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15214): Terminating (SIGTERM) 21:14:31.072406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15217): Terminating (SIGTERM) 21:14:31.118557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15220): Terminating (SIGTERM) 21:14:31.161208 --- ParallelTerminationStrategy: PID 15210 died... 21:14:31.181402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15210): Terminated: ok {rc=0} 21:14:31.228709 --- ParallelTerminationStrategy: PID 15211 died... 21:14:31.248934 run iperf3-srv_10.42.42.10(pid=15211): Terminated {rc=256} 21:14:31.295798 --- ParallelTerminationStrategy: PID 15214 died... 21:14:31.316091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15214): Terminated: ok {rc=0} 21:14:31.363072 --- ParallelTerminationStrategy: PID 15217 died... 21:14:31.383535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15217): Terminated: ok {rc=0} 21:14:31.430992 --- ParallelTerminationStrategy: PID 15220 died... 21:14:31.451278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15220): Terminated: ok {rc=0} 21:14:31.540000 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 21:14:32.685362 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:32.696776 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 21:14:32.746851 tst iperf3m4.py: using LAC 16854 21:14:32.865546 tst iperf3m4.py: using RAC 24 21:14:32.994430 tst iperf3m4.py: using CellId 16854 21:14:33.123234 tst iperf3m4.py: using BVCI 16855 21:14:33.243145 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:33.254417 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:33.265497 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:33.276491 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:33.287575 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:33.298525 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:33.309733 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:33.320639 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:33.331853 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:14:33.448616 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:14:33.566081 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:14:33.681582 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:14:33.797649 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:14:33.999601 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:14:34.301706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15222): Launched 21:14:34.565064 run iperf3-srv_10.42.42.10(pid=15223): Launched 21:14:34.678372 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:14:34.879722 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:14:35.182292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15224): Launched 21:14:35.444778 run iperf3-srv_10.42.42.10(pid=15225): Launched 21:14:35.557597 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:14:35.758388 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:14:36.060553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15226): Launched 21:14:36.324268 run iperf3-srv_10.42.42.10(pid=15227): Launched 21:14:36.437409 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:14:36.638506 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:14:36.940170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15228): Launched 21:14:37.202557 run iperf3-srv_10.42.42.10(pid=15229): Launched 21:14:37.315475 tst iperf3m4.py:8: start network... 21:14:37.516195 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:14:37.982841 run create_hlr_db(pid=15230): Launched 21:14:38.099429 bus /gobi_6: Setting Powered False 21:14:39.159290 run create_hlr_db(pid=15230): Terminated: ok {rc=0} 21:14:39.579426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15232): Launched 21:14:39.881322 run osmo-hlr_10.42.42.2(pid=15233): Launched 21:14:39.996607 run osmo-stp_10.42.42.5: Starting osmo-stp 21:14:40.535550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15235): Launched 21:14:40.836929 run osmo-stp_10.42.42.5(pid=15236): Launched 21:14:40.952305 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:14:41.471708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15238): Launched 21:14:41.587386 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:14:41.843495 run patchelf(pid=15239): Launched 21:14:42.012475 run osmo-stp_10.42.42.5(pid=15236): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15236)] 21:14:42.141336 run osmo-stp_10.42.42.5(pid=15236): stdout: | (launched: 2022-12-08_21:14:40.780909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:42.270877 run osmo-stp_10.42.42.5(pid=15236): stderr: | [0;m[38;5;43m20221208211440951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211440952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211440952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211440952 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211440953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211440953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211440953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:42.400788 run osmo-stp_10.42.42.5(pid=15236): stdout: | (launched: 2022-12-08_21:14:40.780909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:42.524777 run osmo-stp_10.42.42.5(pid=15236): stderr: | [0;m[38;5;43m20221208211440951 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211440952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211440952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211440952 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211440953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211440953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211440953 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:42.672200 run patchelf(pid=15239): Terminating (SIGINT) 21:14:42.842547 run patchelf(pid=15239): Terminated: ok {rc=0} 21:14:42.964874 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15236): Process ended prematurely: osmo-stp_10.42.42.5(pid=15236) [trial-2349↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15236)] [trial-2349↪gprs:nanobts+band-900↪iperf3m4.py:8] 21:14:42.974550 tst iperf3m4.py:8: Test FAILED (10.3 sec) 21:14:43.002422 run osmo-hlr_10.42.42.2(pid=15233): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15233)] 21:14:43.050458 run osmo-hlr_10.42.42.2(pid=15233): stdout: | (launched: 2022-12-08_21:14:39.825458) 21:14:43.099887 run osmo-hlr_10.42.42.2(pid=15233): stderr: | [0;m[1;31m20221208211440001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211440001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211440001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211440001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211440001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211440001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211440013 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211440021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211440022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211440022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:14:43.149626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15222): Terminating (SIGTERM) 21:14:43.189410 run iperf3-srv_10.42.42.10(pid=15223): Terminating (SIGTERM) 21:14:43.229026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15224): Terminating (SIGTERM) 21:14:43.268630 run iperf3-srv_10.42.42.10(pid=15225): Terminating (SIGTERM) 21:14:43.308047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15226): Terminating (SIGTERM) 21:14:43.347833 run iperf3-srv_10.42.42.10(pid=15227): Terminating (SIGTERM) 21:14:43.387318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15228): Terminating (SIGTERM) 21:14:43.427039 run iperf3-srv_10.42.42.10(pid=15229): Terminating (SIGTERM) 21:14:43.466569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15232): Terminating (SIGTERM) 21:14:43.506201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15235): Terminating (SIGTERM) 21:14:43.545679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15238): Terminating (SIGTERM) 21:14:43.585554 --- ParallelTerminationStrategy: PID 15222 died... 21:14:43.604064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15222): Terminated: ok {rc=0} 21:14:43.648076 --- ParallelTerminationStrategy: PID 15223 died... 21:14:43.666674 run iperf3-srv_10.42.42.10(pid=15223): Terminated {rc=256} 21:14:43.710468 --- ParallelTerminationStrategy: PID 15224 died... 21:14:43.729055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15224): Terminated: ok {rc=0} 21:14:43.772533 --- ParallelTerminationStrategy: PID 15225 died... 21:14:43.791046 run iperf3-srv_10.42.42.10(pid=15225): Terminated {rc=256} 21:14:43.835023 --- ParallelTerminationStrategy: PID 15226 died... 21:14:43.853571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15226): Terminated: ok {rc=0} 21:14:43.897670 --- ParallelTerminationStrategy: PID 15227 died... 21:14:43.916095 run iperf3-srv_10.42.42.10(pid=15227): Terminated {rc=256} 21:14:43.959829 --- ParallelTerminationStrategy: PID 15228 died... 21:14:43.978498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15228): Terminated: ok {rc=0} 21:14:44.022223 --- ParallelTerminationStrategy: PID 15229 died... 21:14:44.040777 run iperf3-srv_10.42.42.10(pid=15229): Terminated {rc=256} 21:14:44.084523 --- ParallelTerminationStrategy: PID 15232 died... 21:14:44.103229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15232): Terminated: ok {rc=0} 21:14:44.147465 --- ParallelTerminationStrategy: PID 15235 died... 21:14:44.165834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15235): Terminated: ok {rc=0} 21:14:44.209713 --- ParallelTerminationStrategy: PID 15238 died... 21:14:44.228074 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15238): Terminated: ok {rc=0} 21:14:44.312277 bus /gobi_4: Setting Powered False 21:14:45.411416 bus /gobi_4: Setting Powered False 21:14:46.532061 bus /gobi_1: Setting Powered False 21:14:47.635994 bus /gobi_1: Setting Powered False 21:14:48.748379 bus /gobi_0: Setting Powered False 21:14:49.845756 bus /gobi_0: Setting Powered False 21:14:50.962077 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-900 ping.py ---------------------------------------------- 21:14:52.064382 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:52.076266 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 21:14:52.125623 tst ping.py: using LAC 16855 21:14:52.253031 tst ping.py: using RAC 25 21:14:52.370536 tst ping.py: using CellId 16855 21:14:52.487116 tst ping.py: using BVCI 16856 21:14:52.597162 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:52.607844 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:52.618472 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:52.629899 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:52.641203 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:52.652281 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:52.663781 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:52.675167 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:14:52.794805 tst ping.py:19: start network... 21:14:53.009369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:14:53.499952 run create_hlr_db(pid=15241): Launched 21:14:53.628842 bus /gobi_6: Setting Powered False 21:14:54.692467 run create_hlr_db(pid=15241): Terminated: ok {rc=0} 21:14:55.117150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15243): Launched 21:14:55.412288 run osmo-hlr_10.42.42.2(pid=15244): Launched 21:14:55.524315 run osmo-stp_10.42.42.5: Starting osmo-stp 21:14:56.045846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15246): Launched 21:14:56.340417 run osmo-stp_10.42.42.5(pid=15247): Launched 21:14:56.452357 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:14:56.962717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15249): Launched 21:14:57.075550 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:14:57.326029 run patchelf(pid=15250): Launched 21:14:57.491462 run osmo-stp_10.42.42.5(pid=15247): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15247)] 21:14:57.616914 run osmo-stp_10.42.42.5(pid=15247): stdout: | (launched: 2022-12-08_21:14:56.286113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:57.743652 run osmo-stp_10.42.42.5(pid=15247): stderr: | [0;m[38;5;43m20221208211456456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211456457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211456457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211456458 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211456458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211456458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211456458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:57.870595 run osmo-stp_10.42.42.5(pid=15247): stdout: | (launched: 2022-12-08_21:14:56.286113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:57.991756 run osmo-stp_10.42.42.5(pid=15247): stderr: | [0;m[38;5;43m20221208211456456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211456457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211456457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211456458 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211456458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211456458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211456458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:58.135528 run patchelf(pid=15250): Terminating (SIGINT) 21:14:58.302159 run patchelf(pid=15250): Terminated: ok {rc=0} 21:14:58.422301 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15247): Process ended prematurely: osmo-stp_10.42.42.5(pid=15247) [trial-2349↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15247)] [trial-2349↪gprs:nanobts+band-900↪ping.py:22] 21:14:58.431115 tst ping.py:22: Test FAILED (6.4 sec) 21:14:58.457925 run osmo-hlr_10.42.42.2(pid=15244): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15244)] 21:14:58.505996 run osmo-hlr_10.42.42.2(pid=15244): stdout: | (launched: 2022-12-08_21:14:55.357810) 21:14:58.554831 run osmo-hlr_10.42.42.2(pid=15244): stderr: | [0;m[1;31m20221208211455533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211455533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211455533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211455533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211455533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211455533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211455544 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211455554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211455555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211455555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:14:58.604086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15243): Terminating (SIGTERM) 21:14:58.643649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15246): Terminating (SIGTERM) 21:14:58.683371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15249): Terminating (SIGTERM) 21:14:58.723637 --- ParallelTerminationStrategy: PID 15243 died... 21:14:58.743002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15243): Terminated: ok {rc=0} 21:14:58.788204 --- ParallelTerminationStrategy: PID 15246 died... 21:14:58.807201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15246): Terminated: ok {rc=0} 21:14:58.852325 --- ParallelTerminationStrategy: PID 15249 died... 21:14:58.871162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15249): Terminated: ok {rc=0} 21:14:58.957158 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 21:15:00.045295 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:00.056926 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 21:15:00.105260 tst ping_idle_ping.py: using LAC 16856 21:15:00.223751 tst ping_idle_ping.py: using RAC 26 21:15:00.340107 tst ping_idle_ping.py: using CellId 16856 21:15:00.456646 tst ping_idle_ping.py: using BVCI 16857 21:15:00.566549 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:00.577303 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:00.587846 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:00.598653 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:00.609349 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:00.619957 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:00.630789 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:00.641646 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:15:00.755694 tst ping_idle_ping.py:24: start network... 21:15:00.999224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:15:01.522682 run create_hlr_db(pid=15254): Launched 21:15:01.690411 bus /gobi_6: Setting Powered False 21:15:02.753449 run create_hlr_db(pid=15254): Terminated: ok {rc=0} 21:15:03.199509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15256): Launched 21:15:03.495732 run osmo-hlr_10.42.42.2(pid=15257): Launched 21:15:03.608389 run osmo-stp_10.42.42.5: Starting osmo-stp 21:15:04.116193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15259): Launched 21:15:04.415468 run osmo-stp_10.42.42.5(pid=15260): Launched 21:15:04.529018 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:15:05.042019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15262): Launched 21:15:05.155974 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:15:05.407233 run patchelf(pid=15263): Launched 21:15:05.573167 run osmo-stp_10.42.42.5(pid=15260): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15260)] 21:15:05.699462 run osmo-stp_10.42.42.5(pid=15260): stdout: | (launched: 2022-12-08_21:15:04.359569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:05.826756 run osmo-stp_10.42.42.5(pid=15260): stderr: | [0;m[38;5;43m20221208211504532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211504532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211504532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211504533 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211504533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211504533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211504533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:05.954251 run osmo-stp_10.42.42.5(pid=15260): stdout: | (launched: 2022-12-08_21:15:04.359569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:06.075733 run osmo-stp_10.42.42.5(pid=15260): stderr: | [0;m[38;5;43m20221208211504532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211504532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211504532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211504533 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211504533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211504533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211504533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:06.220134 run patchelf(pid=15263): Terminating (SIGINT) 21:15:06.387072 run patchelf(pid=15263): Terminated: ok {rc=0} 21:15:06.507735 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15260): Process ended prematurely: osmo-stp_10.42.42.5(pid=15260) [trial-2349↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15260)] [trial-2349↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 21:15:06.516531 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 21:15:06.543934 run osmo-hlr_10.42.42.2(pid=15257): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15257)] 21:15:06.592294 run osmo-hlr_10.42.42.2(pid=15257): stdout: | (launched: 2022-12-08_21:15:03.440871) 21:15:06.641913 run osmo-hlr_10.42.42.2(pid=15257): stderr: | [0;m[1;31m20221208211503617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211503617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211503617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211503617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211503617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211503617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211503630 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211503638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211503638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211503638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:15:06.692168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15256): Terminating (SIGTERM) 21:15:06.732456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15259): Terminating (SIGTERM) 21:15:06.772435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15262): Terminating (SIGTERM) 21:15:06.812779 --- ParallelTerminationStrategy: PID 15256 died... 21:15:06.831981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15256): Terminated: ok {rc=0} 21:15:06.876620 --- ParallelTerminationStrategy: PID 15259 died... 21:15:06.895257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15259): Terminated: ok {rc=0} 21:15:06.939704 --- ParallelTerminationStrategy: PID 15262 died... 21:15:06.958459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15262): Terminated: ok {rc=0} 21:15:07.044155 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 21:15:08.342895 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:15:08.349306 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 21:15:08.382126 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 21:15:08.420403 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 21:15:08.507252 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 21:15:08.539341 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 21:15:08.578137 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 21:15:09.176253 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 21:15:09.224835 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:09.235740 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:15:09.284231 tst cs_paging_gprs_active.py: using LAC 16857 21:15:09.402594 tst cs_paging_gprs_active.py: using RAC 27 21:15:09.522745 tst cs_paging_gprs_active.py: using CellId 16857 21:15:09.642743 tst cs_paging_gprs_active.py: using BVCI 16858 21:15:09.751838 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:09.762805 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:09.773562 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:09.784432 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:09.795311 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:09.806329 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:09.817385 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:09.828167 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:09.839242 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:15:09.959821 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:15:10.083378 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:15:10.304424 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:15:10.631649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15268): Launched 21:15:10.914065 run iperf3-srv_10.42.42.10(pid=15269): Launched 21:15:11.036125 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:15:11.253998 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:15:11.579156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15270): Launched 21:15:11.861695 run iperf3-srv_10.42.42.10(pid=15271): Launched 21:15:11.983693 tst cs_paging_gprs_active.py:38: start network... 21:15:12.202319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:15:12.706279 run create_hlr_db(pid=15272): Launched 21:15:12.839167 bus /gobi_6: Setting Powered False 21:15:13.903012 run create_hlr_db(pid=15272): Terminated: ok {rc=0} 21:15:14.356347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15274): Launched 21:15:14.681926 run osmo-hlr_10.42.42.2(pid=15275): Launched 21:15:14.805062 run osmo-stp_10.42.42.5: Starting osmo-stp 21:15:15.366278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15277): Launched 21:15:15.690380 run osmo-stp_10.42.42.5(pid=15278): Launched 21:15:15.813357 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:15:16.492243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15280): Launched 21:15:16.626204 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:15:16.894393 run patchelf(pid=15281): Launched 21:15:17.083807 run osmo-stp_10.42.42.5(pid=15278): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15278)] 21:15:17.220015 run osmo-stp_10.42.42.5(pid=15278): stdout: | (launched: 2022-12-08_21:15:15.630782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:17.349851 run osmo-stp_10.42.42.5(pid=15278): stderr: | [0;m[38;5;43m20221208211515825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211515825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211515826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211515826 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211515826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211515827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211515827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:17.479643 run osmo-stp_10.42.42.5(pid=15278): stdout: | (launched: 2022-12-08_21:15:15.630782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:17.604448 run osmo-stp_10.42.42.5(pid=15278): stderr: | [0;m[38;5;43m20221208211515825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211515825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211515826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211515826 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211515826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211515827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211515827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:17.751830 run patchelf(pid=15281): Terminating (SIGINT) 21:15:17.921432 run patchelf(pid=15281): Terminated: ok {rc=0} 21:15:18.043408 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15278): Process ended prematurely: osmo-stp_10.42.42.5(pid=15278) [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15278)] [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 21:15:18.052919 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 21:15:18.080291 run osmo-hlr_10.42.42.2(pid=15275): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15275)] 21:15:18.128453 run osmo-hlr_10.42.42.2(pid=15275): stdout: | (launched: 2022-12-08_21:15:14.622575) 21:15:18.177938 run osmo-hlr_10.42.42.2(pid=15275): stderr: | [0;m[1;31m20221208211514821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211514821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211514821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211514821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211514821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211514821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211514833 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211514841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211514842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211514842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:15:18.228145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15268): Terminating (SIGTERM) 21:15:18.268152 run iperf3-srv_10.42.42.10(pid=15269): Terminating (SIGTERM) 21:15:18.308259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15270): Terminating (SIGTERM) 21:15:18.348387 run iperf3-srv_10.42.42.10(pid=15271): Terminating (SIGTERM) 21:15:18.388136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15274): Terminating (SIGTERM) 21:15:18.428107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15277): Terminating (SIGTERM) 21:15:18.467914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15280): Terminating (SIGTERM) 21:15:18.508186 --- ParallelTerminationStrategy: PID 15268 died... 21:15:18.527441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15268): Terminated: ok {rc=0} 21:15:18.572443 --- ParallelTerminationStrategy: PID 15269 died... 21:15:18.590882 run iperf3-srv_10.42.42.10(pid=15269): Terminated {rc=256} 21:15:18.635932 --- ParallelTerminationStrategy: PID 15270 died... 21:15:18.654754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15270): Terminated: ok {rc=0} 21:15:18.699237 --- ParallelTerminationStrategy: PID 15271 died... 21:15:18.717783 run iperf3-srv_10.42.42.10(pid=15271): Terminated {rc=256} 21:15:18.761890 --- ParallelTerminationStrategy: PID 15274 died... 21:15:18.780493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15274): Terminated: ok {rc=0} 21:15:18.824853 --- ParallelTerminationStrategy: PID 15277 died... 21:15:18.843542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15277): Terminated: ok {rc=0} 21:15:18.887814 --- ParallelTerminationStrategy: PID 15280 died... 21:15:18.906480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15280): Terminated: ok {rc=0} 21:15:18.992434 bus /gobi_0: Setting Powered False 21:15:20.091678 bus /gobi_0: Setting Powered False 21:15:21.204683 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 21:15:22.354154 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:22.366190 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:15:22.420601 tst iperf3.py: using LAC 16858 21:15:22.549113 tst iperf3.py: using RAC 28 21:15:22.676357 tst iperf3.py: using CellId 16858 21:15:22.796107 tst iperf3.py: using BVCI 16859 21:15:22.907354 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:22.918391 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:22.929126 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:22.940166 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:22.951074 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:22.961977 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:22.973096 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:22.984055 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:22.995116 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:15:23.112150 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:15:23.316005 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:15:23.619303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15282): Launched 21:15:23.881901 run iperf3-srv_10.42.42.10(pid=15283): Launched 21:15:23.994520 tst iperf3.py:8: start network... 21:15:24.196117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:15:24.662274 run create_hlr_db(pid=15284): Launched 21:15:24.776826 bus /gobi_6: Setting Powered False 21:15:25.837103 run create_hlr_db(pid=15284): Terminated: ok {rc=0} 21:15:26.279859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15286): Launched 21:15:26.603072 run osmo-hlr_10.42.42.2(pid=15287): Launched 21:15:26.727027 run osmo-stp_10.42.42.5: Starting osmo-stp 21:15:27.289666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15289): Launched 21:15:27.613803 run osmo-stp_10.42.42.5(pid=15290): Launched 21:15:27.737212 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:15:28.294725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15292): Launched 21:15:28.418751 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:15:28.692876 run patchelf(pid=15293): Launched 21:15:28.873686 run osmo-stp_10.42.42.5(pid=15290): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15290)] 21:15:29.010895 run osmo-stp_10.42.42.5(pid=15290): stdout: | (launched: 2022-12-08_21:15:27.554437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:29.149273 run osmo-stp_10.42.42.5(pid=15290): stderr: | [0;m[38;5;43m20221208211527746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211527747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211527747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211527747 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211527748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211527748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211527748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:29.287495 run osmo-stp_10.42.42.5(pid=15290): stdout: | (launched: 2022-12-08_21:15:27.554437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:29.419925 run osmo-stp_10.42.42.5(pid=15290): stderr: | [0;m[38;5;43m20221208211527746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211527747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211527747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211527747 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211527748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211527748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211527748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:29.576858 run patchelf(pid=15293): Terminating (SIGINT) 21:15:29.759370 run patchelf(pid=15293): Terminated: ok {rc=0} 21:15:29.890058 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15290): Process ended prematurely: osmo-stp_10.42.42.5(pid=15290) [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15290)] [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 21:15:29.900212 tst iperf3.py:8: Test FAILED (7.6 sec) 21:15:29.928639 run osmo-hlr_10.42.42.2(pid=15287): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15287)] 21:15:29.978669 run osmo-hlr_10.42.42.2(pid=15287): stdout: | (launched: 2022-12-08_21:15:26.543624) 21:15:30.030338 run osmo-hlr_10.42.42.2(pid=15287): stderr: | [0;m[1;31m20221208211526743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211526744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211526744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211526744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211526744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211526744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211526758 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211526766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211526766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211526766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:15:30.082106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15282): Terminating (SIGTERM) 21:15:30.123658 run iperf3-srv_10.42.42.10(pid=15283): Terminating (SIGTERM) 21:15:30.166540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15286): Terminating (SIGTERM) 21:15:30.208331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15289): Terminating (SIGTERM) 21:15:30.249705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15292): Terminating (SIGTERM) 21:15:30.291464 --- ParallelTerminationStrategy: PID 15282 died... 21:15:30.311454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15282): Terminated: ok {rc=0} 21:15:30.357390 --- ParallelTerminationStrategy: PID 15283 died... 21:15:30.376811 run iperf3-srv_10.42.42.10(pid=15283): Terminated {rc=256} 21:15:30.422582 --- ParallelTerminationStrategy: PID 15286 died... 21:15:30.442152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15286): Terminated: ok {rc=0} 21:15:30.487911 --- ParallelTerminationStrategy: PID 15289 died... 21:15:30.507308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15289): Terminated: ok {rc=0} 21:15:30.552911 --- ParallelTerminationStrategy: PID 15292 died... 21:15:30.572478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15292): Terminated: ok {rc=0} 21:15:30.658667 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 21:15:31.827067 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:31.842162 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:15:31.901620 tst iperf3m4.py: using LAC 16859 21:15:32.031950 tst iperf3m4.py: using RAC 29 21:15:32.153376 tst iperf3m4.py: using CellId 16859 21:15:32.291871 tst iperf3m4.py: using BVCI 16860 21:15:32.402966 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:32.414182 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:32.425179 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:32.436537 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:32.447816 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:32.459034 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:32.470939 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:32.482272 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:32.493698 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:15:32.616798 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:15:32.734405 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:15:32.855614 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:15:32.971916 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:15:33.174962 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:15:33.477673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15294): Launched 21:15:33.741230 run iperf3-srv_10.42.42.10(pid=15295): Launched 21:15:33.855254 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:15:34.058157 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:15:34.361370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15296): Launched 21:15:34.625188 run iperf3-srv_10.42.42.10(pid=15297): Launched 21:15:34.738559 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:15:34.941276 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:15:35.245047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15298): Launched 21:15:35.508519 run iperf3-srv_10.42.42.10(pid=15299): Launched 21:15:35.621871 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:15:35.823576 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:15:36.128658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15300): Launched 21:15:36.393169 run iperf3-srv_10.42.42.10(pid=15301): Launched 21:15:36.506424 tst iperf3m4.py:8: start network... 21:15:36.707930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:15:37.176135 run create_hlr_db(pid=15302): Launched 21:15:37.308658 bus /gobi_6: Setting Powered False 21:15:38.369532 run create_hlr_db(pid=15302): Terminated: ok {rc=0} 21:15:38.814187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15304): Launched 21:15:39.140840 run osmo-hlr_10.42.42.2(pid=15305): Launched 21:15:39.264909 run osmo-stp_10.42.42.5: Starting osmo-stp 21:15:39.822869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15307): Launched 21:15:40.148459 run osmo-stp_10.42.42.5(pid=15308): Launched 21:15:40.271048 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:15:40.827909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15310): Launched 21:15:40.951647 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:15:41.227009 run patchelf(pid=15311): Launched 21:15:41.407417 run osmo-stp_10.42.42.5(pid=15308): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15308)] 21:15:41.544218 run osmo-stp_10.42.42.5(pid=15308): stdout: | (launched: 2022-12-08_21:15:40.088444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:41.682730 run osmo-stp_10.42.42.5(pid=15308): stderr: | [0;m[38;5;43m20221208211540281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211540281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211540281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211540281 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211540282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211540282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211540282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:41.820902 run osmo-stp_10.42.42.5(pid=15308): stdout: | (launched: 2022-12-08_21:15:40.088444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:41.953946 run osmo-stp_10.42.42.5(pid=15308): stderr: | [0;m[38;5;43m20221208211540281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211540281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211540281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211540281 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211540282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211540282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211540282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:42.111905 run patchelf(pid=15311): Terminating (SIGINT) 21:15:42.293927 run patchelf(pid=15311): Terminated: ok {rc=0} 21:15:42.424564 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15308): Process ended prematurely: osmo-stp_10.42.42.5(pid=15308) [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15308)] [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 21:15:42.434773 tst iperf3m4.py:8: Test FAILED (10.7 sec) 21:15:42.463492 run osmo-hlr_10.42.42.2(pid=15305): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15305)] 21:15:42.513347 run osmo-hlr_10.42.42.2(pid=15305): stdout: | (launched: 2022-12-08_21:15:39.081378) 21:15:42.564801 run osmo-hlr_10.42.42.2(pid=15305): stderr: | [0;m[1;31m20221208211539280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211539280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211539280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211539280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211539280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211539280 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211539293 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211539301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211539301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211539301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:15:42.616608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15294): Terminating (SIGTERM) 21:15:42.658339 run iperf3-srv_10.42.42.10(pid=15295): Terminating (SIGTERM) 21:15:42.699820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15296): Terminating (SIGTERM) 21:15:42.741359 run iperf3-srv_10.42.42.10(pid=15297): Terminating (SIGTERM) 21:15:42.783004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15298): Terminating (SIGTERM) 21:15:42.824516 run iperf3-srv_10.42.42.10(pid=15299): Terminating (SIGTERM) 21:15:42.866546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15300): Terminating (SIGTERM) 21:15:42.908108 run iperf3-srv_10.42.42.10(pid=15301): Terminating (SIGTERM) 21:15:42.949548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15304): Terminating (SIGTERM) 21:15:42.991467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15307): Terminating (SIGTERM) 21:15:43.033177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15310): Terminating (SIGTERM) 21:15:43.075121 --- ParallelTerminationStrategy: PID 15294 died... 21:15:43.095235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15294): Terminated: ok {rc=0} 21:15:43.141314 --- ParallelTerminationStrategy: PID 15295 died... 21:15:43.160487 run iperf3-srv_10.42.42.10(pid=15295): Terminated {rc=256} 21:15:43.206834 --- ParallelTerminationStrategy: PID 15296 died... 21:15:43.226255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15296): Terminated: ok {rc=0} 21:15:43.271917 --- ParallelTerminationStrategy: PID 15297 died... 21:15:43.291347 run iperf3-srv_10.42.42.10(pid=15297): Terminated {rc=256} 21:15:43.336926 --- ParallelTerminationStrategy: PID 15298 died... 21:15:43.356520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15298): Terminated: ok {rc=0} 21:15:43.402394 --- ParallelTerminationStrategy: PID 15299 died... 21:15:43.421810 run iperf3-srv_10.42.42.10(pid=15299): Terminated {rc=256} 21:15:43.467417 --- ParallelTerminationStrategy: PID 15300 died... 21:15:43.486930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15300): Terminated: ok {rc=0} 21:15:43.532679 --- ParallelTerminationStrategy: PID 15301 died... 21:15:43.552083 run iperf3-srv_10.42.42.10(pid=15301): Terminated {rc=256} 21:15:43.597537 --- ParallelTerminationStrategy: PID 15304 died... 21:15:43.616935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15304): Terminated: ok {rc=0} 21:15:43.662610 --- ParallelTerminationStrategy: PID 15307 died... 21:15:43.682065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15307): Terminated: ok {rc=0} 21:15:43.727526 --- ParallelTerminationStrategy: PID 15310 died... 21:15:43.747011 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15310): Terminated: ok {rc=0} 21:15:43.832839 bus /gobi_4: Setting Powered False 21:15:44.930855 bus /gobi_4: Setting Powered False 21:15:46.049512 bus /gobi_1: Setting Powered False 21:15:47.162354 bus /gobi_1: Setting Powered False 21:15:48.278833 bus /gobi_0: Setting Powered False 21:15:49.374108 bus /gobi_0: Setting Powered False 21:15:50.489997 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 21:15:51.592203 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:51.603901 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:15:51.653683 tst ping.py: using LAC 16860 21:15:51.777239 tst ping.py: using RAC 30 21:15:51.893367 tst ping.py: using CellId 16860 21:15:52.008010 tst ping.py: using BVCI 16861 21:15:52.115455 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:52.126540 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:52.137472 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:52.148454 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:52.159436 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:52.170442 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:52.181575 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:52.192575 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:15:52.307058 tst ping.py:19: start network... 21:15:52.504253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:15:52.959204 run create_hlr_db(pid=15313): Launched 21:15:53.072147 bus /gobi_6: Setting Powered False 21:15:54.131641 run create_hlr_db(pid=15313): Terminated: ok {rc=0} 21:15:54.544441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15315): Launched 21:15:54.841179 run osmo-hlr_10.42.42.2(pid=15316): Launched 21:15:54.954585 run osmo-stp_10.42.42.5: Starting osmo-stp 21:15:55.466881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15318): Launched 21:15:55.764057 run osmo-stp_10.42.42.5(pid=15319): Launched 21:15:55.876583 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:15:56.388185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15321): Launched 21:15:56.502717 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:15:56.756347 run patchelf(pid=15322): Launched 21:15:56.922462 run osmo-stp_10.42.42.5(pid=15319): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15319)] 21:15:57.049137 run osmo-stp_10.42.42.5(pid=15319): stdout: | (launched: 2022-12-08_21:15:55.709186) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:57.176204 run osmo-stp_10.42.42.5(pid=15319): stderr: | [0;m[38;5;43m20221208211555877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211555877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211555877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211555878 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211555880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211555880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211555880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:57.304078 run osmo-stp_10.42.42.5(pid=15319): stdout: | (launched: 2022-12-08_21:15:55.709186) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:57.425717 run osmo-stp_10.42.42.5(pid=15319): stderr: | [0;m[38;5;43m20221208211555877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211555877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211555877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211555878 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211555880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211555880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211555880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:57.570099 run patchelf(pid=15322): Terminating (SIGINT) 21:15:57.737180 run patchelf(pid=15322): Terminated: ok {rc=0} 21:15:57.857116 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15319): Process ended prematurely: osmo-stp_10.42.42.5(pid=15319) [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15319)] [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 21:15:57.865985 tst ping.py:22: Test FAILED (6.3 sec) 21:15:57.892827 run osmo-hlr_10.42.42.2(pid=15316): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15316)] 21:15:57.940699 run osmo-hlr_10.42.42.2(pid=15316): stdout: | (launched: 2022-12-08_21:15:54.786200) 21:15:57.990100 run osmo-hlr_10.42.42.2(pid=15316): stderr: | [0;m[1;31m20221208211554964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211554964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211554964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211554964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211554964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211554964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211554976 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211554984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211554984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211554985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:15:58.039827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15315): Terminating (SIGTERM) 21:15:58.079256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15318): Terminating (SIGTERM) 21:15:58.118882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15321): Terminating (SIGTERM) 21:15:58.158824 --- ParallelTerminationStrategy: PID 15315 died... 21:15:58.177971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15315): Terminated: ok {rc=0} 21:15:58.222293 --- ParallelTerminationStrategy: PID 15318 died... 21:15:58.241024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15318): Terminated: ok {rc=0} 21:15:58.285625 --- ParallelTerminationStrategy: PID 15321 died... 21:15:58.304311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15321): Terminated: ok {rc=0} 21:15:58.389254 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 21:15:59.477029 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:59.489413 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:15:59.541242 tst ping_idle_ping.py: using LAC 16861 21:15:59.658805 tst ping_idle_ping.py: using RAC 31 21:15:59.776391 tst ping_idle_ping.py: using CellId 16861 21:15:59.893308 tst ping_idle_ping.py: using BVCI 16862 21:16:00.003129 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:00.014511 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:00.025574 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:00.036897 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:00.048258 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:00.059656 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:00.071277 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:00.082749 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:16:00.202513 tst ping_idle_ping.py:24: start network... 21:16:00.418571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:16:00.944034 run create_hlr_db(pid=15323): Launched 21:16:01.083474 bus /gobi_6: Setting Powered False 21:16:02.142434 run create_hlr_db(pid=15323): Terminated: ok {rc=0} 21:16:02.564276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15325): Launched 21:16:02.862123 run osmo-hlr_10.42.42.2(pid=15326): Launched 21:16:02.974586 run osmo-stp_10.42.42.5: Starting osmo-stp 21:16:03.485595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15328): Launched 21:16:03.783766 run osmo-stp_10.42.42.5(pid=15329): Launched 21:16:03.897658 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:16:04.411093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15331): Launched 21:16:04.525889 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:16:04.778095 run patchelf(pid=15332): Launched 21:16:04.944585 run osmo-stp_10.42.42.5(pid=15329): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15329)] 21:16:05.071639 run osmo-stp_10.42.42.5(pid=15329): stdout: | (launched: 2022-12-08_21:16:03.728482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:05.200058 run osmo-stp_10.42.42.5(pid=15329): stderr: | [0;m[38;5;43m20221208211603899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211603899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211603899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211603900 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211603900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211603900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211603900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:05.327785 run osmo-stp_10.42.42.5(pid=15329): stdout: | (launched: 2022-12-08_21:16:03.728482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:05.449356 run osmo-stp_10.42.42.5(pid=15329): stderr: | [0;m[38;5;43m20221208211603899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211603899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211603899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211603900 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211603900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211603900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211603900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:05.593719 run patchelf(pid=15332): Terminating (SIGINT) 21:16:05.761736 run patchelf(pid=15332): Terminated: ok {rc=0} 21:16:05.882413 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15329): Process ended prematurely: osmo-stp_10.42.42.5(pid=15329) [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15329)] [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 21:16:05.891459 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 21:16:05.918586 run osmo-hlr_10.42.42.2(pid=15326): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15326)] 21:16:05.966828 run osmo-hlr_10.42.42.2(pid=15326): stdout: | (launched: 2022-12-08_21:16:02.807227) 21:16:06.016208 run osmo-hlr_10.42.42.2(pid=15326): stderr: | [0;m[1;31m20221208211602983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211602983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211602983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211602983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211602983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211602983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211602995 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211603003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211603004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211603004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:16:06.065955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15325): Terminating (SIGTERM) 21:16:06.106030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15328): Terminating (SIGTERM) 21:16:06.146026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15331): Terminating (SIGTERM) 21:16:06.186320 --- ParallelTerminationStrategy: PID 15325 died... 21:16:06.205284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15325): Terminated: ok {rc=0} 21:16:06.250281 --- ParallelTerminationStrategy: PID 15328 died... 21:16:06.268753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15328): Terminated: ok {rc=0} 21:16:06.313219 --- ParallelTerminationStrategy: PID 15331 died... 21:16:06.331805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15331): Terminated: ok {rc=0} 21:16:06.417774 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 21:16:07.720492 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:16:07.727359 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 21:16:07.761876 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 21:16:07.801148 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 21:16:07.888115 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 21:16:07.920264 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 21:16:07.959976 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 21:16:08.554620 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 21:16:08.604505 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:08.615670 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:16:08.681733 tst cs_paging_gprs_active.py: using LAC 16862 21:16:08.810191 tst cs_paging_gprs_active.py: using RAC 32 21:16:08.940761 tst cs_paging_gprs_active.py: using CellId 16862 21:16:09.067658 tst cs_paging_gprs_active.py: using BVCI 16863 21:16:09.187189 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:09.198883 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:09.210370 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:09.221896 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:09.233396 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:09.244708 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:09.256295 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:09.267633 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:09.279076 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:16:09.401541 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:16:09.521124 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:16:09.723762 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:16:10.027396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15336): Launched 21:16:10.290688 run iperf3-srv_10.42.42.10(pid=15337): Launched 21:16:10.404283 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:16:10.606536 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:16:10.909582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15338): Launched 21:16:11.174192 run iperf3-srv_10.42.42.10(pid=15339): Launched 21:16:11.287394 tst cs_paging_gprs_active.py:38: start network... 21:16:11.488336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:16:11.956595 run create_hlr_db(pid=15340): Launched 21:16:12.073347 bus /gobi_6: Setting Powered False 21:16:13.134287 run create_hlr_db(pid=15340): Terminated: ok {rc=0} 21:16:13.577781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15342): Launched 21:16:13.904584 run osmo-hlr_10.42.42.2(pid=15343): Launched 21:16:14.028647 run osmo-stp_10.42.42.5: Starting osmo-stp 21:16:14.590328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15345): Launched 21:16:14.916901 run osmo-stp_10.42.42.5(pid=15346): Launched 21:16:15.041468 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:16:15.602706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15348): Launched 21:16:15.726909 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:16:16.036230 run patchelf(pid=15349): Launched 21:16:16.225848 run osmo-stp_10.42.42.5(pid=15346): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15346)] 21:16:16.360040 run osmo-stp_10.42.42.5(pid=15346): stdout: | (launched: 2022-12-08_21:16:14.857158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:16.493692 run osmo-stp_10.42.42.5(pid=15346): stderr: | [0;m[38;5;43m20221208211615051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211615051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211615051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211615052 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211615052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211615052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211615052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:16.630376 run osmo-stp_10.42.42.5(pid=15346): stdout: | (launched: 2022-12-08_21:16:14.857158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:16.759990 run osmo-stp_10.42.42.5(pid=15346): stderr: | [0;m[38;5;43m20221208211615051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211615051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211615051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211615052 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211615052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211615052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211615052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:16.913291 run patchelf(pid=15349): Terminating (SIGINT) 21:16:17.089261 run patchelf(pid=15349): Terminated: ok {rc=0} 21:16:17.214845 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15346): Process ended prematurely: osmo-stp_10.42.42.5(pid=15346) [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15346)] [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 21:16:17.224544 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 21:16:17.252541 run osmo-hlr_10.42.42.2(pid=15343): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15343)] 21:16:17.301803 run osmo-hlr_10.42.42.2(pid=15343): stdout: | (launched: 2022-12-08_21:16:13.845243) 21:16:17.351973 run osmo-hlr_10.42.42.2(pid=15343): stderr: | [0;m[1;31m20221208211614047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211614047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211614047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211614047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211614047 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211614048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211614060 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211614068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211614069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211614069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:16:17.402497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15336): Terminating (SIGTERM) 21:16:17.442681 run iperf3-srv_10.42.42.10(pid=15337): Terminating (SIGTERM) 21:16:17.482896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15338): Terminating (SIGTERM) 21:16:17.523263 run iperf3-srv_10.42.42.10(pid=15339): Terminating (SIGTERM) 21:16:17.563478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15342): Terminating (SIGTERM) 21:16:17.603718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15345): Terminating (SIGTERM) 21:16:17.643873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15348): Terminating (SIGTERM) 21:16:17.684545 --- ParallelTerminationStrategy: PID 15336 died... 21:16:17.703794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15336): Terminated: ok {rc=0} 21:16:17.748421 --- ParallelTerminationStrategy: PID 15337 died... 21:16:17.767075 run iperf3-srv_10.42.42.10(pid=15337): Terminated {rc=256} 21:16:17.811679 --- ParallelTerminationStrategy: PID 15338 died... 21:16:17.830361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15338): Terminated: ok {rc=0} 21:16:17.874388 --- ParallelTerminationStrategy: PID 15339 died... 21:16:17.893027 run iperf3-srv_10.42.42.10(pid=15339): Terminated {rc=256} 21:16:17.937396 --- ParallelTerminationStrategy: PID 15342 died... 21:16:17.956087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15342): Terminated: ok {rc=0} 21:16:18.000432 --- ParallelTerminationStrategy: PID 15345 died... 21:16:18.019264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15345): Terminated: ok {rc=0} 21:16:18.063697 --- ParallelTerminationStrategy: PID 15348 died... 21:16:18.082543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15348): Terminated: ok {rc=0} 21:16:18.168243 bus /gobi_0: Setting Powered False 21:16:19.266998 bus /gobi_0: Setting Powered False 21:16:20.381577 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 21:16:21.525777 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:21.537557 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:16:21.608418 tst iperf3.py: using LAC 16863 21:16:21.726417 tst iperf3.py: using RAC 33 21:16:21.845982 tst iperf3.py: using CellId 16863 21:16:21.965065 tst iperf3.py: using BVCI 16864 21:16:22.076081 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:22.087066 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:22.097958 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:22.109127 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:22.120115 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:22.131175 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:22.142323 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:22.153342 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:22.164553 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:16:22.284082 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:16:22.503276 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:16:22.828010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15350): Launched 21:16:23.110519 run iperf3-srv_10.42.42.10(pid=15351): Launched 21:16:23.233136 tst iperf3.py:8: start network... 21:16:23.451780 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:16:23.955839 run create_hlr_db(pid=15352): Launched 21:16:24.088695 bus /gobi_6: Setting Powered False 21:16:25.152917 run create_hlr_db(pid=15352): Terminated: ok {rc=0} 21:16:25.586001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15354): Launched 21:16:25.889493 run osmo-hlr_10.42.42.2(pid=15355): Launched 21:16:26.004412 run osmo-stp_10.42.42.5: Starting osmo-stp 21:16:26.540605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15357): Launched 21:16:26.842755 run osmo-stp_10.42.42.5(pid=15358): Launched 21:16:26.957282 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:16:27.477264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15360): Launched 21:16:27.593459 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:16:27.849670 run patchelf(pid=15361): Launched 21:16:28.018412 run osmo-stp_10.42.42.5(pid=15358): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15358)] 21:16:28.146311 run osmo-stp_10.42.42.5(pid=15358): stdout: | (launched: 2022-12-08_21:16:26.786680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:28.275658 run osmo-stp_10.42.42.5(pid=15358): stderr: | [0;m[38;5;43m20221208211626958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211626958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211626958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211626958 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211626959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211626959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211626959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:28.405086 run osmo-stp_10.42.42.5(pid=15358): stdout: | (launched: 2022-12-08_21:16:26.786680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:28.529417 run osmo-stp_10.42.42.5(pid=15358): stderr: | [0;m[38;5;43m20221208211626958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211626958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211626958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211626958 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211626959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211626959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211626959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:28.676289 run patchelf(pid=15361): Terminating (SIGINT) 21:16:28.847279 run patchelf(pid=15361): Terminated: ok {rc=0} 21:16:28.969771 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15358): Process ended prematurely: osmo-stp_10.42.42.5(pid=15358) [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15358)] [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 21:16:28.979081 tst iperf3.py:8: Test FAILED (7.5 sec) 21:16:29.006496 run osmo-hlr_10.42.42.2(pid=15355): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15355)] 21:16:29.054303 run osmo-hlr_10.42.42.2(pid=15355): stdout: | (launched: 2022-12-08_21:16:25.833564) 21:16:29.103436 run osmo-hlr_10.42.42.2(pid=15355): stderr: | [0;m[1;31m20221208211626010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211626010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211626010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211626010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211626010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211626010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211626022 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211626032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211626032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211626032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:16:29.153344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15350): Terminating (SIGTERM) 21:16:29.193197 run iperf3-srv_10.42.42.10(pid=15351): Terminating (SIGTERM) 21:16:29.232724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15354): Terminating (SIGTERM) 21:16:29.272901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15357): Terminating (SIGTERM) 21:16:29.312649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15360): Terminating (SIGTERM) 21:16:29.352797 --- ParallelTerminationStrategy: PID 15350 died... 21:16:29.372019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15350): Terminated: ok {rc=0} 21:16:29.416444 --- ParallelTerminationStrategy: PID 15351 died... 21:16:29.435178 run iperf3-srv_10.42.42.10(pid=15351): Terminated {rc=256} 21:16:29.479219 --- ParallelTerminationStrategy: PID 15354 died... 21:16:29.497881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15354): Terminated: ok {rc=0} 21:16:29.541926 --- ParallelTerminationStrategy: PID 15357 died... 21:16:29.560299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15357): Terminated: ok {rc=0} 21:16:29.605147 --- ParallelTerminationStrategy: PID 15360 died... 21:16:29.623808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15360): Terminated: ok {rc=0} 21:16:29.709178 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 21:16:30.855905 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:30.868651 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:16:30.938956 tst iperf3m4.py: using LAC 16864 21:16:31.060781 tst iperf3m4.py: using RAC 34 21:16:31.191252 tst iperf3m4.py: using CellId 16864 21:16:31.311629 tst iperf3m4.py: using BVCI 16865 21:16:31.424928 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:31.436903 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:31.448842 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:31.461673 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:31.475138 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:31.486855 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:31.500036 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:31.514094 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:31.526044 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:16:31.647162 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:16:31.792540 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:16:31.938030 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:16:32.074738 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:16:32.293939 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:16:32.619678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15362): Launched 21:16:32.902652 run iperf3-srv_10.42.42.10(pid=15363): Launched 21:16:33.024739 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:16:33.244223 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:16:33.570184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15364): Launched 21:16:33.852579 run iperf3-srv_10.42.42.10(pid=15365): Launched 21:16:33.974841 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:16:34.194105 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:16:34.519932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15366): Launched 21:16:34.802586 run iperf3-srv_10.42.42.10(pid=15367): Launched 21:16:34.924381 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:16:35.144415 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:16:35.470798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15368): Launched 21:16:35.753458 run iperf3-srv_10.42.42.10(pid=15369): Launched 21:16:35.875125 tst iperf3m4.py:8: start network... 21:16:36.094491 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:16:36.597912 run create_hlr_db(pid=15370): Launched 21:16:36.731176 bus /gobi_6: Setting Powered False 21:16:37.795068 run create_hlr_db(pid=15370): Terminated: ok {rc=0} 21:16:38.246880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15372): Launched 21:16:38.572060 run osmo-hlr_10.42.42.2(pid=15373): Launched 21:16:38.695018 run osmo-stp_10.42.42.5: Starting osmo-stp 21:16:39.255097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15375): Launched 21:16:39.580539 run osmo-stp_10.42.42.5(pid=15376): Launched 21:16:39.703745 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:16:40.262814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15378): Launched 21:16:40.388733 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:16:40.662951 run patchelf(pid=15379): Launched 21:16:40.843604 run osmo-stp_10.42.42.5(pid=15376): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15376)] 21:16:40.980800 run osmo-stp_10.42.42.5(pid=15376): stdout: | (launched: 2022-12-08_21:16:39.520883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:41.119637 run osmo-stp_10.42.42.5(pid=15376): stderr: | [0;m[38;5;43m20221208211639714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211639714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211639715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211639715 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211639715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211639715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211639716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:41.258296 run osmo-stp_10.42.42.5(pid=15376): stdout: | (launched: 2022-12-08_21:16:39.520883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:41.391604 run osmo-stp_10.42.42.5(pid=15376): stderr: | [0;m[38;5;43m20221208211639714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211639714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211639715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211639715 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211639715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211639715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211639716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:41.548699 run patchelf(pid=15379): Terminating (SIGINT) 21:16:41.730741 run patchelf(pid=15379): Terminated: ok {rc=0} 21:16:41.861409 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15376): Process ended prematurely: osmo-stp_10.42.42.5(pid=15376) [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15376)] [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 21:16:41.871531 tst iperf3m4.py:8: Test FAILED (11.1 sec) 21:16:41.900477 run osmo-hlr_10.42.42.2(pid=15373): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15373)] 21:16:41.950584 run osmo-hlr_10.42.42.2(pid=15373): stdout: | (launched: 2022-12-08_21:16:38.512158) 21:16:42.002139 run osmo-hlr_10.42.42.2(pid=15373): stderr: | [0;m[1;31m20221208211638713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211638713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211638713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211638713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211638713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211638713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211638725 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211638734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211638734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211638734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:16:42.054468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15362): Terminating (SIGTERM) 21:16:42.096399 run iperf3-srv_10.42.42.10(pid=15363): Terminating (SIGTERM) 21:16:42.138391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15364): Terminating (SIGTERM) 21:16:42.180340 run iperf3-srv_10.42.42.10(pid=15365): Terminating (SIGTERM) 21:16:42.222006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15366): Terminating (SIGTERM) 21:16:42.263862 run iperf3-srv_10.42.42.10(pid=15367): Terminating (SIGTERM) 21:16:42.305707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15368): Terminating (SIGTERM) 21:16:42.347562 run iperf3-srv_10.42.42.10(pid=15369): Terminating (SIGTERM) 21:16:42.389239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15372): Terminating (SIGTERM) 21:16:42.430949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15375): Terminating (SIGTERM) 21:16:42.472826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15378): Terminating (SIGTERM) 21:16:42.515306 --- ParallelTerminationStrategy: PID 15362 died... 21:16:42.535375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15362): Terminated: ok {rc=0} 21:16:42.581418 --- ParallelTerminationStrategy: PID 15363 died... 21:16:42.600690 run iperf3-srv_10.42.42.10(pid=15363): Terminated {rc=256} 21:16:42.646696 --- ParallelTerminationStrategy: PID 15364 died... 21:16:42.666290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15364): Terminated: ok {rc=0} 21:16:42.712063 --- ParallelTerminationStrategy: PID 15365 died... 21:16:42.731586 run iperf3-srv_10.42.42.10(pid=15365): Terminated {rc=256} 21:16:42.777224 --- ParallelTerminationStrategy: PID 15366 died... 21:16:42.796741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15366): Terminated: ok {rc=0} 21:16:42.842554 --- ParallelTerminationStrategy: PID 15367 died... 21:16:42.862020 run iperf3-srv_10.42.42.10(pid=15367): Terminated {rc=256} 21:16:42.907871 --- ParallelTerminationStrategy: PID 15368 died... 21:16:42.927562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15368): Terminated: ok {rc=0} 21:16:42.973140 --- ParallelTerminationStrategy: PID 15369 died... 21:16:42.992574 run iperf3-srv_10.42.42.10(pid=15369): Terminated {rc=256} 21:16:43.038824 --- ParallelTerminationStrategy: PID 15372 died... 21:16:43.058389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15372): Terminated: ok {rc=0} 21:16:43.104434 --- ParallelTerminationStrategy: PID 15375 died... 21:16:43.124068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15375): Terminated: ok {rc=0} 21:16:43.170145 --- ParallelTerminationStrategy: PID 15378 died... 21:16:43.189941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15378): Terminated: ok {rc=0} 21:16:43.277847 bus /gobi_4: Setting Powered False 21:16:44.377142 bus /gobi_4: Setting Powered False 21:16:45.493219 bus /gobi_1: Setting Powered False 21:16:46.589371 bus /gobi_1: Setting Powered False 21:16:47.706856 bus /gobi_0: Setting Powered False 21:16:48.805571 bus /gobi_0: Setting Powered False 21:16:49.921683 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 21:16:51.024531 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:51.036360 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:16:51.105129 tst ping.py: using LAC 16865 21:16:51.222346 tst ping.py: using RAC 35 21:16:51.341344 tst ping.py: using CellId 16865 21:16:51.460203 tst ping.py: using BVCI 16866 21:16:51.569936 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:51.581276 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:51.592098 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:51.603633 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:51.614975 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:51.626442 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:51.638457 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:51.649657 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:16:51.765627 tst ping.py:19: start network... 21:16:51.981345 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:16:52.474898 run create_hlr_db(pid=15380): Launched 21:16:52.604553 bus /gobi_6: Setting Powered False 21:16:53.668914 run create_hlr_db(pid=15380): Terminated: ok {rc=0} 21:16:54.096662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15382): Launched 21:16:54.394538 run osmo-hlr_10.42.42.2(pid=15383): Launched 21:16:54.509161 run osmo-stp_10.42.42.5: Starting osmo-stp 21:16:55.038143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15385): Launched 21:16:55.335532 run osmo-stp_10.42.42.5(pid=15386): Launched 21:16:55.448683 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:16:55.961284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15388): Launched 21:16:56.075305 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:16:56.327172 run patchelf(pid=15389): Launched 21:16:56.493604 run osmo-stp_10.42.42.5(pid=15386): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15386)] 21:16:56.620424 run osmo-stp_10.42.42.5(pid=15386): stdout: | (launched: 2022-12-08_21:16:55.280619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:56.748856 run osmo-stp_10.42.42.5(pid=15386): stderr: | [0;m[38;5;43m20221208211655452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211655452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211655452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211655453 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211655453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211655453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211655453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:56.877299 run osmo-stp_10.42.42.5(pid=15386): stdout: | (launched: 2022-12-08_21:16:55.280619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:56.999461 run osmo-stp_10.42.42.5(pid=15386): stderr: | [0;m[38;5;43m20221208211655452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211655452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211655452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211655453 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211655453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211655453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211655453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:57.144753 run patchelf(pid=15389): Terminating (SIGINT) 21:16:57.312486 run patchelf(pid=15389): Terminated: ok {rc=0} 21:16:57.433115 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15386): Process ended prematurely: osmo-stp_10.42.42.5(pid=15386) [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15386)] [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 21:16:57.442029 tst ping.py:22: Test FAILED (6.4 sec) 21:16:57.469368 run osmo-hlr_10.42.42.2(pid=15383): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15383)] 21:16:57.517192 run osmo-hlr_10.42.42.2(pid=15383): stdout: | (launched: 2022-12-08_21:16:54.339445) 21:16:57.566351 run osmo-hlr_10.42.42.2(pid=15383): stderr: | [0;m[1;31m20221208211654514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211654514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211654514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211654514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211654514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211654515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211654526 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211654537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211654537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211654538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:16:57.615783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15382): Terminating (SIGTERM) 21:16:57.655588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15385): Terminating (SIGTERM) 21:16:57.695268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15388): Terminating (SIGTERM) 21:16:57.735526 --- ParallelTerminationStrategy: PID 15382 died... 21:16:57.754734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15382): Terminated: ok {rc=0} 21:16:57.799592 --- ParallelTerminationStrategy: PID 15385 died... 21:16:57.818450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15385): Terminated: ok {rc=0} 21:16:57.863084 --- ParallelTerminationStrategy: PID 15388 died... 21:16:57.882069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15388): Terminated: ok {rc=0} 21:16:57.968374 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 21:16:59.056731 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:59.068848 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:16:59.136864 tst ping_idle_ping.py: using LAC 16866 21:16:59.255464 tst ping_idle_ping.py: using RAC 36 21:16:59.373207 tst ping_idle_ping.py: using CellId 16866 21:16:59.489393 tst ping_idle_ping.py: using BVCI 16867 21:16:59.597069 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:59.608087 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:59.618929 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:59.629968 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:59.640893 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:59.651906 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:59.663024 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:59.674104 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:16:59.792380 tst ping_idle_ping.py:24: start network... 21:17:00.007963 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:17:00.506171 run create_hlr_db(pid=15390): Launched 21:17:00.637122 bus /gobi_6: Setting Powered False 21:17:01.699420 run create_hlr_db(pid=15390): Terminated: ok {rc=0} 21:17:02.174389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15395): Launched 21:17:02.485359 run osmo-hlr_10.42.42.2(pid=15396): Launched 21:17:02.599379 run osmo-stp_10.42.42.5: Starting osmo-stp 21:17:03.121772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15398): Launched 21:17:03.419306 run osmo-stp_10.42.42.5(pid=15399): Launched 21:17:03.532263 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:17:04.043386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15401): Launched 21:17:04.156746 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:17:04.407797 run patchelf(pid=15402): Launched 21:17:04.573749 run osmo-stp_10.42.42.5(pid=15399): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15399)] 21:17:04.699900 run osmo-stp_10.42.42.5(pid=15399): stdout: | (launched: 2022-12-08_21:17:03.364335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:04.827807 run osmo-stp_10.42.42.5(pid=15399): stderr: | [0;m[38;5;43m20221208211703533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211703533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211703533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211703534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211703534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211703534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211703534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:04.955787 run osmo-stp_10.42.42.5(pid=15399): stdout: | (launched: 2022-12-08_21:17:03.364335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:05.077554 run osmo-stp_10.42.42.5(pid=15399): stderr: | [0;m[38;5;43m20221208211703533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211703533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211703533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211703534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211703534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211703534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211703534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:05.222154 run patchelf(pid=15402): Terminating (SIGINT) 21:17:05.389541 run patchelf(pid=15402): Terminated: ok {rc=0} 21:17:05.510220 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15399): Process ended prematurely: osmo-stp_10.42.42.5(pid=15399) [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15399)] [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 21:17:05.519072 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 21:17:05.546266 run osmo-hlr_10.42.42.2(pid=15396): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15396)] 21:17:05.593668 run osmo-hlr_10.42.42.2(pid=15396): stdout: | (launched: 2022-12-08_21:17:02.430401) 21:17:05.642874 run osmo-hlr_10.42.42.2(pid=15396): stderr: | [0;m[1;31m20221208211702604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211702604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211702604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211702604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211702604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211702604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211702616 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211702625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211702626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211702626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:17:05.692344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15395): Terminating (SIGTERM) 21:17:05.731909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15398): Terminating (SIGTERM) 21:17:05.771727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15401): Terminating (SIGTERM) 21:17:05.811855 --- ParallelTerminationStrategy: PID 15395 died... 21:17:05.830933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15395): Terminated: ok {rc=0} 21:17:05.875339 --- ParallelTerminationStrategy: PID 15398 died... 21:17:05.894241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15398): Terminated: ok {rc=0} 21:17:05.938451 --- ParallelTerminationStrategy: PID 15401 died... 21:17:05.957105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15401): Terminated: ok {rc=0} 21:17:06.042997 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 21:17:07.350192 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:17:07.357712 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 21:17:07.390592 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 21:17:07.428820 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 21:17:07.517422 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 21:17:07.551382 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 21:17:07.591745 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 21:17:08.189224 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 21:17:08.242668 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:08.254549 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:17:08.307706 tst cs_paging_gprs_active.py: using LAC 16867 21:17:08.434172 tst cs_paging_gprs_active.py: using RAC 37 21:17:08.558005 tst cs_paging_gprs_active.py: using CellId 16867 21:17:08.683023 tst cs_paging_gprs_active.py: using BVCI 16868 21:17:08.799238 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:08.811235 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:08.823078 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:08.834787 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:08.846551 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:08.858189 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:08.870066 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:08.881592 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:08.894121 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:17:09.017089 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:17:09.136439 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:17:09.352219 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:09.672754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15406): Launched 21:17:09.950039 run iperf3-srv_10.42.42.10(pid=15407): Launched 21:17:10.070301 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:17:10.284560 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:10.604401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15408): Launched 21:17:10.881160 run iperf3-srv_10.42.42.10(pid=15409): Launched 21:17:11.001076 tst cs_paging_gprs_active.py:38: start network... 21:17:11.216323 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:17:11.713395 run create_hlr_db(pid=15410): Launched 21:17:11.843909 bus /gobi_6: Setting Powered False 21:17:12.906433 run create_hlr_db(pid=15410): Terminated: ok {rc=0} 21:17:13.352728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15412): Launched 21:17:13.673544 run osmo-hlr_10.42.42.2(pid=15413): Launched 21:17:13.795246 run osmo-stp_10.42.42.5: Starting osmo-stp 21:17:14.346281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15415): Launched 21:17:14.667183 run osmo-stp_10.42.42.5(pid=15416): Launched 21:17:14.789404 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:17:15.342356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15418): Launched 21:17:15.465418 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:17:15.735945 run patchelf(pid=15419): Launched 21:17:15.930586 run osmo-stp_10.42.42.5(pid=15416): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15416)] 21:17:16.068857 run osmo-stp_10.42.42.5(pid=15416): stdout: | (launched: 2022-12-08_21:17:14.608279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:16.209646 run osmo-stp_10.42.42.5(pid=15416): stderr: | [0;m[38;5;43m20221208211714800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211714800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211714800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211714801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211714801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211714801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211714801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:16.350491 run osmo-stp_10.42.42.5(pid=15416): stdout: | (launched: 2022-12-08_21:17:14.608279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:16.485203 run osmo-stp_10.42.42.5(pid=15416): stderr: | [0;m[38;5;43m20221208211714800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211714800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211714800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211714801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211714801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211714801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211714801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:16.644272 run patchelf(pid=15419): Terminating (SIGINT) 21:17:16.827698 run patchelf(pid=15419): Terminated: ok {rc=0} 21:17:16.960360 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15416): Process ended prematurely: osmo-stp_10.42.42.5(pid=15416) [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15416)] [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 21:17:16.971207 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 21:17:17.000927 run osmo-hlr_10.42.42.2(pid=15413): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15413)] 21:17:17.053181 run osmo-hlr_10.42.42.2(pid=15413): stdout: | (launched: 2022-12-08_21:17:13.615313) 21:17:17.105829 run osmo-hlr_10.42.42.2(pid=15413): stderr: | [0;m[1;31m20221208211713812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211713812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211713812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211713812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211713812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211713812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211713824 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211713832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211713832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211713832 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:17:17.159031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15406): Terminating (SIGTERM) 21:17:17.201418 run iperf3-srv_10.42.42.10(pid=15407): Terminating (SIGTERM) 21:17:17.243218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15408): Terminating (SIGTERM) 21:17:17.285088 run iperf3-srv_10.42.42.10(pid=15409): Terminating (SIGTERM) 21:17:17.326719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15412): Terminating (SIGTERM) 21:17:17.368685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15415): Terminating (SIGTERM) 21:17:17.410469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15418): Terminating (SIGTERM) 21:17:17.452326 --- ParallelTerminationStrategy: PID 15406 died... 21:17:17.472302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15406): Terminated: ok {rc=0} 21:17:17.518609 --- ParallelTerminationStrategy: PID 15407 died... 21:17:17.538237 run iperf3-srv_10.42.42.10(pid=15407): Terminated {rc=256} 21:17:17.584472 --- ParallelTerminationStrategy: PID 15408 died... 21:17:17.604074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15408): Terminated: ok {rc=0} 21:17:17.650218 --- ParallelTerminationStrategy: PID 15409 died... 21:17:17.669787 run iperf3-srv_10.42.42.10(pid=15409): Terminated {rc=256} 21:17:17.715591 --- ParallelTerminationStrategy: PID 15412 died... 21:17:17.735033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15412): Terminated: ok {rc=0} 21:17:17.780772 --- ParallelTerminationStrategy: PID 15415 died... 21:17:17.800276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15415): Terminated: ok {rc=0} 21:17:17.846199 --- ParallelTerminationStrategy: PID 15418 died... 21:17:17.865849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15418): Terminated: ok {rc=0} 21:17:17.953050 bus /gobi_0: Setting Powered False 21:17:19.051482 bus /gobi_0: Setting Powered False 21:17:20.168343 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 21:17:21.316522 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:21.329253 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:17:21.380569 tst iperf3.py: using LAC 16868 21:17:21.507310 tst iperf3.py: using RAC 38 21:17:21.632602 tst iperf3.py: using CellId 16868 21:17:21.759399 tst iperf3.py: using BVCI 16869 21:17:21.877307 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:21.889471 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:21.901038 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:21.912619 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:21.924267 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:21.935932 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:21.947660 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:21.959223 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:21.971029 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:17:22.087930 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:17:22.286051 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:22.583481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15420): Launched 21:17:22.842839 run iperf3-srv_10.42.42.10(pid=15421): Launched 21:17:22.954257 tst iperf3.py:8: start network... 21:17:23.152687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:17:23.613165 run create_hlr_db(pid=15422): Launched 21:17:23.737305 bus /gobi_6: Setting Powered False 21:17:24.796292 run create_hlr_db(pid=15422): Terminated: ok {rc=0} 21:17:25.233637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15424): Launched 21:17:25.552737 run osmo-hlr_10.42.42.2(pid=15425): Launched 21:17:25.676110 run osmo-stp_10.42.42.5: Starting osmo-stp 21:17:26.227198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15427): Launched 21:17:26.545878 run osmo-stp_10.42.42.5(pid=15428): Launched 21:17:26.667699 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:17:27.218510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15430): Launched 21:17:27.340654 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:17:27.610657 run patchelf(pid=15431): Launched 21:17:27.789147 run osmo-stp_10.42.42.5(pid=15428): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15428)] 21:17:27.924345 run osmo-stp_10.42.42.5(pid=15428): stdout: | (launched: 2022-12-08_21:17:26.487703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:28.061842 run osmo-stp_10.42.42.5(pid=15428): stderr: | [0;m[38;5;43m20221208211726680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211726680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211726680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211726680 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211726683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211726683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211726683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:28.198792 run osmo-stp_10.42.42.5(pid=15428): stdout: | (launched: 2022-12-08_21:17:26.487703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:28.329804 run osmo-stp_10.42.42.5(pid=15428): stderr: | [0;m[38;5;43m20221208211726680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211726680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211726680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211726680 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211726683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211726683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211726683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:28.485380 run patchelf(pid=15431): Terminating (SIGINT) 21:17:28.664609 run patchelf(pid=15431): Terminated: ok {rc=0} 21:17:28.793883 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15428): Process ended prematurely: osmo-stp_10.42.42.5(pid=15428) [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15428)] [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 21:17:28.804135 tst iperf3.py:8: Test FAILED (7.5 sec) 21:17:28.832300 run osmo-hlr_10.42.42.2(pid=15425): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15425)] 21:17:28.882096 run osmo-hlr_10.42.42.2(pid=15425): stdout: | (launched: 2022-12-08_21:17:25.493979) 21:17:28.933568 run osmo-hlr_10.42.42.2(pid=15425): stderr: | [0;m[1;31m20221208211725691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211725691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211725692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211725692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211725692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211725692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211725704 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211725712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211725713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211725713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:17:28.985513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15420): Terminating (SIGTERM) 21:17:29.026982 run iperf3-srv_10.42.42.10(pid=15421): Terminating (SIGTERM) 21:17:29.068566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15424): Terminating (SIGTERM) 21:17:29.109957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15427): Terminating (SIGTERM) 21:17:29.151233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15430): Terminating (SIGTERM) 21:17:29.192923 --- ParallelTerminationStrategy: PID 15420 died... 21:17:29.212387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15420): Terminated: ok {rc=0} 21:17:29.257926 --- ParallelTerminationStrategy: PID 15421 died... 21:17:29.277230 run iperf3-srv_10.42.42.10(pid=15421): Terminated {rc=256} 21:17:29.322579 --- ParallelTerminationStrategy: PID 15424 died... 21:17:29.341993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15424): Terminated: ok {rc=0} 21:17:29.387971 --- ParallelTerminationStrategy: PID 15427 died... 21:17:29.407306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15427): Terminated: ok {rc=0} 21:17:29.452844 --- ParallelTerminationStrategy: PID 15430 died... 21:17:29.472282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15430): Terminated: ok {rc=0} 21:17:29.559012 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 21:17:30.710527 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:30.723259 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:17:30.774661 tst iperf3m4.py: using LAC 16869 21:17:30.927071 tst iperf3m4.py: using RAC 39 21:17:31.053566 tst iperf3m4.py: using CellId 16869 21:17:31.239835 tst iperf3m4.py: using BVCI 16870 21:17:31.361909 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:31.374451 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:31.386773 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:31.399155 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:31.411454 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:31.423810 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:31.436321 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:31.448574 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:31.461390 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:17:31.583317 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:17:31.738005 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:17:31.877989 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:17:32.018612 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:17:32.247583 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:32.558977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15432): Launched 21:17:32.820748 run iperf3-srv_10.42.42.10(pid=15433): Launched 21:17:32.933489 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:17:33.134426 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:33.434439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15434): Launched 21:17:33.695034 run iperf3-srv_10.42.42.10(pid=15435): Launched 21:17:33.808230 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:17:34.008756 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:34.309441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15436): Launched 21:17:34.570941 run iperf3-srv_10.42.42.10(pid=15437): Launched 21:17:34.683102 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:17:34.882912 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:35.182199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15438): Launched 21:17:35.441685 run iperf3-srv_10.42.42.10(pid=15439): Launched 21:17:35.553729 tst iperf3m4.py:8: start network... 21:17:35.762092 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:17:36.257883 run create_hlr_db(pid=15443): Launched 21:17:36.388014 bus /gobi_6: Setting Powered False 21:17:37.450838 run create_hlr_db(pid=15443): Terminated: ok {rc=0} 21:17:37.897528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15445): Launched 21:17:38.216479 run osmo-hlr_10.42.42.2(pid=15446): Launched 21:17:38.337399 run osmo-stp_10.42.42.5: Starting osmo-stp 21:17:38.886005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15448): Launched 21:17:39.207355 run osmo-stp_10.42.42.5(pid=15449): Launched 21:17:39.330087 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:17:39.883923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15451): Launched 21:17:40.006607 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:17:40.278707 run patchelf(pid=15452): Launched 21:17:40.456876 run osmo-stp_10.42.42.5(pid=15449): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15449)] 21:17:40.592833 run osmo-stp_10.42.42.5(pid=15449): stdout: | (launched: 2022-12-08_21:17:39.148579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:40.729836 run osmo-stp_10.42.42.5(pid=15449): stderr: | [0;m[38;5;43m20221208211739339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211739339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211739339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211739340 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211739340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211739340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211739340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:40.866983 run osmo-stp_10.42.42.5(pid=15449): stdout: | (launched: 2022-12-08_21:17:39.148579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:40.998097 run osmo-stp_10.42.42.5(pid=15449): stderr: | [0;m[38;5;43m20221208211739339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211739339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211739339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211739340 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211739340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211739340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211739340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:41.154312 run patchelf(pid=15452): Terminating (SIGINT) 21:17:41.334311 run patchelf(pid=15452): Terminated: ok {rc=0} 21:17:41.463653 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15449): Process ended prematurely: osmo-stp_10.42.42.5(pid=15449) [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15449)] [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 21:17:41.473722 tst iperf3m4.py:8: Test FAILED (10.8 sec) 21:17:41.502128 run osmo-hlr_10.42.42.2(pid=15446): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15446)] 21:17:41.552072 run osmo-hlr_10.42.42.2(pid=15446): stdout: | (launched: 2022-12-08_21:17:38.158300) 21:17:41.603672 run osmo-hlr_10.42.42.2(pid=15446): stderr: | [0;m[1;31m20221208211738359 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211738359 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211738359 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211738359 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211738359 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211738359 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211738377 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211738387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211738387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211738387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:17:41.655659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15432): Terminating (SIGTERM) 21:17:41.697305 run iperf3-srv_10.42.42.10(pid=15433): Terminating (SIGTERM) 21:17:41.738871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15434): Terminating (SIGTERM) 21:17:41.780812 run iperf3-srv_10.42.42.10(pid=15435): Terminating (SIGTERM) 21:17:41.822590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15436): Terminating (SIGTERM) 21:17:41.864199 run iperf3-srv_10.42.42.10(pid=15437): Terminating (SIGTERM) 21:17:41.905812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15438): Terminating (SIGTERM) 21:17:41.947393 run iperf3-srv_10.42.42.10(pid=15439): Terminating (SIGTERM) 21:17:41.988707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15445): Terminating (SIGTERM) 21:17:42.030226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15448): Terminating (SIGTERM) 21:17:42.071992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15451): Terminating (SIGTERM) 21:17:42.114179 --- ParallelTerminationStrategy: PID 15432 died... 21:17:42.133937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15432): Terminated: ok {rc=0} 21:17:42.179708 --- ParallelTerminationStrategy: PID 15433 died... 21:17:42.199025 run iperf3-srv_10.42.42.10(pid=15433): Terminated {rc=256} 21:17:42.244705 --- ParallelTerminationStrategy: PID 15434 died... 21:17:42.264251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15434): Terminated: ok {rc=0} 21:17:42.309766 --- ParallelTerminationStrategy: PID 15435 died... 21:17:42.329221 run iperf3-srv_10.42.42.10(pid=15435): Terminated {rc=256} 21:17:42.374974 --- ParallelTerminationStrategy: PID 15436 died... 21:17:42.394267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15436): Terminated: ok {rc=0} 21:17:42.439864 --- ParallelTerminationStrategy: PID 15437 died... 21:17:42.459197 run iperf3-srv_10.42.42.10(pid=15437): Terminated {rc=256} 21:17:42.504649 --- ParallelTerminationStrategy: PID 15438 died... 21:17:42.523981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15438): Terminated: ok {rc=0} 21:17:42.570082 --- ParallelTerminationStrategy: PID 15439 died... 21:17:42.589402 run iperf3-srv_10.42.42.10(pid=15439): Terminated {rc=256} 21:17:42.634997 --- ParallelTerminationStrategy: PID 15445 died... 21:17:42.654361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15445): Terminated: ok {rc=0} 21:17:42.700531 --- ParallelTerminationStrategy: PID 15448 died... 21:17:42.720062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15448): Terminated: ok {rc=0} 21:17:42.765739 --- ParallelTerminationStrategy: PID 15451 died... 21:17:42.785168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15451): Terminated: ok {rc=0} 21:17:42.873129 bus /gobi_4: Setting Powered False 21:17:43.972847 bus /gobi_4: Setting Powered False 21:17:45.089005 bus /gobi_1: Setting Powered False 21:17:46.188266 bus /gobi_1: Setting Powered False 21:17:47.305830 bus /gobi_0: Setting Powered False 21:17:48.403674 bus /gobi_0: Setting Powered False 21:17:49.515965 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 21:17:50.618349 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:50.630860 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:17:50.689042 tst ping.py: using LAC 16870 21:17:50.811896 tst ping.py: using RAC 40 21:17:50.936356 tst ping.py: using CellId 16870 21:17:51.059076 tst ping.py: using BVCI 16871 21:17:51.173835 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:51.185922 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:51.197607 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:51.209239 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:51.220744 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:51.232452 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:51.244220 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:51.255829 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:17:51.374048 tst ping.py:19: start network... 21:17:51.585301 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:17:52.070789 run create_hlr_db(pid=15453): Launched 21:17:52.197804 bus /gobi_6: Setting Powered False 21:17:53.260518 run create_hlr_db(pid=15453): Terminated: ok {rc=0} 21:17:53.679572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15455): Launched 21:17:53.973063 run osmo-hlr_10.42.42.2(pid=15456): Launched 21:17:54.084200 run osmo-stp_10.42.42.5: Starting osmo-stp 21:17:54.601352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15458): Launched 21:17:54.893520 run osmo-stp_10.42.42.5(pid=15459): Launched 21:17:55.004307 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:17:55.509349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15461): Launched 21:17:55.622171 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:17:55.869930 run patchelf(pid=15462): Launched 21:17:56.047483 run osmo-stp_10.42.42.5(pid=15459): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15459)] 21:17:56.181276 run osmo-stp_10.42.42.5(pid=15459): stdout: | (launched: 2022-12-08_21:17:54.839135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:56.315909 run osmo-stp_10.42.42.5(pid=15459): stderr: | [0;m[38;5;43m20221208211755007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211755007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211755007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211755008 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211755008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211755008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211755008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:56.451493 run osmo-stp_10.42.42.5(pid=15459): stdout: | (launched: 2022-12-08_21:17:54.839135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:56.579976 run osmo-stp_10.42.42.5(pid=15459): stderr: | [0;m[38;5;43m20221208211755007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211755007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211755007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211755008 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211755008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211755008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211755008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:56.732229 run patchelf(pid=15462): Terminating (SIGINT) 21:17:56.908382 run patchelf(pid=15462): Terminated: ok {rc=0} 21:17:57.035536 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15459): Process ended prematurely: osmo-stp_10.42.42.5(pid=15459) [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15459)] [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 21:17:57.044936 tst ping.py:22: Test FAILED (6.4 sec) 21:17:57.073161 run osmo-hlr_10.42.42.2(pid=15456): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15456)] 21:17:57.122982 run osmo-hlr_10.42.42.2(pid=15456): stdout: | (launched: 2022-12-08_21:17:53.918888) 21:17:57.174471 run osmo-hlr_10.42.42.2(pid=15456): stderr: | [0;m[1;31m20221208211754094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211754094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211754094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211754094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211754094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211754094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211754107 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211754115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211754115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211754116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:17:57.226469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15455): Terminating (SIGTERM) 21:17:57.267875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15458): Terminating (SIGTERM) 21:17:57.309365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15461): Terminating (SIGTERM) 21:17:57.351254 --- ParallelTerminationStrategy: PID 15455 died... 21:17:57.371122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15455): Terminated: ok {rc=0} 21:17:57.417198 --- ParallelTerminationStrategy: PID 15458 died... 21:17:57.436585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15458): Terminated: ok {rc=0} 21:17:57.482552 --- ParallelTerminationStrategy: PID 15461 died... 21:17:57.502048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15461): Terminated: ok {rc=0} 21:17:57.589933 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 21:17:58.677045 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:58.690033 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:17:58.742309 tst ping_idle_ping.py: using LAC 16871 21:17:58.866650 tst ping_idle_ping.py: using RAC 41 21:17:58.991006 tst ping_idle_ping.py: using CellId 16871 21:17:59.114498 tst ping_idle_ping.py: using BVCI 16872 21:17:59.229317 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:59.241206 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:59.252770 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:59.264511 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:59.276074 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:59.287749 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:59.299459 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:59.311190 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:17:59.426743 tst ping_idle_ping.py:24: start network... 21:17:59.623503 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:18:00.081876 run create_hlr_db(pid=15463): Launched 21:18:00.194224 bus /gobi_6: Setting Powered False 21:18:01.269738 run create_hlr_db(pid=15463): Terminated: ok {rc=0} 21:18:01.759777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15465): Launched 21:18:02.076659 run osmo-hlr_10.42.42.2(pid=15466): Launched 21:18:02.234338 run osmo-stp_10.42.42.5: Starting osmo-stp 21:18:02.814004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15468): Launched 21:18:03.129010 run osmo-stp_10.42.42.5(pid=15469): Launched 21:18:03.248144 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:18:03.791152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15471): Launched 21:18:03.911743 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:18:04.178935 run patchelf(pid=15472): Launched 21:18:04.354618 run osmo-stp_10.42.42.5(pid=15469): ERR: Terminated: ERROR {rc=1} [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15469)] 21:18:04.488183 run osmo-stp_10.42.42.5(pid=15469): stdout: | (launched: 2022-12-08_21:18:03.071070) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:18:04.623588 run osmo-stp_10.42.42.5(pid=15469): stderr: | [0;m[38;5;43m20221208211803262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211803263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211803263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211803263 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211803264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211803264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211803264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:04.758628 run osmo-stp_10.42.42.5(pid=15469): stdout: | (launched: 2022-12-08_21:18:03.071070) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:18:04.887831 run osmo-stp_10.42.42.5(pid=15469): stderr: | [0;m[38;5;43m20221208211803262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211803263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211803263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211803263 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211803264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211803264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211803264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:05.040813 run patchelf(pid=15472): Terminating (SIGINT) 21:18:05.218637 run patchelf(pid=15472): Terminated: ok {rc=0} 21:18:05.345821 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15469): Process ended prematurely: osmo-stp_10.42.42.5(pid=15469) [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15469)] [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 21:18:05.355338 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 21:18:05.383056 run osmo-hlr_10.42.42.2(pid=15466): ERR: Terminated: ERROR {rc=237} [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15466)] 21:18:05.432776 run osmo-hlr_10.42.42.2(pid=15466): stdout: | (launched: 2022-12-08_21:18:02.014929) 21:18:05.484351 run osmo-hlr_10.42.42.2(pid=15466): stderr: | [0;m[1;31m20221208211802335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211802335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211802335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211802335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211802335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211802336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211802353 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211802362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211802362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211802362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:18:05.536289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15465): Terminating (SIGTERM) 21:18:05.578078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15468): Terminating (SIGTERM) 21:18:05.619975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15471): Terminating (SIGTERM) 21:18:05.662208 --- ParallelTerminationStrategy: PID 15465 died... 21:18:05.682131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15465): Terminated: ok {rc=0} 21:18:05.728633 --- ParallelTerminationStrategy: PID 15468 died... 21:18:05.748220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15468): Terminated: ok {rc=0} 21:18:05.793981 --- ParallelTerminationStrategy: PID 15471 died... 21:18:05.813570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15471): Terminated: ok {rc=0} 21:18:05.900689 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 21:18:07.223768 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:18:07.231735 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:18:07.264851 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 21:18:07.300122 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:18:07.354757 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:18:07.387629 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 21:18:07.422735 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:18:07.981633 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2349 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 21:18:07.987798 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:18:08.000011 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:18:08.069427 tst switch_tch_pdch.py: using LAC 16872 21:18:08.186832 tst switch_tch_pdch.py: using RAC 42 21:18:08.302274 tst switch_tch_pdch.py: using CellId 16872 21:18:08.417256 tst switch_tch_pdch.py: using BVCI 16873 21:18:08.524399 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:18:08.535952 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:18:08.547219 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:18:08.558902 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:18:08.570586 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:18:08.582136 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:18:08.593740 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:18:08.605357 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:18:08.719568 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:18:08.834715 tst switch_tch_pdch.py:51: start network... 21:18:09.030200 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:18:09.481707 run create_hlr_db(pid=15477): Launched 21:18:09.592254 bus /gobi_6: Setting Powered False 21:18:10.650939 run create_hlr_db(pid=15477): Terminated: ok {rc=0} 21:18:11.081081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15479): Launched 21:18:11.395257 run osmo-hlr_10.42.42.2(pid=15480): Launched 21:18:11.514508 run osmo-stp_10.42.42.5: Starting osmo-stp 21:18:12.060757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15482): Launched 21:18:12.374672 run osmo-stp_10.42.42.5(pid=15483): Launched 21:18:12.493957 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:18:13.036863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15485): Launched 21:18:13.158601 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:18:13.425549 run patchelf(pid=15486): Launched 21:18:13.601634 run osmo-stp_10.42.42.5(pid=15483): ERR: Terminated: ERROR {rc=1} [trial-2349↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15483)] 21:18:13.735632 run osmo-stp_10.42.42.5(pid=15483): stdout: | (launched: 2022-12-08_21:18:12.317522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:18:13.871236 run osmo-stp_10.42.42.5(pid=15483): stderr: | [0;m[38;5;43m20221208211812506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211812507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211812507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211812507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211812508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211812508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211812508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:14.006998 run osmo-stp_10.42.42.5(pid=15483): stdout: | (launched: 2022-12-08_21:18:12.317522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:18:14.137405 run osmo-stp_10.42.42.5(pid=15483): stderr: | [0;m[38;5;43m20221208211812506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211812507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211812507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211812507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211812508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211812508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211812508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:14.291017 run patchelf(pid=15486): Terminating (SIGINT) 21:18:14.468903 run patchelf(pid=15486): Terminated: ok {rc=0} 21:18:14.597245 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15483): Process ended prematurely: osmo-stp_10.42.42.5(pid=15483) [trial-2349↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15483)] [trial-2349↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 21:18:14.606795 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 21:18:14.634698 run osmo-hlr_10.42.42.2(pid=15480): ERR: Terminated: ERROR {rc=237} [trial-2349↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15480)] 21:18:14.684756 run osmo-hlr_10.42.42.2(pid=15480): stdout: | (launched: 2022-12-08_21:18:11.337970) 21:18:14.736804 run osmo-hlr_10.42.42.2(pid=15480): stderr: | [0;m[1;31m20221208211811535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211811535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211811535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211811535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211811535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211811535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211811548 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211811559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211811559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211811559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:18:14.789417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15479): Terminating (SIGTERM) 21:18:14.831373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15482): Terminating (SIGTERM) 21:18:14.873182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15485): Terminating (SIGTERM) 21:18:14.915118 --- ParallelTerminationStrategy: PID 15479 died... 21:18:14.935009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15479): Terminated: ok {rc=0} 21:18:14.981192 --- ParallelTerminationStrategy: PID 15482 died... 21:18:15.000634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15482): Terminated: ok {rc=0} 21:18:15.046794 --- ParallelTerminationStrategy: PID 15485 died... 21:18:15.066607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15485): Terminated: ok {rc=0} 21:18:15.154481 bus /gobi_0: Setting Powered False 21:18:16.249275 bus /gobi_0: Setting Powered False 21:18:17.361995 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2349 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 nitb_smpp --------------------------------------------------------------------- 21:18:18.617747 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:18:18.620472 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 21:18:18.641742 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 21:18:18.649615 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 21:18:18.683371 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 21:18:18.704590 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 21:18:18.711489 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 21:18:19.234802 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2349 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 21:18:19.240911 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 21:18:19.259856 tst esme_connect_policy_acceptall.py: using MSISDN 6855 21:18:19.392689 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:18:19.950481 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15490): Launched 21:18:20.249600 run osmo-nitb_10.42.42.2(pid=15491): Launched 21:18:20.416398 run osmo-nitb_10.42.42.2(pid=15491): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15491)] 21:18:20.551875 run osmo-nitb_10.42.42.2(pid=15491): stdout: | (launched: 2022-12-08_21:18:20.195032) 21:18:20.689190 run osmo-nitb_10.42.42.2(pid=15491): stderr: | (launched: 2022-12-08_21:18:20.239373) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:18:20.826143 run osmo-nitb_10.42.42.2(pid=15491): stdout: | (launched: 2022-12-08_21:18:20.195032) 21:18:20.956583 run osmo-nitb_10.42.42.2(pid=15491): stderr: | (launched: 2022-12-08_21:18:20.239373) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8fda692268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15491): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15491) [trial-2349↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15491)] 21:18:21.363738 tst osmo-nitb_10.42.42.2(pid=15491): stdout: | (launched: 2022-12-08_21:18:20.195032) 21:18:21.484344 tst osmo-nitb_10.42.42.2(pid=15491): stderr: | (launched: 2022-12-08_21:18:20.239373) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:18:21.626232 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=15491): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15491) [trial-2349↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15491)] [trial-2349↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 21:18:21.634346 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 21:18:21.640649 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15490): Terminating (SIGTERM) 21:18:21.849676 --- ParallelTerminationStrategy: PID 15490 died... 21:18:21.870237 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15490): Terminated: ok {rc=0} ---------------------------------------------- trial-2349 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 21:18:21.918476 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 21:18:21.938892 tst esme_connect_policy_closed.py: using MSISDN 6856 21:18:22.060297 tst esme_connect_policy_closed.py: using MSISDN 6857 21:18:22.169935 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:18:22.725711 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15492): Launched 21:18:23.025676 run osmo-nitb_10.42.42.2(pid=15493): Launched 21:18:23.187128 run osmo-nitb_10.42.42.2(pid=15493): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15493)] 21:18:23.310713 run osmo-nitb_10.42.42.2(pid=15493): stdout: | (launched: 2022-12-08_21:18:22.971000) 21:18:23.435872 run osmo-nitb_10.42.42.2(pid=15493): stderr: | (launched: 2022-12-08_21:18:23.015521) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:18:23.561168 run osmo-nitb_10.42.42.2(pid=15493): stdout: | (launched: 2022-12-08_21:18:22.971000) 21:18:23.680062 run osmo-nitb_10.42.42.2(pid=15493): stderr: | (launched: 2022-12-08_21:18:23.015521) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:18:23.822605 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=15493): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15493) [trial-2349↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15493)] [trial-2349↪nitb_smpp↪esme_connect_policy_closed.py:24] 21:18:23.831014 tst esme_connect_policy_closed.py:24: Test FAILED (1.9 sec) 21:18:23.837604 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15492): Terminating (SIGTERM) 21:18:24.046745 --- ParallelTerminationStrategy: PID 15492 died... 21:18:24.066473 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15492): Terminated: ok {rc=0} ---------------------------------------------- trial-2349 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 21:18:24.115157 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 21:18:24.126548 tst nitb_smpp: Using 1 x bts (candidates: 1) 21:18:24.162078 tst esme_ms_sms_storeforward.py: using LAC 16873 21:18:24.281214 tst esme_ms_sms_storeforward.py: using RAC 43 21:18:24.408613 tst esme_ms_sms_storeforward.py: using CellId 16873 21:18:24.535967 tst esme_ms_sms_storeforward.py: using BVCI 16874 21:18:24.654706 tst nitb_smpp: Using 1 x modem (candidates: 1) 21:18:24.779646 tst esme_ms_sms_storeforward.py: using MSISDN 6858 21:18:24.888072 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 21:18:25.090117 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:18:25.705288 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15494): Launched 21:18:26.007677 run osmo-nitb_10.42.42.2(pid=15495): Launched 21:18:26.171284 run osmo-nitb_10.42.42.2(pid=15495): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15495)] 21:18:26.295903 run osmo-nitb_10.42.42.2(pid=15495): stdout: | (launched: 2022-12-08_21:18:25.952541) 21:18:26.421884 run osmo-nitb_10.42.42.2(pid=15495): stderr: | (launched: 2022-12-08_21:18:25.997470) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:18:26.548183 run osmo-nitb_10.42.42.2(pid=15495): stdout: | (launched: 2022-12-08_21:18:25.952541) 21:18:26.668344 run osmo-nitb_10.42.42.2(pid=15495): stderr: | (launched: 2022-12-08_21:18:25.997470) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:18:26.811861 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=15495): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15495) [trial-2349↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15495)] [trial-2349↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 21:18:26.820139 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.7 sec) 21:18:26.826516 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15494): Terminating (SIGTERM) 21:18:27.035466 --- ParallelTerminationStrategy: PID 15494 died... 21:18:27.055685 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15494): Terminated: ok {rc=0} 21:18:27.141334 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 21:18:28.228933 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 21:18:28.240585 tst nitb_smpp: Using 1 x bts (candidates: 1) 21:18:28.277187 tst esme_ms_sms_transaction.py: using LAC 16874 21:18:28.399378 tst esme_ms_sms_transaction.py: using RAC 44 21:18:28.519766 tst esme_ms_sms_transaction.py: using CellId 16874 21:18:28.642204 tst esme_ms_sms_transaction.py: using BVCI 16875 21:18:28.752604 tst nitb_smpp: Using 1 x modem (candidates: 1) 21:18:28.882844 tst esme_ms_sms_transaction.py: using MSISDN 6859 21:18:28.999873 tst esme_ms_sms_transaction.py:18: start nitb and bts... 21:18:29.218230 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:18:29.869399 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15496): Launched 21:18:30.192179 run osmo-nitb_10.42.42.2(pid=15497): Launched 21:18:30.370514 run osmo-nitb_10.42.42.2(pid=15497): ERR: Terminated: ERROR {rc=2} [trial-2349↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15497)] 21:18:30.515062 run osmo-nitb_10.42.42.2(pid=15497): stdout: | (launched: 2022-12-08_21:18:30.133226) 21:18:30.661819 run osmo-nitb_10.42.42.2(pid=15497): stderr: | (launched: 2022-12-08_21:18:30.181753) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:18:30.808469 run osmo-nitb_10.42.42.2(pid=15497): stdout: | (launched: 2022-12-08_21:18:30.133226) 21:18:30.999010 run osmo-nitb_10.42.42.2(pid=15497): stderr: | (launched: 2022-12-08_21:18:30.181753) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8fda692268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15497): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15497) [trial-2349↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15497)] 21:18:31.312689 tst osmo-nitb_10.42.42.2(pid=15497): stdout: | (launched: 2022-12-08_21:18:30.133226) 21:18:31.444842 tst osmo-nitb_10.42.42.2(pid=15497): stderr: | (launched: 2022-12-08_21:18:30.181753) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:18:31.602747 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=15497): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15497) [trial-2349↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15497)] [trial-2349↪nitb_smpp↪esme_ms_sms_transaction.py:21] 21:18:31.612707 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 21:18:31.620713 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15496): Terminating (SIGTERM) 21:18:31.833858 --- ParallelTerminationStrategy: PID 15496 died... 21:18:31.854460 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15496): Terminated: ok {rc=0} 21:18:31.950456 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 smpp --------------------------------------------------------------------- 21:18:33.119967 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:18:33.123119 tst smpp: Verifying 1 x bts (candidates: 11) 21:18:33.145285 tst smpp: Verifying 6 x ip_address (candidates: 9) 21:18:33.173915 tst smpp: Verifying 1 x modem (candidates: 12) 21:18:33.207678 tst smpp: Reserving 1 x bts (candidates: 11) 21:18:33.228098 tst smpp: Reserving 6 x ip_address (candidates: 9) 21:18:33.255661 tst smpp: Reserving 1 x modem (candidates: 12) 21:18:33.782816 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2349 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 21:18:33.787928 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:33.798358 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:33.809518 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:33.821302 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:33.843606 tst esme_connect_policy_acceptall.py: using MSISDN 6860 21:18:33.955035 run osmo-stp_10.42.42.4: Starting osmo-stp 21:18:34.465978 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=15502): Launched 21:18:34.766748 run osmo-stp_10.42.42.4(pid=15503): Launched 21:18:34.881058 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:18:35.347242 run create_hlr_db(pid=15504): Launched 21:18:35.461455 bus /sierra_2: Setting Powered False 21:18:36.521265 run create_hlr_db(pid=15504): Terminated: ok {rc=0} 21:18:36.963722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15506): Launched 21:18:37.285617 run osmo-hlr_10.42.42.2(pid=15507): Launched 21:18:37.408667 run osmo-msc_10.42.42.5: Starting osmo-msc 21:18:37.993485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15509): Launched 21:18:38.317617 run osmo-msc_10.42.42.5(pid=15510): Launched 21:18:38.497390 run osmo-hlr_10.42.42.2(pid=15507): ERR: Terminated: ERROR {rc=237} [trial-2349↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15507)] 21:18:38.635678 run osmo-hlr_10.42.42.2(pid=15507): stdout: | (launched: 2022-12-08_21:18:37.227192) 21:18:38.772762 run osmo-hlr_10.42.42.2(pid=15507): stderr: | [0;m[1;31m20221208211837420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211837420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211837420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211837420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211837420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211837420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211837432 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211837442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211837443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211837443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:18:38.909218 run osmo-hlr_10.42.42.2(pid=15507): stdout: | (launched: 2022-12-08_21:18:37.227192) 21:18:39.037633 run osmo-hlr_10.42.42.2(pid=15507): stderr: | [0;m[1;31m20221208211837420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211837420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211837420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211837420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211837420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211837420 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211837432 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211837442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211837443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211837443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:18:39.191892 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=15507): Process ended prematurely: osmo-hlr_10.42.42.2(pid=15507) [trial-2349↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15507)] [trial-2349↪smpp↪esme_connect_policy_acceptall.py:23] 21:18:39.200764 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.4 sec) 21:18:39.227905 run osmo-msc_10.42.42.5(pid=15510): ERR: Terminated: ERROR {rc=9} [trial-2349↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=15510)] 21:18:39.277689 run osmo-msc_10.42.42.5(pid=15510): stdout: | (launched: 2022-12-08_21:18:38.258977) 21:18:39.329431 run osmo-msc_10.42.42.5(pid=15510): stderr: | [0;m[38;5;43m20221208211838620 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221208211838620 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221208211838620 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221208211838620 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221208211838620 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221208211838620 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221208211838620 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221208211838620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221208211838621 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 21:18:39.381233 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=15502): Terminating (SIGTERM) 21:18:39.422414 run osmo-stp_10.42.42.4(pid=15503): Terminating (SIGTERM) 21:18:39.463675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15506): Terminating (SIGTERM) 21:18:39.507025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15509): Terminating (SIGTERM) 21:18:39.552328 --- ParallelTerminationStrategy: PID 15502 died... 21:18:39.573096 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=15502): Terminated: ok {rc=0} 21:18:39.621080 --- ParallelTerminationStrategy: PID 15503 died... 21:18:39.640527 run osmo-stp_10.42.42.4(pid=15503): Terminated: ok {rc=0} 21:18:39.686016 --- ParallelTerminationStrategy: PID 15506 died... 21:18:39.705385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15506): Terminated: ok {rc=0} 21:18:39.750853 --- ParallelTerminationStrategy: PID 15509 died... 21:18:39.770273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15509): Terminated: ok {rc=0} ---------------------------------------------- trial-2349 smpp esme_connect_policy_closed.py ---------------------------------------------- 21:18:39.820596 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:39.832006 tst smpp: Using 1 x bts (candidates: 1) 21:18:39.867880 tst esme_connect_policy_closed.py: using LAC 16875 21:18:39.988692 tst esme_connect_policy_closed.py: using RAC 45 21:18:40.106453 tst esme_connect_policy_closed.py: using CellId 16875 21:18:40.225279 tst esme_connect_policy_closed.py: using BVCI 16876 21:18:40.334787 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:40.345411 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:40.355793 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:40.376306 tst esme_connect_policy_closed.py: using MSISDN 6861 21:18:40.508893 tst esme_connect_policy_closed.py: using MSISDN 6862 21:18:40.627344 run osmo-stp_10.42.42.4: Starting osmo-stp 21:18:41.179114 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=15513): Launched 21:18:41.503160 run osmo-stp_10.42.42.4(pid=15514): Launched 21:18:41.626197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:18:42.127430 run create_hlr_db(pid=15515): Launched 21:18:43.317505 run create_hlr_db(pid=15515): Terminated: ok {rc=0} 21:18:43.662315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15517): Launched 21:18:43.988425 run osmo-hlr_10.42.42.2(pid=15518): Launched 21:18:44.112793 run osmo-msc_10.42.42.5: Starting osmo-msc 21:18:44.702618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15520): Launched 21:18:45.030770 run osmo-msc_10.42.42.5(pid=15521): Launched 21:18:45.212358 run osmo-hlr_10.42.42.2(pid=15518): ERR: Terminated: ERROR {rc=237} [trial-2349↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15518)] 21:18:45.351438 run osmo-hlr_10.42.42.2(pid=15518): stdout: | (launched: 2022-12-08_21:18:43.929408) 21:18:45.491828 run osmo-hlr_10.42.42.2(pid=15518): stderr: | [0;m[1;31m20221208211844123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211844123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211844123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211844123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211844123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211844123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211844135 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211844144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211844144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211844144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:18:45.629352 run osmo-hlr_10.42.42.2(pid=15518): stdout: | (launched: 2022-12-08_21:18:43.929408) 21:18:45.759080 run osmo-hlr_10.42.42.2(pid=15518): stderr: | [0;m[1;31m20221208211844123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211844123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211844123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211844123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211844123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211844123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211844135 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211844144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211844144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211844144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:18:45.942120 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=15518): Process ended prematurely: osmo-hlr_10.42.42.2(pid=15518) [trial-2349↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15518)] [trial-2349↪smpp↪esme_connect_policy_closed.py:31] 21:18:45.955842 tst esme_connect_policy_closed.py:31: Test FAILED (6.1 sec) 21:18:45.984773 run osmo-msc_10.42.42.5(pid=15521): ERR: Terminated: ERROR {rc=9} [trial-2349↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=15521)] 21:18:46.037603 run osmo-msc_10.42.42.5(pid=15521): stdout: | (launched: 2022-12-08_21:18:44.971442) 21:18:46.105255 run osmo-msc_10.42.42.5(pid=15521): stderr: | [0;m[38;5;43m20221208211845347 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221208211845347 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221208211845347 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221208211845347 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221208211845347 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221208211845347 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221208211845347 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221208211845347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221208211845348 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 21:18:46.172510 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=15513): Terminating (SIGTERM) 21:18:46.227616 run osmo-stp_10.42.42.4(pid=15514): Terminating (SIGTERM) 21:18:46.281784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15517): Terminating (SIGTERM) 21:18:46.333813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15520): Terminating (SIGTERM) 21:18:46.388288 --- ParallelTerminationStrategy: PID 15513 died... 21:18:46.419054 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=15513): Terminated: ok {rc=0} 21:18:46.547400 --- ParallelTerminationStrategy: PID 15517 died... 21:18:46.588121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15517): Terminated: ok {rc=0} 21:18:46.656730 --- ParallelTerminationStrategy: PID 15514 died... 21:18:46.682007 run osmo-stp_10.42.42.4(pid=15514): Terminated: ok {rc=0} 21:18:46.739529 --- ParallelTerminationStrategy: PID 15520 died... 21:18:46.765905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15520): Terminated: ok {rc=0} ---------------------------------------------- trial-2349 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 21:18:46.832799 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:46.848610 tst smpp: Using 1 x bts (candidates: 1) 21:18:46.891352 tst esme_ms_sms_storeforward.py: using LAC 16876 21:18:47.057301 tst esme_ms_sms_storeforward.py: using RAC 46 21:18:47.185734 tst esme_ms_sms_storeforward.py: using CellId 16876 21:18:47.316226 tst esme_ms_sms_storeforward.py: using BVCI 16877 21:18:47.437192 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:47.448164 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:47.459205 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:47.470209 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:47.481194 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:47.492329 tst smpp: Using 1 x modem (candidates: 1) 21:18:47.619778 tst esme_ms_sms_storeforward.py: using MSISDN 6863 21:18:47.732090 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:18:48.202610 run create_hlr_db(pid=15524): Launched 21:18:49.373350 run create_hlr_db(pid=15524): Terminated: ok {rc=0} 21:18:49.695578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15526): Launched 21:18:49.999001 run osmo-hlr_10.42.42.2(pid=15527): Launched 21:18:50.115113 run osmo-stp_10.42.42.5: Starting osmo-stp 21:18:50.653569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15529): Launched 21:18:50.960762 run osmo-stp_10.42.42.5(pid=15530): Launched 21:18:51.077429 run osmo-msc_10.42.42.6: Starting osmo-msc 21:18:51.627222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15532): Launched 21:18:51.932650 run osmo-msc_10.42.42.6(pid=15533): Launched 21:18:52.102706 run osmo-stp_10.42.42.5(pid=15530): ERR: Terminated: ERROR {rc=1} [trial-2349↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15530)] 21:18:52.233885 run osmo-stp_10.42.42.5(pid=15530): stdout: | (launched: 2022-12-08_21:18:50.903812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:18:52.363756 run osmo-stp_10.42.42.5(pid=15530): stderr: | [0;m[38;5;43m20221208211851076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211851076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211851077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211851077 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211851078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211851078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211851078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:52.490552 run osmo-stp_10.42.42.5(pid=15530): stdout: | (launched: 2022-12-08_21:18:50.903812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:18:52.612091 run osmo-stp_10.42.42.5(pid=15530): stderr: | [0;m[38;5;43m20221208211851076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211851076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211851077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211851077 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211851078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211851078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211851078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:52.756402 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=15530): Process ended prematurely: osmo-stp_10.42.42.5(pid=15530) [trial-2349↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15530)] [trial-2349↪smpp↪esme_ms_sms_storeforward.py:30] 21:18:52.764806 tst esme_ms_sms_storeforward.py:30: Test FAILED (5.9 sec) 21:18:52.791362 run osmo-hlr_10.42.42.2(pid=15527): ERR: Terminated: ERROR {rc=237} [trial-2349↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15527)] 21:18:52.839493 run osmo-hlr_10.42.42.2(pid=15527): stdout: | (launched: 2022-12-08_21:18:49.943697) 21:18:52.888855 run osmo-hlr_10.42.42.2(pid=15527): stderr: | [0;m[1;31m20221208211850120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211850121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211850121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211850121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211850121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211850121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211850132 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211850143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211850143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211850143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:18:52.957933 run osmo-msc_10.42.42.6(pid=15533): ERR: Terminated: ERROR {rc=2} [trial-2349↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15533)] 21:18:53.005726 run osmo-msc_10.42.42.6(pid=15533): stdout: | (launched: 2022-12-08_21:18:51.876465) 21:18:53.054820 run osmo-msc_10.42.42.6(pid=15533): stderr: | [0;m[38;5;43m20221208211852147 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211852147 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa1691aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211852147 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211852147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211852147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211852147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211852149 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211852150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211852150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211852150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:18:53.105002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15526): Terminating (SIGTERM) 21:18:53.145059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15529): Terminating (SIGTERM) 21:18:53.184753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15532): Terminating (SIGTERM) 21:18:53.224895 --- ParallelTerminationStrategy: PID 15526 died... 21:18:53.244007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15526): Terminated: ok {rc=0} 21:18:53.288301 --- ParallelTerminationStrategy: PID 15529 died... 21:18:53.306971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15529): Terminated: ok {rc=0} 21:18:53.351534 --- ParallelTerminationStrategy: PID 15532 died... 21:18:53.370223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15532): Terminated: ok {rc=0} 21:18:53.455988 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 smpp esme_ms_sms_transaction.py ---------------------------------------------- 21:18:54.544607 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:54.556307 tst smpp: Using 1 x bts (candidates: 1) 21:18:54.593385 tst esme_ms_sms_transaction.py: using LAC 16877 21:18:54.713472 tst esme_ms_sms_transaction.py: using RAC 47 21:18:54.833296 tst esme_ms_sms_transaction.py: using CellId 16877 21:18:54.953360 tst esme_ms_sms_transaction.py: using BVCI 16878 21:18:55.062358 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:55.072689 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:55.083084 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:55.093680 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:55.104187 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:55.114678 tst smpp: Using 1 x modem (candidates: 1) 21:18:55.240356 tst esme_ms_sms_transaction.py: using MSISDN 6864 21:18:55.351677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:18:55.818533 run create_hlr_db(pid=15535): Launched 21:18:55.934110 bus /sierra_2: Setting Powered False 21:18:56.994457 run create_hlr_db(pid=15535): Terminated: ok {rc=0} 21:18:57.441180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15537): Launched 21:18:57.768219 run osmo-hlr_10.42.42.2(pid=15538): Launched 21:18:57.892902 run osmo-stp_10.42.42.5: Starting osmo-stp 21:18:58.451874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15540): Launched 21:18:58.776220 run osmo-stp_10.42.42.5(pid=15541): Launched 21:18:58.899873 run osmo-msc_10.42.42.6: Starting osmo-msc 21:18:59.490918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15543): Launched 21:18:59.817453 run osmo-msc_10.42.42.6(pid=15544): Launched 21:18:59.998344 run osmo-stp_10.42.42.5(pid=15541): ERR: Terminated: ERROR {rc=1} [trial-2349↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15541)] 21:19:00.135214 run osmo-stp_10.42.42.5(pid=15541): stdout: | (launched: 2022-12-08_21:18:58.717154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:00.280855 run osmo-stp_10.42.42.5(pid=15541): stderr: | [0;m[38;5;43m20221208211858909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211858910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211858910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211858910 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211858911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211858911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211858911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:00.418058 run osmo-stp_10.42.42.5(pid=15541): stdout: | (launched: 2022-12-08_21:18:58.717154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:00.548719 run osmo-stp_10.42.42.5(pid=15541): stderr: | [0;m[38;5;43m20221208211858909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211858910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211858910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211858910 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211858911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211858911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211858911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:00.703603 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=15541): Process ended prematurely: osmo-stp_10.42.42.5(pid=15541) [trial-2349↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15541)] [trial-2349↪smpp↪esme_ms_sms_transaction.py:28] 21:19:00.712524 tst esme_ms_sms_transaction.py:28: Test FAILED (6.2 sec) 21:19:00.739962 run osmo-hlr_10.42.42.2(pid=15538): ERR: Terminated: ERROR {rc=237} [trial-2349↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15538)] 21:19:00.790065 run osmo-hlr_10.42.42.2(pid=15538): stdout: | (launched: 2022-12-08_21:18:57.708878) 21:19:00.842248 run osmo-hlr_10.42.42.2(pid=15538): stderr: | [0;m[1;31m20221208211857910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211857910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211857910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211857910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211857910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211857910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211857922 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211857930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211857930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211857930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:19:00.921079 run osmo-msc_10.42.42.6(pid=15544): ERR: Terminated: ERROR {rc=2} [trial-2349↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15544)] 21:19:00.972061 run osmo-msc_10.42.42.6(pid=15544): stdout: | (launched: 2022-12-08_21:18:59.757598) 21:19:01.024764 run osmo-msc_10.42.42.6(pid=15544): stderr: | [0;m[38;5;43m20221208211900081 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211900081 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6019c02c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211900081 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211900081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211900081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211900081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211900083 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211900084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211900084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211900084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:19:01.077895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15537): Terminating (SIGTERM) 21:19:01.120351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15540): Terminating (SIGTERM) 21:19:01.163163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15543): Terminating (SIGTERM) 21:19:01.205995 --- ParallelTerminationStrategy: PID 15537 died... 21:19:01.226068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15537): Terminated: ok {rc=0} 21:19:01.273328 --- ParallelTerminationStrategy: PID 15540 died... 21:19:01.293524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15540): Terminated: ok {rc=0} 21:19:01.340803 --- ParallelTerminationStrategy: PID 15543 died... 21:19:01.361072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15543): Terminated: ok {rc=0} 21:19:01.449493 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 encryption --------------------------------------------------------------------- 21:19:02.640266 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:19:02.644033 tst encryption: Verifying 1 x bts (candidates: 11) 21:19:02.666083 tst encryption: Verifying 6 x ip_address (candidates: 9) 21:19:02.694246 tst encryption: Verifying 1 x modem (candidates: 12) 21:19:02.730300 tst encryption: Reserving 1 x bts (candidates: 11) 21:19:02.752055 tst encryption: Reserving 6 x ip_address (candidates: 9) 21:19:02.780582 tst encryption: Reserving 1 x modem (candidates: 12) 21:19:03.308199 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2349 encryption register_a5_0_authopt.py ---------------------------------------------- 21:19:03.363346 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:03.374607 tst encryption: Using 1 x bts (candidates: 1) 21:19:03.411486 tst register_a5_0_authopt.py: using LAC 16878 21:19:03.541016 tst register_a5_0_authopt.py: using RAC 48 21:19:03.670700 tst register_a5_0_authopt.py: using CellId 16878 21:19:03.799719 tst register_a5_0_authopt.py: using BVCI 16879 21:19:03.920899 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:03.931915 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:03.942794 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:03.953665 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:03.964422 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:03.975230 tst encryption: Using 1 x modem (candidates: 1) 21:19:04.093633 tst register_a5_0_authopt.py:8: start network... 21:19:04.317165 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:19:04.826848 run create_hlr_db(pid=15549): Launched 21:19:04.961393 bus /sierra_2: Setting Powered False 21:19:06.026319 run create_hlr_db(pid=15549): Terminated: ok {rc=0} 21:19:06.465873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15551): Launched 21:19:06.772845 run osmo-hlr_10.42.42.2(pid=15552): Launched 21:19:06.890097 run osmo-stp_10.42.42.5: Starting osmo-stp 21:19:07.434771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15554): Launched 21:19:07.741488 run osmo-stp_10.42.42.5(pid=15555): Launched 21:19:07.858730 run osmo-msc_10.42.42.6: Starting osmo-msc 21:19:08.412919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15557): Launched 21:19:08.719639 run osmo-msc_10.42.42.6(pid=15558): Launched 21:19:08.890601 run osmo-stp_10.42.42.5(pid=15555): ERR: Terminated: ERROR {rc=1} [trial-2349↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15555)] 21:19:09.020528 run osmo-stp_10.42.42.5(pid=15555): stdout: | (launched: 2022-12-08_21:19:07.685286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:09.150802 run osmo-stp_10.42.42.5(pid=15555): stderr: | [0;m[38;5;43m20221208211907856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211907856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211907857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211907857 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211907858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211907858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211907858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:09.279153 run osmo-stp_10.42.42.5(pid=15555): stdout: | (launched: 2022-12-08_21:19:07.685286) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:09.401596 run osmo-stp_10.42.42.5(pid=15555): stderr: | [0;m[38;5;43m20221208211907856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211907856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211907857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211907857 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211907858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211907858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211907858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:09.547471 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15555): Process ended prematurely: osmo-stp_10.42.42.5(pid=15555) [trial-2349↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15555)] [trial-2349↪encryption↪register_a5_0_authopt.py:8] 21:19:09.556561 tst register_a5_0_authopt.py:8: Test FAILED (6.2 sec) 21:19:09.583128 run osmo-hlr_10.42.42.2(pid=15552): ERR: Terminated: ERROR {rc=237} [trial-2349↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15552)] 21:19:09.631361 run osmo-hlr_10.42.42.2(pid=15552): stdout: | (launched: 2022-12-08_21:19:06.716609) 21:19:09.680750 run osmo-hlr_10.42.42.2(pid=15552): stderr: | [0;m[1;31m20221208211906895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211906895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211906895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211906895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211906895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211906895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211906907 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211906916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211906916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211906916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:19:09.749729 run osmo-msc_10.42.42.6(pid=15558): ERR: Terminated: ERROR {rc=2} [trial-2349↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15558)] 21:19:09.797506 run osmo-msc_10.42.42.6(pid=15558): stdout: | (launched: 2022-12-08_21:19:08.663631) 21:19:09.847043 run osmo-msc_10.42.42.6(pid=15558): stderr: | [0;m[38;5;43m20221208211908938 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211908939 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8d12533c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211908939 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211908939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211908939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211908939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211908941 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211908942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211908942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211908942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:19:09.896857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15551): Terminating (SIGTERM) 21:19:09.936858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15554): Terminating (SIGTERM) 21:19:09.977114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15557): Terminating (SIGTERM) 21:19:10.017939 --- ParallelTerminationStrategy: PID 15551 died... 21:19:10.037245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15551): Terminated: ok {rc=0} 21:19:10.081925 --- ParallelTerminationStrategy: PID 15554 died... 21:19:10.100660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15554): Terminated: ok {rc=0} 21:19:10.145110 --- ParallelTerminationStrategy: PID 15557 died... 21:19:10.163781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15557): Terminated: ok {rc=0} 21:19:10.247685 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 encryption register_a5_0_authreq.py ---------------------------------------------- 21:19:11.391033 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:11.402369 tst encryption: Using 1 x bts (candidates: 1) 21:19:11.438390 tst register_a5_0_authreq.py: using LAC 16879 21:19:11.558238 tst register_a5_0_authreq.py: using RAC 49 21:19:11.681101 tst register_a5_0_authreq.py: using CellId 16879 21:19:11.812508 tst register_a5_0_authreq.py: using BVCI 16880 21:19:11.936699 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:11.948515 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:11.959992 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:11.971547 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:11.983050 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:11.994618 tst encryption: Using 1 x modem (candidates: 1) 21:19:12.113343 tst register_a5_0_authreq.py:8: start network... 21:19:12.319929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:19:12.794051 run create_hlr_db(pid=15560): Launched 21:19:12.929164 bus /sierra_2: Setting Powered False 21:19:13.994187 run create_hlr_db(pid=15560): Terminated: ok {rc=0} 21:19:14.452244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15562): Launched 21:19:14.782656 run osmo-hlr_10.42.42.2(pid=15563): Launched 21:19:14.908506 run osmo-stp_10.42.42.5: Starting osmo-stp 21:19:15.474700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15565): Launched 21:19:15.802591 run osmo-stp_10.42.42.5(pid=15566): Launched 21:19:16.002623 run osmo-msc_10.42.42.6: Starting osmo-msc 21:19:16.769822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15568): Launched 21:19:17.100520 run osmo-msc_10.42.42.6(pid=15569): Launched 21:19:17.459118 run osmo-stp_10.42.42.5(pid=15566): ERR: Terminated: ERROR {rc=1} [trial-2349↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15566)] 21:19:17.588661 run osmo-stp_10.42.42.5(pid=15566): stdout: | (launched: 2022-12-08_21:19:15.743019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:17.717530 run osmo-stp_10.42.42.5(pid=15566): stderr: | [0;m[38;5;43m20221208211916063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211916063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211916064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211916064 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211916069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211916069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211916069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:17.846444 run osmo-stp_10.42.42.5(pid=15566): stdout: | (launched: 2022-12-08_21:19:15.743019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:17.968932 run osmo-stp_10.42.42.5(pid=15566): stderr: | [0;m[38;5;43m20221208211916063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211916063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211916064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211916064 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211916069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211916069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211916069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:18.115814 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15566): Process ended prematurely: osmo-stp_10.42.42.5(pid=15566) [trial-2349↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15566)] [trial-2349↪encryption↪register_a5_0_authreq.py:8] 21:19:18.124891 tst register_a5_0_authreq.py:8: Test FAILED (6.8 sec) 21:19:18.151633 run osmo-hlr_10.42.42.2(pid=15563): ERR: Terminated: ERROR {rc=237} [trial-2349↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15563)] 21:19:18.199738 run osmo-hlr_10.42.42.2(pid=15563): stdout: | (launched: 2022-12-08_21:19:14.722929) 21:19:18.249551 run osmo-hlr_10.42.42.2(pid=15563): stderr: | [0;m[1;31m20221208211914921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211914921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211914921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211914921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211914921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211914922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211914934 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211914943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211914943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211914943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:19:18.318699 run osmo-msc_10.42.42.6(pid=15569): ERR: Terminated: ERROR {rc=2} [trial-2349↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15569)] 21:19:18.366858 run osmo-msc_10.42.42.6(pid=15569): stdout: | (launched: 2022-12-08_21:19:17.037676) 21:19:18.416350 run osmo-msc_10.42.42.6(pid=15569): stderr: | [0;m[38;5;43m20221208211917362 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211917362 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9eb0234c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211917362 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211917362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211917363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211917363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211917373 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211917373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211917373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211917373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:19:18.466348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15562): Terminating (SIGTERM) 21:19:18.506603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15565): Terminating (SIGTERM) 21:19:18.547194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15568): Terminating (SIGTERM) 21:19:18.587965 --- ParallelTerminationStrategy: PID 15562 died... 21:19:18.607159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15562): Terminated: ok {rc=0} 21:19:18.651923 --- ParallelTerminationStrategy: PID 15565 died... 21:19:18.670768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15565): Terminated: ok {rc=0} 21:19:18.715216 --- ParallelTerminationStrategy: PID 15568 died... 21:19:18.734062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15568): Terminated: ok {rc=0} 21:19:18.820505 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 encryption register_a5_1_authreq.py ---------------------------------------------- 21:19:19.969712 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:19.981056 tst encryption: Using 1 x bts (candidates: 1) 21:19:20.015227 tst register_a5_1_authreq.py: using LAC 16880 21:19:20.134282 tst register_a5_1_authreq.py: using RAC 50 21:19:20.256219 tst register_a5_1_authreq.py: using CellId 16880 21:19:20.376154 tst register_a5_1_authreq.py: using BVCI 16881 21:19:20.488555 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:20.499120 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:20.509611 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:20.520182 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:20.530834 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:20.541385 tst encryption: Using 1 x modem (candidates: 1) 21:19:20.660605 tst register_a5_1_authreq.py:8: start network... 21:19:20.884121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:19:21.394250 run create_hlr_db(pid=15571): Launched 21:19:21.529072 bus /sierra_2: Setting Powered False 21:19:22.594461 run create_hlr_db(pid=15571): Terminated: ok {rc=0} 21:19:23.032133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15573): Launched 21:19:23.362751 run osmo-hlr_10.42.42.2(pid=15574): Launched 21:19:23.487843 run osmo-stp_10.42.42.5: Starting osmo-stp 21:19:24.054648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15576): Launched 21:19:24.384122 run osmo-stp_10.42.42.5(pid=15577): Launched 21:19:24.510213 run osmo-msc_10.42.42.6: Starting osmo-msc 21:19:25.105741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15579): Launched 21:19:25.434829 run osmo-msc_10.42.42.6(pid=15580): Launched 21:19:25.619371 run osmo-stp_10.42.42.5(pid=15577): ERR: Terminated: ERROR {rc=1} [trial-2349↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15577)] 21:19:25.757722 run osmo-stp_10.42.42.5(pid=15577): stdout: | (launched: 2022-12-08_21:19:24.324129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:25.896622 run osmo-stp_10.42.42.5(pid=15577): stderr: | [0;m[38;5;43m20221208211924518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211924518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211924519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211924519 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211924519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211924519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211924519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:26.034805 run osmo-stp_10.42.42.5(pid=15577): stdout: | (launched: 2022-12-08_21:19:24.324129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:26.166459 run osmo-stp_10.42.42.5(pid=15577): stderr: | [0;m[38;5;43m20221208211924518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211924518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211924519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211924519 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211924519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211924519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211924519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:26.323451 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15577): Process ended prematurely: osmo-stp_10.42.42.5(pid=15577) [trial-2349↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15577)] [trial-2349↪encryption↪register_a5_1_authreq.py:8] 21:19:26.333106 tst register_a5_1_authreq.py:8: Test FAILED (6.4 sec) 21:19:26.360774 run osmo-hlr_10.42.42.2(pid=15574): ERR: Terminated: ERROR {rc=237} [trial-2349↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15574)] 21:19:26.410522 run osmo-hlr_10.42.42.2(pid=15574): stdout: | (launched: 2022-12-08_21:19:23.302818) 21:19:26.461829 run osmo-hlr_10.42.42.2(pid=15574): stderr: | [0;m[1;31m20221208211923504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211923504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211923504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211923504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211923504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211923504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211923519 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211923530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211923530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211923530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:19:26.533794 run osmo-msc_10.42.42.6(pid=15580): ERR: Terminated: ERROR {rc=2} [trial-2349↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15580)] 21:19:26.583253 run osmo-msc_10.42.42.6(pid=15580): stdout: | (launched: 2022-12-08_21:19:25.374981) 21:19:26.634955 run osmo-msc_10.42.42.6(pid=15580): stderr: | [0;m[38;5;43m20221208211925699 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211925699 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0e32073c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211925699 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211925700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211925700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211925700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211925703 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211925704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211925704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211925704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:19:26.686500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15573): Terminating (SIGTERM) 21:19:26.727795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15576): Terminating (SIGTERM) 21:19:26.769360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15579): Terminating (SIGTERM) 21:19:26.811107 --- ParallelTerminationStrategy: PID 15573 died... 21:19:26.831041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15573): Terminated: ok {rc=0} 21:19:26.877140 --- ParallelTerminationStrategy: PID 15576 died... 21:19:26.896682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15576): Terminated: ok {rc=0} 21:19:26.942511 --- ParallelTerminationStrategy: PID 15579 died... 21:19:26.962107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15579): Terminated: ok {rc=0} 21:19:27.050052 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2349 encryption register_a5_3_authreq.py ---------------------------------------------- 21:19:28.202015 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:28.213745 tst encryption: Using 1 x bts (candidates: 1) 21:19:28.251597 tst register_a5_3_authreq.py: using LAC 16881 21:19:28.387532 tst register_a5_3_authreq.py: using RAC 51 21:19:28.517477 tst register_a5_3_authreq.py: using CellId 16881 21:19:28.646157 tst register_a5_3_authreq.py: using BVCI 16882 21:19:28.769074 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:28.780187 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:28.791256 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:28.802932 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:28.814608 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:28.826215 tst encryption: Using 1 x modem (candidates: 1) 21:19:28.959784 tst register_a5_3_authreq.py:8: start network... 21:19:29.184334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:19:29.693559 run create_hlr_db(pid=15582): Launched 21:19:29.828485 bus /sierra_2: Setting Powered False 21:19:30.912888 run create_hlr_db(pid=15582): Terminated: ok {rc=0} 21:19:31.366336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15584): Launched 21:19:31.694451 run osmo-hlr_10.42.42.2(pid=15585): Launched 21:19:31.948901 run osmo-stp_10.42.42.5: Starting osmo-stp 21:19:32.632413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15587): Launched 21:19:32.940087 run osmo-stp_10.42.42.5(pid=15588): Launched 21:19:33.056633 run osmo-msc_10.42.42.6: Starting osmo-msc 21:19:33.611188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15590): Launched 21:19:33.921477 run osmo-msc_10.42.42.6(pid=15591): Launched 21:19:34.093567 run osmo-stp_10.42.42.5(pid=15588): ERR: Terminated: ERROR {rc=1} [trial-2349↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15588)] 21:19:34.224578 run osmo-stp_10.42.42.5(pid=15588): stdout: | (launched: 2022-12-08_21:19:32.884297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:34.355724 run osmo-stp_10.42.42.5(pid=15588): stderr: | [0;m[38;5;43m20221208211933054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211933054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211933054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211933055 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211933055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211933055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211933055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:34.484805 run osmo-stp_10.42.42.5(pid=15588): stdout: | (launched: 2022-12-08_21:19:32.884297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:34.607847 run osmo-stp_10.42.42.5(pid=15588): stderr: | [0;m[38;5;43m20221208211933054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208211933054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208211933054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208211933055 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208211933055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208211933055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208211933055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:34.755988 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15588): Process ended prematurely: osmo-stp_10.42.42.5(pid=15588) [trial-2349↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15588)] [trial-2349↪encryption↪register_a5_3_authreq.py:8] 21:19:34.765082 tst register_a5_3_authreq.py:8: Test FAILED (6.6 sec) 21:19:34.791713 run osmo-hlr_10.42.42.2(pid=15585): ERR: Terminated: ERROR {rc=237} [trial-2349↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15585)] 21:19:34.839488 run osmo-hlr_10.42.42.2(pid=15585): stdout: | (launched: 2022-12-08_21:19:31.637455) 21:19:34.888705 run osmo-hlr_10.42.42.2(pid=15585): stderr: | [0;m[1;31m20221208211931874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208211931874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208211931874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208211931874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208211931874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208211931874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208211931894 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208211931920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208211931922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208211931923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:19:34.957315 run osmo-msc_10.42.42.6(pid=15591): ERR: Terminated: ERROR {rc=2} [trial-2349↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15591)] 21:19:35.004766 run osmo-msc_10.42.42.6(pid=15591): stdout: | (launched: 2022-12-08_21:19:33.865397) 21:19:35.053766 run osmo-msc_10.42.42.6(pid=15591): stderr: | [0;m[38;5;43m20221208211934139 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208211934139 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feac5f79c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208211934139 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208211934139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208211934139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208211934139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208211934141 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208211934142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208211934142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208211934142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:19:35.103266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15584): Terminating (SIGTERM) 21:19:35.142967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15587): Terminating (SIGTERM) 21:19:35.182777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15590): Terminating (SIGTERM) 21:19:35.222807 --- ParallelTerminationStrategy: PID 15584 died... 21:19:35.241787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15584): Terminated: ok {rc=0} 21:19:35.286689 --- ParallelTerminationStrategy: PID 15587 died... 21:19:35.305124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15587): Terminated: ok {rc=0} 21:19:35.348642 --- ParallelTerminationStrategy: PID 15590 died... 21:19:35.367086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15590): Terminated: ok {rc=0} 21:19:35.452515 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 21:19:36.658498 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:19:36.663349 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 21:19:36.681577 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 21:19:36.709361 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 21:19:36.736840 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 21:19:36.755999 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 21:19:36.782718 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 21:19:37.293521 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2349 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 21:19:37.298034 tst handover.py:11: TEST_CONFIG: {} 21:19:37.502909 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:19:37.518782 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:19:37.541899 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:19:37.591801 tst handover.py: using MSISDN 6865 21:19:37.705700 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6865', subscriber_id=0} 21:19:37.812827 run srsepc_10.42.42.118: Starting srsepc 21:19:39.650376 run rm-remote-dir(pid=15598): Launched 21:19:39.771896 bus /sierra_2: Setting Powered False 21:19:40.836712 run rm-remote-dir(pid=15598): Terminated: ok {rc=0} 21:19:41.301871 run mk-remote-dir(pid=15599): Launched 21:19:42.493996 run mk-remote-dir(pid=15599): Terminated: ok {rc=0} 21:19:42.802288 run scp-inst-to-remote(pid=15600): Launched 21:19:44.992819 run scp-inst-to-remote(pid=15600): Terminated: ok {rc=0} 21:19:45.326688 run rm-remote-dir(pid=15602): Launched 21:19:46.506851 run rm-remote-dir(pid=15602): Terminated: ok {rc=0} 21:19:46.873278 run mk-remote-dir(pid=15603): Launched 21:19:48.108519 run mk-remote-dir(pid=15603): Terminated: ok {rc=0} 21:19:48.416292 run scp-cfg-to-remote(pid=15604): Launched 21:19:49.606897 run scp-cfg-to-remote(pid=15604): Terminated: ok {rc=0} 21:19:49.920202 run scp-db-to-remote(pid=15606): Launched 21:19:51.111638 run scp-db-to-remote(pid=15606): Terminated: ok {rc=0} 21:19:51.252529 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:19:51.582712 run patchelf(pid=15608): Launched 21:19:52.773750 run patchelf(pid=15608): Terminated: ok {rc=0} 21:19:52.914245 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:19:53.245747 run setcap-netadm(pid=15609): Launched 21:19:54.432557 run setcap-netadm(pid=15609): Terminated: ok {rc=0} 21:19:54.755885 run srsepc(pid=15610): Launched 21:19:54.870614 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:19:55.975836 run rm-remote-dir(pid=15611): Launched 21:19:56.151659 run srsepc(pid=15610): ERR: Terminated: ERROR {rc=127} [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15610)] 21:19:56.285891 run srsepc(pid=15610): stdout: | (launched: 2022-12-08_21:19:54.699969) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:19:56.421104 run srsepc(pid=15610): stderr: | (launched: 2022-12-08_21:19:54.745612) | Connection to 10.42.42.116 closed. 21:19:56.556083 run srsepc(pid=15610): stdout: | (launched: 2022-12-08_21:19:54.699969) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:19:56.685999 run srsepc(pid=15610): stderr: | (launched: 2022-12-08_21:19:54.745612) | Connection to 10.42.42.116 closed. 21:19:56.839779 run rm-remote-dir(pid=15611): Terminating (SIGINT) 21:19:57.017922 run rm-remote-dir(pid=15611): Terminated: ok {rc=0} 21:19:57.146594 tst handover.py:37: ERR: Error: srsepc(pid=15610): Process ended prematurely: srsepc(pid=15610) [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15610)] [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 21:19:57.156636 tst handover.py:37: Test FAILED (19.9 sec) 21:19:57.234843 run scp-back-log(pid=15612): Launched 21:19:58.310722 run scp-back-log(pid=15612): ERR: Terminated: ERROR {rc=1} [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15612)] 21:19:58.371644 run scp-back-log(pid=15612): stdout: | (launched: 2022-12-08_21:19:57.203598) 21:19:58.433936 run scp-back-log(pid=15612): stderr: | (launched: 2022-12-08_21:19:57.223359) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:19:58.503993 tst srsepc_10.42.42.118: Error('scp-back-log(pid=15612): launch_sync(): local process exited with status 1 [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15612)]') ---------------------------------------------- trial-2349 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 21:19:58.549269 tst iperf3_bidir.py:13: Number of physical ue: 1 21:19:58.755977 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:19:58.797490 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 21:19:59.001961 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:19:59.017743 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:19:59.050442 tst iperf3_bidir.py: using MSISDN 6866 21:19:59.163719 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6866', subscriber_id=0} 21:19:59.271296 run srsepc_10.42.42.118: Starting srsepc 21:19:59.898846 run rm-remote-dir(pid=15614): Launched 21:20:01.077474 run rm-remote-dir(pid=15614): Terminated: ok {rc=0} 21:20:01.444818 run mk-remote-dir(pid=15618): Launched 21:20:02.714901 run mk-remote-dir(pid=15618): Terminated: ok {rc=0} 21:20:03.003045 run scp-inst-to-remote(pid=15619): Launched 21:20:05.186113 run scp-inst-to-remote(pid=15619): Terminated: ok {rc=0} 21:20:05.543513 run rm-remote-dir(pid=15621): Launched 21:20:06.735676 run rm-remote-dir(pid=15621): Terminated: ok {rc=0} 21:20:07.095207 run mk-remote-dir(pid=15622): Launched 21:20:08.289906 run mk-remote-dir(pid=15622): Terminated: ok {rc=0} 21:20:08.596668 run scp-cfg-to-remote(pid=15623): Launched 21:20:09.786752 run scp-cfg-to-remote(pid=15623): Terminated: ok {rc=0} 21:20:10.091928 run scp-db-to-remote(pid=15625): Launched 21:20:11.283508 run scp-db-to-remote(pid=15625): Terminated: ok {rc=0} 21:20:11.423923 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:20:11.754841 run patchelf(pid=15627): Launched 21:20:12.945954 run patchelf(pid=15627): Terminated: ok {rc=0} 21:20:13.087585 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:20:13.419660 run setcap-netadm(pid=15628): Launched 21:20:14.609780 run setcap-netadm(pid=15628): Terminated: ok {rc=0} 21:20:14.957415 run srsepc(pid=15629): Launched 21:20:15.082268 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:20:16.336604 run rm-remote-dir(pid=15630): Launched 21:20:16.546786 run srsepc(pid=15629): ERR: Terminated: ERROR {rc=127} [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15629)] 21:20:16.748393 run srsepc(pid=15629): stdout: | (launched: 2022-12-08_21:20:14.897303) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:20:16.890172 run srsepc(pid=15629): stderr: | (launched: 2022-12-08_21:20:14.946582) | Connection to 10.42.42.116 closed. 21:20:17.033400 run srsepc(pid=15629): stdout: | (launched: 2022-12-08_21:20:14.897303) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:20:17.168872 run srsepc(pid=15629): stderr: | (launched: 2022-12-08_21:20:14.946582) | Connection to 10.42.42.116 closed. 21:20:17.326645 run rm-remote-dir(pid=15630): Terminating (SIGINT) 21:20:17.505340 run rm-remote-dir(pid=15630): Terminated: ok {rc=0} 21:20:17.634237 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=15629): Process ended prematurely: srsepc(pid=15629) [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15629)] [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 21:20:17.644532 tst iperf3_bidir.py:42: Test FAILED (19.1 sec) 21:20:17.722805 run scp-back-log(pid=15631): Launched 21:20:18.800751 run scp-back-log(pid=15631): ERR: Terminated: ERROR {rc=1} [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15631)] 21:20:18.861866 run scp-back-log(pid=15631): stdout: | (launched: 2022-12-08_21:20:17.692140) 21:20:18.924198 run scp-back-log(pid=15631): stderr: | (launched: 2022-12-08_21:20:17.711846) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:20:18.994400 tst srsepc_10.42.42.118: Error('scp-back-log(pid=15631): launch_sync(): local process exited with status 1 [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15631)]') ---------------------------------------------- trial-2349 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 21:20:19.041025 tst iperf3_dl.py:13: Number of physical ue: 1 21:20:19.248554 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:20:19.301651 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 21:20:19.506388 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:20:19.522302 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:20:19.553637 tst iperf3_dl.py: using MSISDN 6867 21:20:19.664622 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6867', subscriber_id=0} 21:20:19.771708 run srsepc_10.42.42.118: Starting srsepc 21:20:20.398547 run rm-remote-dir(pid=15633): Launched 21:20:21.578147 run rm-remote-dir(pid=15633): Terminated: ok {rc=0} 21:20:21.913466 run mk-remote-dir(pid=15634): Launched 21:20:23.092281 run mk-remote-dir(pid=15634): Terminated: ok {rc=0} 21:20:23.378034 run scp-inst-to-remote(pid=15635): Launched 21:20:25.557113 run scp-inst-to-remote(pid=15635): Terminated: ok {rc=0} 21:20:25.891106 run rm-remote-dir(pid=15637): Launched 21:20:27.068714 run rm-remote-dir(pid=15637): Terminated: ok {rc=0} 21:20:27.404671 run mk-remote-dir(pid=15638): Launched 21:20:28.583100 run mk-remote-dir(pid=15638): Terminated: ok {rc=0} 21:20:28.868904 run scp-cfg-to-remote(pid=15639): Launched 21:20:30.046907 run scp-cfg-to-remote(pid=15639): Terminated: ok {rc=0} 21:20:30.331544 run scp-db-to-remote(pid=15641): Launched 21:20:31.514115 run scp-db-to-remote(pid=15641): Terminated: ok {rc=0} 21:20:31.662661 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:20:32.045478 run patchelf(pid=15643): Launched 21:20:33.290481 run patchelf(pid=15643): Terminated: ok {rc=0} 21:20:33.432020 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:20:33.762332 run setcap-netadm(pid=15644): Launched 21:20:34.953883 run setcap-netadm(pid=15644): Terminated: ok {rc=0} 21:20:35.300790 run srsepc(pid=15645): Launched 21:20:35.426299 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:20:36.611127 run rm-remote-dir(pid=15646): Launched 21:20:36.802777 run srsepc(pid=15645): ERR: Terminated: ERROR {rc=127} [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15645)] 21:20:36.947109 run srsepc(pid=15645): stdout: | (launched: 2022-12-08_21:20:35.241276) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:20:37.091108 run srsepc(pid=15645): stderr: | (launched: 2022-12-08_21:20:35.290129) | Connection to 10.42.42.116 closed. 21:20:37.236060 run srsepc(pid=15645): stdout: | (launched: 2022-12-08_21:20:35.241276) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:20:37.374795 run srsepc(pid=15645): stderr: | (launched: 2022-12-08_21:20:35.290129) | Connection to 10.42.42.116 closed. 21:20:37.539359 run rm-remote-dir(pid=15646): Terminating (SIGINT) 21:20:37.728204 run rm-remote-dir(pid=15646): Terminated: ok {rc=0} 21:20:37.864737 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=15645): Process ended prematurely: srsepc(pid=15645) [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15645)] [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 21:20:37.875631 tst iperf3_dl.py:42: Test FAILED (18.8 sec) 21:20:37.955827 run scp-back-log(pid=15647): Launched 21:20:39.035237 run scp-back-log(pid=15647): ERR: Terminated: ERROR {rc=1} [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15647)] 21:20:39.098809 run scp-back-log(pid=15647): stdout: | (launched: 2022-12-08_21:20:37.924001) 21:20:39.164317 run scp-back-log(pid=15647): stderr: | (launched: 2022-12-08_21:20:37.944501) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:20:39.238048 tst srsepc_10.42.42.118: Error('scp-back-log(pid=15647): launch_sync(): local process exited with status 1 [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15647)]') ---------------------------------------------- trial-2349 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 21:20:39.285398 tst iperf3_ul.py:13: Number of physical ue: 1 21:20:39.507043 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:20:39.551028 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 21:20:39.771726 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:20:39.788128 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:20:39.821053 tst iperf3_ul.py: using MSISDN 6868 21:20:39.939707 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6868', subscriber_id=0} 21:20:40.054808 run srsepc_10.42.42.118: Starting srsepc 21:20:40.726118 run rm-remote-dir(pid=15649): Launched 21:20:41.919900 run rm-remote-dir(pid=15649): Terminated: ok {rc=0} 21:20:42.279128 run mk-remote-dir(pid=15650): Launched 21:20:43.473583 run mk-remote-dir(pid=15650): Terminated: ok {rc=0} 21:20:43.781252 run scp-inst-to-remote(pid=15651): Launched 21:20:45.970258 run scp-inst-to-remote(pid=15651): Terminated: ok {rc=0} 21:20:46.401038 run rm-remote-dir(pid=15653): Launched 21:20:47.624693 run rm-remote-dir(pid=15653): Terminated: ok {rc=0} 21:20:47.961657 run mk-remote-dir(pid=15654): Launched 21:20:49.141069 run mk-remote-dir(pid=15654): Terminated: ok {rc=0} 21:20:49.429581 run scp-cfg-to-remote(pid=15655): Launched 21:20:50.606897 run scp-cfg-to-remote(pid=15655): Terminated: ok {rc=0} 21:20:50.891652 run scp-db-to-remote(pid=15657): Launched 21:20:52.073788 run scp-db-to-remote(pid=15657): Terminated: ok {rc=0} 21:20:52.215241 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:20:52.547002 run patchelf(pid=15659): Launched 21:20:53.739561 run patchelf(pid=15659): Terminated: ok {rc=0} 21:20:53.881125 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:20:54.214174 run setcap-netadm(pid=15660): Launched 21:20:55.406513 run setcap-netadm(pid=15660): Terminated: ok {rc=0} 21:20:55.754220 run srsepc(pid=15661): Launched 21:20:55.878166 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:20:57.063813 run rm-remote-dir(pid=15662): Launched 21:20:57.255353 run srsepc(pid=15661): ERR: Terminated: ERROR {rc=127} [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15661)] 21:20:57.401418 run srsepc(pid=15661): stdout: | (launched: 2022-12-08_21:20:55.694147) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:20:57.546744 run srsepc(pid=15661): stderr: | (launched: 2022-12-08_21:20:55.743371) | Connection to 10.42.42.116 closed. 21:20:57.691893 run srsepc(pid=15661): stdout: | (launched: 2022-12-08_21:20:55.694147) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:20:57.831828 run srsepc(pid=15661): stderr: | (launched: 2022-12-08_21:20:55.743371) | Connection to 10.42.42.116 closed. 21:20:57.997711 run rm-remote-dir(pid=15662): Terminating (SIGINT) 21:20:58.188125 run rm-remote-dir(pid=15662): Terminated: ok {rc=0} 21:20:58.325381 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=15661): Process ended prematurely: srsepc(pid=15661) [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15661)] [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 21:20:58.336251 tst iperf3_ul.py:42: Test FAILED (19.0 sec) 21:20:58.417913 run scp-back-log(pid=15663): Launched 21:20:59.498344 run scp-back-log(pid=15663): ERR: Terminated: ERROR {rc=1} [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15663)] 21:20:59.562474 run scp-back-log(pid=15663): stdout: | (launched: 2022-12-08_21:20:58.385183) 21:20:59.627789 run scp-back-log(pid=15663): stderr: | (launched: 2022-12-08_21:20:58.405806) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:20:59.701598 tst srsepc_10.42.42.118: Error('scp-back-log(pid=15663): launch_sync(): local process exited with status 1 [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15663)]') ---------------------------------------------- trial-2349 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 21:20:59.750208 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:20:59.767730 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:20:59.791458 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:20:59.840936 tst ping.py: using MSISDN 6869 21:20:59.964074 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6869', subscriber_id=0} 21:21:00.079364 run srsepc_10.42.42.118: Starting srsepc 21:21:00.755504 run rm-remote-dir(pid=15665): Launched 21:21:02.003632 run rm-remote-dir(pid=15665): Terminated: ok {rc=0} 21:21:02.397488 run mk-remote-dir(pid=15666): Launched 21:21:03.579965 run mk-remote-dir(pid=15666): Terminated: ok {rc=0} 21:21:03.887137 run scp-inst-to-remote(pid=15667): Launched 21:21:06.075315 run scp-inst-to-remote(pid=15667): Terminated: ok {rc=0} 21:21:06.410047 run rm-remote-dir(pid=15670): Launched 21:21:07.588441 run rm-remote-dir(pid=15670): Terminated: ok {rc=0} 21:21:07.925175 run mk-remote-dir(pid=15671): Launched 21:21:09.104314 run mk-remote-dir(pid=15671): Terminated: ok {rc=0} 21:21:09.391238 run scp-cfg-to-remote(pid=15672): Launched 21:21:10.568167 run scp-cfg-to-remote(pid=15672): Terminated: ok {rc=0} 21:21:10.853720 run scp-db-to-remote(pid=15674): Launched 21:21:12.034828 run scp-db-to-remote(pid=15674): Terminated: ok {rc=0} 21:21:12.176450 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:21:12.508479 run patchelf(pid=15676): Launched 21:21:13.700043 run patchelf(pid=15676): Terminated: ok {rc=0} 21:21:13.840280 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:21:14.172673 run setcap-netadm(pid=15677): Launched 21:21:15.363485 run setcap-netadm(pid=15677): Terminated: ok {rc=0} 21:21:15.710846 run srsepc(pid=15678): Launched 21:21:15.843591 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:21:17.048278 run rm-remote-dir(pid=15679): Launched 21:21:17.344543 run srsepc(pid=15678): ERR: Terminated: ERROR {rc=127} [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15678)] 21:21:17.488680 run srsepc(pid=15678): stdout: | (launched: 2022-12-08_21:21:15.650484) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:21:17.625578 run srsepc(pid=15678): stderr: | (launched: 2022-12-08_21:21:15.699454) | Connection to 10.42.42.116 closed. 21:21:17.762206 run srsepc(pid=15678): stdout: | (launched: 2022-12-08_21:21:15.650484) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:21:17.893078 run srsepc(pid=15678): stderr: | (launched: 2022-12-08_21:21:15.699454) | Connection to 10.42.42.116 closed. 21:21:18.047583 run rm-remote-dir(pid=15679): Terminating (SIGINT) 21:21:18.225779 run rm-remote-dir(pid=15679): Terminated: ok {rc=0} 21:21:18.354970 tst ping.py:16: ERR: Error: srsepc(pid=15678): Process ended prematurely: srsepc(pid=15678) [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15678)] [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 21:21:18.365061 tst ping.py:16: Test FAILED (18.6 sec) 21:21:18.443115 run scp-back-log(pid=15680): Launched 21:21:19.520393 run scp-back-log(pid=15680): ERR: Terminated: ERROR {rc=1} [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15680)] 21:21:19.581107 run scp-back-log(pid=15680): stdout: | (launched: 2022-12-08_21:21:18.412246) 21:21:19.643248 run scp-back-log(pid=15680): stderr: | (launched: 2022-12-08_21:21:18.432024) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:21:19.713109 tst srsepc_10.42.42.118: Error('scp-back-log(pid=15680): launch_sync(): local process exited with status 1 [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15680)]') ---------------------------------------------- trial-2349 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 21:21:19.759084 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:21:19.775743 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:21:19.799213 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:21:19.850771 tst rrc_idle_mo_ping.py: using MSISDN 6870 21:21:19.966136 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6870', subscriber_id=0} 21:21:20.073506 run srsepc_10.42.42.118: Starting srsepc 21:21:20.699364 run rm-remote-dir(pid=15683): Launched 21:21:21.878196 run rm-remote-dir(pid=15683): Terminated: ok {rc=0} 21:21:22.217700 run mk-remote-dir(pid=15684): Launched 21:21:23.396555 run mk-remote-dir(pid=15684): Terminated: ok {rc=0} 21:21:23.683371 run scp-inst-to-remote(pid=15685): Launched 21:21:25.861592 run scp-inst-to-remote(pid=15685): Terminated: ok {rc=0} 21:21:26.194756 run rm-remote-dir(pid=15687): Launched 21:21:27.374634 run rm-remote-dir(pid=15687): Terminated: ok {rc=0} 21:21:27.710140 run mk-remote-dir(pid=15688): Launched 21:21:28.887311 run mk-remote-dir(pid=15688): Terminated: ok {rc=0} 21:21:29.174623 run scp-cfg-to-remote(pid=15689): Launched 21:21:30.352292 run scp-cfg-to-remote(pid=15689): Terminated: ok {rc=0} 21:21:30.637141 run scp-db-to-remote(pid=15691): Launched 21:21:31.818372 run scp-db-to-remote(pid=15691): Terminated: ok {rc=0} 21:21:31.964394 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:21:32.301139 run patchelf(pid=15693): Launched 21:21:33.476691 run patchelf(pid=15693): Terminated: ok {rc=0} 21:21:33.608622 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:21:33.918341 run setcap-netadm(pid=15694): Launched 21:21:35.094966 run setcap-netadm(pid=15694): Terminated: ok {rc=0} 21:21:35.417983 run srsepc(pid=15695): Launched 21:21:35.531702 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:21:36.640650 run rm-remote-dir(pid=15696): Launched 21:21:36.816484 run srsepc(pid=15695): ERR: Terminated: ERROR {rc=127} [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15695)] 21:21:36.951439 run srsepc(pid=15695): stdout: | (launched: 2022-12-08_21:21:35.361950) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:21:37.087036 run srsepc(pid=15695): stderr: | (launched: 2022-12-08_21:21:35.407295) | Connection to 10.42.42.116 closed. 21:21:37.222589 run srsepc(pid=15695): stdout: | (launched: 2022-12-08_21:21:35.361950) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:21:37.352410 run srsepc(pid=15695): stderr: | (launched: 2022-12-08_21:21:35.407295) | Connection to 10.42.42.116 closed. 21:21:37.506066 run rm-remote-dir(pid=15696): Terminating (SIGINT) 21:21:37.684533 run rm-remote-dir(pid=15696): Terminated: ok {rc=0} 21:21:37.813265 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=15695): Process ended prematurely: srsepc(pid=15695) [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15695)] [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 21:21:37.823240 tst rrc_idle_mo_ping.py:16: Test FAILED (18.1 sec) 21:21:37.899977 run scp-back-log(pid=15697): Launched 21:21:38.976537 run scp-back-log(pid=15697): ERR: Terminated: ERROR {rc=1} [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15697)] 21:21:39.036713 run scp-back-log(pid=15697): stdout: | (launched: 2022-12-08_21:21:37.869873) 21:21:39.098742 run scp-back-log(pid=15697): stderr: | (launched: 2022-12-08_21:21:37.889484) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:21:39.168154 tst srsepc_10.42.42.118: Error('scp-back-log(pid=15697): launch_sync(): local process exited with status 1 [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15697)]') ---------------------------------------------- trial-2349 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 21:21:39.213780 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:21:39.230358 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:21:39.253622 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:21:39.303484 tst rrc_idle_mt_ping.py: using MSISDN 6871 21:21:39.426767 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='6871', subscriber_id=0} 21:21:39.542271 run srsepc_10.42.42.118: Starting srsepc 21:21:40.215779 run rm-remote-dir(pid=15699): Launched 21:21:41.409037 run rm-remote-dir(pid=15699): Terminated: ok {rc=0} 21:21:41.769848 run mk-remote-dir(pid=15700): Launched 21:21:42.962564 run mk-remote-dir(pid=15700): Terminated: ok {rc=0} 21:21:43.270305 run scp-inst-to-remote(pid=15701): Launched 21:21:45.465635 run scp-inst-to-remote(pid=15701): Terminated: ok {rc=0} 21:21:45.824601 run rm-remote-dir(pid=15703): Launched 21:21:47.074984 run rm-remote-dir(pid=15703): Terminated: ok {rc=0} 21:21:47.417783 run mk-remote-dir(pid=15704): Launched 21:21:48.598357 run mk-remote-dir(pid=15704): Terminated: ok {rc=0} 21:21:48.885529 run scp-cfg-to-remote(pid=15705): Launched 21:21:50.062444 run scp-cfg-to-remote(pid=15705): Terminated: ok {rc=0} 21:21:50.347929 run scp-db-to-remote(pid=15707): Launched 21:21:51.529276 run scp-db-to-remote(pid=15707): Terminated: ok {rc=0} 21:21:51.662164 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:21:51.972649 run patchelf(pid=15709): Launched 21:21:53.151492 run patchelf(pid=15709): Terminated: ok {rc=0} 21:21:53.284199 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:21:53.594169 run setcap-netadm(pid=15710): Launched 21:21:54.772879 run setcap-netadm(pid=15710): Terminated: ok {rc=0} 21:21:55.097330 run srsepc(pid=15711): Launched 21:21:55.212045 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:21:56.322211 run rm-remote-dir(pid=15712): Launched 21:21:56.500480 run srsepc(pid=15711): ERR: Terminated: ERROR {rc=127} [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15711)] 21:21:56.635325 run srsepc(pid=15711): stdout: | (launched: 2022-12-08_21:21:55.040840) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:21:56.770808 run srsepc(pid=15711): stderr: | (launched: 2022-12-08_21:21:55.086614) | Connection to 10.42.42.116 closed. 21:21:56.905952 run srsepc(pid=15711): stdout: | (launched: 2022-12-08_21:21:55.040840) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:21:57.036246 run srsepc(pid=15711): stderr: | (launched: 2022-12-08_21:21:55.086614) | Connection to 10.42.42.116 closed. 21:21:57.190385 run rm-remote-dir(pid=15712): Terminating (SIGINT) 21:21:57.368620 run rm-remote-dir(pid=15712): Terminated: ok {rc=0} 21:21:57.497933 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=15711): Process ended prematurely: srsepc(pid=15711) [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15711)] [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 21:21:57.507983 tst rrc_idle_mt_ping.py:16: Test FAILED (18.3 sec) 21:21:57.585254 run scp-back-log(pid=15713): Launched 21:21:58.662109 run scp-back-log(pid=15713): ERR: Terminated: ERROR {rc=1} [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15713)] 21:21:58.722712 run scp-back-log(pid=15713): stdout: | (launched: 2022-12-08_21:21:57.554721) 21:21:58.785112 run scp-back-log(pid=15713): stderr: | (launched: 2022-12-08_21:21:57.574461) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:21:58.854929 tst srsepc_10.42.42.118: Error('scp-back-log(pid=15713): launch_sync(): local process exited with status 1 [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15713)]') --------------------------------------------------------------------- trial-2349 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 21:21:58.985765 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:21:58.990966 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 21:21:59.032496 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 21:21:59.059211 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 21:21:59.110638 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 21:21:59.153300 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 21:21:59.180037 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 21:21:59.730271 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 21:21:59.735918 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 21:21:59.746919 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 21:21:59.785304 tst handover.py: using LAC 16882 21:21:59.907835 tst handover.py: using RAC 52 21:22:00.029773 tst handover.py: using CellId 16882 21:22:00.148930 tst handover.py: using BVCI 16883 21:22:00.259095 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 21:22:00.293541 tst handover.py: using LAC 16883 21:22:00.412925 tst handover.py: using RAC 53 21:22:00.532389 tst handover.py: using CellId 16883 21:22:00.653700 tst handover.py: using BVCI 16884 21:22:00.766153 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 21:22:00.777332 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 21:22:00.788058 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 21:22:00.798956 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 21:22:00.810296 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 21:22:00.821448 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 21:22:00.955273 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 21:22:01.080720 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:22:01.558641 run create_hlr_db(pid=15718): Launched 21:22:02.773369 run create_hlr_db(pid=15718): Terminated: ok {rc=0} 21:22:03.093720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15720): Launched 21:22:03.397478 run osmo-hlr_10.42.42.2(pid=15721): Launched 21:22:03.513108 run osmo-stp_10.42.42.5: Starting osmo-stp 21:22:04.035040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15723): Launched 21:22:04.337692 run osmo-stp_10.42.42.5(pid=15724): Launched 21:22:04.454190 run osmo-msc_10.42.42.6: Starting osmo-msc 21:22:05.001652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15726): Launched 21:22:05.304324 run osmo-msc_10.42.42.6(pid=15727): Launched 21:22:05.472711 run osmo-stp_10.42.42.5(pid=15724): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15724)] 21:22:05.600814 run osmo-stp_10.42.42.5(pid=15724): stdout: | (launched: 2022-12-08_21:22:04.281917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:05.729116 run osmo-stp_10.42.42.5(pid=15724): stderr: | [0;m[38;5;43m20221208212204449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212204449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212204450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212204450 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212204450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212204451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212204451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:05.855431 run osmo-stp_10.42.42.5(pid=15724): stdout: | (launched: 2022-12-08_21:22:04.281917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:05.975827 run osmo-stp_10.42.42.5(pid=15724): stderr: | [0;m[38;5;43m20221208212204449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212204449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212204450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212204450 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212204450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212204451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212204451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:06.119249 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15724): Process ended prematurely: osmo-stp_10.42.42.5(pid=15724) [trial-2349↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15724)] [trial-2349↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 21:22:06.127675 tst handover.py:18: Test FAILED (6.4 sec) 21:22:06.154211 run osmo-hlr_10.42.42.2(pid=15721): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15721)] 21:22:06.202076 run osmo-hlr_10.42.42.2(pid=15721): stdout: | (launched: 2022-12-08_21:22:03.341637) 21:22:06.251785 run osmo-hlr_10.42.42.2(pid=15721): stderr: | [0;m[1;31m20221208212203519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212203519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212203519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212203519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212203519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212203520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212203532 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212203542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212203542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212203542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:22:06.320363 run osmo-msc_10.42.42.6(pid=15727): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15727)] 21:22:06.367935 run osmo-msc_10.42.42.6(pid=15727): stdout: | (launched: 2022-12-08_21:22:05.249105) 21:22:06.416875 run osmo-msc_10.42.42.6(pid=15727): stderr: | [0;m[38;5;43m20221208212205520 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212205520 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f488e40bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212205521 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212205521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212205521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212205521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212205523 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212205524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212205524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212205524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:22:06.466427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15720): Terminating (SIGTERM) 21:22:06.506242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15723): Terminating (SIGTERM) 21:22:06.545922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15726): Terminating (SIGTERM) 21:22:06.585885 --- ParallelTerminationStrategy: PID 15720 died... 21:22:06.604816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15720): Terminated: ok {rc=0} 21:22:06.649277 --- ParallelTerminationStrategy: PID 15723 died... 21:22:06.667555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15723): Terminated: ok {rc=0} 21:22:06.711540 --- ParallelTerminationStrategy: PID 15726 died... 21:22:06.730175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15726): Terminated: ok {rc=0} 21:22:06.814729 bus /sierra_3: Setting Powered False 21:22:07.914941 bus /sierra_3: Setting Powered False 21:22:09.030433 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 21:22:10.280249 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:22:10.285878 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 21:22:10.328299 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 21:22:10.355808 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 21:22:10.409322 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 21:22:10.450653 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 21:22:10.478476 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 21:22:11.033905 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 21:22:11.039169 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:22:11.050548 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 21:22:11.090780 tst handover.py: using LAC 16884 21:22:11.220511 tst handover.py: using RAC 54 21:22:11.349318 tst handover.py: using CellId 16884 21:22:11.478365 tst handover.py: using BVCI 16885 21:22:11.597675 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 21:22:11.632324 tst handover.py: using LAC 16885 21:22:11.761572 tst handover.py: using RAC 55 21:22:11.881879 tst handover.py: using CellId 16885 21:22:12.011025 tst handover.py: using BVCI 16886 21:22:12.130993 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:22:12.142542 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:22:12.153857 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:22:12.165366 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:22:12.177307 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:22:12.188570 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 21:22:12.304693 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 21:22:12.424797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:22:12.898515 run create_hlr_db(pid=15732): Launched 21:22:13.030409 bus /sierra_2: Setting Powered False 21:22:14.090579 run create_hlr_db(pid=15732): Terminated: ok {rc=0} 21:22:14.489278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15734): Launched 21:22:14.793042 run osmo-hlr_10.42.42.2(pid=15735): Launched 21:22:14.909433 run osmo-stp_10.42.42.5: Starting osmo-stp 21:22:15.405255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15737): Launched 21:22:15.707827 run osmo-stp_10.42.42.5(pid=15738): Launched 21:22:15.823679 run osmo-msc_10.42.42.6: Starting osmo-msc 21:22:16.446259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15740): Launched 21:22:16.769347 run osmo-msc_10.42.42.6(pid=15741): Launched 21:22:17.037858 run osmo-stp_10.42.42.5(pid=15738): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15738)] 21:22:17.297652 run osmo-stp_10.42.42.5(pid=15738): stdout: | (launched: 2022-12-08_21:22:15.652184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:17.437448 run osmo-stp_10.42.42.5(pid=15738): stderr: | [0;m[38;5;43m20221208212215823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212215823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212215824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212215824 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212215825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212215825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212215825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:17.575373 run osmo-stp_10.42.42.5(pid=15738): stdout: | (launched: 2022-12-08_21:22:15.652184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:17.705513 run osmo-stp_10.42.42.5(pid=15738): stderr: | [0;m[38;5;43m20221208212215823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212215823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212215824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212215824 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212215825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212215825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212215825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:17.861187 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15738): Process ended prematurely: osmo-stp_10.42.42.5(pid=15738) [trial-2349↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15738)] [trial-2349↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 21:22:17.870361 tst handover.py:18: Test FAILED (6.8 sec) 21:22:17.898100 run osmo-hlr_10.42.42.2(pid=15735): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15735)] 21:22:17.948446 run osmo-hlr_10.42.42.2(pid=15735): stdout: | (launched: 2022-12-08_21:22:14.737745) 21:22:18.001454 run osmo-hlr_10.42.42.2(pid=15735): stderr: | [0;m[1;31m20221208212214912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212214912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212214913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212214913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212214913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212214913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212214931 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212214941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212214941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212214941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:22:18.073874 run osmo-msc_10.42.42.6(pid=15741): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15741)] 21:22:18.124031 run osmo-msc_10.42.42.6(pid=15741): stdout: | (launched: 2022-12-08_21:22:16.710457) 21:22:18.176252 run osmo-msc_10.42.42.6(pid=15741): stderr: | [0;m[38;5;43m20221208212217234 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212217234 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f84789e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212217234 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212217234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212217234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212217235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212217236 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212217245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212217245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212217245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:22:18.228756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15734): Terminating (SIGTERM) 21:22:18.270987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15737): Terminating (SIGTERM) 21:22:18.313100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15740): Terminating (SIGTERM) 21:22:18.355610 --- ParallelTerminationStrategy: PID 15734 died... 21:22:18.375586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15734): Terminated: ok {rc=0} 21:22:18.422150 --- ParallelTerminationStrategy: PID 15737 died... 21:22:18.441709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15737): Terminated: ok {rc=0} 21:22:18.487887 --- ParallelTerminationStrategy: PID 15740 died... 21:22:18.507564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15740): Terminated: ok {rc=0} 21:22:18.595362 bus /sierra_3: Setting Powered False 21:22:19.694492 bus /sierra_3: Setting Powered False 21:22:20.813437 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 21:22:22.061137 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:22:22.066773 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 21:22:22.121909 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 21:22:22.150304 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 21:22:22.203629 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 21:22:22.258694 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 21:22:22.286012 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 21:22:22.835287 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 21:22:22.840856 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:22:22.852171 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 21:22:22.890423 tst handover.py: using LAC 16886 21:22:23.010276 tst handover.py: using RAC 56 21:22:23.132627 tst handover.py: using CellId 16886 21:22:23.261017 tst handover.py: using BVCI 16887 21:22:23.379066 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 21:22:23.426749 tst handover.py: using LAC 16887 21:22:23.551540 tst handover.py: using RAC 57 21:22:23.679632 tst handover.py: using CellId 16887 21:22:23.805280 tst handover.py: using BVCI 16888 21:22:23.923223 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:22:23.934532 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:22:23.945823 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:22:23.957093 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:22:23.968536 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:22:23.979815 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 21:22:24.095586 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 21:22:24.218079 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:22:24.694121 run create_hlr_db(pid=15746): Launched 21:22:24.827782 bus /sierra_2: Setting Powered False 21:22:25.893080 run create_hlr_db(pid=15746): Terminated: ok {rc=0} 21:22:26.301927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15748): Launched 21:22:26.606371 run osmo-hlr_10.42.42.2(pid=15749): Launched 21:22:26.723368 run osmo-stp_10.42.42.5: Starting osmo-stp 21:22:27.219251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15751): Launched 21:22:27.525057 run osmo-stp_10.42.42.5(pid=15752): Launched 21:22:27.641218 run osmo-msc_10.42.42.6: Starting osmo-msc 21:22:28.164275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15754): Launched 21:22:28.467100 run osmo-msc_10.42.42.6(pid=15755): Launched 21:22:28.636268 run osmo-stp_10.42.42.5(pid=15752): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15752)] 21:22:28.765165 run osmo-stp_10.42.42.5(pid=15752): stdout: | (launched: 2022-12-08_21:22:27.467509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:28.893756 run osmo-stp_10.42.42.5(pid=15752): stderr: | [0;m[38;5;43m20221208212227641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212227642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212227642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212227642 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212227643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212227643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212227643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:29.020268 run osmo-stp_10.42.42.5(pid=15752): stdout: | (launched: 2022-12-08_21:22:27.467509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:29.140757 run osmo-stp_10.42.42.5(pid=15752): stderr: | [0;m[38;5;43m20221208212227641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212227642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212227642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212227642 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212227643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212227643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212227643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:29.285168 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15752): Process ended prematurely: osmo-stp_10.42.42.5(pid=15752) [trial-2349↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15752)] [trial-2349↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 21:22:29.293611 tst handover.py:18: Test FAILED (6.4 sec) 21:22:29.320044 run osmo-hlr_10.42.42.2(pid=15749): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15749)] 21:22:29.368413 run osmo-hlr_10.42.42.2(pid=15749): stdout: | (launched: 2022-12-08_21:22:26.550516) 21:22:29.417858 run osmo-hlr_10.42.42.2(pid=15749): stderr: | [0;m[1;31m20221208212226724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212226724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212226724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212226724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212226724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212226724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212226736 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212226744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212226745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212226745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:22:29.487079 run osmo-msc_10.42.42.6(pid=15755): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15755)] 21:22:29.534808 run osmo-msc_10.42.42.6(pid=15755): stdout: | (launched: 2022-12-08_21:22:28.411879) 21:22:29.584334 run osmo-msc_10.42.42.6(pid=15755): stderr: | [0;m[38;5;43m20221208212228682 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212228682 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f45428fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212228682 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212228682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212228683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212228683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212228684 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212228685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212228685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212228685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:22:29.634359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15748): Terminating (SIGTERM) 21:22:29.674661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15751): Terminating (SIGTERM) 21:22:29.714837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15754): Terminating (SIGTERM) 21:22:29.755472 --- ParallelTerminationStrategy: PID 15748 died... 21:22:29.774607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15748): Terminated: ok {rc=0} 21:22:29.819418 --- ParallelTerminationStrategy: PID 15751 died... 21:22:29.838121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15751): Terminated: ok {rc=0} 21:22:29.882704 --- ParallelTerminationStrategy: PID 15754 died... 21:22:29.901482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15754): Terminated: ok {rc=0} 21:22:29.987615 bus /sierra_3: Setting Powered False 21:22:31.085008 bus /sierra_3: Setting Powered False 21:22:32.209962 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 21:22:33.469660 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:22:33.474772 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 21:22:33.525194 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 21:22:33.551772 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 21:22:33.603331 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 21:22:33.652717 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 21:22:33.679265 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 21:22:34.230894 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 21:22:34.236322 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:22:34.247537 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:22:34.286133 tst handover.py: using LAC 16888 21:22:34.404924 tst handover.py: using RAC 58 21:22:34.523154 tst handover.py: using CellId 16888 21:22:34.642913 tst handover.py: using BVCI 16889 21:22:34.752155 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:22:34.796576 tst handover.py: using LAC 16889 21:22:34.916359 tst handover.py: using RAC 59 21:22:35.035458 tst handover.py: using CellId 16889 21:22:35.163375 tst handover.py: using BVCI 16890 21:22:35.282243 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:22:35.294017 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:22:35.305694 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:22:35.317444 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:22:35.328883 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:22:35.340249 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:22:35.459583 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:22:35.582084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:22:36.030604 run create_hlr_db(pid=15763): Launched 21:22:36.148457 bus /sierra_2: Setting Powered False 21:22:37.209197 run create_hlr_db(pid=15763): Terminated: ok {rc=0} 21:22:37.608009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15765): Launched 21:22:37.910907 run osmo-hlr_10.42.42.2(pid=15766): Launched 21:22:38.026061 run osmo-stp_10.42.42.5: Starting osmo-stp 21:22:38.522797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15768): Launched 21:22:38.824855 run osmo-stp_10.42.42.5(pid=15769): Launched 21:22:38.940061 run osmo-msc_10.42.42.6: Starting osmo-msc 21:22:39.465858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15771): Launched 21:22:39.770493 run osmo-msc_10.42.42.6(pid=15772): Launched 21:22:39.940208 run osmo-stp_10.42.42.5(pid=15769): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15769)] 21:22:40.070191 run osmo-stp_10.42.42.5(pid=15769): stdout: | (launched: 2022-12-08_21:22:38.769129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:40.198829 run osmo-stp_10.42.42.5(pid=15769): stderr: | [0;m[38;5;43m20221208212238940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212238940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212238940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212238941 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212238941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212238941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212238941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:40.325286 run osmo-stp_10.42.42.5(pid=15769): stdout: | (launched: 2022-12-08_21:22:38.769129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:40.445804 run osmo-stp_10.42.42.5(pid=15769): stderr: | [0;m[38;5;43m20221208212238940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212238940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212238940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212238941 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212238941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212238941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212238941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:40.590132 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15769): Process ended prematurely: osmo-stp_10.42.42.5(pid=15769) [trial-2349↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15769)] [trial-2349↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 21:22:40.598521 tst handover.py:18: Test FAILED (6.4 sec) 21:22:40.624829 run osmo-hlr_10.42.42.2(pid=15766): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15766)] 21:22:40.672703 run osmo-hlr_10.42.42.2(pid=15766): stdout: | (launched: 2022-12-08_21:22:37.855597) 21:22:40.722206 run osmo-hlr_10.42.42.2(pid=15766): stderr: | [0;m[1;31m20221208212238033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212238033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212238033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212238033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212238033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212238033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212238044 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212238053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212238053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212238053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:22:40.791235 run osmo-msc_10.42.42.6(pid=15772): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15772)] 21:22:40.839154 run osmo-msc_10.42.42.6(pid=15772): stdout: | (launched: 2022-12-08_21:22:39.714346) 21:22:40.888528 run osmo-msc_10.42.42.6(pid=15772): stderr: | [0;m[38;5;43m20221208212239985 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212239985 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe627375c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212239985 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212239985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212239985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212239986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212239987 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212239988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212239988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212239988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:22:40.938291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15765): Terminating (SIGTERM) 21:22:40.978180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15768): Terminating (SIGTERM) 21:22:41.018122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15771): Terminating (SIGTERM) 21:22:41.058329 --- ParallelTerminationStrategy: PID 15765 died... 21:22:41.077688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15765): Terminated: ok {rc=0} 21:22:41.122040 --- ParallelTerminationStrategy: PID 15768 died... 21:22:41.140505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15768): Terminated: ok {rc=0} 21:22:41.184760 --- ParallelTerminationStrategy: PID 15771 died... 21:22:41.203254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15771): Terminated: ok {rc=0} 21:22:41.288877 bus /sierra_3: Setting Powered False 21:22:42.388612 bus /sierra_3: Setting Powered False 21:22:43.504285 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 21:22:44.760611 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:22:44.765925 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 21:22:44.820281 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 21:22:44.847037 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 21:22:44.899619 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 21:22:44.953546 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 21:22:44.980062 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 21:22:45.536482 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 21:22:45.542932 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:22:45.554917 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:22:45.597069 tst handover.py: using LAC 16890 21:22:45.716722 tst handover.py: using RAC 60 21:22:45.834490 tst handover.py: using CellId 16890 21:22:45.979194 tst handover.py: using BVCI 16891 21:22:46.102417 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:22:46.156741 tst handover.py: using LAC 16891 21:22:46.275456 tst handover.py: using RAC 61 21:22:46.396783 tst handover.py: using CellId 16891 21:22:46.516642 tst handover.py: using BVCI 16892 21:22:46.659659 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:22:46.671562 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:22:46.683231 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:22:46.695187 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:22:46.707138 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:22:46.719047 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:22:46.838944 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:22:46.977513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:22:47.474967 run create_hlr_db(pid=15777): Launched 21:22:47.591299 bus /sierra_2: Setting Powered False 21:22:48.651577 run create_hlr_db(pid=15777): Terminated: ok {rc=0} 21:22:49.067289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15779): Launched 21:22:49.395794 run osmo-hlr_10.42.42.2(pid=15780): Launched 21:22:49.520141 run osmo-stp_10.42.42.5: Starting osmo-stp 21:22:50.054354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15782): Launched 21:22:50.382101 run osmo-stp_10.42.42.5(pid=15783): Launched 21:22:50.506025 run osmo-msc_10.42.42.6: Starting osmo-msc 21:22:51.066483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15785): Launched 21:22:51.390960 run osmo-msc_10.42.42.6(pid=15786): Launched 21:22:51.573116 run osmo-stp_10.42.42.5(pid=15783): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15783)] 21:22:51.709751 run osmo-stp_10.42.42.5(pid=15783): stdout: | (launched: 2022-12-08_21:22:50.322442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:51.846650 run osmo-stp_10.42.42.5(pid=15783): stderr: | [0;m[38;5;43m20221208212250513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212250514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212250514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212250514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212250515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212250515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212250515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:51.982598 run osmo-stp_10.42.42.5(pid=15783): stdout: | (launched: 2022-12-08_21:22:50.322442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:52.111227 run osmo-stp_10.42.42.5(pid=15783): stderr: | [0;m[38;5;43m20221208212250513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212250514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212250514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212250514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212250515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212250515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212250515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:52.266180 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15783): Process ended prematurely: osmo-stp_10.42.42.5(pid=15783) [trial-2349↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15783)] [trial-2349↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 21:22:52.275582 tst handover.py:18: Test FAILED (6.7 sec) 21:22:52.303005 run osmo-hlr_10.42.42.2(pid=15780): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15780)] 21:22:52.353267 run osmo-hlr_10.42.42.2(pid=15780): stdout: | (launched: 2022-12-08_21:22:49.336253) 21:22:52.405235 run osmo-hlr_10.42.42.2(pid=15780): stderr: | [0;m[1;31m20221208212249536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212249536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212249536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212249536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212249536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212249536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212249549 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212249557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212249557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212249557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:22:52.477593 run osmo-msc_10.42.42.6(pid=15786): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15786)] 21:22:52.527830 run osmo-msc_10.42.42.6(pid=15786): stdout: | (launched: 2022-12-08_21:22:51.332172) 21:22:52.579895 run osmo-msc_10.42.42.6(pid=15786): stderr: | [0;m[38;5;43m20221208212251654 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212251654 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f99f192ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212251654 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212251654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212251654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212251655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212251656 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212251657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212251657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212251657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:22:52.632008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15779): Terminating (SIGTERM) 21:22:52.673789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15782): Terminating (SIGTERM) 21:22:52.715429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15785): Terminating (SIGTERM) 21:22:52.757270 --- ParallelTerminationStrategy: PID 15779 died... 21:22:52.777232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15779): Terminated: ok {rc=0} 21:22:52.823246 --- ParallelTerminationStrategy: PID 15782 died... 21:22:52.842820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15782): Terminated: ok {rc=0} 21:22:52.889249 --- ParallelTerminationStrategy: PID 15785 died... 21:22:52.908788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15785): Terminated: ok {rc=0} 21:22:52.995878 bus /sierra_3: Setting Powered False 21:22:54.095360 bus /sierra_3: Setting Powered False 21:22:55.210579 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 21:22:56.475381 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:22:56.480833 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 21:22:56.524216 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 21:22:56.552026 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 21:22:56.604443 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 21:22:56.647029 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 21:22:56.674460 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 21:22:57.235751 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 21:22:57.242506 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:22:57.254356 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 21:22:57.302395 tst handover.py: using LAC 16892 21:22:57.430985 tst handover.py: using RAC 62 21:22:57.559776 tst handover.py: using CellId 16892 21:22:57.686752 tst handover.py: using BVCI 16893 21:22:57.806401 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 21:22:57.842907 tst handover.py: using LAC 16893 21:22:57.974714 tst handover.py: using RAC 63 21:22:58.102322 tst handover.py: using CellId 16893 21:22:58.228517 tst handover.py: using BVCI 16894 21:22:58.346970 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:22:58.358475 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:22:58.369838 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:22:58.380844 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:22:58.392288 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:22:58.403651 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 21:22:58.521443 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 21:22:58.644428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:22:59.122323 run create_hlr_db(pid=15791): Launched 21:22:59.255691 bus /sierra_2: Setting Powered False 21:23:00.320932 run create_hlr_db(pid=15791): Terminated: ok {rc=0} 21:23:00.727177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15793): Launched 21:23:01.067397 run osmo-hlr_10.42.42.2(pid=15794): Launched 21:23:01.337435 run osmo-stp_10.42.42.5: Starting osmo-stp 21:23:02.189698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15845): Launched 21:23:02.658432 run osmo-stp_10.42.42.5(pid=15858): Launched 21:23:02.964184 run osmo-msc_10.42.42.6: Starting osmo-msc 21:23:03.814033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15976): Launched 21:23:04.223416 run osmo-msc_10.42.42.6(pid=16026): Launched 21:23:04.628572 run osmo-stp_10.42.42.5(pid=15858): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15858)] 21:23:04.875571 run osmo-stp_10.42.42.5(pid=15858): stdout: | (launched: 2022-12-08_21:23:02.575764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:05.100333 run osmo-stp_10.42.42.5(pid=15858): stderr: | [0;m[38;5;43m20221208212302946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212302947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212302947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212302949 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212302949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212302949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212302949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:05.231784 run osmo-stp_10.42.42.5(pid=15858): stdout: | (launched: 2022-12-08_21:23:02.575764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:05.357302 run osmo-stp_10.42.42.5(pid=15858): stderr: | [0;m[38;5;43m20221208212302946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212302947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212302947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212302949 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212302949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212302949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212302949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:05.507605 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15858): Process ended prematurely: osmo-stp_10.42.42.5(pid=15858) [trial-2349↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15858)] [trial-2349↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 21:23:05.517151 tst handover.py:18: Test FAILED (8.3 sec) 21:23:05.546735 run osmo-hlr_10.42.42.2(pid=15794): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15794)] 21:23:05.598639 run osmo-hlr_10.42.42.2(pid=15794): stdout: | (launched: 2022-12-08_21:23:01.004880) 21:23:05.651235 run osmo-hlr_10.42.42.2(pid=15794): stderr: | [0;m[1;31m20221208212301393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212301393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212301393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212301393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212301393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212301394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212301416 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212301424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212301424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212301441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:23:05.723552 run osmo-msc_10.42.42.6(pid=16026): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16026)] 21:23:05.774354 run osmo-msc_10.42.42.6(pid=16026): stdout: | (launched: 2022-12-08_21:23:04.153962) 21:23:05.827288 run osmo-msc_10.42.42.6(pid=16026): stderr: | [0;m[38;5;43m20221208212304708 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212304708 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f074b370c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212304721 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212304721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212304721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212304721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212304723 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212304724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212304724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212304724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:23:05.879802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15793): Terminating (SIGTERM) 21:23:05.922106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15845): Terminating (SIGTERM) 21:23:05.965531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15976): Terminating (SIGTERM) 21:23:06.010430 --- ParallelTerminationStrategy: PID 15793 died... 21:23:06.031830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15793): Terminated: ok {rc=0} 21:23:06.081268 --- ParallelTerminationStrategy: PID 15845 died... 21:23:06.101092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15845): Terminated: ok {rc=0} 21:23:06.148516 --- ParallelTerminationStrategy: PID 15976 died... 21:23:06.168270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15976): Terminated: ok {rc=0} 21:23:06.257681 bus /sierra_3: Setting Powered False 21:23:07.356866 bus /sierra_3: Setting Powered False 21:23:08.476197 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 21:23:09.731363 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:23:09.737240 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 21:23:09.796028 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 21:23:09.823763 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 21:23:09.876557 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 21:23:09.932690 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 21:23:09.963157 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 21:23:10.511251 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 21:23:10.518180 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:23:10.530371 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:23:10.572796 tst handover.py: using LAC 16894 21:23:10.697794 tst handover.py: using RAC 64 21:23:10.820757 tst handover.py: using CellId 16894 21:23:10.948708 tst handover.py: using BVCI 16895 21:23:11.063248 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:23:11.116334 tst handover.py: using LAC 16895 21:23:11.240408 tst handover.py: using RAC 65 21:23:11.361394 tst handover.py: using CellId 16895 21:23:11.484417 tst handover.py: using BVCI 16896 21:23:11.600287 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:23:11.612141 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:23:11.624016 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:23:11.638046 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:23:11.649795 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:23:11.662326 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:23:11.785729 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:23:11.907398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:23:12.368759 run create_hlr_db(pid=16077): Launched 21:23:12.531985 bus /sierra_2: Setting Powered False 21:23:13.595717 run create_hlr_db(pid=16077): Terminated: ok {rc=0} 21:23:14.011400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16079): Launched 21:23:14.339301 run osmo-hlr_10.42.42.2(pid=16080): Launched 21:23:14.582566 run osmo-stp_10.42.42.5: Starting osmo-stp 21:23:15.293444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16082): Launched 21:23:15.625500 run osmo-stp_10.42.42.5(pid=16083): Launched 21:23:15.894223 run osmo-msc_10.42.42.6: Starting osmo-msc 21:23:16.640921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16085): Launched 21:23:17.053767 run osmo-msc_10.42.42.6(pid=16086): Launched 21:23:17.450267 run osmo-stp_10.42.42.5(pid=16083): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16083)] 21:23:17.734072 run osmo-stp_10.42.42.5(pid=16083): stdout: | (launched: 2022-12-08_21:23:15.564018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:17.996448 run osmo-stp_10.42.42.5(pid=16083): stderr: | [0;m[38;5;43m20221208212315917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212315917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212315917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212315918 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212315918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212315918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212315918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:18.261704 run osmo-stp_10.42.42.5(pid=16083): stdout: | (launched: 2022-12-08_21:23:15.564018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:18.402750 run osmo-stp_10.42.42.5(pid=16083): stderr: | [0;m[38;5;43m20221208212315917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212315917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212315917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212315918 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212315918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212315918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212315918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:18.553548 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16083): Process ended prematurely: osmo-stp_10.42.42.5(pid=16083) [trial-2349↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16083)] [trial-2349↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 21:23:18.562959 tst handover.py:18: Test FAILED (8.0 sec) 21:23:18.591810 run osmo-hlr_10.42.42.2(pid=16080): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16080)] 21:23:18.642717 run osmo-hlr_10.42.42.2(pid=16080): stdout: | (launched: 2022-12-08_21:23:14.282435) 21:23:18.694942 run osmo-hlr_10.42.42.2(pid=16080): stderr: | [0;m[1;31m20221208212314634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212314634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212314634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212314634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212314634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212314634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212314653 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212314662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212314662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212314662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:23:18.767709 run osmo-msc_10.42.42.6(pid=16086): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16086)] 21:23:18.819501 run osmo-msc_10.42.42.6(pid=16086): stdout: | (launched: 2022-12-08_21:23:16.976042) 21:23:18.871920 run osmo-msc_10.42.42.6(pid=16086): stderr: | [0;m[38;5;43m20221208212317573 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212317577 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6e1e3fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212317577 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212317577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212317577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212317577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212317579 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212317580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212317580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212317580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:23:18.925049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16079): Terminating (SIGTERM) 21:23:18.970206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16082): Terminating (SIGTERM) 21:23:19.015604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16085): Terminating (SIGTERM) 21:23:19.061074 --- ParallelTerminationStrategy: PID 16079 died... 21:23:19.081167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16079): Terminated: ok {rc=0} 21:23:19.130482 --- ParallelTerminationStrategy: PID 16082 died... 21:23:19.150162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16082): Terminated: ok {rc=0} 21:23:19.197802 --- ParallelTerminationStrategy: PID 16085 died... 21:23:19.218600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16085): Terminated: ok {rc=0} 21:23:19.306978 bus /sierra_3: Setting Powered False 21:23:20.408533 bus /sierra_3: Setting Powered False 21:23:21.525588 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 21:23:22.790053 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:23:22.796170 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 21:23:22.854710 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:23:22.883855 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 21:23:22.936718 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 21:23:22.994072 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:23:23.022828 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 21:23:23.572752 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 21:23:23.580018 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:23:23.592343 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:23:23.636525 tst handover.py: using LAC 16896 21:23:23.760842 tst handover.py: using RAC 66 21:23:23.885660 tst handover.py: using CellId 16896 21:23:24.014096 tst handover.py: using BVCI 16897 21:23:24.131609 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:23:24.181439 tst handover.py: using LAC 16897 21:23:24.306046 tst handover.py: using RAC 67 21:23:24.432217 tst handover.py: using CellId 16897 21:23:24.557283 tst handover.py: using BVCI 16898 21:23:24.675978 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:23:24.688364 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:23:24.701660 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:23:24.714406 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:23:24.726457 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:23:24.739454 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:23:24.864021 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:23:24.986620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:23:25.458017 run create_hlr_db(pid=16091): Launched 21:23:25.576631 bus /sierra_2: Setting Powered False 21:23:26.637550 run create_hlr_db(pid=16091): Terminated: ok {rc=0} 21:23:27.033268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16095): Launched 21:23:27.338172 run osmo-hlr_10.42.42.2(pid=16096): Launched 21:23:27.454209 run osmo-stp_10.42.42.5: Starting osmo-stp 21:23:27.968841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16098): Launched 21:23:28.273230 run osmo-stp_10.42.42.5(pid=16099): Launched 21:23:28.389636 run osmo-msc_10.42.42.6: Starting osmo-msc 21:23:28.911147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16101): Launched 21:23:29.214309 run osmo-msc_10.42.42.6(pid=16102): Launched 21:23:29.383185 run osmo-stp_10.42.42.5(pid=16099): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16099)] 21:23:29.510848 run osmo-stp_10.42.42.5(pid=16099): stdout: | (launched: 2022-12-08_21:23:28.216908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:29.638631 run osmo-stp_10.42.42.5(pid=16099): stderr: | [0;m[38;5;43m20221208212328387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212328388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212328388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212328388 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212328389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212328389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212328389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:29.764441 run osmo-stp_10.42.42.5(pid=16099): stdout: | (launched: 2022-12-08_21:23:28.216908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:29.883979 run osmo-stp_10.42.42.5(pid=16099): stderr: | [0;m[38;5;43m20221208212328387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212328388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212328388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212328388 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212328389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212328389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212328389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:30.027824 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16099): Process ended prematurely: osmo-stp_10.42.42.5(pid=16099) [trial-2349↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16099)] [trial-2349↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 21:23:30.036198 tst handover.py:18: Test FAILED (6.5 sec) 21:23:30.062519 run osmo-hlr_10.42.42.2(pid=16096): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16096)] 21:23:30.110572 run osmo-hlr_10.42.42.2(pid=16096): stdout: | (launched: 2022-12-08_21:23:27.282104) 21:23:30.159968 run osmo-hlr_10.42.42.2(pid=16096): stderr: | [0;m[1;31m20221208212327459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212327460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212327460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212327460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212327460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212327460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212327472 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212327480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212327481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212327481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:23:30.228635 run osmo-msc_10.42.42.6(pid=16102): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16102)] 21:23:30.276393 run osmo-msc_10.42.42.6(pid=16102): stdout: | (launched: 2022-12-08_21:23:29.158121) 21:23:30.325767 run osmo-msc_10.42.42.6(pid=16102): stderr: | [0;m[38;5;43m20221208212329430 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212329430 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa5d4e9bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212329430 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212329430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212329430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212329431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212329432 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212329433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212329433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212329433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:23:30.375627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16095): Terminating (SIGTERM) 21:23:30.415279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16098): Terminating (SIGTERM) 21:23:30.454954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16101): Terminating (SIGTERM) 21:23:30.494940 --- ParallelTerminationStrategy: PID 16095 died... 21:23:30.513940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16095): Terminated: ok {rc=0} 21:23:30.558879 --- ParallelTerminationStrategy: PID 16098 died... 21:23:30.577435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16098): Terminated: ok {rc=0} 21:23:30.621154 --- ParallelTerminationStrategy: PID 16101 died... 21:23:30.639696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16101): Terminated: ok {rc=0} 21:23:30.723381 bus /sierra_3: Setting Powered False 21:23:31.817417 bus /sierra_3: Setting Powered False 21:23:32.929966 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 21:23:34.185064 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:23:34.189953 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 21:23:34.227093 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 21:23:34.253864 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 21:23:34.305977 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 21:23:34.343967 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 21:23:34.370345 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 21:23:34.918470 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 21:23:34.923808 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:23:34.934829 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 21:23:34.970118 tst handover.py: using LAC 16898 21:23:35.089658 tst handover.py: using RAC 68 21:23:35.220203 tst handover.py: using CellId 16898 21:23:35.348328 tst handover.py: using BVCI 16899 21:23:35.465626 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 21:23:35.499156 tst handover.py: using LAC 16899 21:23:35.624775 tst handover.py: using RAC 69 21:23:35.750430 tst handover.py: using CellId 16899 21:23:35.875574 tst handover.py: using BVCI 16900 21:23:35.993333 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:23:36.004580 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:23:36.015638 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:23:36.026709 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:23:36.037807 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:23:36.048866 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 21:23:36.166368 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 21:23:36.288378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:23:36.764768 run create_hlr_db(pid=16107): Launched 21:23:36.897723 bus /sierra_2: Setting Powered False 21:23:37.961758 run create_hlr_db(pid=16107): Terminated: ok {rc=0} 21:23:38.370165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16109): Launched 21:23:38.673478 run osmo-hlr_10.42.42.2(pid=16110): Launched 21:23:38.789588 run osmo-stp_10.42.42.5: Starting osmo-stp 21:23:39.301267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16112): Launched 21:23:39.605758 run osmo-stp_10.42.42.5(pid=16113): Launched 21:23:39.732353 run osmo-msc_10.42.42.6: Starting osmo-msc 21:23:40.296064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16115): Launched 21:23:40.621582 run osmo-msc_10.42.42.6(pid=16116): Launched 21:23:40.805087 run osmo-stp_10.42.42.5(pid=16113): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16113)] 21:23:40.942457 run osmo-stp_10.42.42.5(pid=16113): stdout: | (launched: 2022-12-08_21:23:39.549106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:41.080758 run osmo-stp_10.42.42.5(pid=16113): stderr: | [0;m[38;5;43m20221208212339739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212339739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212339739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212339740 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212339740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212339740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212339740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:41.217917 run osmo-stp_10.42.42.5(pid=16113): stdout: | (launched: 2022-12-08_21:23:39.549106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:41.347299 run osmo-stp_10.42.42.5(pid=16113): stderr: | [0;m[38;5;43m20221208212339739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212339739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212339739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212339740 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212339740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212339740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212339740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:41.501941 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16113): Process ended prematurely: osmo-stp_10.42.42.5(pid=16113) [trial-2349↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16113)] [trial-2349↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 21:23:41.510908 tst handover.py:18: Test FAILED (6.6 sec) 21:23:41.538101 run osmo-hlr_10.42.42.2(pid=16110): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16110)] 21:23:41.587996 run osmo-hlr_10.42.42.2(pid=16110): stdout: | (launched: 2022-12-08_21:23:38.617961) 21:23:41.639341 run osmo-hlr_10.42.42.2(pid=16110): stderr: | [0;m[1;31m20221208212338795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212338795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212338795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212338795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212338796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212338796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212338807 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212338816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212338816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212338816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:23:41.711205 run osmo-msc_10.42.42.6(pid=16116): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16116)] 21:23:41.760768 run osmo-msc_10.42.42.6(pid=16116): stdout: | (launched: 2022-12-08_21:23:40.562314) 21:23:41.811996 run osmo-msc_10.42.42.6(pid=16116): stderr: | [0;m[38;5;43m20221208212340884 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212340884 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff161082c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212340884 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212340884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212340884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212340885 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212340888 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212340889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212340889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212340889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:23:41.863453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16109): Terminating (SIGTERM) 21:23:41.905048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16112): Terminating (SIGTERM) 21:23:41.946356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16115): Terminating (SIGTERM) 21:23:41.988276 --- ParallelTerminationStrategy: PID 16109 died... 21:23:42.008203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16109): Terminated: ok {rc=0} 21:23:42.054122 --- ParallelTerminationStrategy: PID 16112 died... 21:23:42.073533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16112): Terminated: ok {rc=0} 21:23:42.119417 --- ParallelTerminationStrategy: PID 16115 died... 21:23:42.138826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16115): Terminated: ok {rc=0} 21:23:42.226822 bus /sierra_3: Setting Powered False 21:23:43.325912 bus /sierra_3: Setting Powered False 21:23:44.440933 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 21:23:45.674678 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:23:45.679829 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 21:23:45.730542 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 21:23:45.757017 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 21:23:45.809322 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 21:23:45.867380 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 21:23:45.901345 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 21:23:46.442008 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 21:23:46.448417 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:23:46.460023 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 21:23:46.498999 tst handover.py: using LAC 16900 21:23:46.622368 tst handover.py: using RAC 70 21:23:46.760380 tst handover.py: using CellId 16900 21:23:46.912724 tst handover.py: using BVCI 16901 21:23:47.058148 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 21:23:47.109231 tst handover.py: using LAC 16901 21:23:47.256362 tst handover.py: using RAC 71 21:23:47.387488 tst handover.py: using CellId 16901 21:23:47.505787 tst handover.py: using BVCI 16902 21:23:47.617240 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:23:47.628063 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:23:47.638989 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:23:47.649856 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:23:47.660728 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:23:47.671602 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 21:23:47.792718 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 21:23:47.910652 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:23:48.354632 run create_hlr_db(pid=16123): Launched 21:23:48.471908 bus /sierra_2: Setting Powered False 21:23:49.535972 run create_hlr_db(pid=16123): Terminated: ok {rc=0} 21:23:49.967558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16125): Launched 21:23:50.272409 run osmo-hlr_10.42.42.2(pid=16126): Launched 21:23:50.388795 run osmo-stp_10.42.42.5: Starting osmo-stp 21:23:50.884660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16128): Launched 21:23:51.188487 run osmo-stp_10.42.42.5(pid=16129): Launched 21:23:51.303965 run osmo-msc_10.42.42.6: Starting osmo-msc 21:23:51.824877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16131): Launched 21:23:52.129762 run osmo-msc_10.42.42.6(pid=16132): Launched 21:23:52.298947 run osmo-stp_10.42.42.5(pid=16129): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16129)] 21:23:52.428007 run osmo-stp_10.42.42.5(pid=16129): stdout: | (launched: 2022-12-08_21:23:51.132258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:52.557299 run osmo-stp_10.42.42.5(pid=16129): stderr: | [0;m[38;5;43m20221208212351307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212351307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212351307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212351307 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212351308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212351308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212351308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:52.683900 run osmo-stp_10.42.42.5(pid=16129): stdout: | (launched: 2022-12-08_21:23:51.132258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:52.806024 run osmo-stp_10.42.42.5(pid=16129): stderr: | [0;m[38;5;43m20221208212351307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212351307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212351307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212351307 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212351308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212351308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212351308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:52.950723 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16129): Process ended prematurely: osmo-stp_10.42.42.5(pid=16129) [trial-2349↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16129)] [trial-2349↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 21:23:52.959005 tst handover.py:18: Test FAILED (6.5 sec) 21:23:52.985023 run osmo-hlr_10.42.42.2(pid=16126): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16126)] 21:23:53.032717 run osmo-hlr_10.42.42.2(pid=16126): stdout: | (launched: 2022-12-08_21:23:50.216287) 21:23:53.081919 run osmo-hlr_10.42.42.2(pid=16126): stderr: | [0;m[1;31m20221208212350391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212350391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212350391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212350392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212350392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212350392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212350448 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212350458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212350458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212350458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:23:53.150363 run osmo-msc_10.42.42.6(pid=16132): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16132)] 21:23:53.197979 run osmo-msc_10.42.42.6(pid=16132): stdout: | (launched: 2022-12-08_21:23:52.073218) 21:23:53.247231 run osmo-msc_10.42.42.6(pid=16132): stderr: | [0;m[38;5;43m20221208212352347 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212352347 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f74fe740c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212352347 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212352347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212352347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212352348 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212352349 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212352350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212352350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212352350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:23:53.296604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16125): Terminating (SIGTERM) 21:23:53.335870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16128): Terminating (SIGTERM) 21:23:53.375661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16131): Terminating (SIGTERM) 21:23:53.415491 --- ParallelTerminationStrategy: PID 16125 died... 21:23:53.434330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16125): Terminated: ok {rc=0} 21:23:53.478046 --- ParallelTerminationStrategy: PID 16128 died... 21:23:53.496199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16128): Terminated: ok {rc=0} 21:23:53.540058 --- ParallelTerminationStrategy: PID 16131 died... 21:23:53.558332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16131): Terminated: ok {rc=0} 21:23:53.643820 bus /sierra_3: Setting Powered False 21:23:54.741647 bus /sierra_3: Setting Powered False 21:23:55.856834 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 21:23:57.108358 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:23:57.113572 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 21:23:57.160042 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 21:23:57.186511 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 21:23:57.238999 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 21:23:57.285274 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 21:23:57.311713 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 21:23:57.862835 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 21:23:57.867913 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:23:57.879001 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:23:57.914354 tst handover.py: using LAC 16902 21:23:58.034550 tst handover.py: using RAC 72 21:23:58.154909 tst handover.py: using CellId 16902 21:23:58.274394 tst handover.py: using BVCI 16903 21:23:58.383441 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:23:58.428761 tst handover.py: using LAC 16903 21:23:58.548696 tst handover.py: using RAC 73 21:23:58.667495 tst handover.py: using CellId 16903 21:23:58.787419 tst handover.py: using BVCI 16904 21:23:58.899142 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:23:58.910199 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:23:58.921051 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:23:58.932073 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:23:58.943377 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:23:58.954473 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:23:59.074744 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:23:59.194502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:23:59.637213 run create_hlr_db(pid=16137): Launched 21:23:59.752913 bus /sierra_2: Setting Powered False 21:24:00.813766 run create_hlr_db(pid=16137): Terminated: ok {rc=0} 21:24:01.265698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16139): Launched 21:24:01.583653 run osmo-hlr_10.42.42.2(pid=16140): Launched 21:24:01.729519 run osmo-stp_10.42.42.5: Starting osmo-stp 21:24:02.380148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16142): Launched 21:24:02.683515 run osmo-stp_10.42.42.5(pid=16143): Launched 21:24:02.799256 run osmo-msc_10.42.42.6: Starting osmo-msc 21:24:03.322202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16145): Launched 21:24:03.625920 run osmo-msc_10.42.42.6(pid=16146): Launched 21:24:03.795631 run osmo-stp_10.42.42.5(pid=16143): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16143)] 21:24:03.924603 run osmo-stp_10.42.42.5(pid=16143): stdout: | (launched: 2022-12-08_21:24:02.627919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:04.053421 run osmo-stp_10.42.42.5(pid=16143): stderr: | [0;m[38;5;43m20221208212402797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212402797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212402797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212402798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212402800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212402800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212402800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:04.179949 run osmo-stp_10.42.42.5(pid=16143): stdout: | (launched: 2022-12-08_21:24:02.627919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:04.300161 run osmo-stp_10.42.42.5(pid=16143): stderr: | [0;m[38;5;43m20221208212402797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212402797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212402797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212402798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212402800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212402800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212402800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:04.444467 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16143): Process ended prematurely: osmo-stp_10.42.42.5(pid=16143) [trial-2349↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16143)] [trial-2349↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 21:24:04.452668 tst handover.py:18: Test FAILED (6.6 sec) 21:24:04.478898 run osmo-hlr_10.42.42.2(pid=16140): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16140)] 21:24:04.526790 run osmo-hlr_10.42.42.2(pid=16140): stdout: | (launched: 2022-12-08_21:24:01.523079) 21:24:04.576172 run osmo-hlr_10.42.42.2(pid=16140): stderr: | [0;m[1;31m20221208212401893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212401893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212401893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212401893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212401893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212401893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212401906 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212401915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212401915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212401915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:24:04.644722 run osmo-msc_10.42.42.6(pid=16146): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16146)] 21:24:04.692301 run osmo-msc_10.42.42.6(pid=16146): stdout: | (launched: 2022-12-08_21:24:03.570449) 21:24:04.741537 run osmo-msc_10.42.42.6(pid=16146): stderr: | [0;m[38;5;43m20221208212403842 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212403842 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc4836a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212403842 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212403842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212403842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212403843 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212403846 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212403846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212403847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212403847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:24:04.791342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16139): Terminating (SIGTERM) 21:24:04.831615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16142): Terminating (SIGTERM) 21:24:04.871262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16145): Terminating (SIGTERM) 21:24:04.911274 --- ParallelTerminationStrategy: PID 16139 died... 21:24:04.930241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16139): Terminated: ok {rc=0} 21:24:04.974481 --- ParallelTerminationStrategy: PID 16142 died... 21:24:04.992808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16142): Terminated: ok {rc=0} 21:24:05.036890 --- ParallelTerminationStrategy: PID 16145 died... 21:24:05.055711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16145): Terminated: ok {rc=0} 21:24:05.139156 bus /sierra_3: Setting Powered False 21:24:06.237719 bus /sierra_3: Setting Powered False 21:24:07.353823 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 21:24:08.611812 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:24:08.617567 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 21:24:08.670005 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 21:24:08.697403 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 21:24:08.750200 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 21:24:08.802177 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 21:24:08.829480 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 21:24:09.383083 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 21:24:09.388399 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:24:09.399825 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:24:09.434645 tst handover.py: using LAC 16904 21:24:09.561756 tst handover.py: using RAC 74 21:24:09.689446 tst handover.py: using CellId 16904 21:24:09.811319 tst handover.py: using BVCI 16905 21:24:09.930795 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:24:09.982222 tst handover.py: using LAC 16905 21:24:10.102535 tst handover.py: using RAC 75 21:24:10.222792 tst handover.py: using CellId 16905 21:24:10.341352 tst handover.py: using BVCI 16906 21:24:10.453535 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:24:10.464631 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:24:10.475556 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:24:10.486793 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:24:10.497863 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:24:10.508897 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:24:10.623527 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:24:10.745098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:24:11.220260 run create_hlr_db(pid=16151): Launched 21:24:11.353027 bus /sierra_2: Setting Powered False 21:24:12.417862 run create_hlr_db(pid=16151): Terminated: ok {rc=0} 21:24:12.825537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16153): Launched 21:24:13.130985 run osmo-hlr_10.42.42.2(pid=16154): Launched 21:24:13.247102 run osmo-stp_10.42.42.5: Starting osmo-stp 21:24:13.743790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16156): Launched 21:24:14.048646 run osmo-stp_10.42.42.5(pid=16157): Launched 21:24:14.165301 run osmo-msc_10.42.42.6: Starting osmo-msc 21:24:14.687509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16159): Launched 21:24:14.992540 run osmo-msc_10.42.42.6(pid=16160): Launched 21:24:15.162816 run osmo-stp_10.42.42.5(pid=16157): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16157)] 21:24:15.292707 run osmo-stp_10.42.42.5(pid=16157): stdout: | (launched: 2022-12-08_21:24:13.992459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:15.422085 run osmo-stp_10.42.42.5(pid=16157): stderr: | [0;m[38;5;43m20221208212414164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212414164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212414164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212414165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212414165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212414165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212414165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:15.549107 run osmo-stp_10.42.42.5(pid=16157): stdout: | (launched: 2022-12-08_21:24:13.992459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:15.669451 run osmo-stp_10.42.42.5(pid=16157): stderr: | [0;m[38;5;43m20221208212414164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212414164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212414164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212414165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212414165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212414165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212414165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:15.814514 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16157): Process ended prematurely: osmo-stp_10.42.42.5(pid=16157) [trial-2349↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16157)] [trial-2349↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 21:24:15.822825 tst handover.py:18: Test FAILED (6.4 sec) 21:24:15.850622 run osmo-hlr_10.42.42.2(pid=16154): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16154)] 21:24:15.906066 run osmo-hlr_10.42.42.2(pid=16154): stdout: | (launched: 2022-12-08_21:24:13.075163) 21:24:15.957333 run osmo-hlr_10.42.42.2(pid=16154): stderr: | [0;m[1;31m20221208212413252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212413252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212413252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212413252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212413252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212413252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212413264 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212413274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212413275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212413275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:24:16.028601 run osmo-msc_10.42.42.6(pid=16160): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16160)] 21:24:16.078285 run osmo-msc_10.42.42.6(pid=16160): stdout: | (launched: 2022-12-08_21:24:14.936335) 21:24:16.129702 run osmo-msc_10.42.42.6(pid=16160): stderr: | [0;m[38;5;43m20221208212415208 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212415208 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8084bedc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212415208 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212415208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212415208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212415209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212415210 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212415211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212415211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212415211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:24:16.182164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16153): Terminating (SIGTERM) 21:24:16.224403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16156): Terminating (SIGTERM) 21:24:16.266625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16159): Terminating (SIGTERM) 21:24:16.309075 --- ParallelTerminationStrategy: PID 16153 died... 21:24:16.328543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16153): Terminated: ok {rc=0} 21:24:16.375746 --- ParallelTerminationStrategy: PID 16156 died... 21:24:16.395240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16156): Terminated: ok {rc=0} 21:24:16.442321 --- ParallelTerminationStrategy: PID 16159 died... 21:24:16.461936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16159): Terminated: ok {rc=0} 21:24:16.548769 bus /sierra_3: Setting Powered False 21:24:17.646844 bus /sierra_3: Setting Powered False 21:24:18.760914 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 21:24:20.022649 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:24:20.028006 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 21:24:20.067408 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 21:24:20.094869 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 21:24:20.148015 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 21:24:20.187267 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 21:24:20.214711 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 21:24:20.766891 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 21:24:20.773291 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:24:20.784189 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 21:24:20.820651 tst handover.py: using LAC 16906 21:24:20.939295 tst handover.py: using RAC 76 21:24:21.061421 tst handover.py: using CellId 16906 21:24:21.180393 tst handover.py: using BVCI 16907 21:24:21.290332 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 21:24:21.348655 tst handover.py: using LAC 16907 21:24:21.466211 tst handover.py: using RAC 77 21:24:21.584114 tst handover.py: using CellId 16907 21:24:21.701283 tst handover.py: using BVCI 16908 21:24:21.810933 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:24:21.821909 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:24:21.832646 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:24:21.843635 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:24:21.854782 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:24:21.865762 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 21:24:21.985538 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 21:24:22.102383 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:24:22.545686 run create_hlr_db(pid=16165): Launched 21:24:22.668698 bus /sierra_2: Setting Powered False 21:24:23.733363 run create_hlr_db(pid=16165): Terminated: ok {rc=0} 21:24:24.141862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16167): Launched 21:24:24.445327 run osmo-hlr_10.42.42.2(pid=16168): Launched 21:24:24.560675 run osmo-stp_10.42.42.5: Starting osmo-stp 21:24:25.061405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16170): Launched 21:24:25.364646 run osmo-stp_10.42.42.5(pid=16171): Launched 21:24:25.481748 run osmo-msc_10.42.42.6: Starting osmo-msc 21:24:26.004682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16173): Launched 21:24:26.309279 run osmo-msc_10.42.42.6(pid=16174): Launched 21:24:26.479167 run osmo-stp_10.42.42.5(pid=16171): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16171)] 21:24:26.608261 run osmo-stp_10.42.42.5(pid=16171): stdout: | (launched: 2022-12-08_21:24:25.309151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:26.736896 run osmo-stp_10.42.42.5(pid=16171): stderr: | [0;m[38;5;43m20221208212425480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212425480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212425480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212425481 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212425483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212425483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212425483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:26.863178 run osmo-stp_10.42.42.5(pid=16171): stdout: | (launched: 2022-12-08_21:24:25.309151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:26.983018 run osmo-stp_10.42.42.5(pid=16171): stderr: | [0;m[38;5;43m20221208212425480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212425480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212425480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212425481 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212425483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212425483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212425483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:27.127497 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16171): Process ended prematurely: osmo-stp_10.42.42.5(pid=16171) [trial-2349↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16171)] [trial-2349↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 21:24:27.135779 tst handover.py:18: Test FAILED (6.4 sec) 21:24:27.162158 run osmo-hlr_10.42.42.2(pid=16168): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16168)] 21:24:27.209835 run osmo-hlr_10.42.42.2(pid=16168): stdout: | (launched: 2022-12-08_21:24:24.389312) 21:24:27.259263 run osmo-hlr_10.42.42.2(pid=16168): stderr: | [0;m[1;31m20221208212424564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212424564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212424565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212424565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212424565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212424565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212424576 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212424585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212424585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212424585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:24:27.328597 run osmo-msc_10.42.42.6(pid=16174): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16174)] 21:24:27.376268 run osmo-msc_10.42.42.6(pid=16174): stdout: | (launched: 2022-12-08_21:24:26.253678) 21:24:27.425792 run osmo-msc_10.42.42.6(pid=16174): stderr: | [0;m[38;5;43m20221208212426524 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212426525 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f33f480fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212426525 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212426525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212426525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212426525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212426527 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212426527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212426527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212426528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:24:27.475664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16167): Terminating (SIGTERM) 21:24:27.516119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16170): Terminating (SIGTERM) 21:24:27.556058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16173): Terminating (SIGTERM) 21:24:27.596130 --- ParallelTerminationStrategy: PID 16167 died... 21:24:27.615311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16167): Terminated: ok {rc=0} 21:24:27.659850 --- ParallelTerminationStrategy: PID 16170 died... 21:24:27.678535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16170): Terminated: ok {rc=0} 21:24:27.723110 --- ParallelTerminationStrategy: PID 16173 died... 21:24:27.741659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16173): Terminated: ok {rc=0} 21:24:27.827776 bus /sierra_3: Setting Powered False 21:24:28.926348 bus /sierra_3: Setting Powered False 21:24:30.042077 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 21:24:31.307887 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:24:31.314324 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 21:24:31.367638 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 21:24:31.396115 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 21:24:31.455108 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 21:24:31.522702 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 21:24:31.558897 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 21:24:32.102084 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 21:24:32.112243 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:24:32.125373 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:24:32.167096 tst handover.py: using LAC 16908 21:24:32.320395 tst handover.py: using RAC 78 21:24:32.454603 tst handover.py: using CellId 16908 21:24:32.584740 tst handover.py: using BVCI 16909 21:24:32.698419 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:24:32.745991 tst handover.py: using LAC 16909 21:24:32.865737 tst handover.py: using RAC 79 21:24:32.993614 tst handover.py: using CellId 16909 21:24:33.123966 tst handover.py: using BVCI 16910 21:24:33.242266 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:24:33.253833 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:24:33.265084 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:24:33.276274 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:24:33.287491 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:24:33.298683 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:24:33.415269 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:24:33.530822 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:24:33.971333 run create_hlr_db(pid=16179): Launched 21:24:34.088021 bus /sierra_2: Setting Powered False 21:24:35.148772 run create_hlr_db(pid=16179): Terminated: ok {rc=0} 21:24:35.564009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16181): Launched 21:24:35.889697 run osmo-hlr_10.42.42.2(pid=16182): Launched 21:24:36.014600 run osmo-stp_10.42.42.5: Starting osmo-stp 21:24:36.549254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16184): Launched 21:24:36.875152 run osmo-stp_10.42.42.5(pid=16185): Launched 21:24:36.999959 run osmo-msc_10.42.42.6: Starting osmo-msc 21:24:37.560758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16187): Launched 21:24:37.886504 run osmo-msc_10.42.42.6(pid=16188): Launched 21:24:38.067668 run osmo-stp_10.42.42.5(pid=16185): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16185)] 21:24:38.204587 run osmo-stp_10.42.42.5(pid=16185): stdout: | (launched: 2022-12-08_21:24:36.816059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:38.342430 run osmo-stp_10.42.42.5(pid=16185): stderr: | [0;m[38;5;43m20221208212437009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212437009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212437009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212437009 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212437010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212437010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212437010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:38.478795 run osmo-stp_10.42.42.5(pid=16185): stdout: | (launched: 2022-12-08_21:24:36.816059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:38.608096 run osmo-stp_10.42.42.5(pid=16185): stderr: | [0;m[38;5;43m20221208212437009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212437009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212437009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212437009 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212437010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212437010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212437010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:38.762987 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16185): Process ended prematurely: osmo-stp_10.42.42.5(pid=16185) [trial-2349↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16185)] [trial-2349↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 21:24:38.771990 tst handover.py:18: Test FAILED (6.7 sec) 21:24:38.799467 run osmo-hlr_10.42.42.2(pid=16182): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16182)] 21:24:38.849456 run osmo-hlr_10.42.42.2(pid=16182): stdout: | (launched: 2022-12-08_21:24:35.830749) 21:24:38.901336 run osmo-hlr_10.42.42.2(pid=16182): stderr: | [0;m[1;31m20221208212436033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212436033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212436033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212436033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212436033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212436033 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212436046 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212436054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212436054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212436054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:24:38.973541 run osmo-msc_10.42.42.6(pid=16188): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16188)] 21:24:39.023269 run osmo-msc_10.42.42.6(pid=16188): stdout: | (launched: 2022-12-08_21:24:37.827264) 21:24:39.074673 run osmo-msc_10.42.42.6(pid=16188): stderr: | [0;m[38;5;43m20221208212438149 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212438149 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbc5a82dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212438150 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212438150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212438150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212438150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212438152 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212438152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212438152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212438152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:24:39.127211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16181): Terminating (SIGTERM) 21:24:39.168804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16184): Terminating (SIGTERM) 21:24:39.210417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16187): Terminating (SIGTERM) 21:24:39.252702 --- ParallelTerminationStrategy: PID 16181 died... 21:24:39.272418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16181): Terminated: ok {rc=0} 21:24:39.318715 --- ParallelTerminationStrategy: PID 16184 died... 21:24:39.338324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16184): Terminated: ok {rc=0} 21:24:39.384292 --- ParallelTerminationStrategy: PID 16187 died... 21:24:39.403886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16187): Terminated: ok {rc=0} 21:24:39.490190 bus /sierra_3: Setting Powered False 21:24:40.588276 bus /sierra_3: Setting Powered False 21:24:41.705348 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 21:24:42.964304 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:24:42.969840 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 21:24:43.020770 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:24:43.048192 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 21:24:43.105911 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 21:24:43.157317 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:24:43.184583 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 21:24:43.733034 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 21:24:43.738352 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:24:43.749606 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:24:43.784656 tst handover.py: using LAC 16910 21:24:43.904412 tst handover.py: using RAC 80 21:24:44.020892 tst handover.py: using CellId 16910 21:24:44.138456 tst handover.py: using BVCI 16911 21:24:44.249214 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:24:44.295793 tst handover.py: using LAC 16911 21:24:44.413132 tst handover.py: using RAC 81 21:24:44.531087 tst handover.py: using CellId 16911 21:24:44.648225 tst handover.py: using BVCI 16912 21:24:44.757590 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:24:44.768416 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:24:44.779108 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:24:44.790148 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:24:44.801226 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:24:44.812160 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:24:44.931707 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:24:45.051259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:24:45.529574 run create_hlr_db(pid=16193): Launched 21:24:45.662231 bus /sierra_2: Setting Powered False 21:24:46.725427 run create_hlr_db(pid=16193): Terminated: ok {rc=0} 21:24:47.147186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16195): Launched 21:24:47.465564 run osmo-hlr_10.42.42.2(pid=16196): Launched 21:24:47.583639 run osmo-stp_10.42.42.5: Starting osmo-stp 21:24:48.094109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16198): Launched 21:24:48.400456 run osmo-stp_10.42.42.5(pid=16199): Launched 21:24:48.518667 run osmo-msc_10.42.42.6: Starting osmo-msc 21:24:49.043589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16201): Launched 21:24:49.348240 run osmo-msc_10.42.42.6(pid=16202): Launched 21:24:49.518259 run osmo-stp_10.42.42.5(pid=16199): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16199)] 21:24:49.650388 run osmo-stp_10.42.42.5(pid=16199): stdout: | (launched: 2022-12-08_21:24:48.344763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:49.779495 run osmo-stp_10.42.42.5(pid=16199): stderr: | [0;m[38;5;43m20221208212448516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212448516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212448517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212448517 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212448517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212448518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212448518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:49.906018 run osmo-stp_10.42.42.5(pid=16199): stdout: | (launched: 2022-12-08_21:24:48.344763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:50.026431 run osmo-stp_10.42.42.5(pid=16199): stderr: | [0;m[38;5;43m20221208212448516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212448516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212448517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212448517 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212448517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212448518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212448518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:50.170918 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16199): Process ended prematurely: osmo-stp_10.42.42.5(pid=16199) [trial-2349↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16199)] [trial-2349↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 21:24:50.179257 tst handover.py:18: Test FAILED (6.4 sec) 21:24:50.205716 run osmo-hlr_10.42.42.2(pid=16196): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16196)] 21:24:50.254311 run osmo-hlr_10.42.42.2(pid=16196): stdout: | (launched: 2022-12-08_21:24:47.409466) 21:24:50.304167 run osmo-hlr_10.42.42.2(pid=16196): stderr: | [0;m[1;31m20221208212447586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212447586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212447586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212447586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212447586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212447586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212447598 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212447606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212447606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212447607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:24:50.373573 run osmo-msc_10.42.42.6(pid=16202): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16202)] 21:24:50.421485 run osmo-msc_10.42.42.6(pid=16202): stdout: | (launched: 2022-12-08_21:24:49.292340) 21:24:50.471102 run osmo-msc_10.42.42.6(pid=16202): stderr: | [0;m[38;5;43m20221208212449565 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212449565 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f21c1c1ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212449565 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212449565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212449565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212449566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212449567 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212449568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212449568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212449568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:24:50.521191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16195): Terminating (SIGTERM) 21:24:50.561288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16198): Terminating (SIGTERM) 21:24:50.601892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16201): Terminating (SIGTERM) 21:24:50.642206 --- ParallelTerminationStrategy: PID 16195 died... 21:24:50.661207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16195): Terminated: ok {rc=0} 21:24:50.705850 --- ParallelTerminationStrategy: PID 16198 died... 21:24:50.724239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16198): Terminated: ok {rc=0} 21:24:50.768314 --- ParallelTerminationStrategy: PID 16201 died... 21:24:50.786753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16201): Terminated: ok {rc=0} 21:24:50.872064 bus /sierra_3: Setting Powered False 21:24:51.972588 bus /sierra_3: Setting Powered False 21:24:53.089179 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 21:24:54.342442 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:24:54.348757 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 21:24:54.399008 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 21:24:54.426418 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 21:24:54.479794 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 21:24:54.530682 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 21:24:54.557896 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 21:24:55.108840 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 21:24:55.114166 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:24:55.125421 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 21:24:55.162007 tst handover.py: using LAC 16912 21:24:55.293329 tst handover.py: using RAC 82 21:24:55.426773 tst handover.py: using CellId 16912 21:24:55.555762 tst handover.py: using BVCI 16913 21:24:55.675851 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 21:24:55.724249 tst handover.py: using LAC 16913 21:24:55.844355 tst handover.py: using RAC 83 21:24:55.961880 tst handover.py: using CellId 16913 21:24:56.082072 tst handover.py: using BVCI 16914 21:24:56.193881 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:24:56.204805 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:24:56.215610 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:24:56.227061 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:24:56.238936 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:24:56.250148 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 21:24:56.371759 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 21:24:56.488134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:24:56.932049 run create_hlr_db(pid=16207): Launched 21:24:57.046676 bus /sierra_2: Setting Powered False 21:24:58.106710 run create_hlr_db(pid=16207): Terminated: ok {rc=0} 21:24:58.525746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16209): Launched 21:24:58.829210 run osmo-hlr_10.42.42.2(pid=16210): Launched 21:24:58.945327 run osmo-stp_10.42.42.5: Starting osmo-stp 21:24:59.457245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16212): Launched 21:24:59.760516 run osmo-stp_10.42.42.5(pid=16213): Launched 21:24:59.876904 run osmo-msc_10.42.42.6: Starting osmo-msc 21:25:00.402667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16215): Launched 21:25:00.707704 run osmo-msc_10.42.42.6(pid=16216): Launched 21:25:00.938246 run osmo-stp_10.42.42.5(pid=16213): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16213)] 21:25:01.142746 run osmo-stp_10.42.42.5(pid=16213): stdout: | (launched: 2022-12-08_21:24:59.704814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:01.315778 run osmo-stp_10.42.42.5(pid=16213): stderr: | [0;m[38;5;43m20221208212459877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212459877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212459877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212459877 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212459878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212459878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212459878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:01.467739 run osmo-stp_10.42.42.5(pid=16213): stdout: | (launched: 2022-12-08_21:24:59.704814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:01.595593 run osmo-stp_10.42.42.5(pid=16213): stderr: | [0;m[38;5;43m20221208212459877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212459877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212459877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212459877 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212459878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212459878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212459878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:01.759302 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16213): Process ended prematurely: osmo-stp_10.42.42.5(pid=16213) [trial-2349↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16213)] [trial-2349↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 21:25:01.768622 tst handover.py:18: Test FAILED (6.6 sec) 21:25:01.801493 run osmo-hlr_10.42.42.2(pid=16210): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16210)] 21:25:01.852586 run osmo-hlr_10.42.42.2(pid=16210): stdout: | (launched: 2022-12-08_21:24:58.773921) 21:25:01.910912 run osmo-hlr_10.42.42.2(pid=16210): stderr: | [0;m[1;31m20221208212458948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212458948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212458948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212458948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212458948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212458948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212458961 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212458969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212458969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212458970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:25:01.982849 run osmo-msc_10.42.42.6(pid=16216): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16216)] 21:25:02.033243 run osmo-msc_10.42.42.6(pid=16216): stdout: | (launched: 2022-12-08_21:25:00.651461) 21:25:02.085196 run osmo-msc_10.42.42.6(pid=16216): stderr: | [0;m[38;5;43m20221208212500955 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212500955 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8b5655dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212500955 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212500955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212500955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212500955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212500967 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212500968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212500968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212500968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:25:02.137681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16209): Terminating (SIGTERM) 21:25:02.180078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16212): Terminating (SIGTERM) 21:25:02.222467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16215): Terminating (SIGTERM) 21:25:02.264895 --- ParallelTerminationStrategy: PID 16209 died... 21:25:02.284361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16209): Terminated: ok {rc=0} 21:25:02.331687 --- ParallelTerminationStrategy: PID 16212 died... 21:25:02.351277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16212): Terminated: ok {rc=0} 21:25:02.398947 --- ParallelTerminationStrategy: PID 16215 died... 21:25:02.418694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16215): Terminated: ok {rc=0} 21:25:02.507418 bus /sierra_3: Setting Powered False 21:25:03.605978 bus /sierra_3: Setting Powered False 21:25:04.721080 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 21:25:05.976062 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:25:05.982751 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 21:25:06.029650 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 21:25:06.057141 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 21:25:06.110898 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 21:25:06.157656 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 21:25:06.185203 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 21:25:06.738147 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 21:25:06.743903 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:25:06.755625 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:25:06.790626 tst handover.py: using LAC 16914 21:25:06.919714 tst handover.py: using RAC 84 21:25:07.049284 tst handover.py: using CellId 16914 21:25:07.177033 tst handover.py: using BVCI 16915 21:25:07.297458 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:25:07.343844 tst handover.py: using LAC 16915 21:25:07.473031 tst handover.py: using RAC 85 21:25:07.600696 tst handover.py: using CellId 16915 21:25:07.730416 tst handover.py: using BVCI 16916 21:25:07.850163 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:25:07.861967 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:25:07.873494 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:25:07.885306 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:25:07.897100 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:25:07.908798 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:25:08.025879 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:25:08.144572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:25:08.590889 run create_hlr_db(pid=16324): Launched 21:25:08.707946 bus /sierra_2: Setting Powered False 21:25:09.769166 run create_hlr_db(pid=16324): Terminated: ok {rc=0} 21:25:10.186988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16326): Launched 21:25:10.514628 run osmo-hlr_10.42.42.2(pid=16327): Launched 21:25:10.641624 run osmo-stp_10.42.42.5: Starting osmo-stp 21:25:11.174652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16329): Launched 21:25:11.503230 run osmo-stp_10.42.42.5(pid=16330): Launched 21:25:11.629587 run osmo-msc_10.42.42.6: Starting osmo-msc 21:25:12.189262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16332): Launched 21:25:12.516700 run osmo-msc_10.42.42.6(pid=16333): Launched 21:25:12.701270 run osmo-stp_10.42.42.5(pid=16330): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16330)] 21:25:12.839221 run osmo-stp_10.42.42.5(pid=16330): stdout: | (launched: 2022-12-08_21:25:11.444116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:12.977422 run osmo-stp_10.42.42.5(pid=16330): stderr: | [0;m[38;5;43m20221208212511637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212511637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212511637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212511637 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212511638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212511638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212511638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:13.114554 run osmo-stp_10.42.42.5(pid=16330): stdout: | (launched: 2022-12-08_21:25:11.444116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:13.244768 run osmo-stp_10.42.42.5(pid=16330): stderr: | [0;m[38;5;43m20221208212511637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212511637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212511637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212511637 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212511638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212511638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212511638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:13.401560 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16330): Process ended prematurely: osmo-stp_10.42.42.5(pid=16330) [trial-2349↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16330)] [trial-2349↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 21:25:13.410656 tst handover.py:18: Test FAILED (6.7 sec) 21:25:13.438259 run osmo-hlr_10.42.42.2(pid=16327): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16327)] 21:25:13.488746 run osmo-hlr_10.42.42.2(pid=16327): stdout: | (launched: 2022-12-08_21:25:10.455167) 21:25:13.540880 run osmo-hlr_10.42.42.2(pid=16327): stderr: | [0;m[1;31m20221208212510652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212510652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212510652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212510652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212510653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212510653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212510665 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212510673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212510674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212510674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:25:13.613590 run osmo-msc_10.42.42.6(pid=16333): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16333)] 21:25:13.663918 run osmo-msc_10.42.42.6(pid=16333): stdout: | (launched: 2022-12-08_21:25:12.457384) 21:25:13.715853 run osmo-msc_10.42.42.6(pid=16333): stderr: | [0;m[38;5;43m20221208212512779 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212512779 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd0557a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212512779 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212512779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212512780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212512780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212512782 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212512782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212512782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212512782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:25:13.768088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16326): Terminating (SIGTERM) 21:25:13.810368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16329): Terminating (SIGTERM) 21:25:13.852863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16332): Terminating (SIGTERM) 21:25:13.895209 --- ParallelTerminationStrategy: PID 16326 died... 21:25:13.915124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16326): Terminated: ok {rc=0} 21:25:13.961666 --- ParallelTerminationStrategy: PID 16329 died... 21:25:13.981373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16329): Terminated: ok {rc=0} 21:25:14.027952 --- ParallelTerminationStrategy: PID 16332 died... 21:25:14.047991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16332): Terminated: ok {rc=0} 21:25:14.138905 bus /sierra_3: Setting Powered False 21:25:15.244326 bus /sierra_3: Setting Powered False 21:25:16.383514 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 21:25:17.677361 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:25:17.682767 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 21:25:17.760649 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 21:25:17.803647 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 21:25:17.881563 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 21:25:17.951853 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 21:25:17.980654 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 21:25:18.573969 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 21:25:18.582866 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:25:18.599313 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:25:18.655964 tst handover.py: using LAC 16916 21:25:18.823388 tst handover.py: using RAC 86 21:25:18.946989 tst handover.py: using CellId 16916 21:25:19.102817 tst handover.py: using BVCI 16917 21:25:19.258628 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:25:19.310849 tst handover.py: using LAC 16917 21:25:19.474375 tst handover.py: using RAC 87 21:25:19.649054 tst handover.py: using CellId 16917 21:25:19.814753 tst handover.py: using BVCI 16918 21:25:19.938717 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:25:19.951166 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:25:19.963287 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:25:19.975591 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:25:19.988044 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:25:20.000400 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:25:20.146411 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:25:20.303429 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:25:20.788797 run create_hlr_db(pid=16342): Launched 21:25:20.991438 bus /sierra_2: Setting Powered False 21:25:22.056042 run create_hlr_db(pid=16342): Terminated: ok {rc=0} 21:25:22.464251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16344): Launched 21:25:22.790643 run osmo-hlr_10.42.42.2(pid=16345): Launched 21:25:23.006390 run osmo-stp_10.42.42.5: Starting osmo-stp 21:25:23.639006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16347): Launched 21:25:24.014713 run osmo-stp_10.42.42.5(pid=16348): Launched 21:25:24.266335 run osmo-msc_10.42.42.6: Starting osmo-msc 21:25:24.910012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16350): Launched 21:25:25.289619 run osmo-msc_10.42.42.6(pid=16351): Launched 21:25:25.683869 run osmo-stp_10.42.42.5(pid=16348): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16348)] 21:25:25.967562 run osmo-stp_10.42.42.5(pid=16348): stdout: | (launched: 2022-12-08_21:25:23.951685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:26.241402 run osmo-stp_10.42.42.5(pid=16348): stderr: | [0;m[38;5;43m20221208212524251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212524251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212524252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212524252 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212524253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212524253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212524253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:26.378015 run osmo-stp_10.42.42.5(pid=16348): stdout: | (launched: 2022-12-08_21:25:23.951685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:26.510031 run osmo-stp_10.42.42.5(pid=16348): stderr: | [0;m[38;5;43m20221208212524251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212524251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212524252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212524252 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212524253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212524253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212524253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:26.660306 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16348): Process ended prematurely: osmo-stp_10.42.42.5(pid=16348) [trial-2349↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16348)] [trial-2349↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 21:25:26.670218 tst handover.py:18: Test FAILED (8.1 sec) 21:25:26.699396 run osmo-hlr_10.42.42.2(pid=16345): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16345)] 21:25:26.749772 run osmo-hlr_10.42.42.2(pid=16345): stdout: | (launched: 2022-12-08_21:25:22.728074) 21:25:26.801382 run osmo-hlr_10.42.42.2(pid=16345): stderr: | [0;m[1;31m20221208212523051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212523051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212523051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212523051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212523051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212523051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212523084 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212523107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212523107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212523107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:25:26.873807 run osmo-msc_10.42.42.6(pid=16351): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16351)] 21:25:26.924139 run osmo-msc_10.42.42.6(pid=16351): stdout: | (launched: 2022-12-08_21:25:25.223955) 21:25:26.975987 run osmo-msc_10.42.42.6(pid=16351): stderr: | [0;m[38;5;43m20221208212525798 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212525798 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffa76483c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212525798 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212525798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212525798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212525799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212525800 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212525802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212525802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212525803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:25:27.029188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16344): Terminating (SIGTERM) 21:25:27.072766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16347): Terminating (SIGTERM) 21:25:27.116550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16350): Terminating (SIGTERM) 21:25:27.161170 --- ParallelTerminationStrategy: PID 16344 died... 21:25:27.181075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16344): Terminated: ok {rc=0} 21:25:27.230546 --- ParallelTerminationStrategy: PID 16347 died... 21:25:27.250111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16347): Terminated: ok {rc=0} 21:25:27.297189 --- ParallelTerminationStrategy: PID 16350 died... 21:25:27.316499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16350): Terminated: ok {rc=0} 21:25:27.404742 bus /sierra_3: Setting Powered False 21:25:28.506470 bus /sierra_3: Setting Powered False 21:25:29.630423 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 21:25:30.969887 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:25:30.975942 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 21:25:31.030706 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 21:25:31.064308 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 21:25:31.117384 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 21:25:31.172618 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 21:25:31.208206 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 21:25:31.814108 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 21:25:31.821717 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:25:31.835686 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 21:25:31.871637 tst handover.py: using LAC 16918 21:25:32.002355 tst handover.py: using RAC 88 21:25:32.158094 tst handover.py: using CellId 16918 21:25:32.312781 tst handover.py: using BVCI 16919 21:25:32.469557 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 21:25:32.509338 tst handover.py: using LAC 16919 21:25:32.673335 tst handover.py: using RAC 89 21:25:32.844417 tst handover.py: using CellId 16919 21:25:32.994987 tst handover.py: using BVCI 16920 21:25:33.139311 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:25:33.152753 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:25:33.165275 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:25:33.182401 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:25:33.197200 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:25:33.213594 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 21:25:33.343379 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 21:25:33.472299 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:25:33.988735 run create_hlr_db(pid=16356): Launched 21:25:34.161466 bus /sierra_2: Setting Powered False 21:25:35.252768 run create_hlr_db(pid=16356): Terminated: ok {rc=0} 21:25:35.722914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16358): Launched 21:25:36.075743 run osmo-hlr_10.42.42.2(pid=16359): Launched 21:25:36.330980 run osmo-stp_10.42.42.5: Starting osmo-stp 21:25:37.017368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16361): Launched 21:25:37.344791 run osmo-stp_10.42.42.5(pid=16362): Launched 21:25:37.586059 run osmo-msc_10.42.42.6: Starting osmo-msc 21:25:38.187830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16364): Launched 21:25:38.522511 run osmo-msc_10.42.42.6(pid=16365): Launched 21:25:38.909862 run osmo-stp_10.42.42.5(pid=16362): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16362)] 21:25:39.265355 run osmo-stp_10.42.42.5(pid=16362): stdout: | (launched: 2022-12-08_21:25:37.288181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:39.476153 run osmo-stp_10.42.42.5(pid=16362): stderr: | [0;m[38;5;43m20221208212537559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212537559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212537559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212537560 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212537560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212537560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212537560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:39.627875 run osmo-stp_10.42.42.5(pid=16362): stdout: | (launched: 2022-12-08_21:25:37.288181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:39.754041 run osmo-stp_10.42.42.5(pid=16362): stderr: | [0;m[38;5;43m20221208212537559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212537559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212537559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212537560 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212537560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212537560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212537560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:39.903649 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16362): Process ended prematurely: osmo-stp_10.42.42.5(pid=16362) [trial-2349↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16362)] [trial-2349↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 21:25:39.912222 tst handover.py:18: Test FAILED (8.1 sec) 21:25:39.941147 run osmo-hlr_10.42.42.2(pid=16359): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16359)] 21:25:39.992411 run osmo-hlr_10.42.42.2(pid=16359): stdout: | (launched: 2022-12-08_21:25:36.014101) 21:25:40.045416 run osmo-hlr_10.42.42.2(pid=16359): stderr: | [0;m[1;31m20221208212536324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212536324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212536324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212536324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212536324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212536337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212536368 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212536387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212536387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212536388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:25:40.118464 run osmo-msc_10.42.42.6(pid=16365): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16365)] 21:25:40.167883 run osmo-msc_10.42.42.6(pid=16365): stdout: | (launched: 2022-12-08_21:25:38.464769) 21:25:40.219548 run osmo-msc_10.42.42.6(pid=16365): stderr: | [0;m[38;5;43m20221208212539108 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212539108 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efccbee0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212539108 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212539108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212539108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212539108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212539110 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212539110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212539111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212539111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:25:40.271934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16358): Terminating (SIGTERM) 21:25:40.314003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16361): Terminating (SIGTERM) 21:25:40.356444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16364): Terminating (SIGTERM) 21:25:40.400071 --- ParallelTerminationStrategy: PID 16358 died... 21:25:40.419738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16358): Terminated: ok {rc=0} 21:25:40.467957 --- ParallelTerminationStrategy: PID 16361 died... 21:25:40.487221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16361): Terminated: ok {rc=0} 21:25:40.533895 --- ParallelTerminationStrategy: PID 16364 died... 21:25:40.553915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16364): Terminated: ok {rc=0} 21:25:40.643178 bus /sierra_3: Setting Powered False 21:25:41.754148 bus /sierra_3: Setting Powered False 21:25:42.894443 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 21:25:44.195341 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:25:44.201796 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 21:25:44.268782 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 21:25:44.297657 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 21:25:44.360774 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 21:25:44.418706 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 21:25:44.452763 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 21:25:45.002867 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 21:25:45.015968 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:25:45.031929 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:25:45.079986 tst handover.py: using LAC 16920 21:25:45.214300 tst handover.py: using RAC 90 21:25:45.365007 tst handover.py: using CellId 16920 21:25:45.525341 tst handover.py: using BVCI 16921 21:25:45.657299 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:25:45.710298 tst handover.py: using LAC 16921 21:25:45.840107 tst handover.py: using RAC 91 21:25:46.000989 tst handover.py: using CellId 16921 21:25:46.158563 tst handover.py: using BVCI 16922 21:25:46.303042 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:25:46.317349 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:25:46.331219 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:25:46.345523 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:25:46.359598 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:25:46.373621 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:25:46.516825 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:25:46.665309 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:25:47.250830 run create_hlr_db(pid=16370): Launched 21:25:47.446271 bus /sierra_2: Setting Powered False 21:25:48.518402 run create_hlr_db(pid=16370): Terminated: ok {rc=0} 21:25:48.959052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16372): Launched 21:25:49.323350 run osmo-hlr_10.42.42.2(pid=16373): Launched 21:25:49.608769 run osmo-stp_10.42.42.5: Starting osmo-stp 21:25:50.343783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16375): Launched 21:25:50.711598 run osmo-stp_10.42.42.5(pid=16376): Launched 21:25:50.958637 run osmo-msc_10.42.42.6: Starting osmo-msc 21:25:51.618767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16378): Launched 21:25:51.980511 run osmo-msc_10.42.42.6(pid=16379): Launched 21:25:52.347938 run osmo-stp_10.42.42.5(pid=16376): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16376)] 21:25:52.547838 run osmo-stp_10.42.42.5(pid=16376): stdout: | (launched: 2022-12-08_21:25:50.651493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:52.832560 run osmo-stp_10.42.42.5(pid=16376): stderr: | [0;m[38;5;43m20221208212550891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212550891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212550891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212550892 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212550892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212550893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212550893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:52.967390 run osmo-stp_10.42.42.5(pid=16376): stdout: | (launched: 2022-12-08_21:25:50.651493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:53.096053 run osmo-stp_10.42.42.5(pid=16376): stderr: | [0;m[38;5;43m20221208212550891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212550891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212550891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212550892 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212550892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212550893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212550893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:53.245185 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16376): Process ended prematurely: osmo-stp_10.42.42.5(pid=16376) [trial-2349↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16376)] [trial-2349↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 21:25:53.253763 tst handover.py:18: Test FAILED (8.2 sec) 21:25:53.281528 run osmo-hlr_10.42.42.2(pid=16373): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16373)] 21:25:53.330554 run osmo-hlr_10.42.42.2(pid=16373): stdout: | (launched: 2022-12-08_21:25:49.266519) 21:25:53.381268 run osmo-hlr_10.42.42.2(pid=16373): stderr: | [0;m[1;31m20221208212549617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212549617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212549617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212549617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212549617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212549617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212549637 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212549649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212549649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212549649 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:25:53.451054 run osmo-msc_10.42.42.6(pid=16379): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16379)] 21:25:53.500521 run osmo-msc_10.42.42.6(pid=16379): stdout: | (launched: 2022-12-08_21:25:51.920483) 21:25:53.550872 run osmo-msc_10.42.42.6(pid=16379): stderr: | [0;m[38;5;43m20221208212552450 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212552450 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdc036d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212552450 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212552450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212552450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212552450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212552452 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212552452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212552453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212552453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:25:53.602586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16372): Terminating (SIGTERM) 21:25:53.645024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16375): Terminating (SIGTERM) 21:25:53.688814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16378): Terminating (SIGTERM) 21:25:53.731932 --- ParallelTerminationStrategy: PID 16372 died... 21:25:53.750825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16372): Terminated: ok {rc=0} 21:25:53.796781 --- ParallelTerminationStrategy: PID 16375 died... 21:25:53.815611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16375): Terminated: ok {rc=0} 21:25:53.861180 --- ParallelTerminationStrategy: PID 16378 died... 21:25:53.879907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16378): Terminated: ok {rc=0} 21:25:53.966395 bus /sierra_3: Setting Powered False 21:25:55.080726 bus /sierra_3: Setting Powered False 21:25:56.223560 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 21:25:57.507038 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:25:57.512476 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 21:25:57.564392 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:25:57.593833 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 21:25:57.644122 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 21:25:57.696314 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:25:57.725681 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 21:25:58.293562 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 21:25:58.300183 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:25:58.312030 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:25:58.376543 tst handover.py: using LAC 16922 21:25:58.528150 tst handover.py: using RAC 92 21:25:58.650932 tst handover.py: using CellId 16922 21:25:58.777290 tst handover.py: using BVCI 16923 21:25:58.914390 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:25:58.964876 tst handover.py: using LAC 16923 21:25:59.098631 tst handover.py: using RAC 93 21:25:59.223525 tst handover.py: using CellId 16923 21:25:59.344829 tst handover.py: using BVCI 16924 21:25:59.459266 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:25:59.471108 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:25:59.483013 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:25:59.495993 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:25:59.508529 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:25:59.520889 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:25:59.641624 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:25:59.771423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:26:00.227723 run create_hlr_db(pid=16384): Launched 21:26:00.386224 bus /sierra_2: Setting Powered False 21:26:01.472319 run create_hlr_db(pid=16384): Terminated: ok {rc=0} 21:26:01.968314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16386): Launched 21:26:02.451469 run osmo-hlr_10.42.42.2(pid=16387): Launched 21:26:02.726411 run osmo-stp_10.42.42.5: Starting osmo-stp 21:26:03.401043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16389): Launched 21:26:03.756193 run osmo-stp_10.42.42.5(pid=16390): Launched 21:26:04.002439 run osmo-msc_10.42.42.6: Starting osmo-msc 21:26:04.663924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16392): Launched 21:26:05.035226 run osmo-msc_10.42.42.6(pid=16393): Launched 21:26:05.385752 run osmo-stp_10.42.42.5(pid=16390): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16390)] 21:26:05.621049 run osmo-stp_10.42.42.5(pid=16390): stdout: | (launched: 2022-12-08_21:26:03.696103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:05.882970 run osmo-stp_10.42.42.5(pid=16390): stderr: | [0;m[38;5;43m20221208212603993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212603993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212603993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212603994 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212603994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212603994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212603994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:06.034596 run osmo-stp_10.42.42.5(pid=16390): stdout: | (launched: 2022-12-08_21:26:03.696103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:06.172607 run osmo-stp_10.42.42.5(pid=16390): stderr: | [0;m[38;5;43m20221208212603993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212603993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212603993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212603994 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212603994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212603994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212603994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:06.335862 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16390): Process ended prematurely: osmo-stp_10.42.42.5(pid=16390) [trial-2349↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16390)] [trial-2349↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 21:26:06.345369 tst handover.py:18: Test FAILED (8.0 sec) 21:26:06.375955 run osmo-hlr_10.42.42.2(pid=16387): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16387)] 21:26:06.430469 run osmo-hlr_10.42.42.2(pid=16387): stdout: | (launched: 2022-12-08_21:26:02.382866) 21:26:06.487981 run osmo-hlr_10.42.42.2(pid=16387): stderr: | [0;m[1;31m20221208212602639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212602639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212602639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212602639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212602639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212602641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212602660 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212602672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212602672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212602672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:26:06.563868 run osmo-msc_10.42.42.6(pid=16393): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16393)] 21:26:06.615864 run osmo-msc_10.42.42.6(pid=16393): stdout: | (launched: 2022-12-08_21:26:04.975059) 21:26:06.671865 run osmo-msc_10.42.42.6(pid=16393): stderr: | [0;m[38;5;43m20221208212605557 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212605558 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3b6017bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212605558 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212605558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212605558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212605559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212605562 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212605563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212605563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212605563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:26:06.726025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16386): Terminating (SIGTERM) 21:26:06.769479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16389): Terminating (SIGTERM) 21:26:06.814538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16392): Terminating (SIGTERM) 21:26:06.858828 --- ParallelTerminationStrategy: PID 16386 died... 21:26:06.880221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16386): Terminated: ok {rc=0} 21:26:06.930307 --- ParallelTerminationStrategy: PID 16389 died... 21:26:06.950612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16389): Terminated: ok {rc=0} 21:26:06.999555 --- ParallelTerminationStrategy: PID 16392 died... 21:26:07.019720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16392): Terminated: ok {rc=0} 21:26:07.122963 bus /sierra_3: Setting Powered False 21:26:08.236203 bus /sierra_3: Setting Powered False 21:26:09.386942 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 21:26:10.687244 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:26:10.693298 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 21:26:10.756306 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 21:26:10.784085 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 21:26:10.835337 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 21:26:10.917638 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 21:26:10.946470 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 21:26:11.486479 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 21:26:11.500361 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:26:11.535853 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:26:11.586509 tst handover.py: using LAC 16924 21:26:11.714539 tst handover.py: using RAC 94 21:26:11.834309 tst handover.py: using CellId 16924 21:26:11.960425 tst handover.py: using BVCI 16925 21:26:12.085399 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:26:12.129217 tst handover.py: using LAC 16925 21:26:12.261156 tst handover.py: using RAC 95 21:26:12.399874 tst handover.py: using CellId 16925 21:26:12.565302 tst handover.py: using BVCI 16926 21:26:12.704705 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:26:12.717748 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:26:12.730240 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:26:12.743008 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:26:12.755801 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:26:12.769060 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:26:12.892576 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:26:13.018676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:26:13.539181 run create_hlr_db(pid=16398): Launched 21:26:13.707332 bus /sierra_2: Setting Powered False 21:26:14.791433 run create_hlr_db(pid=16398): Terminated: ok {rc=0} 21:26:15.238355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16400): Launched 21:26:15.631351 run osmo-hlr_10.42.42.2(pid=16401): Launched 21:26:15.894339 run osmo-stp_10.42.42.5: Starting osmo-stp 21:26:16.627786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16403): Launched 21:26:17.047351 run osmo-stp_10.42.42.5(pid=16404): Launched 21:26:17.235560 run osmo-msc_10.42.42.6: Starting osmo-msc 21:26:17.987851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16406): Launched 21:26:18.361191 run osmo-msc_10.42.42.6(pid=16407): Launched 21:26:18.781276 run osmo-stp_10.42.42.5(pid=16404): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16404)] 21:26:18.956315 run osmo-stp_10.42.42.5(pid=16404): stdout: | (launched: 2022-12-08_21:26:16.982256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:19.198325 run osmo-stp_10.42.42.5(pid=16404): stderr: | [0;m[38;5;43m20221208212617290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212617290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212617290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212617291 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212617291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212617291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212617291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:19.340693 run osmo-stp_10.42.42.5(pid=16404): stdout: | (launched: 2022-12-08_21:26:16.982256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:19.475740 run osmo-stp_10.42.42.5(pid=16404): stderr: | [0;m[38;5;43m20221208212617290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212617290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212617290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212617291 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212617291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212617291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212617291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:19.637080 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16404): Process ended prematurely: osmo-stp_10.42.42.5(pid=16404) [trial-2349↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16404)] [trial-2349↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 21:26:19.647358 tst handover.py:18: Test FAILED (8.1 sec) 21:26:19.676755 run osmo-hlr_10.42.42.2(pid=16401): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16401)] 21:26:19.728338 run osmo-hlr_10.42.42.2(pid=16401): stdout: | (launched: 2022-12-08_21:26:15.570047) 21:26:19.782332 run osmo-hlr_10.42.42.2(pid=16401): stderr: | [0;m[1;31m20221208212615897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212615897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212615897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212615897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212615897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212615897 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212615913 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212615954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212615955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212615955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:26:19.857281 run osmo-msc_10.42.42.6(pid=16407): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16407)] 21:26:19.909902 run osmo-msc_10.42.42.6(pid=16407): stdout: | (launched: 2022-12-08_21:26:18.299021) 21:26:19.964561 run osmo-msc_10.42.42.6(pid=16407): stderr: | [0;m[38;5;43m20221208212618827 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212618827 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f661fde7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212618827 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212618827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212618827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212618828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212618829 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212618830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212618830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212618830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:26:20.019261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16400): Terminating (SIGTERM) 21:26:20.063730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16403): Terminating (SIGTERM) 21:26:20.109365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16406): Terminating (SIGTERM) 21:26:20.153839 --- ParallelTerminationStrategy: PID 16400 died... 21:26:20.174898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16400): Terminated: ok {rc=0} 21:26:20.225042 --- ParallelTerminationStrategy: PID 16403 died... 21:26:20.245641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16403): Terminated: ok {rc=0} 21:26:20.294062 --- ParallelTerminationStrategy: PID 16406 died... 21:26:20.314639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16406): Terminated: ok {rc=0} 21:26:20.407358 bus /sierra_3: Setting Powered False 21:26:21.517580 bus /sierra_3: Setting Powered False 21:26:22.651708 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 21:26:23.948441 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:26:23.954639 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 21:26:24.065043 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 21:26:24.107886 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 21:26:24.179371 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 21:26:24.284528 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 21:26:24.324386 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 21:26:24.837423 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 21:26:24.847003 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:26:24.859201 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:26:24.914949 tst handover.py: using LAC 16926 21:26:25.043598 tst handover.py: using RAC 96 21:26:25.169244 tst handover.py: using CellId 16926 21:26:25.293275 tst handover.py: using BVCI 16927 21:26:25.421839 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:26:25.471649 tst handover.py: using LAC 16927 21:26:25.617097 tst handover.py: using RAC 97 21:26:25.764632 tst handover.py: using CellId 16927 21:26:25.913283 tst handover.py: using BVCI 16928 21:26:26.037938 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:26:26.049890 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:26:26.062331 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:26:26.074750 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:26:26.087639 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:26:26.100108 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:26:26.227280 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:26:26.365106 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:26:26.823685 run create_hlr_db(pid=16412): Launched 21:26:26.977685 bus /sierra_2: Setting Powered False 21:26:28.064078 run create_hlr_db(pid=16412): Terminated: ok {rc=0} 21:26:28.476706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16414): Launched 21:26:28.804764 run osmo-hlr_10.42.42.2(pid=16415): Launched 21:26:29.039555 run osmo-stp_10.42.42.5: Starting osmo-stp 21:26:29.665004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16417): Launched 21:26:29.980726 run osmo-stp_10.42.42.5(pid=16418): Launched 21:26:30.166088 run osmo-msc_10.42.42.6: Starting osmo-msc 21:26:30.824730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16420): Launched 21:26:31.194263 run osmo-msc_10.42.42.6(pid=16421): Launched 21:26:31.464492 run osmo-stp_10.42.42.5(pid=16418): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16418)] 21:26:31.740852 run osmo-stp_10.42.42.5(pid=16418): stdout: | (launched: 2022-12-08_21:26:29.921525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:32.070081 run osmo-stp_10.42.42.5(pid=16418): stderr: | [0;m[38;5;43m20221208212630184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212630184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212630184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212630185 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212630185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212630185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212630185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:32.270764 run osmo-stp_10.42.42.5(pid=16418): stdout: | (launched: 2022-12-08_21:26:29.921525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:32.418700 run osmo-stp_10.42.42.5(pid=16418): stderr: | [0;m[38;5;43m20221208212630184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212630184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212630184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212630185 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212630185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212630185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212630185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:32.581452 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16418): Process ended prematurely: osmo-stp_10.42.42.5(pid=16418) [trial-2349↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16418)] [trial-2349↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 21:26:32.590866 tst handover.py:18: Test FAILED (7.7 sec) 21:26:32.619273 run osmo-hlr_10.42.42.2(pid=16415): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16415)] 21:26:32.675699 run osmo-hlr_10.42.42.2(pid=16415): stdout: | (launched: 2022-12-08_21:26:28.746308) 21:26:32.729914 run osmo-hlr_10.42.42.2(pid=16415): stderr: | [0;m[1;31m20221208212629082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212629082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212629082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212629082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212629082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212629082 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212629115 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212629132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212629132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212629132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:26:32.803974 run osmo-msc_10.42.42.6(pid=16421): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16421)] 21:26:32.855435 run osmo-msc_10.42.42.6(pid=16421): stdout: | (launched: 2022-12-08_21:26:31.133920) 21:26:32.909445 run osmo-msc_10.42.42.6(pid=16421): stderr: | [0;m[38;5;43m20221208212631832 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212631841 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa5765b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212631841 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212631841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212631842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212631842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212631843 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212631844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212631844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212631844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:26:32.962143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16414): Terminating (SIGTERM) 21:26:33.029942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16417): Terminating (SIGTERM) 21:26:33.073197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16420): Terminating (SIGTERM) 21:26:33.120303 --- ParallelTerminationStrategy: PID 16414 died... 21:26:33.141382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16414): Terminated: ok {rc=0} 21:26:33.190319 --- ParallelTerminationStrategy: PID 16417 died... 21:26:33.210642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16417): Terminated: ok {rc=0} 21:26:33.258096 --- ParallelTerminationStrategy: PID 16420 died... 21:26:33.278249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16420): Terminated: ok {rc=0} 21:26:33.370628 bus /sierra_3: Setting Powered False 21:26:34.482810 bus /sierra_3: Setting Powered False 21:26:35.622996 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 21:26:36.921237 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:26:36.927143 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 21:26:36.982835 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 21:26:37.011599 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 21:26:37.063990 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 21:26:37.131813 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 21:26:37.161457 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 21:26:37.711860 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 21:26:37.719511 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:26:37.735039 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 21:26:37.804142 tst handover.py: using LAC 16928 21:26:37.949144 tst handover.py: using RAC 98 21:26:38.074293 tst handover.py: using CellId 16928 21:26:38.209570 tst handover.py: using BVCI 16929 21:26:38.331285 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 21:26:38.367813 tst handover.py: using LAC 16929 21:26:38.494950 tst handover.py: using RAC 99 21:26:38.619324 tst handover.py: using CellId 16929 21:26:38.746452 tst handover.py: using BVCI 16930 21:26:38.866001 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:26:38.878328 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:26:38.890063 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:26:38.905035 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:26:38.916661 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:26:38.930673 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 21:26:39.054142 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 21:26:39.179432 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:26:39.654509 run create_hlr_db(pid=16426): Launched 21:26:39.816174 bus /sierra_2: Setting Powered False 21:26:40.882446 run create_hlr_db(pid=16426): Terminated: ok {rc=0} 21:26:41.301640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16428): Launched 21:26:41.672096 run osmo-hlr_10.42.42.2(pid=16429): Launched 21:26:41.962578 run osmo-stp_10.42.42.5: Starting osmo-stp 21:26:42.563986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16431): Launched 21:26:42.931031 run osmo-stp_10.42.42.5(pid=16432): Launched 21:26:43.180502 run osmo-msc_10.42.42.6: Starting osmo-msc 21:26:43.833650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16434): Launched 21:26:44.180589 run osmo-msc_10.42.42.6(pid=16435): Launched 21:26:44.553327 run osmo-stp_10.42.42.5(pid=16432): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16432)] 21:26:44.742472 run osmo-stp_10.42.42.5(pid=16432): stdout: | (launched: 2022-12-08_21:26:42.869718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:44.937551 run osmo-stp_10.42.42.5(pid=16432): stderr: | [0;m[38;5;43m20221208212643164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212643165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212643165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212643165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212643166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212643166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212643166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:45.100561 run osmo-stp_10.42.42.5(pid=16432): stdout: | (launched: 2022-12-08_21:26:42.869718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:45.237444 run osmo-stp_10.42.42.5(pid=16432): stderr: | [0;m[38;5;43m20221208212643164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212643165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212643165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212643165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212643166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212643166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212643166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:45.399414 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16432): Process ended prematurely: osmo-stp_10.42.42.5(pid=16432) [trial-2349↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16432)] [trial-2349↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 21:26:45.408835 tst handover.py:18: Test FAILED (7.7 sec) 21:26:45.437449 run osmo-hlr_10.42.42.2(pid=16429): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16429)] 21:26:45.490024 run osmo-hlr_10.42.42.2(pid=16429): stdout: | (launched: 2022-12-08_21:26:41.615211) 21:26:45.543976 run osmo-hlr_10.42.42.2(pid=16429): stderr: | [0;m[1;31m20221208212641921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212641921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212641921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212641921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212641921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212641921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212641947 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212641967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212641967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212641968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:26:45.619146 run osmo-msc_10.42.42.6(pid=16435): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16435)] 21:26:45.671213 run osmo-msc_10.42.42.6(pid=16435): stdout: | (launched: 2022-12-08_21:26:44.119562) 21:26:45.725186 run osmo-msc_10.42.42.6(pid=16435): stderr: | [0;m[38;5;43m20221208212644622 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212644622 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9e48780c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212644622 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212644622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212644622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212644623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212644624 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212644629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212644629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212644629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:26:45.779341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16428): Terminating (SIGTERM) 21:26:45.822942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16431): Terminating (SIGTERM) 21:26:45.868563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16434): Terminating (SIGTERM) 21:26:45.914108 --- ParallelTerminationStrategy: PID 16428 died... 21:26:45.935087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16428): Terminated: ok {rc=0} 21:26:45.985632 --- ParallelTerminationStrategy: PID 16431 died... 21:26:46.006297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16431): Terminated: ok {rc=0} 21:26:46.054358 --- ParallelTerminationStrategy: PID 16434 died... 21:26:46.074852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16434): Terminated: ok {rc=0} 21:26:46.181019 bus /sierra_3: Setting Powered False 21:26:47.320896 bus /sierra_3: Setting Powered False 21:26:48.483643 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 21:26:49.765889 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:26:49.771823 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 21:26:49.839149 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 21:26:49.868133 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 21:26:49.919133 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 21:26:49.984347 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 21:26:50.013076 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 21:26:50.577086 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 21:26:50.583880 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:26:50.596396 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:26:50.652819 tst handover.py: using LAC 16930 21:26:50.792465 tst handover.py: using RAC 100 21:26:50.925290 tst handover.py: using CellId 16930 21:26:51.066700 tst handover.py: using BVCI 16931 21:26:51.204873 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:26:51.256882 tst handover.py: using LAC 16931 21:26:51.419874 tst handover.py: using RAC 101 21:26:51.575516 tst handover.py: using CellId 16931 21:26:51.703276 tst handover.py: using BVCI 16932 21:26:51.824887 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:26:51.837070 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:26:51.849459 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:26:51.861554 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:26:51.873831 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:26:51.886375 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:26:52.009554 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:26:52.134050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:26:52.622945 run create_hlr_db(pid=16440): Launched 21:26:52.791772 bus /sierra_2: Setting Powered False 21:26:53.871241 run create_hlr_db(pid=16440): Terminated: ok {rc=0} 21:26:54.335241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16442): Launched 21:26:54.684478 run osmo-hlr_10.42.42.2(pid=16443): Launched 21:26:54.943505 run osmo-stp_10.42.42.5: Starting osmo-stp 21:26:55.568577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16445): Launched 21:26:55.916467 run osmo-stp_10.42.42.5(pid=16446): Launched 21:26:56.079445 run osmo-msc_10.42.42.6: Starting osmo-msc 21:26:56.749058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16448): Launched 21:26:57.100153 run osmo-msc_10.42.42.6(pid=16449): Launched 21:26:57.571133 run osmo-stp_10.42.42.5(pid=16446): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16446)] 21:26:57.779432 run osmo-stp_10.42.42.5(pid=16446): stdout: | (launched: 2022-12-08_21:26:55.853676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:57.920693 run osmo-stp_10.42.42.5(pid=16446): stderr: | [0;m[38;5;43m20221208212656216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212656216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212656216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212656216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212656217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212656217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212656217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:58.061306 run osmo-stp_10.42.42.5(pid=16446): stdout: | (launched: 2022-12-08_21:26:55.853676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:58.196778 run osmo-stp_10.42.42.5(pid=16446): stderr: | [0;m[38;5;43m20221208212656216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212656216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212656216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212656216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212656217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212656217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212656217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:58.358963 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16446): Process ended prematurely: osmo-stp_10.42.42.5(pid=16446) [trial-2349↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16446)] [trial-2349↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 21:26:58.368845 tst handover.py:18: Test FAILED (7.8 sec) 21:26:58.397869 run osmo-hlr_10.42.42.2(pid=16443): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16443)] 21:26:58.449839 run osmo-hlr_10.42.42.2(pid=16443): stdout: | (launched: 2022-12-08_21:26:54.622406) 21:26:58.503692 run osmo-hlr_10.42.42.2(pid=16443): stderr: | [0;m[1;31m20221208212654929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212654929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212654929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212654929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212654929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212654929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212654980 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212654990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212654991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212654991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:26:58.578436 run osmo-msc_10.42.42.6(pid=16449): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16449)] 21:26:58.635954 run osmo-msc_10.42.42.6(pid=16449): stdout: | (launched: 2022-12-08_21:26:57.036537) 21:26:58.690268 run osmo-msc_10.42.42.6(pid=16449): stderr: | [0;m[38;5;43m20221208212657516 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212657516 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc3f3170c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212657516 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212657516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212657516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212657517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212657518 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212657519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212657519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212657519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:26:58.744414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16442): Terminating (SIGTERM) 21:26:58.788370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16445): Terminating (SIGTERM) 21:26:58.833751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16448): Terminating (SIGTERM) 21:26:58.879003 --- ParallelTerminationStrategy: PID 16442 died... 21:26:58.899698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16442): Terminated: ok {rc=0} 21:26:58.948846 --- ParallelTerminationStrategy: PID 16445 died... 21:26:58.969413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16445): Terminated: ok {rc=0} 21:26:59.017571 --- ParallelTerminationStrategy: PID 16448 died... 21:26:59.037741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16448): Terminated: ok {rc=0} 21:26:59.136030 bus /sierra_3: Setting Powered False 21:27:00.254466 bus /sierra_3: Setting Powered False 21:27:01.404619 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 21:27:02.715430 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:27:02.722659 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 21:27:02.833894 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:27:02.861687 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 21:27:02.915404 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 21:27:02.982999 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:27:03.011203 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 21:27:03.611977 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 21:27:03.618819 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:27:03.630766 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:27:03.683389 tst handover.py: using LAC 16932 21:27:03.810211 tst handover.py: using RAC 102 21:27:03.935392 tst handover.py: using CellId 16932 21:27:04.075243 tst handover.py: using BVCI 16933 21:27:04.189850 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:27:04.240565 tst handover.py: using LAC 16933 21:27:04.380350 tst handover.py: using RAC 103 21:27:04.515588 tst handover.py: using CellId 16933 21:27:04.676726 tst handover.py: using BVCI 16934 21:27:04.795409 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:27:04.807122 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:27:04.818634 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:27:04.831231 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:27:04.843633 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:27:04.870513 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:27:05.000398 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:27:05.124738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:27:05.615075 run create_hlr_db(pid=16455): Launched 21:27:05.785708 bus /sierra_2: Setting Powered False 21:27:06.874856 run create_hlr_db(pid=16455): Terminated: ok {rc=0} 21:27:07.293531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16457): Launched 21:27:07.633121 run osmo-hlr_10.42.42.2(pid=16458): Launched 21:27:07.852430 run osmo-stp_10.42.42.5: Starting osmo-stp 21:27:08.490854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16460): Launched 21:27:08.809744 run osmo-stp_10.42.42.5(pid=16461): Launched 21:27:09.023579 run osmo-msc_10.42.42.6: Starting osmo-msc 21:27:09.636127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16463): Launched 21:27:09.964471 run osmo-msc_10.42.42.6(pid=16464): Launched 21:27:10.265593 run osmo-stp_10.42.42.5(pid=16461): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16461)] 21:27:10.495820 run osmo-stp_10.42.42.5(pid=16461): stdout: | (launched: 2022-12-08_21:27:08.751734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:10.690022 run osmo-stp_10.42.42.5(pid=16461): stderr: | [0;m[38;5;43m20221208212709004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212709004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212709004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212709005 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212709005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212709005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212709005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:10.847288 run osmo-stp_10.42.42.5(pid=16461): stdout: | (launched: 2022-12-08_21:27:08.751734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:10.982619 run osmo-stp_10.42.42.5(pid=16461): stderr: | [0;m[38;5;43m20221208212709004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212709004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212709004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212709005 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212709005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212709005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212709005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:11.146332 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16461): Process ended prematurely: osmo-stp_10.42.42.5(pid=16461) [trial-2349↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16461)] [trial-2349↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 21:27:11.155289 tst handover.py:18: Test FAILED (7.5 sec) 21:27:11.183418 run osmo-hlr_10.42.42.2(pid=16458): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16458)] 21:27:11.235107 run osmo-hlr_10.42.42.2(pid=16458): stdout: | (launched: 2022-12-08_21:27:07.572273) 21:27:11.288808 run osmo-hlr_10.42.42.2(pid=16458): stderr: | [0;m[1;31m20221208212707905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212707905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212707905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212707905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212707905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212707906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212707932 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212707948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212707948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212707958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:27:11.364212 run osmo-msc_10.42.42.6(pid=16464): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16464)] 21:27:11.418068 run osmo-msc_10.42.42.6(pid=16464): stdout: | (launched: 2022-12-08_21:27:09.905672) 21:27:11.474375 run osmo-msc_10.42.42.6(pid=16464): stderr: | [0;m[38;5;43m20221208212710392 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212710392 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdc86934c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212710392 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212710392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212710392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212710393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212710395 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212710395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212710395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212710395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:27:11.527214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16457): Terminating (SIGTERM) 21:27:11.570545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16460): Terminating (SIGTERM) 21:27:11.615443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16463): Terminating (SIGTERM) 21:27:11.660157 --- ParallelTerminationStrategy: PID 16457 died... 21:27:11.680730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16457): Terminated: ok {rc=0} 21:27:11.745573 --- ParallelTerminationStrategy: PID 16460 died... 21:27:11.774989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16460): Terminated: ok {rc=0} 21:27:11.821663 --- ParallelTerminationStrategy: PID 16463 died... 21:27:11.841421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16463): Terminated: ok {rc=0} 21:27:11.943304 bus /sierra_3: Setting Powered False 21:27:13.047565 bus /sierra_3: Setting Powered False 21:27:14.165116 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 21:27:15.476501 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:27:15.483302 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 21:27:15.551709 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 21:27:15.583631 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 21:27:15.650553 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 21:27:15.735453 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 21:27:15.773120 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 21:27:16.319913 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 21:27:16.326083 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:27:16.339418 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:27:16.388287 tst handover.py: using LAC 16934 21:27:16.553182 tst handover.py: using RAC 104 21:27:16.695920 tst handover.py: using CellId 16934 21:27:16.849672 tst handover.py: using BVCI 16935 21:27:16.989887 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:27:17.041073 tst handover.py: using LAC 16935 21:27:17.187771 tst handover.py: using RAC 105 21:27:17.318578 tst handover.py: using CellId 16935 21:27:17.466238 tst handover.py: using BVCI 16936 21:27:17.587928 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:27:17.600218 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:27:17.612312 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:27:17.624377 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:27:17.636542 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:27:17.648592 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:27:17.773626 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:27:17.898622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:27:18.388258 run create_hlr_db(pid=16469): Launched 21:27:18.559153 bus /sierra_2: Setting Powered False 21:27:19.636452 run create_hlr_db(pid=16469): Terminated: ok {rc=0} 21:27:20.099383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16471): Launched 21:27:20.449238 run osmo-hlr_10.42.42.2(pid=16472): Launched 21:27:20.684256 run osmo-stp_10.42.42.5: Starting osmo-stp 21:27:21.345781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16474): Launched 21:27:21.707215 run osmo-stp_10.42.42.5(pid=16475): Launched 21:27:21.957799 run osmo-msc_10.42.42.6: Starting osmo-msc 21:27:22.551785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16477): Launched 21:27:22.894191 run osmo-msc_10.42.42.6(pid=16478): Launched 21:27:23.245766 run osmo-stp_10.42.42.5(pid=16475): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16475)] 21:27:23.415878 run osmo-stp_10.42.42.5(pid=16475): stdout: | (launched: 2022-12-08_21:27:21.646889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:23.634696 run osmo-stp_10.42.42.5(pid=16475): stderr: | [0;m[38;5;43m20221208212721931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212721931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212721931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212721932 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212721932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212721932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212721932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:23.771958 run osmo-stp_10.42.42.5(pid=16475): stdout: | (launched: 2022-12-08_21:27:21.646889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:23.895965 run osmo-stp_10.42.42.5(pid=16475): stderr: | [0;m[38;5;43m20221208212721931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212721931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212721931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212721932 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212721932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212721932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212721932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:24.045910 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16475): Process ended prematurely: osmo-stp_10.42.42.5(pid=16475) [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16475)] [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 21:27:24.055179 tst handover.py:18: Test FAILED (7.7 sec) 21:27:24.084683 run osmo-hlr_10.42.42.2(pid=16472): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16472)] 21:27:24.135262 run osmo-hlr_10.42.42.2(pid=16472): stdout: | (launched: 2022-12-08_21:27:20.393088) 21:27:24.188459 run osmo-hlr_10.42.42.2(pid=16472): stderr: | [0;m[1;31m20221208212720722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212720722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212720722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212720722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212720722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212720722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212720751 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212720767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212720767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212720768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:27:24.260598 run osmo-msc_10.42.42.6(pid=16478): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16478)] 21:27:24.310875 run osmo-msc_10.42.42.6(pid=16478): stdout: | (launched: 2022-12-08_21:27:22.834645) 21:27:24.364003 run osmo-msc_10.42.42.6(pid=16478): stderr: | [0;m[38;5;43m20221208212723263 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212723264 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd5441d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212723264 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212723264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212723264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212723264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212723267 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212723267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212723267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212723268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:27:24.416915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16471): Terminating (SIGTERM) 21:27:24.459464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16474): Terminating (SIGTERM) 21:27:24.501495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16477): Terminating (SIGTERM) 21:27:24.545358 --- ParallelTerminationStrategy: PID 16471 died... 21:27:24.565480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16471): Terminated: ok {rc=0} 21:27:24.614099 --- ParallelTerminationStrategy: PID 16474 died... 21:27:24.633863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16474): Terminated: ok {rc=0} 21:27:24.681225 --- ParallelTerminationStrategy: PID 16477 died... 21:27:24.701204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16477): Terminated: ok {rc=0} 21:27:24.790761 bus /sierra_3: Setting Powered False 21:27:25.897394 bus /sierra_3: Setting Powered False 21:27:27.032058 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 21:27:28.364392 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:27:28.370757 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 21:27:28.420599 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 21:27:28.449785 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 21:27:28.508779 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 21:27:28.578302 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 21:27:28.628050 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 21:27:29.159480 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 21:27:29.166344 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:27:29.178922 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 21:27:29.223274 tst handover.py: using LAC 16936 21:27:29.359781 tst handover.py: using RAC 106 21:27:29.489460 tst handover.py: using CellId 16936 21:27:29.619669 tst handover.py: using BVCI 16937 21:27:29.741749 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 21:27:29.777366 tst handover.py: using LAC 16937 21:27:29.928492 tst handover.py: using RAC 107 21:27:30.060012 tst handover.py: using CellId 16937 21:27:30.198487 tst handover.py: using BVCI 16938 21:27:30.329807 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:27:30.343364 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:27:30.356241 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:27:30.368779 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:27:30.382351 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:27:30.395029 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 21:27:30.527697 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 21:27:30.652606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:27:31.259268 run create_hlr_db(pid=16483): Launched 21:27:31.439715 bus /sierra_2: Setting Powered False 21:27:32.526828 run create_hlr_db(pid=16483): Terminated: ok {rc=0} 21:27:32.960582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16485): Launched 21:27:33.302979 run osmo-hlr_10.42.42.2(pid=16486): Launched 21:27:33.531519 run osmo-stp_10.42.42.5: Starting osmo-stp 21:27:34.217434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16488): Launched 21:27:34.555180 run osmo-stp_10.42.42.5(pid=16489): Launched 21:27:34.681136 run osmo-msc_10.42.42.6: Starting osmo-msc 21:27:35.262801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16491): Launched 21:27:35.635811 run osmo-msc_10.42.42.6(pid=16492): Launched 21:27:35.836858 run osmo-stp_10.42.42.5(pid=16489): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16489)] 21:27:35.982353 run osmo-stp_10.42.42.5(pid=16489): stdout: | (launched: 2022-12-08_21:27:34.494648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:36.125438 run osmo-stp_10.42.42.5(pid=16489): stderr: | [0;m[38;5;43m20221208212734739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212734740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212734740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212734740 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212734741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212734741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212734741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:36.299919 run osmo-stp_10.42.42.5(pid=16489): stdout: | (launched: 2022-12-08_21:27:34.494648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:36.439819 run osmo-stp_10.42.42.5(pid=16489): stderr: | [0;m[38;5;43m20221208212734739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212734740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212734740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212734740 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212734741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212734741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212734741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:36.601484 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16489): Process ended prematurely: osmo-stp_10.42.42.5(pid=16489) [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16489)] [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 21:27:36.610925 tst handover.py:18: Test FAILED (7.4 sec) 21:27:36.639353 run osmo-hlr_10.42.42.2(pid=16486): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16486)] 21:27:36.690554 run osmo-hlr_10.42.42.2(pid=16486): stdout: | (launched: 2022-12-08_21:27:33.238412) 21:27:36.744559 run osmo-hlr_10.42.42.2(pid=16486): stderr: | [0;m[1;31m20221208212733452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212733452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212733452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212733452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212733452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212733452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212733474 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212733503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212733503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212733503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:27:36.820792 run osmo-msc_10.42.42.6(pid=16492): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16492)] 21:27:36.872467 run osmo-msc_10.42.42.6(pid=16492): stdout: | (launched: 2022-12-08_21:27:35.574054) 21:27:36.924940 run osmo-msc_10.42.42.6(pid=16492): stderr: | [0;m[38;5;43m20221208212736082 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212736082 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe70293fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212736082 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212736082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212736082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212736083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212736085 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212736085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212736085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212736085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:27:36.979112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16485): Terminating (SIGTERM) 21:27:37.022198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16488): Terminating (SIGTERM) 21:27:37.068535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16491): Terminating (SIGTERM) 21:27:37.113343 --- ParallelTerminationStrategy: PID 16485 died... 21:27:37.133559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16485): Terminated: ok {rc=0} 21:27:37.179900 --- ParallelTerminationStrategy: PID 16488 died... 21:27:37.199629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16488): Terminated: ok {rc=0} 21:27:37.245683 --- ParallelTerminationStrategy: PID 16491 died... 21:27:37.265390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16491): Terminated: ok {rc=0} 21:27:37.354958 bus /sierra_3: Setting Powered False 21:27:38.459975 bus /sierra_3: Setting Powered False 21:27:39.598646 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 21:27:40.877859 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:27:40.884688 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 21:27:40.950732 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 21:27:40.978834 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 21:27:41.030545 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 21:27:41.092477 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 21:27:41.120048 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 21:27:41.689982 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 21:27:41.697314 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:27:41.710256 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:27:41.765298 tst handover.py: using LAC 16938 21:27:41.904118 tst handover.py: using RAC 108 21:27:42.040617 tst handover.py: using CellId 16938 21:27:42.171472 tst handover.py: using BVCI 16939 21:27:42.292049 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:27:42.343695 tst handover.py: using LAC 16939 21:27:42.476775 tst handover.py: using RAC 109 21:27:42.618216 tst handover.py: using CellId 16939 21:27:42.751427 tst handover.py: using BVCI 16940 21:27:42.882127 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:27:42.895016 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:27:42.908257 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:27:42.921931 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:27:42.934610 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:27:42.948004 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:27:43.072395 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:27:43.204200 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:27:43.699435 run create_hlr_db(pid=16499): Launched 21:27:43.836732 bus /sierra_2: Setting Powered False 21:27:44.908125 run create_hlr_db(pid=16499): Terminated: ok {rc=0} 21:27:45.350461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16501): Launched 21:27:45.682968 run osmo-hlr_10.42.42.2(pid=16502): Launched 21:27:45.873791 run osmo-stp_10.42.42.5: Starting osmo-stp 21:27:46.612166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16504): Launched 21:27:46.980454 run osmo-stp_10.42.42.5(pid=16505): Launched 21:27:47.178676 run osmo-msc_10.42.42.6: Starting osmo-msc 21:27:47.993783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16507): Launched 21:27:48.372706 run osmo-msc_10.42.42.6(pid=16508): Launched 21:27:48.561307 run osmo-stp_10.42.42.5(pid=16505): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16505)] 21:27:48.702853 run osmo-stp_10.42.42.5(pid=16505): stdout: | (launched: 2022-12-08_21:27:46.910438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:48.914887 run osmo-stp_10.42.42.5(pid=16505): stderr: | [0;m[38;5;43m20221208212747274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212747274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212747275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212747275 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212747276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212747276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212747276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:49.162630 run osmo-stp_10.42.42.5(pid=16505): stdout: | (launched: 2022-12-08_21:27:46.910438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:49.308506 run osmo-stp_10.42.42.5(pid=16505): stderr: | [0;m[38;5;43m20221208212747274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212747274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212747275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212747275 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212747276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212747276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212747276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:49.487119 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16505): Process ended prematurely: osmo-stp_10.42.42.5(pid=16505) [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16505)] [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 21:27:49.496698 tst handover.py:18: Test FAILED (7.8 sec) 21:27:49.526059 run osmo-hlr_10.42.42.2(pid=16502): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16502)] 21:27:49.576672 run osmo-hlr_10.42.42.2(pid=16502): stdout: | (launched: 2022-12-08_21:27:45.621899) 21:27:49.628325 run osmo-hlr_10.42.42.2(pid=16502): stderr: | [0;m[1;31m20221208212745817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212745817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212745817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212745817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212745817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212745817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212745837 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212745848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212745848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212745848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:27:49.700889 run osmo-msc_10.42.42.6(pid=16508): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16508)] 21:27:49.751434 run osmo-msc_10.42.42.6(pid=16508): stdout: | (launched: 2022-12-08_21:27:48.310385) 21:27:49.803357 run osmo-msc_10.42.42.6(pid=16508): stderr: | [0;m[38;5;43m20221208212748761 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212748761 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4591d55c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212748761 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212748762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212748762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212748762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212748764 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212748764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212748764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212748764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:27:49.855807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16501): Terminating (SIGTERM) 21:27:49.897541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16504): Terminating (SIGTERM) 21:27:49.939451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16507): Terminating (SIGTERM) 21:27:49.981560 --- ParallelTerminationStrategy: PID 16501 died... 21:27:50.001742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16501): Terminated: ok {rc=0} 21:27:50.048835 --- ParallelTerminationStrategy: PID 16504 died... 21:27:50.068591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16504): Terminated: ok {rc=0} 21:27:50.114736 --- ParallelTerminationStrategy: PID 16507 died... 21:27:50.134526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16507): Terminated: ok {rc=0} 21:27:50.225172 bus /sierra_3: Setting Powered False 21:27:51.328543 bus /sierra_3: Setting Powered False 21:27:52.444248 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 21:27:53.724324 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:27:53.729960 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 21:27:53.792380 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:27:53.820576 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 21:27:53.876881 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 21:27:53.944118 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:27:53.975032 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 21:27:54.521189 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 21:27:54.526722 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:27:54.539972 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:27:54.584915 tst handover.py: using LAC 16940 21:27:54.716650 tst handover.py: using RAC 110 21:27:54.849592 tst handover.py: using CellId 16940 21:27:54.988849 tst handover.py: using BVCI 16941 21:27:55.112465 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:27:55.161996 tst handover.py: using LAC 16941 21:27:55.293809 tst handover.py: using RAC 111 21:27:55.429227 tst handover.py: using CellId 16941 21:27:55.557976 tst handover.py: using BVCI 16942 21:27:55.684811 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:27:55.699689 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:27:55.713416 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:27:55.728544 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:27:55.744867 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:27:55.759252 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:27:55.893413 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:27:56.027010 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:27:56.540736 run create_hlr_db(pid=16513): Launched 21:27:56.679928 bus /sierra_2: Setting Powered False 21:27:57.747067 run create_hlr_db(pid=16513): Terminated: ok {rc=0} 21:27:58.180251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16515): Launched 21:27:58.511061 run osmo-hlr_10.42.42.2(pid=16516): Launched 21:27:58.635174 run osmo-stp_10.42.42.5: Starting osmo-stp 21:27:59.199861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16518): Launched 21:27:59.561462 run osmo-stp_10.42.42.5(pid=16519): Launched 21:27:59.821034 run osmo-msc_10.42.42.6: Starting osmo-msc 21:28:00.498871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16521): Launched 21:28:00.873412 run osmo-msc_10.42.42.6(pid=16522): Launched 21:28:01.302005 run osmo-stp_10.42.42.5(pid=16519): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16519)] 21:28:01.622416 run osmo-stp_10.42.42.5(pid=16519): stdout: | (launched: 2022-12-08_21:27:59.493097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:01.856444 run osmo-stp_10.42.42.5(pid=16519): stderr: | [0;m[38;5;43m20221208212759851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212759851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212759851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212759852 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212759852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212759852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212759852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:02.029856 run osmo-stp_10.42.42.5(pid=16519): stdout: | (launched: 2022-12-08_21:27:59.493097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:02.183055 run osmo-stp_10.42.42.5(pid=16519): stderr: | [0;m[38;5;43m20221208212759851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212759851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212759851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212759852 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212759852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212759852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212759852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:02.372804 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16519): Process ended prematurely: osmo-stp_10.42.42.5(pid=16519) [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16519)] [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 21:28:02.384370 tst handover.py:18: Test FAILED (7.8 sec) 21:28:02.418352 run osmo-hlr_10.42.42.2(pid=16516): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16516)] 21:28:02.476361 run osmo-hlr_10.42.42.2(pid=16516): stdout: | (launched: 2022-12-08_21:27:58.451352) 21:28:02.535136 run osmo-hlr_10.42.42.2(pid=16516): stderr: | [0;m[1;31m20221208212758702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212758703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212758703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212758703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212758703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212758703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212758715 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212758727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212758727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212758727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:28:02.620857 run osmo-msc_10.42.42.6(pid=16522): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16522)] 21:28:02.680248 run osmo-msc_10.42.42.6(pid=16522): stdout: | (launched: 2022-12-08_21:28:00.792217) 21:28:02.742401 run osmo-msc_10.42.42.6(pid=16522): stderr: | [0;m[38;5;43m20221208212801401 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212801401 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1a81c9bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212801401 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212801402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212801402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212801402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212801408 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212801409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212801409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212801409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:28:02.805314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16515): Terminating (SIGTERM) 21:28:02.853582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16518): Terminating (SIGTERM) 21:28:02.904120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16521): Terminating (SIGTERM) 21:28:02.956591 --- ParallelTerminationStrategy: PID 16515 died... 21:28:02.980205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16515): Terminated: ok {rc=0} 21:28:03.035554 --- ParallelTerminationStrategy: PID 16518 died... 21:28:03.059574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16518): Terminated: ok {rc=0} 21:28:03.119845 --- ParallelTerminationStrategy: PID 16521 died... 21:28:03.143338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16521): Terminated: ok {rc=0} 21:28:03.251487 bus /sierra_3: Setting Powered False 21:28:04.366661 bus /sierra_3: Setting Powered False 21:28:05.499074 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 21:28:06.794486 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:28:06.802528 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 21:28:06.861555 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 21:28:06.892023 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 21:28:06.946560 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 21:28:07.004350 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 21:28:07.034901 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 21:28:07.594385 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 21:28:07.601966 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:28:07.613804 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 21:28:07.664648 tst handover.py: using LAC 16942 21:28:07.797597 tst handover.py: using RAC 112 21:28:07.937117 tst handover.py: using CellId 16942 21:28:08.075543 tst handover.py: using BVCI 16943 21:28:08.202954 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 21:28:08.241129 tst handover.py: using LAC 16943 21:28:08.380001 tst handover.py: using RAC 113 21:28:08.521330 tst handover.py: using CellId 16943 21:28:08.659215 tst handover.py: using BVCI 16944 21:28:08.785240 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:28:08.797747 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:28:08.809519 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:28:08.821643 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:28:08.833490 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:28:08.845211 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 21:28:08.972342 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 21:28:09.092461 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:28:09.576260 run create_hlr_db(pid=16528): Launched 21:28:09.713783 bus /sierra_2: Setting Powered False 21:28:10.788043 run create_hlr_db(pid=16528): Terminated: ok {rc=0} 21:28:11.263240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16530): Launched 21:28:11.599634 run osmo-hlr_10.42.42.2(pid=16531): Launched 21:28:11.733826 run osmo-stp_10.42.42.5: Starting osmo-stp 21:28:12.290506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16533): Launched 21:28:12.630887 run osmo-stp_10.42.42.5(pid=16534): Launched 21:28:12.766247 run osmo-msc_10.42.42.6: Starting osmo-msc 21:28:13.424732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16536): Launched 21:28:13.811122 run osmo-msc_10.42.42.6(pid=16537): Launched 21:28:14.060454 run osmo-stp_10.42.42.5(pid=16534): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16534)] 21:28:14.241484 run osmo-stp_10.42.42.5(pid=16534): stdout: | (launched: 2022-12-08_21:28:12.568278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:14.390635 run osmo-stp_10.42.42.5(pid=16534): stderr: | [0;m[38;5;43m20221208212812861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212812861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212812862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212812862 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212812863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212812863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212812863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:14.540718 run osmo-stp_10.42.42.5(pid=16534): stdout: | (launched: 2022-12-08_21:28:12.568278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:14.685913 run osmo-stp_10.42.42.5(pid=16534): stderr: | [0;m[38;5;43m20221208212812861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212812861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212812862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212812862 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212812863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212812863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212812863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:14.857515 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16534): Process ended prematurely: osmo-stp_10.42.42.5(pid=16534) [trial-2349↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16534)] [trial-2349↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 21:28:14.867409 tst handover.py:18: Test FAILED (7.3 sec) 21:28:14.901858 run osmo-hlr_10.42.42.2(pid=16531): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16531)] 21:28:14.960309 run osmo-hlr_10.42.42.2(pid=16531): stdout: | (launched: 2022-12-08_21:28:11.535918) 21:28:15.018557 run osmo-hlr_10.42.42.2(pid=16531): stderr: | [0;m[1;31m20221208212811774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212811774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212811774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212811774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212811775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212811775 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212811789 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212811801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212811801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212811801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:28:15.101578 run osmo-msc_10.42.42.6(pid=16537): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16537)] 21:28:15.155624 run osmo-msc_10.42.42.6(pid=16537): stdout: | (launched: 2022-12-08_21:28:13.743752) 21:28:15.211301 run osmo-msc_10.42.42.6(pid=16537): stderr: | [0;m[38;5;43m20221208212814023 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212814024 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f216e8a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212814024 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212814024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212814024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212814024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212814026 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212814026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212814026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212814027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:28:15.265842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16530): Terminating (SIGTERM) 21:28:15.310704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16533): Terminating (SIGTERM) 21:28:15.357307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16536): Terminating (SIGTERM) 21:28:15.407775 --- ParallelTerminationStrategy: PID 16530 died... 21:28:15.427778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16530): Terminated: ok {rc=0} 21:28:15.482185 --- ParallelTerminationStrategy: PID 16533 died... 21:28:15.502528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16533): Terminated: ok {rc=0} 21:28:15.552780 --- ParallelTerminationStrategy: PID 16536 died... 21:28:15.573837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16536): Terminated: ok {rc=0} 21:28:15.670974 bus /sierra_3: Setting Powered False 21:28:16.789116 bus /sierra_3: Setting Powered False 21:28:17.938078 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 21:28:19.233820 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:28:19.239691 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 21:28:19.305628 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 21:28:19.333520 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 21:28:19.388622 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 21:28:19.467193 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 21:28:19.497305 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 21:28:20.044359 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 21:28:20.050817 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:20.062772 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:28:20.115200 tst handover.py: using LAC 16944 21:28:20.249156 tst handover.py: using RAC 114 21:28:20.385393 tst handover.py: using CellId 16944 21:28:20.530373 tst handover.py: using BVCI 16945 21:28:20.654547 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:28:20.703843 tst handover.py: using LAC 16945 21:28:20.829208 tst handover.py: using RAC 115 21:28:20.964673 tst handover.py: using CellId 16945 21:28:21.097642 tst handover.py: using BVCI 16946 21:28:21.226579 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:21.238526 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:21.250717 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:21.262628 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:21.274436 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:21.286739 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:28:21.408269 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:28:21.530318 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:28:22.026548 run create_hlr_db(pid=16542): Launched 21:28:22.194892 bus /sierra_2: Setting Powered False 21:28:23.263989 run create_hlr_db(pid=16542): Terminated: ok {rc=0} 21:28:23.713910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16544): Launched 21:28:24.091862 run osmo-hlr_10.42.42.2(pid=16545): Launched 21:28:24.334313 run osmo-stp_10.42.42.5: Starting osmo-stp 21:28:25.069657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16547): Launched 21:28:25.408934 run osmo-stp_10.42.42.5(pid=16548): Launched 21:28:25.542970 run osmo-msc_10.42.42.6: Starting osmo-msc 21:28:26.389667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16550): Launched 21:28:26.764540 run osmo-msc_10.42.42.6(pid=16551): Launched 21:28:27.123711 run osmo-stp_10.42.42.5(pid=16548): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16548)] 21:28:27.351836 run osmo-stp_10.42.42.5(pid=16548): stdout: | (launched: 2022-12-08_21:28:25.345544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:27.498366 run osmo-stp_10.42.42.5(pid=16548): stderr: | [0;m[38;5;43m20221208212825752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212825752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212825752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212825758 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212825758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212825759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212825759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:27.646738 run osmo-stp_10.42.42.5(pid=16548): stdout: | (launched: 2022-12-08_21:28:25.345544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:27.782991 run osmo-stp_10.42.42.5(pid=16548): stderr: | [0;m[38;5;43m20221208212825752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212825752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212825752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212825758 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212825758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212825759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212825759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:27.944756 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16548): Process ended prematurely: osmo-stp_10.42.42.5(pid=16548) [trial-2349↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16548)] [trial-2349↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 21:28:27.954350 tst handover.py:18: Test FAILED (7.9 sec) 21:28:27.983103 run osmo-hlr_10.42.42.2(pid=16545): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16545)] 21:28:28.034819 run osmo-hlr_10.42.42.2(pid=16545): stdout: | (launched: 2022-12-08_21:28:24.035157) 21:28:28.088723 run osmo-hlr_10.42.42.2(pid=16545): stderr: | [0;m[1;31m20221208212824366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212824366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212824366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212824366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212824366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212824366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212824384 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212824400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212824400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212824400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:28:28.163663 run osmo-msc_10.42.42.6(pid=16551): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16551)] 21:28:28.215235 run osmo-msc_10.42.42.6(pid=16551): stdout: | (launched: 2022-12-08_21:28:26.696470) 21:28:28.268632 run osmo-msc_10.42.42.6(pid=16551): stderr: | [0;m[38;5;43m20221208212827246 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212827246 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2ce076ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212827246 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212827246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212827247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212827247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212827249 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212827249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212827249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212827250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:28:28.322251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16544): Terminating (SIGTERM) 21:28:28.365579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16547): Terminating (SIGTERM) 21:28:28.409641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16550): Terminating (SIGTERM) 21:28:28.453581 --- ParallelTerminationStrategy: PID 16544 died... 21:28:28.474377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16544): Terminated: ok {rc=0} 21:28:28.521686 --- ParallelTerminationStrategy: PID 16547 died... 21:28:28.541803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16547): Terminated: ok {rc=0} 21:28:28.588750 --- ParallelTerminationStrategy: PID 16550 died... 21:28:28.608673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16550): Terminated: ok {rc=0} 21:28:28.701159 bus /sierra_3: Setting Powered False 21:28:29.809562 bus /sierra_3: Setting Powered False 21:28:30.946190 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 21:28:32.271983 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:28:32.277456 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 21:28:32.344671 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:28:32.373957 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 21:28:32.432813 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 21:28:32.549143 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:28:32.592670 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 21:28:33.085366 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 21:28:33.092213 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:28:33.104745 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:28:33.160005 tst handover.py: using LAC 16946 21:28:33.291268 tst handover.py: using RAC 116 21:28:33.420113 tst handover.py: using CellId 16946 21:28:33.551762 tst handover.py: using BVCI 16947 21:28:33.683144 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:28:33.734778 tst handover.py: using LAC 16947 21:28:33.873434 tst handover.py: using RAC 117 21:28:34.016140 tst handover.py: using CellId 16947 21:28:34.158618 tst handover.py: using BVCI 16948 21:28:34.281537 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:28:34.293874 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:28:34.305883 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:28:34.318165 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:28:34.330876 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:28:34.343031 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:28:34.468387 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:28:34.595429 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:28:35.092853 run create_hlr_db(pid=16556): Launched 21:28:35.263892 bus /sierra_2: Setting Powered False 21:28:36.336816 run create_hlr_db(pid=16556): Terminated: ok {rc=0} 21:28:36.784255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16558): Launched 21:28:37.142920 run osmo-hlr_10.42.42.2(pid=16559): Launched 21:28:37.379582 run osmo-stp_10.42.42.5: Starting osmo-stp 21:28:38.070214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16561): Launched 21:28:38.411527 run osmo-stp_10.42.42.5(pid=16562): Launched 21:28:38.716312 run osmo-msc_10.42.42.6: Starting osmo-msc 21:28:39.353379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16564): Launched 21:28:39.716446 run osmo-msc_10.42.42.6(pid=16565): Launched 21:28:40.120056 run osmo-stp_10.42.42.5(pid=16562): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16562)] 21:28:40.428153 run osmo-stp_10.42.42.5(pid=16562): stdout: | (launched: 2022-12-08_21:28:38.351225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:40.591553 run osmo-stp_10.42.42.5(pid=16562): stderr: | [0;m[38;5;43m20221208212838690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212838691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212838691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212838691 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212838692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212838692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212838692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:40.729320 run osmo-stp_10.42.42.5(pid=16562): stdout: | (launched: 2022-12-08_21:28:38.351225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:40.876057 run osmo-stp_10.42.42.5(pid=16562): stderr: | [0;m[38;5;43m20221208212838690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212838691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212838691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212838691 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212838692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212838692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212838692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:41.049930 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16562): Process ended prematurely: osmo-stp_10.42.42.5(pid=16562) [trial-2349↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16562)] [trial-2349↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 21:28:41.059976 tst handover.py:18: Test FAILED (8.0 sec) 21:28:41.091845 run osmo-hlr_10.42.42.2(pid=16559): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16559)] 21:28:41.146519 run osmo-hlr_10.42.42.2(pid=16559): stdout: | (launched: 2022-12-08_21:28:37.081087) 21:28:41.203215 run osmo-hlr_10.42.42.2(pid=16559): stderr: | [0;m[1;31m20221208212837334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212837334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212837334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212837335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212837335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212837335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212837356 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212837381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212837381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212837382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:28:41.279456 run osmo-msc_10.42.42.6(pid=16565): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16565)] 21:28:41.333169 run osmo-msc_10.42.42.6(pid=16565): stdout: | (launched: 2022-12-08_21:28:39.656439) 21:28:41.393140 run osmo-msc_10.42.42.6(pid=16565): stderr: | [0;m[38;5;43m20221208212840200 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212840200 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f740ad80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212840205 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212840205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212840205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212840205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212840207 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212840207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212840207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212840207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:28:41.449170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16558): Terminating (SIGTERM) 21:28:41.494097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16561): Terminating (SIGTERM) 21:28:41.540048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16564): Terminating (SIGTERM) 21:28:41.588567 --- ParallelTerminationStrategy: PID 16558 died... 21:28:41.609026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16558): Terminated: ok {rc=0} 21:28:41.661601 --- ParallelTerminationStrategy: PID 16561 died... 21:28:41.681706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16561): Terminated: ok {rc=0} 21:28:41.730502 --- ParallelTerminationStrategy: PID 16564 died... 21:28:41.750117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16564): Terminated: ok {rc=0} 21:28:41.846035 bus /sierra_3: Setting Powered False 21:28:42.945793 bus /sierra_3: Setting Powered False 21:28:44.063637 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 21:28:45.360232 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:28:45.368666 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 21:28:45.426189 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 21:28:45.456245 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 21:28:45.511985 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 21:28:45.567650 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 21:28:45.601727 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 21:28:46.181528 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 21:28:46.188191 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:46.206456 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:28:46.253462 tst handover.py: using LAC 16948 21:28:46.395627 tst handover.py: using RAC 118 21:28:46.578203 tst handover.py: using CellId 16948 21:28:46.718978 tst handover.py: using BVCI 16949 21:28:46.852048 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:28:46.909396 tst handover.py: using LAC 16949 21:28:47.093405 tst handover.py: using RAC 119 21:28:47.236133 tst handover.py: using CellId 16949 21:28:47.378231 tst handover.py: using BVCI 16950 21:28:47.507937 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:47.519910 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:47.531940 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:47.543907 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:47.555969 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:47.567911 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:28:47.696605 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:28:47.821679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:28:48.326331 run create_hlr_db(pid=16570): Launched 21:28:48.495497 bus /sierra_2: Setting Powered False 21:28:49.562826 run create_hlr_db(pid=16570): Terminated: ok {rc=0} 21:28:49.988461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16572): Launched 21:28:50.318419 run osmo-hlr_10.42.42.2(pid=16573): Launched 21:28:50.552140 run osmo-stp_10.42.42.5: Starting osmo-stp 21:28:51.291184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16575): Launched 21:28:51.612819 run osmo-stp_10.42.42.5(pid=16576): Launched 21:28:51.842658 run osmo-msc_10.42.42.6: Starting osmo-msc 21:28:52.549158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16578): Launched 21:28:52.885283 run osmo-msc_10.42.42.6(pid=16579): Launched 21:28:53.123266 run osmo-stp_10.42.42.5(pid=16576): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16576)] 21:28:53.307224 run osmo-stp_10.42.42.5(pid=16576): stdout: | (launched: 2022-12-08_21:28:51.556049) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:53.460659 run osmo-stp_10.42.42.5(pid=16576): stderr: | [0;m[38;5;43m20221208212851887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212851887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212851887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212851887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212851888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212851888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212851888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:53.616891 run osmo-stp_10.42.42.5(pid=16576): stdout: | (launched: 2022-12-08_21:28:51.556049) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:53.761527 run osmo-stp_10.42.42.5(pid=16576): stderr: | [0;m[38;5;43m20221208212851887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212851887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212851887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212851887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212851888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212851888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212851888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:53.934430 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16576): Process ended prematurely: osmo-stp_10.42.42.5(pid=16576) [trial-2349↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16576)] [trial-2349↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 21:28:53.942798 tst handover.py:18: Test FAILED (7.7 sec) 21:28:53.974671 run osmo-hlr_10.42.42.2(pid=16573): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16573)] 21:28:54.029759 run osmo-hlr_10.42.42.2(pid=16573): stdout: | (launched: 2022-12-08_21:28:50.261818) 21:28:54.086712 run osmo-hlr_10.42.42.2(pid=16573): stderr: | [0;m[1;31m20221208212850590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212850590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212850590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212850590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212850590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212850590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212850616 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212850624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212850633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212850633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:28:54.165847 run osmo-msc_10.42.42.6(pid=16579): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16579)] 21:28:54.221524 run osmo-msc_10.42.42.6(pid=16579): stdout: | (launched: 2022-12-08_21:28:52.823544) 21:28:54.277720 run osmo-msc_10.42.42.6(pid=16579): stderr: | [0;m[38;5;43m20221208212853139 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212853139 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9161167c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212853139 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212853139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212853139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212853140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212853141 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212853142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212853142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212853142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:28:54.334321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16572): Terminating (SIGTERM) 21:28:54.380456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16575): Terminating (SIGTERM) 21:28:54.426751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16578): Terminating (SIGTERM) 21:28:54.472760 --- ParallelTerminationStrategy: PID 16572 died... 21:28:54.494610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16572): Terminated: ok {rc=0} 21:28:54.545573 --- ParallelTerminationStrategy: PID 16575 died... 21:28:54.566976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16575): Terminated: ok {rc=0} 21:28:54.617388 --- ParallelTerminationStrategy: PID 16578 died... 21:28:54.638736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16578): Terminated: ok {rc=0} 21:28:54.732993 bus /sierra_3: Setting Powered False 21:28:55.834228 bus /sierra_3: Setting Powered False 21:28:56.960219 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 21:28:58.250350 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:28:58.256548 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 21:28:58.309932 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:28:58.338707 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 21:28:58.395912 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 21:28:58.460770 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:28:58.488872 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 21:28:59.051551 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 21:28:59.057707 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:28:59.069651 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:28:59.110489 tst handover.py: using LAC 16950 21:28:59.251059 tst handover.py: using RAC 120 21:28:59.413998 tst handover.py: using CellId 16950 21:28:59.558776 tst handover.py: using BVCI 16951 21:28:59.692204 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:28:59.746739 tst handover.py: using LAC 16951 21:28:59.893553 tst handover.py: using RAC 121 21:29:00.036737 tst handover.py: using CellId 16951 21:29:00.178272 tst handover.py: using BVCI 16952 21:29:00.302864 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:00.315525 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:00.328235 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:00.342176 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:00.355749 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:00.368747 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:29:00.526913 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:29:00.654097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:29:01.156157 run create_hlr_db(pid=16584): Launched 21:29:01.326171 bus /sierra_2: Setting Powered False 21:29:02.405619 run create_hlr_db(pid=16584): Terminated: ok {rc=0} 21:29:02.864266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16586): Launched 21:29:03.222249 run osmo-hlr_10.42.42.2(pid=16587): Launched 21:29:03.477094 run osmo-stp_10.42.42.5: Starting osmo-stp 21:29:04.057138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16589): Launched 21:29:04.400452 run osmo-stp_10.42.42.5(pid=16590): Launched 21:29:04.536667 run osmo-msc_10.42.42.6: Starting osmo-msc 21:29:05.132708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16592): Launched 21:29:05.473525 run osmo-msc_10.42.42.6(pid=16593): Launched 21:29:05.843287 run osmo-stp_10.42.42.5(pid=16590): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16590)] 21:29:06.111931 run osmo-stp_10.42.42.5(pid=16590): stdout: | (launched: 2022-12-08_21:29:04.337445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:06.297084 run osmo-stp_10.42.42.5(pid=16590): stderr: | [0;m[38;5;43m20221208212904583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212904583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212904583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212904584 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212904584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212904584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212904584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:06.434826 run osmo-stp_10.42.42.5(pid=16590): stdout: | (launched: 2022-12-08_21:29:04.337445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:06.567836 run osmo-stp_10.42.42.5(pid=16590): stderr: | [0;m[38;5;43m20221208212904583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212904583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212904583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212904584 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212904584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212904584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212904584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:06.724937 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16590): Process ended prematurely: osmo-stp_10.42.42.5(pid=16590) [trial-2349↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16590)] [trial-2349↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 21:29:06.734422 tst handover.py:18: Test FAILED (7.7 sec) 21:29:06.763183 run osmo-hlr_10.42.42.2(pid=16587): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16587)] 21:29:06.814535 run osmo-hlr_10.42.42.2(pid=16587): stdout: | (launched: 2022-12-08_21:29:03.150735) 21:29:06.867666 run osmo-hlr_10.42.42.2(pid=16587): stderr: | [0;m[1;31m20221208212903481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212903481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212903481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212903481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212903481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212903481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212903515 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212903542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212903542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212903542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:29:06.941494 run osmo-msc_10.42.42.6(pid=16593): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16593)] 21:29:06.992650 run osmo-msc_10.42.42.6(pid=16593): stdout: | (launched: 2022-12-08_21:29:05.413813) 21:29:07.045372 run osmo-msc_10.42.42.6(pid=16593): stderr: | [0;m[38;5;43m20221208212905927 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212905927 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4f81eabc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212905928 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212905928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212905928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212905928 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212905938 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212905939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212905939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212905939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:29:07.098566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16586): Terminating (SIGTERM) 21:29:07.140922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16589): Terminating (SIGTERM) 21:29:07.183731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16592): Terminating (SIGTERM) 21:29:07.227512 --- ParallelTerminationStrategy: PID 16586 died... 21:29:07.248012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16586): Terminated: ok {rc=0} 21:29:07.295169 --- ParallelTerminationStrategy: PID 16589 died... 21:29:07.315422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16589): Terminated: ok {rc=0} 21:29:07.363087 --- ParallelTerminationStrategy: PID 16592 died... 21:29:07.383537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16592): Terminated: ok {rc=0} 21:29:07.474331 bus /sierra_3: Setting Powered False 21:29:08.598203 bus /sierra_3: Setting Powered False 21:29:09.725355 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2349 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 21:29:10.994089 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:29:11.000576 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 21:29:11.064485 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:29:11.092048 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 21:29:11.147706 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 21:29:11.214758 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:29:11.243319 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 21:29:11.795140 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2349 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 21:29:11.801548 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:11.813270 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:29:11.861589 tst handover.py: using LAC 16952 21:29:11.989999 tst handover.py: using RAC 122 21:29:12.121380 tst handover.py: using CellId 16952 21:29:12.254733 tst handover.py: using BVCI 16953 21:29:12.377220 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:29:12.426491 tst handover.py: using LAC 16953 21:29:12.556828 tst handover.py: using RAC 123 21:29:12.686048 tst handover.py: using CellId 16953 21:29:12.818589 tst handover.py: using BVCI 16954 21:29:12.939097 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:12.950567 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:12.961836 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:12.973124 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:12.984390 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:12.995632 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:29:13.120601 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:29:13.247824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:29:13.739099 run create_hlr_db(pid=16598): Launched 21:29:13.873561 bus /sierra_2: Setting Powered False 21:29:14.934564 run create_hlr_db(pid=16598): Terminated: ok {rc=0} 21:29:15.356842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16611): Launched 21:29:15.686965 run osmo-hlr_10.42.42.2(pid=16612): Launched 21:29:15.813852 run osmo-stp_10.42.42.5: Starting osmo-stp 21:29:16.493935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16614): Launched 21:29:16.868397 run osmo-stp_10.42.42.5(pid=16615): Launched 21:29:17.135386 run osmo-msc_10.42.42.6: Starting osmo-msc 21:29:17.756122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16617): Launched 21:29:18.062882 run osmo-msc_10.42.42.6(pid=16618): Launched 21:29:18.234568 run osmo-stp_10.42.42.5(pid=16615): ERR: Terminated: ERROR {rc=1} [trial-2349↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16615)] 21:29:18.365445 run osmo-stp_10.42.42.5(pid=16615): stdout: | (launched: 2022-12-08_21:29:16.810343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:18.495110 run osmo-stp_10.42.42.5(pid=16615): stderr: | [0;m[38;5;43m20221208212917016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212917017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212917017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212917017 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212917019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212917020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212917020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:18.622050 run osmo-stp_10.42.42.5(pid=16615): stdout: | (launched: 2022-12-08_21:29:16.810343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:18.742892 run osmo-stp_10.42.42.5(pid=16615): stderr: | [0;m[38;5;43m20221208212917016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221208212917017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221208212917017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221208212917017 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221208212917019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221208212917020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221208212917020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:18.887986 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16615): Process ended prematurely: osmo-stp_10.42.42.5(pid=16615) [trial-2349↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16615)] [trial-2349↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 21:29:18.896317 tst handover.py:18: Test FAILED (7.1 sec) 21:29:18.922581 run osmo-hlr_10.42.42.2(pid=16612): ERR: Terminated: ERROR {rc=237} [trial-2349↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16612)] 21:29:18.970672 run osmo-hlr_10.42.42.2(pid=16612): stdout: | (launched: 2022-12-08_21:29:15.626200) 21:29:19.020057 run osmo-hlr_10.42.42.2(pid=16612): stderr: | [0;m[1;31m20221208212915829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221208212915829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221208212915837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221208212915837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221208212915837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221208212915837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221208212915856 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221208212915875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221208212915876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221208212915876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:29:19.088376 run osmo-msc_10.42.42.6(pid=16618): ERR: Terminated: ERROR {rc=2} [trial-2349↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16618)] 21:29:19.136031 run osmo-msc_10.42.42.6(pid=16618): stdout: | (launched: 2022-12-08_21:29:18.006606) 21:29:19.185235 run osmo-msc_10.42.42.6(pid=16618): stderr: | [0;m[38;5;43m20221208212918280 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221208212918280 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f82c26bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221208212918280 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221208212918280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221208212918280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221208212918280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221208212918282 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221208212918282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221208212918283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221208212918283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:29:19.235181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16611): Terminating (SIGTERM) 21:29:19.275320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16614): Terminating (SIGTERM) 21:29:19.316338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16617): Terminating (SIGTERM) 21:29:19.357761 --- ParallelTerminationStrategy: PID 16611 died... 21:29:19.376838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16611): Terminated: ok {rc=0} 21:29:19.423033 --- ParallelTerminationStrategy: PID 16614 died... 21:29:19.442467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16614): Terminated: ok {rc=0} 21:29:19.486795 --- ParallelTerminationStrategy: PID 16617 died... 21:29:19.505610 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16617): Terminated: ok {rc=0} 21:29:19.591865 bus /sierra_3: Setting Powered False 21:29:20.696189 bus /sierra_3: Setting Powered False 21:29:21.829377 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2349 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 21:29:23.140696 tst trial-2349: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349/run.2022-12-08_20-04-33/trial-2349.xml -------------------------------------------------------------------------------------------- trial-2349 FAIL -------------------------------------------------------------------------------------------- 21:29:25.145495 tst trial-2349: trial-2349: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.0 sec) Error: osmo-nitb_10.42.42.2(pid=9035): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9035) [trial-2349↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9035)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.2 sec) Error: osmo-stp_10.42.42.5(pid=9045): Process ended prematurely: osmo-stp_10.42.42.5(pid=9045) [trial-2349↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9045)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=9055): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9055) [trial-2349↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9055)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=9065): Process ended prematurely: osmo-stp_10.42.42.5(pid=9065) [trial-2349↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9065)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9079): Process ended prematurely: osmo-stp_10.42.42.5(pid=9079) [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9079)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9090): Process ended prematurely: osmo-stp_10.42.42.5(pid=9090) [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9090)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=9115): Process ended prematurely: osmo-stp_10.42.42.5(pid=9115) [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9115)] FAIL: mo_mt_call_osmux.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=9386): Process ended prematurely: osmo-stp_10.42.42.5(pid=9386) [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9386)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9401): Process ended prematurely: osmo-stp_10.42.42.5(pid=9401) [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9401)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9412): Process ended prematurely: osmo-stp_10.42.42.5(pid=9412) [trial-2349↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9412)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9426): Process ended prematurely: osmo-stp_10.42.42.5(pid=9426) [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9426)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9437): Process ended prematurely: osmo-stp_10.42.42.5(pid=9437) [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9437)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9452): Process ended prematurely: osmo-stp_10.42.42.5(pid=9452) [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9452)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9480): Process ended prematurely: osmo-stp_10.42.42.5(pid=9480) [trial-2349↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9480)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9494): Process ended prematurely: osmo-stp_10.42.42.5(pid=9494) [trial-2349↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9494)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9506): Process ended prematurely: osmo-stp_10.42.42.5(pid=9506) [trial-2349↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9506)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9520): Process ended prematurely: osmo-stp_10.42.42.5(pid=9520) [trial-2349↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9520)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9531): Process ended prematurely: osmo-stp_10.42.42.5(pid=9531) [trial-2349↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9531)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9545): Process ended prematurely: osmo-stp_10.42.42.5(pid=9545) [trial-2349↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9545)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9559): Process ended prematurely: osmo-stp_10.42.42.5(pid=9559) [trial-2349↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9559)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.6 sec) Error: osmo-stp_10.42.42.5(pid=9577): Process ended prematurely: osmo-stp_10.42.42.5(pid=9577) [trial-2349↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9577)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=9589): Process ended prematurely: osmo-stp_10.42.42.5(pid=9589) [trial-2349↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9589)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=9607): Process ended prematurely: osmo-stp_10.42.42.5(pid=9607) [trial-2349↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9607)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9617): Process ended prematurely: osmo-stp_10.42.42.5(pid=9617) [trial-2349↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9617)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9627): Process ended prematurely: osmo-stp_10.42.42.5(pid=9627) [trial-2349↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9627)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=9645): Process ended prematurely: osmo-stp_10.42.42.5(pid=9645) [trial-2349↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9645)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=9657): Process ended prematurely: osmo-stp_10.42.42.5(pid=9657) [trial-2349↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9657)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=9675): Process ended prematurely: osmo-stp_10.42.42.5(pid=9675) [trial-2349↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9675)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9685): Process ended prematurely: osmo-stp_10.42.42.5(pid=9685) [trial-2349↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9685)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9695): Process ended prematurely: osmo-stp_10.42.42.5(pid=9695) [trial-2349↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9695)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=9714): Process ended prematurely: osmo-stp_10.42.42.5(pid=9714) [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9714)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=9732): Process ended prematurely: osmo-stp_10.42.42.5(pid=9732) [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9732)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=9750): Process ended prematurely: osmo-stp_10.42.42.5(pid=9750) [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9750)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9760): Process ended prematurely: osmo-stp_10.42.42.5(pid=9760) [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9760)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9770): Process ended prematurely: osmo-stp_10.42.42.5(pid=9770) [trial-2349↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9770)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=9788): Process ended prematurely: osmo-stp_10.42.42.5(pid=9788) [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9788)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=9800): Process ended prematurely: osmo-stp_10.42.42.5(pid=9800) [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9800)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=9818): Process ended prematurely: osmo-stp_10.42.42.5(pid=9818) [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9818)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9828): Process ended prematurely: osmo-stp_10.42.42.5(pid=9828) [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9828)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9838): Process ended prematurely: osmo-stp_10.42.42.5(pid=9838) [trial-2349↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9838)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=9852): Process ended prematurely: osmo-stp_10.42.42.5(pid=9852) [trial-2349↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9852)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9865): Process ended prematurely: osmo-stp_10.42.42.5(pid=9865) [trial-2349↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9865)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=9873): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9873) [trial-2349↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9873)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9887): Process ended prematurely: osmo-stp_10.42.42.5(pid=9887) [trial-2349↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9887)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=9896): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9896) [trial-2349↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9896)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=9906): Process ended prematurely: osmo-stp_10.42.42.5(pid=9906) [trial-2349↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9906)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9920): Process ended prematurely: osmo-stp_10.42.42.5(pid=9920) [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9920)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9931): Process ended prematurely: osmo-stp_10.42.42.5(pid=9931) [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9931)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9946): Process ended prematurely: osmo-stp_10.42.42.5(pid=9946) [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9946)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9957): Process ended prematurely: osmo-stp_10.42.42.5(pid=9957) [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9957)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=9974): Process ended prematurely: osmo-stp_10.42.42.5(pid=9974) [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9974)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9985): Process ended prematurely: osmo-stp_10.42.42.5(pid=9985) [trial-2349↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9985)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9999): Process ended prematurely: osmo-stp_10.42.42.5(pid=9999) [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9999)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10010): Process ended prematurely: osmo-stp_10.42.42.5(pid=10010) [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10010)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10024): Process ended prematurely: osmo-stp_10.42.42.5(pid=10024) [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10024)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10051): Process ended prematurely: osmo-stp_10.42.42.5(pid=10051) [trial-2349↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10051)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10065): Process ended prematurely: osmo-stp_10.42.42.5(pid=10065) [trial-2349↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10065)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10076): Process ended prematurely: osmo-stp_10.42.42.5(pid=10076) [trial-2349↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10076)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10090): Process ended prematurely: osmo-stp_10.42.42.5(pid=10090) [trial-2349↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10090)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10102): Process ended prematurely: osmo-stp_10.42.42.5(pid=10102) [trial-2349↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10102)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10116): Process ended prematurely: osmo-stp_10.42.42.5(pid=10116) [trial-2349↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10116)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10127): Process ended prematurely: osmo-stp_10.42.42.5(pid=10127) [trial-2349↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10127)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=10145): Process ended prematurely: osmo-stp_10.42.42.5(pid=10145) [trial-2349↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10145)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=10158): Process ended prematurely: osmo-stp_10.42.42.5(pid=10158) [trial-2349↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10158)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=10176): Process ended prematurely: osmo-stp_10.42.42.5(pid=10176) [trial-2349↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10176)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10186): Process ended prematurely: osmo-stp_10.42.42.5(pid=10186) [trial-2349↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10186)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10196): Process ended prematurely: osmo-stp_10.42.42.5(pid=10196) [trial-2349↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10196)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=10213): Process ended prematurely: osmo-stp_10.42.42.5(pid=10213) [trial-2349↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10213)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=10225): Process ended prematurely: osmo-stp_10.42.42.5(pid=10225) [trial-2349↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10225)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=10243): Process ended prematurely: osmo-stp_10.42.42.5(pid=10243) [trial-2349↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10243)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10256): Process ended prematurely: osmo-stp_10.42.42.5(pid=10256) [trial-2349↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10256)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10266): Process ended prematurely: osmo-stp_10.42.42.5(pid=10266) [trial-2349↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10266)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=10283): Process ended prematurely: osmo-stp_10.42.42.5(pid=10283) [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10283)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=10295): Process ended prematurely: osmo-stp_10.42.42.5(pid=10295) [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10295)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=10313): Process ended prematurely: osmo-stp_10.42.42.5(pid=10313) [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10313)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=10325): Process ended prematurely: osmo-stp_10.42.42.5(pid=10325) [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10325)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10335): Process ended prematurely: osmo-stp_10.42.42.5(pid=10335) [trial-2349↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10335)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=10353): Process ended prematurely: osmo-stp_10.42.42.5(pid=10353) [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10353)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=10365): Process ended prematurely: osmo-stp_10.42.42.5(pid=10365) [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10365)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=10383): Process ended prematurely: osmo-stp_10.42.42.5(pid=10383) [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10383)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10393): Process ended prematurely: osmo-stp_10.42.42.5(pid=10393) [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10393)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10403): Process ended prematurely: osmo-stp_10.42.42.5(pid=10403) [trial-2349↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10403)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10417): Process ended prematurely: osmo-stp_10.42.42.5(pid=10417) [trial-2349↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10417)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10430): Process ended prematurely: osmo-stp_10.42.42.5(pid=10430) [trial-2349↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10430)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=10439): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10439) [trial-2349↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10439)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=10462): Process ended prematurely: osmo-stp_10.42.42.5(pid=10462) [trial-2349↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10462)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=10730): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10730) [trial-2349↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10730)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10740): Process ended prematurely: osmo-stp_10.42.42.5(pid=10740) [trial-2349↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10740)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10754): Process ended prematurely: osmo-stp_10.42.42.5(pid=10754) [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10754)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10765): Process ended prematurely: osmo-stp_10.42.42.5(pid=10765) [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10765)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10779): Process ended prematurely: osmo-stp_10.42.42.5(pid=10779) [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10779)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10791): Process ended prematurely: osmo-stp_10.42.42.5(pid=10791) [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10791)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10805): Process ended prematurely: osmo-stp_10.42.42.5(pid=10805) [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10805)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10816): Process ended prematurely: osmo-stp_10.42.42.5(pid=10816) [trial-2349↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10816)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10830): Process ended prematurely: osmo-stp_10.42.42.5(pid=10830) [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10830)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10841): Process ended prematurely: osmo-stp_10.42.42.5(pid=10841) [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10841)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10855): Process ended prematurely: osmo-stp_10.42.42.5(pid=10855) [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10855)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10866): Process ended prematurely: osmo-stp_10.42.42.5(pid=10866) [trial-2349↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10866)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10884): Process ended prematurely: osmo-stp_10.42.42.5(pid=10884) [trial-2349↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10884)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10895): Process ended prematurely: osmo-stp_10.42.42.5(pid=10895) [trial-2349↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10895)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10922): Process ended prematurely: osmo-stp_10.42.42.5(pid=10922) [trial-2349↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10922)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10933): Process ended prematurely: osmo-stp_10.42.42.5(pid=10933) [trial-2349↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10933)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10947): Process ended prematurely: osmo-stp_10.42.42.5(pid=10947) [trial-2349↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10947)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10958): Process ended prematurely: osmo-stp_10.42.42.5(pid=10958) [trial-2349↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10958)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10972): Process ended prematurely: osmo-stp_10.42.42.5(pid=10972) [trial-2349↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10972)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10983): Process ended prematurely: osmo-stp_10.42.42.5(pid=10983) [trial-2349↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10983)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11000): Process ended prematurely: osmo-stp_10.42.42.5(pid=11000) [trial-2349↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11000)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11011): Process ended prematurely: osmo-stp_10.42.42.5(pid=11011) [trial-2349↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11011)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=11049): Process ended prematurely: osmo-stp_10.42.42.5(pid=11049) [trial-2349↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11049)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=11061): Process ended prematurely: osmo-stp_10.42.42.5(pid=11061) [trial-2349↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11061)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=11079): Process ended prematurely: osmo-stp_10.42.42.5(pid=11079) [trial-2349↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11079)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11089): Process ended prematurely: osmo-stp_10.42.42.5(pid=11089) [trial-2349↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11089)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11099): Process ended prematurely: osmo-stp_10.42.42.5(pid=11099) [trial-2349↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11099)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=11116): Process ended prematurely: osmo-stp_10.42.42.5(pid=11116) [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11116)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=11128): Process ended prematurely: osmo-stp_10.42.42.5(pid=11128) [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11128)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=11146): Process ended prematurely: osmo-stp_10.42.42.5(pid=11146) [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11146)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11156): Process ended prematurely: osmo-stp_10.42.42.5(pid=11156) [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11156)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11166): Process ended prematurely: osmo-stp_10.42.42.5(pid=11166) [trial-2349↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11166)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.3 sec) Error: osmo-stp_10.42.42.5(pid=11185): Process ended prematurely: osmo-stp_10.42.42.5(pid=11185) [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11185)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=11197): Process ended prematurely: osmo-stp_10.42.42.5(pid=11197) [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11197)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=11215): Process ended prematurely: osmo-stp_10.42.42.5(pid=11215) [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11215)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11232): Process ended prematurely: osmo-stp_10.42.42.5(pid=11232) [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11232)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11242): Process ended prematurely: osmo-stp_10.42.42.5(pid=11242) [trial-2349↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11242)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=11262): Process ended prematurely: osmo-stp_10.42.42.5(pid=11262) [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11262)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=11274): Process ended prematurely: osmo-stp_10.42.42.5(pid=11274) [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11274)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=11292): Process ended prematurely: osmo-stp_10.42.42.5(pid=11292) [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11292)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11302): Process ended prematurely: osmo-stp_10.42.42.5(pid=11302) [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11302)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11312): Process ended prematurely: osmo-stp_10.42.42.5(pid=11312) [trial-2349↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11312)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=11329): Process ended prematurely: osmo-stp_10.42.42.5(pid=11329) [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11329)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=11341): Process ended prematurely: osmo-stp_10.42.42.5(pid=11341) [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11341)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=11359): Process ended prematurely: osmo-stp_10.42.42.5(pid=11359) [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11359)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11369): Process ended prematurely: osmo-stp_10.42.42.5(pid=11369) [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11369)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11379): Process ended prematurely: osmo-stp_10.42.42.5(pid=11379) [trial-2349↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11379)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11393): Process ended prematurely: osmo-stp_10.42.42.5(pid=11393) [trial-2349↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11393)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11407): Process ended prematurely: osmo-stp_10.42.42.5(pid=11407) [trial-2349↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11407)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=11415): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11415) [trial-2349↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11415)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11425): Process ended prematurely: osmo-stp_10.42.42.5(pid=11425) [trial-2349↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11425)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=11434): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11434) [trial-2349↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11434)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11444): Process ended prematurely: osmo-stp_10.42.42.5(pid=11444) [trial-2349↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11444)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11458): Process ended prematurely: osmo-stp_10.42.42.5(pid=11458) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11458)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11470): Process ended prematurely: osmo-stp_10.42.42.5(pid=11470) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11470)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11484): Process ended prematurely: osmo-stp_10.42.42.5(pid=11484) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11484)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11495): Process ended prematurely: osmo-stp_10.42.42.5(pid=11495) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11495)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11509): Process ended prematurely: osmo-stp_10.42.42.5(pid=11509) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11509)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11520): Process ended prematurely: osmo-stp_10.42.42.5(pid=11520) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11520)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11536): Process ended prematurely: osmo-stp_10.42.42.5(pid=11536) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11536)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11548): Process ended prematurely: osmo-stp_10.42.42.5(pid=11548) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11548)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11563): Process ended prematurely: osmo-stp_10.42.42.5(pid=11563) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11563)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11574): Process ended prematurely: osmo-stp_10.42.42.5(pid=11574) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11574)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11588): Process ended prematurely: osmo-stp_10.42.42.5(pid=11588) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11588)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11599): Process ended prematurely: osmo-stp_10.42.42.5(pid=11599) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11599)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11616): Process ended prematurely: osmo-stp_10.42.42.5(pid=11616) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11616)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11627): Process ended prematurely: osmo-stp_10.42.42.5(pid=11627) [trial-2349↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11627)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11641): Process ended prematurely: osmo-stp_10.42.42.5(pid=11641) [trial-2349↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11641)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11652): Process ended prematurely: osmo-stp_10.42.42.5(pid=11652) [trial-2349↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11652)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=11670): Process ended prematurely: osmo-stp_10.42.42.5(pid=11670) [trial-2349↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11670)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=11682): Process ended prematurely: osmo-stp_10.42.42.5(pid=11682) [trial-2349↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11682)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=11700): Process ended prematurely: osmo-stp_10.42.42.5(pid=11700) [trial-2349↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11700)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11710): Process ended prematurely: osmo-stp_10.42.42.5(pid=11710) [trial-2349↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11710)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11720): Process ended prematurely: osmo-stp_10.42.42.5(pid=11720) [trial-2349↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11720)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=11737): Process ended prematurely: osmo-stp_10.42.42.5(pid=11737) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11737)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=11749): Process ended prematurely: osmo-stp_10.42.42.5(pid=11749) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11749)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=11769): Process ended prematurely: osmo-stp_10.42.42.5(pid=11769) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11769)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11781): Process ended prematurely: osmo-stp_10.42.42.5(pid=11781) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11781)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11791): Process ended prematurely: osmo-stp_10.42.42.5(pid=11791) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11791)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.4 sec) Error: osmo-stp_10.42.42.5(pid=11820): Process ended prematurely: osmo-stp_10.42.42.5(pid=11820) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11820)] FAIL: iperf3.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=12092): Process ended prematurely: osmo-stp_10.42.42.5(pid=12092) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12092)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=12112): Process ended prematurely: osmo-stp_10.42.42.5(pid=12112) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12112)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12122): Process ended prematurely: osmo-stp_10.42.42.5(pid=12122) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12122)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=12132): Process ended prematurely: osmo-stp_10.42.42.5(pid=12132) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12132)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=12151): Process ended prematurely: osmo-stp_10.42.42.5(pid=12151) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12151)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=12163): Process ended prematurely: osmo-stp_10.42.42.5(pid=12163) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12163)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=12181): Process ended prematurely: osmo-stp_10.42.42.5(pid=12181) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12181)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12192): Process ended prematurely: osmo-stp_10.42.42.5(pid=12192) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12192)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=12202): Process ended prematurely: osmo-stp_10.42.42.5(pid=12202) [trial-2349↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12202)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12215): Process ended prematurely: osmo-stp_10.42.42.5(pid=12215) [trial-2349↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12215)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12231): Process ended prematurely: osmo-stp_10.42.42.5(pid=12231) [trial-2349↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12231)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=12239): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12239) [trial-2349↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12239)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12250): Process ended prematurely: osmo-stp_10.42.42.5(pid=12250) [trial-2349↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12250)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=12259): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12259) [trial-2349↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12259)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=12269): Process ended prematurely: osmo-stp_10.42.42.5(pid=12269) [trial-2349↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12269)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12283): Process ended prematurely: osmo-stp_10.42.42.5(pid=12283) [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12283)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12294): Process ended prematurely: osmo-stp_10.42.42.5(pid=12294) [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12294)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12308): Process ended prematurely: osmo-stp_10.42.42.5(pid=12308) [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12308)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12319): Process ended prematurely: osmo-stp_10.42.42.5(pid=12319) [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12319)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12334): Process ended prematurely: osmo-stp_10.42.42.5(pid=12334) [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12334)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12345): Process ended prematurely: osmo-stp_10.42.42.5(pid=12345) [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12345)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12359): Process ended prematurely: osmo-stp_10.42.42.5(pid=12359) [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12359)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12371): Process ended prematurely: osmo-stp_10.42.42.5(pid=12371) [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12371)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12385): Process ended prematurely: osmo-stp_10.42.42.5(pid=12385) [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12385)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12396): Process ended prematurely: osmo-stp_10.42.42.5(pid=12396) [trial-2349↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12396)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12413): Process ended prematurely: osmo-stp_10.42.42.5(pid=12413) [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12413)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12424): Process ended prematurely: osmo-stp_10.42.42.5(pid=12424) [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12424)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12438): Process ended prematurely: osmo-stp_10.42.42.5(pid=12438) [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12438)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12449): Process ended prematurely: osmo-stp_10.42.42.5(pid=12449) [trial-2349↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12449)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12463): Process ended prematurely: osmo-stp_10.42.42.5(pid=12463) [trial-2349↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12463)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12474): Process ended prematurely: osmo-stp_10.42.42.5(pid=12474) [trial-2349↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12474)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12488): Process ended prematurely: osmo-stp_10.42.42.5(pid=12488) [trial-2349↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12488)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12499): Process ended prematurely: osmo-stp_10.42.42.5(pid=12499) [trial-2349↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12499)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=12518): Process ended prematurely: osmo-stp_10.42.42.5(pid=12518) [trial-2349↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12518)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=12530): Process ended prematurely: osmo-stp_10.42.42.5(pid=12530) [trial-2349↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12530)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=12549): Process ended prematurely: osmo-stp_10.42.42.5(pid=12549) [trial-2349↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12549)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12559): Process ended prematurely: osmo-stp_10.42.42.5(pid=12559) [trial-2349↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12559)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=12572): Process ended prematurely: osmo-stp_10.42.42.5(pid=12572) [trial-2349↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12572)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=12589): Process ended prematurely: osmo-stp_10.42.42.5(pid=12589) [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12589)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=12601): Process ended prematurely: osmo-stp_10.42.42.5(pid=12601) [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12601)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=12619): Process ended prematurely: osmo-stp_10.42.42.5(pid=12619) [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12619)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12629): Process ended prematurely: osmo-stp_10.42.42.5(pid=12629) [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12629)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=12639): Process ended prematurely: osmo-stp_10.42.42.5(pid=12639) [trial-2349↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12639)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=12657): Process ended prematurely: osmo-stp_10.42.42.5(pid=12657) [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12657)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=12669): Process ended prematurely: osmo-stp_10.42.42.5(pid=12669) [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12669)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=12687): Process ended prematurely: osmo-stp_10.42.42.5(pid=12687) [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12687)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12697): Process ended prematurely: osmo-stp_10.42.42.5(pid=12697) [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12697)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12707): Process ended prematurely: osmo-stp_10.42.42.5(pid=12707) [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12707)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=12724): Process ended prematurely: osmo-stp_10.42.42.5(pid=12724) [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12724)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=12737): Process ended prematurely: osmo-stp_10.42.42.5(pid=12737) [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12737)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=12757): Process ended prematurely: osmo-stp_10.42.42.5(pid=12757) [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12757)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12767): Process ended prematurely: osmo-stp_10.42.42.5(pid=12767) [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12767)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12777): Process ended prematurely: osmo-stp_10.42.42.5(pid=12777) [trial-2349↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12777)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=12794): Process ended prematurely: osmo-stp_10.42.42.5(pid=12794) [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12794)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=12806): Process ended prematurely: osmo-stp_10.42.42.5(pid=12806) [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12806)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=12824): Process ended prematurely: osmo-stp_10.42.42.5(pid=12824) [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12824)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12834): Process ended prematurely: osmo-stp_10.42.42.5(pid=12834) [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12834)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12844): Process ended prematurely: osmo-stp_10.42.42.5(pid=12844) [trial-2349↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12844)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12857): Process ended prematurely: osmo-stp_10.42.42.5(pid=12857) [trial-2349↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12857)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12870): Process ended prematurely: osmo-stp_10.42.42.5(pid=12870) [trial-2349↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12870)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=12879): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12879) [trial-2349↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12879)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=12890): Process ended prematurely: osmo-stp_10.42.42.5(pid=12890) [trial-2349↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12890)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=12901): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12901) [trial-2349↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12901)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=12911): Process ended prematurely: osmo-stp_10.42.42.5(pid=12911) [trial-2349↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12911)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12928): Process ended prematurely: osmo-stp_10.42.42.5(pid=12928) [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12928)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12939): Process ended prematurely: osmo-stp_10.42.42.5(pid=12939) [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12939)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12953): Process ended prematurely: osmo-stp_10.42.42.5(pid=12953) [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12953)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12964): Process ended prematurely: osmo-stp_10.42.42.5(pid=12964) [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12964)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12978): Process ended prematurely: osmo-stp_10.42.42.5(pid=12978) [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12978)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=12989): Process ended prematurely: osmo-stp_10.42.42.5(pid=12989) [trial-2349↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12989)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13004): Process ended prematurely: osmo-stp_10.42.42.5(pid=13004) [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13004)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13015): Process ended prematurely: osmo-stp_10.42.42.5(pid=13015) [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13015)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13030): Process ended prematurely: osmo-stp_10.42.42.5(pid=13030) [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13030)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=13041): Process ended prematurely: osmo-stp_10.42.42.5(pid=13041) [trial-2349↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13041)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13055): Process ended prematurely: osmo-stp_10.42.42.5(pid=13055) [trial-2349↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13055)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13066): Process ended prematurely: osmo-stp_10.42.42.5(pid=13066) [trial-2349↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13066)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13080): Process ended prematurely: osmo-stp_10.42.42.5(pid=13080) [trial-2349↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13080)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13091): Process ended prematurely: osmo-stp_10.42.42.5(pid=13091) [trial-2349↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13091)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13105): Process ended prematurely: osmo-stp_10.42.42.5(pid=13105) [trial-2349↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13105)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13116): Process ended prematurely: osmo-stp_10.42.42.5(pid=13116) [trial-2349↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13116)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=13134): Process ended prematurely: osmo-stp_10.42.42.5(pid=13134) [trial-2349↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13134)] FAIL: iperf3.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=13417): Process ended prematurely: osmo-stp_10.42.42.5(pid=13417) [trial-2349↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13417)] FAIL: iperf3m4.py (11.5 sec) Error: osmo-stp_10.42.42.5(pid=13436): Process ended prematurely: osmo-stp_10.42.42.5(pid=13436) [trial-2349↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13436)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13446): Process ended prematurely: osmo-stp_10.42.42.5(pid=13446) [trial-2349↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13446)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13456): Process ended prematurely: osmo-stp_10.42.42.5(pid=13456) [trial-2349↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13456)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=13474): Process ended prematurely: osmo-stp_10.42.42.5(pid=13474) [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13474)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=13486): Process ended prematurely: osmo-stp_10.42.42.5(pid=13486) [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13486)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=13504): Process ended prematurely: osmo-stp_10.42.42.5(pid=13504) [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13504)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13514): Process ended prematurely: osmo-stp_10.42.42.5(pid=13514) [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13514)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13524): Process ended prematurely: osmo-stp_10.42.42.5(pid=13524) [trial-2349↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13524)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=13542): Process ended prematurely: osmo-stp_10.42.42.5(pid=13542) [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13542)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=13558): Process ended prematurely: osmo-stp_10.42.42.5(pid=13558) [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13558)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=13576): Process ended prematurely: osmo-stp_10.42.42.5(pid=13576) [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13576)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13586): Process ended prematurely: osmo-stp_10.42.42.5(pid=13586) [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13586)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13596): Process ended prematurely: osmo-stp_10.42.42.5(pid=13596) [trial-2349↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13596)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=13613): Process ended prematurely: osmo-stp_10.42.42.5(pid=13613) [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13613)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=13625): Process ended prematurely: osmo-stp_10.42.42.5(pid=13625) [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13625)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=13643): Process ended prematurely: osmo-stp_10.42.42.5(pid=13643) [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13643)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13653): Process ended prematurely: osmo-stp_10.42.42.5(pid=13653) [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13653)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13663): Process ended prematurely: osmo-stp_10.42.42.5(pid=13663) [trial-2349↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13663)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13676): Process ended prematurely: osmo-stp_10.42.42.5(pid=13676) [trial-2349↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13676)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13690): Process ended prematurely: osmo-stp_10.42.42.5(pid=13690) [trial-2349↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13690)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=13700): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13700) [trial-2349↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13700)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=13710): Process ended prematurely: osmo-stp_10.42.42.5(pid=13710) [trial-2349↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13710)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=13723): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13723) [trial-2349↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13723)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=13733): Process ended prematurely: osmo-stp_10.42.42.5(pid=13733) [trial-2349↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13733)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13747): Process ended prematurely: osmo-stp_10.42.42.5(pid=13747) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13747)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13758): Process ended prematurely: osmo-stp_10.42.42.5(pid=13758) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13758)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13772): Process ended prematurely: osmo-stp_10.42.42.5(pid=13772) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13772)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13783): Process ended prematurely: osmo-stp_10.42.42.5(pid=13783) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13783)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13797): Process ended prematurely: osmo-stp_10.42.42.5(pid=13797) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13797)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13809): Process ended prematurely: osmo-stp_10.42.42.5(pid=13809) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13809)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13823): Process ended prematurely: osmo-stp_10.42.42.5(pid=13823) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13823)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13834): Process ended prematurely: osmo-stp_10.42.42.5(pid=13834) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13834)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13849): Process ended prematurely: osmo-stp_10.42.42.5(pid=13849) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13849)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13860): Process ended prematurely: osmo-stp_10.42.42.5(pid=13860) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13860)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13874): Process ended prematurely: osmo-stp_10.42.42.5(pid=13874) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13874)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13885): Process ended prematurely: osmo-stp_10.42.42.5(pid=13885) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13885)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=13899): Process ended prematurely: osmo-stp_10.42.42.5(pid=13899) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13899)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13952): Process ended prematurely: osmo-stp_10.42.42.5(pid=13952) [trial-2349↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13952)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13968): Process ended prematurely: osmo-stp_10.42.42.5(pid=13968) [trial-2349↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13968)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13979): Process ended prematurely: osmo-stp_10.42.42.5(pid=13979) [trial-2349↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13979)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=13997): Process ended prematurely: osmo-stp_10.42.42.5(pid=13997) [trial-2349↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13997)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=14009): Process ended prematurely: osmo-stp_10.42.42.5(pid=14009) [trial-2349↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14009)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=14027): Process ended prematurely: osmo-stp_10.42.42.5(pid=14027) [trial-2349↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14027)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14037): Process ended prematurely: osmo-stp_10.42.42.5(pid=14037) [trial-2349↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14037)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14049): Process ended prematurely: osmo-stp_10.42.42.5(pid=14049) [trial-2349↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14049)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=14067): Process ended prematurely: osmo-stp_10.42.42.5(pid=14067) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14067)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=14079): Process ended prematurely: osmo-stp_10.42.42.5(pid=14079) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14079)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=14097): Process ended prematurely: osmo-stp_10.42.42.5(pid=14097) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14097)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14107): Process ended prematurely: osmo-stp_10.42.42.5(pid=14107) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14107)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14118): Process ended prematurely: osmo-stp_10.42.42.5(pid=14118) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14118)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=14136): Process ended prematurely: osmo-stp_10.42.42.5(pid=14136) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14136)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=14149): Process ended prematurely: osmo-stp_10.42.42.5(pid=14149) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14149)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=14167): Process ended prematurely: osmo-stp_10.42.42.5(pid=14167) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14167)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14177): Process ended prematurely: osmo-stp_10.42.42.5(pid=14177) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14177)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14187): Process ended prematurely: osmo-stp_10.42.42.5(pid=14187) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14187)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=14205): Process ended prematurely: osmo-stp_10.42.42.5(pid=14205) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14205)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=14217): Process ended prematurely: osmo-stp_10.42.42.5(pid=14217) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14217)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=14235): Process ended prematurely: osmo-stp_10.42.42.5(pid=14235) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14235)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14245): Process ended prematurely: osmo-stp_10.42.42.5(pid=14245) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14245)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14255): Process ended prematurely: osmo-stp_10.42.42.5(pid=14255) [trial-2349↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14255)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14268): Process ended prematurely: osmo-stp_10.42.42.5(pid=14268) [trial-2349↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14268)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14284): Process ended prematurely: osmo-stp_10.42.42.5(pid=14284) [trial-2349↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14284)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=14292): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14292) [trial-2349↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14292)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14302): Process ended prematurely: osmo-stp_10.42.42.5(pid=14302) [trial-2349↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14302)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=14311): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14311) [trial-2349↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14311)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=14324): Process ended prematurely: osmo-stp_10.42.42.5(pid=14324) [trial-2349↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14324)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14338): Process ended prematurely: osmo-stp_10.42.42.5(pid=14338) [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14338)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14349): Process ended prematurely: osmo-stp_10.42.42.5(pid=14349) [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14349)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14363): Process ended prematurely: osmo-stp_10.42.42.5(pid=14363) [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14363)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14374): Process ended prematurely: osmo-stp_10.42.42.5(pid=14374) [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14374)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14388): Process ended prematurely: osmo-stp_10.42.42.5(pid=14388) [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14388)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14399): Process ended prematurely: osmo-stp_10.42.42.5(pid=14399) [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14399)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14414): Process ended prematurely: osmo-stp_10.42.42.5(pid=14414) [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14414)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14425): Process ended prematurely: osmo-stp_10.42.42.5(pid=14425) [trial-2349↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14425)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14439): Process ended prematurely: osmo-stp_10.42.42.5(pid=14439) [trial-2349↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14439)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14450): Process ended prematurely: osmo-stp_10.42.42.5(pid=14450) [trial-2349↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14450)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14464): Process ended prematurely: osmo-stp_10.42.42.5(pid=14464) [trial-2349↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14464)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14477): Process ended prematurely: osmo-stp_10.42.42.5(pid=14477) [trial-2349↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14477)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (9.8 sec) Error: osmo-stp_10.42.42.5(pid=14545): Process ended prematurely: osmo-stp_10.42.42.5(pid=14545) [trial-2349↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14545)] FAIL: iperf3.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=14779): Process ended prematurely: osmo-stp_10.42.42.5(pid=14779) [trial-2349↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14779)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=14798): Process ended prematurely: osmo-stp_10.42.42.5(pid=14798) [trial-2349↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14798)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14808): Process ended prematurely: osmo-stp_10.42.42.5(pid=14808) [trial-2349↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14808)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14818): Process ended prematurely: osmo-stp_10.42.42.5(pid=14818) [trial-2349↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14818)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=14835): Process ended prematurely: osmo-stp_10.42.42.5(pid=14835) [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14835)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=14847): Process ended prematurely: osmo-stp_10.42.42.5(pid=14847) [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14847)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=14865): Process ended prematurely: osmo-stp_10.42.42.5(pid=14865) [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14865)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14876): Process ended prematurely: osmo-stp_10.42.42.5(pid=14876) [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14876)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14886): Process ended prematurely: osmo-stp_10.42.42.5(pid=14886) [trial-2349↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14886)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=14906): Process ended prematurely: osmo-stp_10.42.42.5(pid=14906) [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14906)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=14919): Process ended prematurely: osmo-stp_10.42.42.5(pid=14919) [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14919)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=14944): Process ended prematurely: osmo-stp_10.42.42.5(pid=14944) [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14944)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14955): Process ended prematurely: osmo-stp_10.42.42.5(pid=14955) [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14955)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14965): Process ended prematurely: osmo-stp_10.42.42.5(pid=14965) [trial-2349↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14965)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14978): Process ended prematurely: osmo-stp_10.42.42.5(pid=14978) [trial-2349↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14978)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=14991): Process ended prematurely: osmo-stp_10.42.42.5(pid=14991) [trial-2349↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14991)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=15001): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15001) [trial-2349↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15001)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=15011): Process ended prematurely: osmo-stp_10.42.42.5(pid=15011) [trial-2349↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15011)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15025): Process ended prematurely: osmo-stp_10.42.42.5(pid=15025) [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15025)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15036): Process ended prematurely: osmo-stp_10.42.42.5(pid=15036) [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15036)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15050): Process ended prematurely: osmo-stp_10.42.42.5(pid=15050) [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15050)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15061): Process ended prematurely: osmo-stp_10.42.42.5(pid=15061) [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15061)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15075): Process ended prematurely: osmo-stp_10.42.42.5(pid=15075) [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15075)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15086): Process ended prematurely: osmo-stp_10.42.42.5(pid=15086) [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15086)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15102): Process ended prematurely: osmo-stp_10.42.42.5(pid=15102) [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15102)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15113): Process ended prematurely: osmo-stp_10.42.42.5(pid=15113) [trial-2349↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15113)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15127): Process ended prematurely: osmo-stp_10.42.42.5(pid=15127) [trial-2349↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15127)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15138): Process ended prematurely: osmo-stp_10.42.42.5(pid=15138) [trial-2349↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15138)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15152): Process ended prematurely: osmo-stp_10.42.42.5(pid=15152) [trial-2349↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15152)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15163): Process ended prematurely: osmo-stp_10.42.42.5(pid=15163) [trial-2349↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15163)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15177): Process ended prematurely: osmo-stp_10.42.42.5(pid=15177) [trial-2349↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15177)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15188): Process ended prematurely: osmo-stp_10.42.42.5(pid=15188) [trial-2349↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15188)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=15206): Process ended prematurely: osmo-stp_10.42.42.5(pid=15206) [trial-2349↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15206)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=15218): Process ended prematurely: osmo-stp_10.42.42.5(pid=15218) [trial-2349↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15218)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=15236): Process ended prematurely: osmo-stp_10.42.42.5(pid=15236) [trial-2349↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15236)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15247): Process ended prematurely: osmo-stp_10.42.42.5(pid=15247) [trial-2349↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15247)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15260): Process ended prematurely: osmo-stp_10.42.42.5(pid=15260) [trial-2349↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15260)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=15278): Process ended prematurely: osmo-stp_10.42.42.5(pid=15278) [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15278)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=15290): Process ended prematurely: osmo-stp_10.42.42.5(pid=15290) [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15290)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=15308): Process ended prematurely: osmo-stp_10.42.42.5(pid=15308) [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15308)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15319): Process ended prematurely: osmo-stp_10.42.42.5(pid=15319) [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15319)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15329): Process ended prematurely: osmo-stp_10.42.42.5(pid=15329) [trial-2349↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15329)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=15346): Process ended prematurely: osmo-stp_10.42.42.5(pid=15346) [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15346)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=15358): Process ended prematurely: osmo-stp_10.42.42.5(pid=15358) [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15358)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=15376): Process ended prematurely: osmo-stp_10.42.42.5(pid=15376) [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15376)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15386): Process ended prematurely: osmo-stp_10.42.42.5(pid=15386) [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15386)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15399): Process ended prematurely: osmo-stp_10.42.42.5(pid=15399) [trial-2349↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15399)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=15416): Process ended prematurely: osmo-stp_10.42.42.5(pid=15416) [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15416)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=15428): Process ended prematurely: osmo-stp_10.42.42.5(pid=15428) [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15428)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=15449): Process ended prematurely: osmo-stp_10.42.42.5(pid=15449) [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15449)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15459): Process ended prematurely: osmo-stp_10.42.42.5(pid=15459) [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15459)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15469): Process ended prematurely: osmo-stp_10.42.42.5(pid=15469) [trial-2349↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15469)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15483): Process ended prematurely: osmo-stp_10.42.42.5(pid=15483) [trial-2349↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15483)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=15491): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15491) [trial-2349↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15491)] FAIL: esme_connect_policy_closed.py (1.9 sec) Error: osmo-nitb_10.42.42.2(pid=15493): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15493) [trial-2349↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15493)] FAIL: esme_ms_sms_storeforward.py (2.7 sec) Error: osmo-nitb_10.42.42.2(pid=15495): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15495) [trial-2349↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15495)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=15497): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15497) [trial-2349↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15497)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.4 sec) Error: osmo-hlr_10.42.42.2(pid=15507): Process ended prematurely: osmo-hlr_10.42.42.2(pid=15507) [trial-2349↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15507)] FAIL: esme_connect_policy_closed.py (6.1 sec) Error: osmo-hlr_10.42.42.2(pid=15518): Process ended prematurely: osmo-hlr_10.42.42.2(pid=15518) [trial-2349↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15518)] FAIL: esme_ms_sms_storeforward.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=15530): Process ended prematurely: osmo-stp_10.42.42.5(pid=15530) [trial-2349↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15530)] FAIL: esme_ms_sms_transaction.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15541): Process ended prematurely: osmo-stp_10.42.42.5(pid=15541) [trial-2349↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15541)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15555): Process ended prematurely: osmo-stp_10.42.42.5(pid=15555) [trial-2349↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15555)] FAIL: register_a5_0_authreq.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15566): Process ended prematurely: osmo-stp_10.42.42.5(pid=15566) [trial-2349↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15566)] FAIL: register_a5_1_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15577): Process ended prematurely: osmo-stp_10.42.42.5(pid=15577) [trial-2349↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15577)] FAIL: register_a5_3_authreq.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15588): Process ended prematurely: osmo-stp_10.42.42.5(pid=15588) [trial-2349↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15588)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (19.9 sec) Error: srsepc(pid=15610): Process ended prematurely: srsepc(pid=15610) [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15610)] FAIL: iperf3_bidir.py (19.1 sec) Error: srsepc(pid=15629): Process ended prematurely: srsepc(pid=15629) [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15629)] FAIL: iperf3_dl.py (18.8 sec) Error: srsepc(pid=15645): Process ended prematurely: srsepc(pid=15645) [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15645)] FAIL: iperf3_ul.py (19.0 sec) Error: srsepc(pid=15661): Process ended prematurely: srsepc(pid=15661) [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15661)] FAIL: ping.py (18.6 sec) Error: srsepc(pid=15678): Process ended prematurely: srsepc(pid=15678) [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15678)] FAIL: rrc_idle_mo_ping.py (18.1 sec) Error: srsepc(pid=15695): Process ended prematurely: srsepc(pid=15695) [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15695)] FAIL: rrc_idle_mt_ping.py (18.3 sec) Error: srsepc(pid=15711): Process ended prematurely: srsepc(pid=15711) [trial-2349↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15711)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15724): Process ended prematurely: osmo-stp_10.42.42.5(pid=15724) [trial-2349↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15724)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15738): Process ended prematurely: osmo-stp_10.42.42.5(pid=15738) [trial-2349↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15738)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15752): Process ended prematurely: osmo-stp_10.42.42.5(pid=15752) [trial-2349↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15752)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15769): Process ended prematurely: osmo-stp_10.42.42.5(pid=15769) [trial-2349↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15769)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15783): Process ended prematurely: osmo-stp_10.42.42.5(pid=15783) [trial-2349↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15783)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=15858): Process ended prematurely: osmo-stp_10.42.42.5(pid=15858) [trial-2349↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15858)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=16083): Process ended prematurely: osmo-stp_10.42.42.5(pid=16083) [trial-2349↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16083)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16099): Process ended prematurely: osmo-stp_10.42.42.5(pid=16099) [trial-2349↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16099)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16113): Process ended prematurely: osmo-stp_10.42.42.5(pid=16113) [trial-2349↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16113)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16129): Process ended prematurely: osmo-stp_10.42.42.5(pid=16129) [trial-2349↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16129)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16143): Process ended prematurely: osmo-stp_10.42.42.5(pid=16143) [trial-2349↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16143)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16157): Process ended prematurely: osmo-stp_10.42.42.5(pid=16157) [trial-2349↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16157)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16171): Process ended prematurely: osmo-stp_10.42.42.5(pid=16171) [trial-2349↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16171)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16185): Process ended prematurely: osmo-stp_10.42.42.5(pid=16185) [trial-2349↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16185)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16199): Process ended prematurely: osmo-stp_10.42.42.5(pid=16199) [trial-2349↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16199)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16213): Process ended prematurely: osmo-stp_10.42.42.5(pid=16213) [trial-2349↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16213)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16330): Process ended prematurely: osmo-stp_10.42.42.5(pid=16330) [trial-2349↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16330)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=16348): Process ended prematurely: osmo-stp_10.42.42.5(pid=16348) [trial-2349↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16348)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=16362): Process ended prematurely: osmo-stp_10.42.42.5(pid=16362) [trial-2349↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16362)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=16376): Process ended prematurely: osmo-stp_10.42.42.5(pid=16376) [trial-2349↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16376)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=16390): Process ended prematurely: osmo-stp_10.42.42.5(pid=16390) [trial-2349↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16390)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=16404): Process ended prematurely: osmo-stp_10.42.42.5(pid=16404) [trial-2349↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16404)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=16418): Process ended prematurely: osmo-stp_10.42.42.5(pid=16418) [trial-2349↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16418)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=16432): Process ended prematurely: osmo-stp_10.42.42.5(pid=16432) [trial-2349↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16432)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=16446): Process ended prematurely: osmo-stp_10.42.42.5(pid=16446) [trial-2349↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16446)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=16461): Process ended prematurely: osmo-stp_10.42.42.5(pid=16461) [trial-2349↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16461)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=16475): Process ended prematurely: osmo-stp_10.42.42.5(pid=16475) [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16475)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=16489): Process ended prematurely: osmo-stp_10.42.42.5(pid=16489) [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16489)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=16505): Process ended prematurely: osmo-stp_10.42.42.5(pid=16505) [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16505)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=16519): Process ended prematurely: osmo-stp_10.42.42.5(pid=16519) [trial-2349↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16519)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=16534): Process ended prematurely: osmo-stp_10.42.42.5(pid=16534) [trial-2349↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16534)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=16548): Process ended prematurely: osmo-stp_10.42.42.5(pid=16548) [trial-2349↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16548)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=16562): Process ended prematurely: osmo-stp_10.42.42.5(pid=16562) [trial-2349↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16562)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=16576): Process ended prematurely: osmo-stp_10.42.42.5(pid=16576) [trial-2349↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16576)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=16590): Process ended prematurely: osmo-stp_10.42.42.5(pid=16590) [trial-2349↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16590)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=16615): Process ended prematurely: osmo-stp_10.42.42.5(pid=16615) [trial-2349↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16615)] + rm -rf trial-2349/inst + cd trial-2349 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-08 20:04:22 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349-run.tgz run.2022-12-08_20-04-33 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2349-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17648.tgz osmo-bts-oc2g.build-5528.tgz osmo-bts-sysmo.build-8032.tgz osmo-bts.build-7501.tgz osmo-ggsn.build-6675.tgz osmo-hlr.build-8695.tgz osmo-hnbgw.build-2940.tgz osmo-mgw.build-8940.tgz osmo-msc.build-29250.tgz osmo-nitb.build-12961.tgz osmo-pcu-oc2g.build-3905.tgz osmo-pcu-sysmo.build-5187.tgz osmo-pcu.build-5148.tgz osmo-sgsn.build-30027.tgz osmo-stp.build-9235.tgz osmo-trx.build-4672.tgz osmocom-bb.build-4692.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE